00010000:00010000:3.0:1763343267.456374:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba7709e422 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.456389:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d0a4a900) 00010000:00010000:3.0:1763343267.456403:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343267.456408:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba7709e422 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.456414:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba7709e422 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.456426:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba7709e429 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.456431:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba7709e429 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.456437:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba7709e429 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.456442:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343267.456445:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba7709e429 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.456451:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba7709e429 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.456458:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d0a4af00) 00010000:00010000:3.0:1763343267.456461:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343267.456464:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba7709e429 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.456469:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba7709e429 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.456571:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba7709e41b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47be9 expref: 255 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.456586:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e430 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47be9 expref: 254 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.456593:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff9400c48a8d00) 00010000:00010000:3.0:1763343267.456595:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1763343267.456598:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e90600, rc 0) 00000100:00100000:3.0:1763343267.456622:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+254:56972:x1848998399516032:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2157us (3745us total) trans 4294972832 rc 0/0 00000100:00100000:3.0:1763343267.456629:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9787 00000100:00100000:3.0:1763343267.456739:0:28561:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9833b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998412864768:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343267.456752:0:28561:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c4514c00/0x9104b1ba7709e40d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x261:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343267.456779:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.456808:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.456843:0:11289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9832a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11289:1848998412864896:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343267.456855:0:11289:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c4514400/0x9104b1ba7709e414 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x25e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343267.456884:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.456908:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399516288 00000100:00100000:3.0:1763343267.456912:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399516288 00010000:00010000:3.0:1763343267.456926:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2000/0x9104b1ba7709e19e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47b25 expref: 39 pid: 28562 timeout: 1160 lvb_type: 0 00000100:00100000:3.0:1763343267.456942:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399516672 00000100:00100000:3.0:1763343267.456945:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399516672 00010000:00010000:3.0:1763343267.456953:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba2a00/0x9104b1ba7709e22a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x261:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47b56 expref: 17 pid: 8413 timeout: 1160 lvb_type: 0 00000100:00100000:3.0:1763343267.456962:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399516544 00000100:00100000:3.0:1763343267.456965:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399516544 00010000:00010000:3.0:1763343267.456974:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709df44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47a5a expref: 18 pid: 8412 timeout: 1160 lvb_type: 0 00000100:00100000:3.0:1763343267.456984:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399516800 00000100:00100000:3.0:1763343267.456986:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399516800 00010000:00010000:3.0:1763343267.456995:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba7709e197 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x25e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47b1e expref: 19 pid: 28562 timeout: 1160 lvb_type: 0 00000100:00100000:3.0:1763343267.457007:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3156 00000100:00100000:3.0:1763343267.457013:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+39:2408:x1848998399516288:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343267.457046:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343267.457052:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2000/0x9104b1ba7709e19e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47b25 expref: 39 pid: 28562 timeout: 1160 lvb_type: 0 00010000:00010000:3.0:1763343267.459016:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2000/0x9104b1ba7709e19e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47b25 expref: 39 pid: 28562 timeout: 1160 lvb_type: 0 00010000:00010000:3.0:1763343267.459649:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2000/0x9104b1ba7709e19e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47b25 expref: 37 pid: 28562 timeout: 1160 lvb_type: 0 00010000:00010000:3.0:1763343267.459670:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343267.459671:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343267.459675:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e3f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.459685:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e3f1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.461738:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343267.461766:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+36:2408:x1848998399516288:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 4752us (5152us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343267.461775:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3156 00000004:00080000:3.0:1763343267.462270:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c390ed80/2, rc 0, transno 21474838887 00000100:00100000:3.0:1763343267.462276:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412862848:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343267.463970:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399517184 00000100:00100000:3.0:1763343267.463974:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399517184 00000100:00100000:3.0:1763343267.464006:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6534 00000100:00100000:3.0:1763343267.464013:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+36:55884:x1848998399517184:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343267.464052:0:28561:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343267.464073:0:28561:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91600/0x9104b1ba7709e445 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47bfe expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343267.464094:0:28561:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x262:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343267.464114:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343267.464117:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343267.464126:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91600/0x9104b1ba7709e445 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47bfe expref: 37 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.464140:0:28561:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91600/0x9104b1ba7709e445 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47bfe expref: 37 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.464149:0:28561:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e91600, rc 0) 00000100:00100000:3.0:1763343267.464198:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+37:55884:x1848998399517184:12345-192.168.201.40@tcp:101:bash.0 Request processed in 186us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343267.464205:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6534 00000100:00100000:3.0:1763343267.473727:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399517824 00000100:00100000:3.0:1763343267.473738:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399517824 00000100:00100000:3.0:1763343267.473945:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9788 00000100:00100000:3.0:1763343267.473955:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+255:56972:x1848998399517824:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343267.473977:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343267.473998:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91800/0x9104b1ba7709e453 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47c05 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343267.477386:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998412865152:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343267.477431:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba7709e468 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000100:00100000:3.0:1763343267.480981:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399518208 00000100:00100000:3.0:1763343267.480990:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399518208 00010000:00010000:3.0:1763343267.481182:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2600/0x9104b1ba7709e396 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47bc6 expref: 258 pid: 6525 timeout: 1160 lvb_type: 0 00010000:00010000:3.0:1763343267.481568:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba7709e468 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.481581:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba7709e468 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:3.0:1763343267.481625:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c1:0x0]: returning size 5 00000004:00200000:3.0:1763343267.481629:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343267.481645:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba7709e468 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.481656:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba7709e468 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.481667:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba7709e45a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.481672:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba7709e45a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.481677:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba7709e45a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.481684:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba7709e45a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.481689:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3916200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343267.481694:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba7709e45a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.481701:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba7709e45a lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.481711:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d0a4ae00) 00010000:00010000:3.0:1763343267.481713:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343267.481717:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba7709e45a lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.481723:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba7709e45a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.481735:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916400/0x9104b1ba7709e461 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.481741:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916400/0x9104b1ba7709e461 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.481746:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916400/0x9104b1ba7709e461 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.481750:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3916400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343267.481752:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916400/0x9104b1ba7709e461 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.481757:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916400/0x9104b1ba7709e461 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.481762:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53b00) 00010000:00010000:3.0:1763343267.481765:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343267.481767:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916400/0x9104b1ba7709e461 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.481772:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916400/0x9104b1ba7709e461 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.481801:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91800/0x9104b1ba7709e453 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47c05 expref: 258 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.481816:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba7709e468 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47c05 expref: 257 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.481827:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff9400c48a8d00) 00010000:00010000:3.0:1763343267.481829:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343267.481831:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917e00, rc 0) 00000100:00100000:3.0:1763343267.482469:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+256:56972:x1848998399517824:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 8513us (8813us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343267.482477:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9788 00000100:00100000:3.0:1763343267.487164:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399518464 00000100:00100000:3.0:1763343267.487177:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399518464 00000100:00100000:3.0:1763343267.487244:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9789 00000100:00100000:3.0:1763343267.487255:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+256:56972:x1848998399518464:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343267.487588:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343267.487612:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e46f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47c0c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.487718:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709e476 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343267.487730:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709e476 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.487739:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709e476 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:3.0:1763343267.487752:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c1:0x0]: returning size 5 00010000:00010000:3.0:1763343267.487854:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e46f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47c0c expref: 256 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.487921:0:6525:0:(ldlm_lockd.c:1463:ldlm_handle_enqueue()) ### save blocking bits 3 in granted lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709e476 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47c0c expref: 255 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.487934:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709e476 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47c0c expref: 255 pid: 6525 timeout: 1160 lvb_type: 0 00010000:00010000:3.0:1763343267.487942:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709e476 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47c0c expref: 255 pid: 6525 timeout: 1160 lvb_type: 0 00010000:00010000:3.0:1763343267.487949:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff9400c48a8d00) 00010000:00010000:3.0:1763343267.487951:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:3.0:1763343267.487953:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcca00/0x9104b1ba7709e492 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.487959:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcca00/0x9104b1ba7709e492 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.487965:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e90c00, rc 0) 00000100:00100000:3.0:1763343267.488043:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+255:56972:x1848998399518464:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 771us (1524us total) trans 4294972835 rc 0/0 00000100:00100000:3.0:1763343267.488050:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9789 00000100:00100000:3.0:1763343267.491052:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399518976 00000100:00100000:3.0:1763343267.491057:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399518976 00000100:00100000:3.0:1763343267.491091:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9791 00000100:00100000:3.0:1763343267.491099:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+256:56972:x1848998399518976:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343267.491118:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343267.491135:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709e499 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47c13 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.491230:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709e4a0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343267.491243:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcca00/0x9104b1ba7709e492 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.491251:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709e4a0 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.491266:0:6525:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcca00/0x9104b1ba7709e492 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.491274:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709e4a0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.492339:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709e4a0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.492347:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709e4a0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:3.0:1763343267.492371:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c1:0x0]: returning size 5 00000004:00200000:3.0:1763343267.492441:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343267.492458:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709e4a0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343267.492480:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709e499 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47c13 expref: 258 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.492493:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709e4a0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47c13 expref: 257 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.492500:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff9400c48a8d00) 00010000:00010000:3.0:1763343267.492503:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763343267.492505:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e90a00, rc 0) 00000100:00100000:3.0:1763343267.492938:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+256:56972:x1848998399518976:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1722us (1968us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343267.492948:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9791 00000100:00100000:3.0:1763343267.495470:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399519104 00000100:00100000:3.0:1763343267.495482:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399519104 00000100:00100000:3.0:1763343267.504165:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.507689:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.507735:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.511775:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399520000 00000100:00100000:3.0:1763343267.511780:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399520000 00002000:00100000:3.0:1763343267.511810:0:28390:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x2c0000400:0x263:0x0] (0->4) req@ffff9400c59b6d80 x1848998399520000/t0(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:8/0 lens 496/0 e 0 to 0 dl 1763343278 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343267.511820:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c59b6d80 with x1848998399520000 ext(0->4) 00010000:00010000:3.0:1763343267.511826:0:28390:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9401ed155000/0x9104b1ba7709e43e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x263:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47bf0 expref: 17 pid: 28561 timeout: 1160 lvb_type: 0 00010000:00010000:3.0:1763343267.511839:0:28390:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9401ed155000/0x9104b1ba7709e43e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x263:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47bf0 expref: 17 pid: 28561 timeout: 1160 lvb_type: 0 00002000:00010000:3.0:1763343267.511846:0:28390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9400c59b6d80 00000100:00100000:3.0:1763343267.511873:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 105 00000100:00100000:3.0:1763343267.511880:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998399520000:12345-192.168.201.40@tcp:4:bash.0 00000100:00100000:3.0:1763343267.512777:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2408:x1848998399520000:12345-192.168.201.40@tcp:4:bash.0 Request processed in 892us (1503us total) trans 17179871619 rc 0/0 00000100:00100000:3.0:1763343267.512787:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 105 00002000:00100000:3.0:1763343267.512794:0:28390:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x2c0000400:0x263:0x0] (0->4) req@ffff9400c59b6d80 x1848998399520000/t17179871619(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:8/0 lens 496/448 e 0 to 0 dl 1763343278 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343267.512810:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c59b6d80 with x1848998399520000 ext(0->4) 00010000:00010000:3.0:1763343267.512816:0:28390:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9401ed155000/0x9104b1ba7709e43e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x263:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47bf0 expref: 19 pid: 28561 timeout: 1160 lvb_type: 0 00010000:00010000:3.0:1763343267.512827:0:28390:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9401ed155000/0x9104b1ba7709e43e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x263:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47bf0 expref: 19 pid: 28561 timeout: 1160 lvb_type: 0 00002000:00010000:3.0:1763343267.512834:0:28390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9400c59b6d80 00000100:00100000:3.0:1763343267.518624:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.518749:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.521709:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343267.521729:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6274e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412865536:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343267.521788:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343267.521834:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412865664:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343267.521857:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343267.521874:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343267.521878:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412865792:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343267.521908:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412865536 00000100:00100000:3.0:1763343267.521915:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412865536 00000100:00100000:3.0:1763343267.521964:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412865664 00000100:00100000:3.0:1763343267.521968:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412865664 00000100:00100000:3.0:1763343267.521984:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412865920 00000100:00100000:3.0:1763343267.521986:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412865920 00000100:00100000:3.0:1763343267.522006:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412865792 00000100:00100000:3.0:1763343267.522008:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412865792 00000100:00100000:3.0:1763343267.522048:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6536 00000100:00100000:3.0:1763343267.522057:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+75:3659:x1848998412865536:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763343267.522183:0:28561:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x262:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343267.522187:0:28561:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x262:0x0] updating lvb mtime from disk: 1763343266 -> 1763343266 00002000:00010000:3.0:1763343267.522189:0:28561:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x262:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343267.522191:0:28561:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x262:0x0] updating lvb ctime from disk: 1763343266 -> 1763343266 00002000:00010000:3.0:1763343267.522194:0:28561:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x262:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343267.522229:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+77:3659:x1848998412865536:12345-0@lo:2:osp-syn-0-1.0 Request processed in 174us (441us total) trans 21474838890 rc 0/0 00000100:00100000:3.0:1763343267.522236:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6536 00000100:00100000:3.0:1763343267.522255:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6539 00000100:00100000:3.0:1763343267.522261:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+18:3661:x1848998412865792:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343267.523874:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+19:3661:x1848998412865792:12345-0@lo:2:osp-syn-1-1.0 Request processed in 1612us (1954us total) trans 17179871621 rc 0/0 00000100:00100000:3.0:1763343267.523882:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6539 00000100:00100000:3.0:1763343267.524672:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.525073:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.529726:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.529795:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.548630:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.566004:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.574690:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.574774:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00080000:3.0:1763343267.576458:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1763343267.577171:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399523328 00000100:00100000:3.0:1763343267.577180:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399523328 00000100:00100000:3.0:1763343267.577228:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6541 00000100:00100000:3.0:1763343267.577238:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2407:x1848998399523328:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:3.0:1763343267.577343:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2407:x1848998399523328:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 106us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343267.577350:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6541 00000100:00100000:3.0:1763343267.579120:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343267.579132:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412866304:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343267.579243:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343267.579319:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343267.579371:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c859ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412866560:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343267.579411:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343267.579442:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412866304 00000100:00100000:3.0:1763343267.579447:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412866304 00000100:00100000:3.0:1763343267.579469:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412866560 00000100:00100000:3.0:1763343267.579472:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412866560 00000100:00100000:3.0:1763343267.581662:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6545 00000100:00100000:3.0:1763343267.581669:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+78:3659:x1848998412866560:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343267.581748:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+78:3659:x1848998412866560:12345-0@lo:2:osp-syn-0-1.0 Request processed in 79us (2336us total) trans 21474838892 rc 0/0 00000100:00100000:3.0:1763343267.582987:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6545 00000004:00080000:3.0:1763343267.583166:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401edc2c000/2, rc 0, transno 17179871622 00000100:00100000:3.0:1763343267.583172:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412866304:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763343267.583191:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401edc2c700/2, rc 0, transno 17179871623 00000100:00100000:3.0:1763343267.583194:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412866176:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343267.589204:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.592477:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.596563:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.596605:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.597689:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.601317:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399524480 00000100:00100000:3.0:1763343267.601323:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399524480 00010000:00010000:3.0:1763343267.601350:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba7709e388 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x263:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47bb8 expref: 41 pid: 8413 timeout: 1160 lvb_type: 1 00000100:00100000:3.0:1763343267.601383:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3164 00000100:00100000:3.0:1763343267.601403:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+41:2407:x1848998399524480:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343267.601416:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343267.601436:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba7709e388 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x263:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47bb8 expref: 41 pid: 8413 timeout: 1160 lvb_type: 1 00010000:00010000:3.0:1763343267.601471:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba7709e388 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x263:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47bb8 expref: 41 pid: 8413 timeout: 1160 lvb_type: 1 00010000:00010000:3.0:1763343267.601498:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343267.601500:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343267.601506:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9401fd2dea00/0x9104b1ba7709e5d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x263:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.601516:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401fd2dea00/0x9104b1ba7709e5d4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x263:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.601538:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343267.601560:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+41:2407:x1848998399524480:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 170us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343267.601567:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3164 00000100:00100000:3.0:1763343267.616530:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.627780:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.632237:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.632285:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.637886:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399526016 00000100:00100000:3.0:1763343267.637893:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399526016 00010000:00010000:3.0:1763343267.637922:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6800/0x9104b1ba7709e381 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x264:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47bbf expref: 22 pid: 8413 timeout: 1160 lvb_type: 1 00000100:00100000:3.0:1763343267.637972:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3165 00000100:00100000:3.0:1763343267.637983:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2408:x1848998399526016:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343267.637996:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343267.638020:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6800/0x9104b1ba7709e381 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x264:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47bbf expref: 22 pid: 8413 timeout: 1160 lvb_type: 1 00010000:00010000:3.0:1763343267.639409:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6800/0x9104b1ba7709e381 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x264:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47bbf expref: 21 pid: 8413 timeout: 1160 lvb_type: 1 00010000:00010000:3.0:1763343267.639433:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6800/0x9104b1ba7709e381 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x264:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47bbf expref: 21 pid: 8413 timeout: 1160 lvb_type: 1 00010000:00010000:3.0:1763343267.639448:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343267.639450:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343267.639456:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba7709e636 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47ca6 expref: 20 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.639466:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba7709e636 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47ca6 expref: 20 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343267.648371:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399526272 00000100:00100000:3.0:1763343267.648380:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399526272 00002000:00010000:3.0:1763343267.648431:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/611 (5->18446744073709551615) 00002000:00100000:3.0:1763343267.648437:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c59b5c00 with x1848998399526272 ext(5->18446744073709551615) 00002000:00010000:3.0:1763343267.648449:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c59b5c00. 00000100:00100000:3.0:1763343267.648477:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399526400 00000100:00100000:3.0:1763343267.648481:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399526400 00002000:00010000:3.0:1763343267.648492:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/612 (0->18446744073709551615) 00002000:00100000:3.0:1763343267.648495:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c59b4e00 with x1848998399526400 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343267.648501:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c59b4e00. 00000100:00100000:3.0:1763343267.648519:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1591 00000100:00100000:3.0:1763343267.648527:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2407:x1848998399526272:12345-192.168.201.40@tcp:10:lfs.0 00002000:00010000:3.0:1763343267.648831:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x263:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:3.0:1763343267.648836:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x263:0x0] updating lvb mtime from disk: 1763343266 -> 1763343266 00002000:00010000:3.0:1763343267.648838:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x263:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343267.648841:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x263:0x0] updating lvb ctime from disk: 1763343266 -> 1763343266 00002000:00010000:3.0:1763343267.648844:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x263:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343267.648900:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399526272:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 373us (752us total) trans 21474838895 rc 0/0 00000100:00100000:3.0:1763343267.648907:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1591 00002000:00010000:3.0:1763343267.648911:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/611 (5->18446744073709551615) 00002000:00100000:3.0:1763343267.648914:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c59b5c00 with x1848998399526272 ext(5->18446744073709551615) 00002000:00010000:3.0:1763343267.648918:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c59b5c00. 00000100:00100000:3.0:1763343267.648935:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1592 00000100:00100000:3.0:1763343267.648943:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399526400:12345-192.168.201.40@tcp:10:lfs.0 00002000:00010000:3.0:1763343267.649073:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x264:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343267.649077:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x264:0x0] updating lvb mtime from disk: 0 -> 1763343266 00002000:00010000:3.0:1763343267.649079:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x264:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343267.649081:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x264:0x0] updating lvb ctime from disk: 0 -> 1763343266 00002000:00010000:3.0:1763343267.649083:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x264:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343267.649106:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399526400:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 163us (925us total) trans 17179871625 rc 0/0 00000100:00100000:3.0:1763343267.649112:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1592 00002000:00010000:3.0:1763343267.649116:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/612 (0->18446744073709551615) 00002000:00100000:3.0:1763343267.649119:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c59b4e00 with x1848998399526400 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343267.649139:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c59b4e00. 00000100:00100000:3.0:1763343267.654718:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399526656 00000100:00100000:3.0:1763343267.654731:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399526656 00000100:00100000:3.0:1763343267.686358:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.694313:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412867328:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343267.697340:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343267.697369:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412867840:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343267.697527:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343267.697548:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343267.697553:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412868224:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343267.697574:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343267.699050:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412868224 00000100:00100000:3.0:1763343267.699061:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412868224 00000100:00100000:3.0:1763343267.699118:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6552 00000100:00100000:3.0:1763343267.699249:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:3661:x1848998412867456:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343267.699282:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:613 count 1 00002000:00010000:3.0:1763343267.699321:0:8413:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x265:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343267.699329:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90400/0x9104b1ba7709e6bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.699343:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343267.699345:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343267.699350:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90400/0x9104b1ba7709e6bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.699365:0:8413:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90400/0x9104b1ba7709e6bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.699375:0:8413:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90400/0x9104b1ba7709e6bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.699382:0:8413:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90400/0x9104b1ba7709e6bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.699411:0:8413:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343267.699661:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3661:x1848998412867456:12345-0@lo:6:osp-syn-0-1.0 Request processed in 415us (2371us total) trans 21474838896 rc 0/0 00000100:00100000:3.0:1763343267.699669:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6552 00000100:00100000:3.0:1763343267.699689:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6555 00000100:00100000:3.0:1763343267.699694:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+23:3660:x1848998412868224:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763343267.699772:0:8413:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x264:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343267.699775:0:8413:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x264:0x0] updating lvb mtime from disk: 1763343266 -> 1763343266 00002000:00010000:3.0:1763343267.699778:0:8413:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x264:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343267.699780:0:8413:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x264:0x0] updating lvb ctime from disk: 1763343266 -> 1763343266 00002000:00010000:3.0:1763343267.699783:0:8413:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x264:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343267.699813:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+23:3660:x1848998412868224:12345-0@lo:2:osp-syn-1-1.0 Request processed in 119us (2238us total) trans 17179871628 rc 0/0 00000100:00100000:3.0:1763343267.699820:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6555 00010000:00010000:3.0:1763343267.699852:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763343267.699858:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90400/0x9104b1ba7709e6bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.699867:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e90400 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343267.699871:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90400/0x9104b1ba7709e6bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.699881:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90400/0x9104b1ba7709e6bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.699897:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90400/0x9104b1ba7709e6bb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.699905:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90400/0x9104b1ba7709e6bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.699919:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343267.699921:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343267.699923:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343267.699960:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b29c00/2, rc 0, transno 17179871628 00000100:00100000:3.0:1763343267.699966:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412868224:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343267.703933:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343267.703987:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412868096:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343267.704058:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763343267.704099:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401efc70700/2, rc 0, transno 21474838896 00000100:00100000:3.0:1763343267.704105:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412867456:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1763343267.704117:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b2b800/2, rc 0, transno 17179871627 00000100:00100000:3.0:1763343267.704132:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412867968:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343267.704184:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.704288:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000004:00080000:3.0:1763343267.709856:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401efc73100/2, rc 0, transno 21474838898 00000100:00100000:3.0:1763343267.709872:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412867584:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763343267.709891:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b2aa00/2, rc 0, transno 17179871629 00000100:00100000:3.0:1763343267.709896:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412868096:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343267.710534:0:14179:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412868608 00000100:00100000:3.0:1763343267.710541:0:14179:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412868608 00000100:00100000:3.0:1763343267.710592:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:3.0:1763343267.710601:0:14179:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+25:3660:x1848998412868608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1763343267.710624:0:14179:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484927680 pending 28672 free 3920220160 avail 3688640512 00000100:00100000:3.0:1763343267.710675:0:14179:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+25:3660:x1848998412868608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343267.710682:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:3.0:1763343267.712483:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399528448 00000100:00100000:3.0:1763343267.712493:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399528448 00010000:00010000:3.0:1763343267.712530:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9401c1660400/0x9104b1ba7709e5b1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x264:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47c7c expref: 14 pid: 28561 timeout: 1160 lvb_type: 0 00000100:00100000:3.0:1763343267.714766:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399528576 00000100:00100000:3.0:1763343267.714784:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399528576 00010000:00010000:3.0:1763343267.714958:0:8626:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0000/0x9104b1ba7709e6c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.714969:0:8626:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0000/0x9104b1ba7709e6c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.714980:0:8626:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0000/0x9104b1ba7709e6c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.714988:0:8626:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0000/0x9104b1ba7709e6c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.715011:0:8626:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343267.715758:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3660:x1848998412867328:12345-0@lo:6:osp-syn-0-1.0 Request processed in 16440us (18415us total) trans 21474838899 rc 0/0 00000100:00100000:3.0:1763343267.715766:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6553 00010000:00010000:3.0:1763343267.716229:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343267.716235:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9401c1661000/0x9104b1ba7709e6d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.716242:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c1661000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343267.716246:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9401c1661000/0x9104b1ba7709e6d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.716254:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9401c1661000/0x9104b1ba7709e6d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.716268:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9401c1661000/0x9104b1ba7709e6d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.716276:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401c1661000/0x9104b1ba7709e6d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.716292:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343267.716293:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343267.716295:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343267.717232:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3440 00000100:00100000:3.0:1763343267.717241:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+253:56976:x1848998399529088:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343267.717440:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+255:56976:x1848998399529088:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 197us (586us total) trans 4294972855 rc 0/0 00000100:00100000:3.0:1763343267.717456:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3440 00000100:00100000:3.0:1763343267.724885:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399529344 00000100:00100000:3.0:1763343267.724896:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399529344 00000100:00100000:3.0:1763343267.724954:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9819 00000100:00100000:3.0:1763343267.724963:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+254:56972:x1848998399529344:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343267.724987:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343267.725011:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709e6e5 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47cd7 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.725118:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e6ec lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343267.725142:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e6ec lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.725153:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e6ec lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.725170:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91800/0x9104b1ba7709e6f3 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343267.725176:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91800/0x9104b1ba7709e6f3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.725182:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91800/0x9104b1ba7709e6f3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.725283:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709e6fa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343267.725290:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709e6fa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.725297:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709e6fa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:3.0:1763343267.725306:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c4:0x0]: returning size 0 00010000:00010000:3.0:1763343267.725381:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e6ec lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.725400:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e6ec lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.725406:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e6ec lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.725412:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e6ec lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.725417:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e91e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343267.725421:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e6ec lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.725432:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e6ec lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.725443:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d0a4ae00) 00010000:00010000:3.0:1763343267.725446:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343267.725451:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e6ec lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.725458:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e6ec lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.725472:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91800/0x9104b1ba7709e6f3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.725478:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91800/0x9104b1ba7709e6f3 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.725483:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91800/0x9104b1ba7709e6f3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.725488:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e91800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343267.725490:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91800/0x9104b1ba7709e6f3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.725495:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91800/0x9104b1ba7709e6f3 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.725501:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d0a4ab00) 00010000:00010000:3.0:1763343267.725504:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343267.725506:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91800/0x9104b1ba7709e6f3 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.725511:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91800/0x9104b1ba7709e6f3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.725549:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709e6e5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47cd7 expref: 257 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.725565:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709e6fa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47cd7 expref: 256 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.725572:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff9401d0a4a100) 00010000:00010000:3.0:1763343267.725574:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343267.725576:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e90a00, rc 0) 00000100:00100000:3.0:1763343267.725632:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+256:56972:x1848998399529344:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 670us (841us total) trans 4294972857 rc 0/0 00000100:00100000:3.0:1763343267.725639:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9819 00000100:00100000:3.0:1763343267.735604:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399529728 00000100:00100000:3.0:1763343267.735612:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399529728 00000100:00100000:3.0:1763343267.742649:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399529856 00000100:00100000:3.0:1763343267.742659:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399529856 00010000:00010000:3.0:1763343267.742701:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba7709e70f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47cde expref: 258 pid: 6525 timeout: 1160 lvb_type: 0 00000100:00100000:3.0:1763343267.758950:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399530112 00000100:00100000:3.0:1763343267.758962:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399530112 00000100:00100000:3.0:1763343267.759017:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6560 00000100:00100000:3.0:1763343267.759060:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399530112:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343267.759078:0:28561:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343267.759103:0:28561:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5e91800/0x9104b1ba7709e72b lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47cf3 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343267.759131:0:28561:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x267:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343267.759154:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343267.759156:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343267.759168:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e91800/0x9104b1ba7709e72b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47cf3 expref: 22 pid: 28561 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343267.759187:0:28561:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e91800/0x9104b1ba7709e72b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47cf3 expref: 22 pid: 28561 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343267.759204:0:28561:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e91800, rc 0) 00000100:00100000:3.0:1763343267.759257:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399530112:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 232us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343267.759263:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6560 00000100:00100000:3.0:1763343267.765059:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.765155:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.765501:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9824 00000100:00100000:3.0:1763343267.765514:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+260:56972:x1848998399530496:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343267.765655:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343267.765671:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709e747 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47cfa expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.765718:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709e747 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47cfa expref: 262 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.765731:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709e747 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47cfa expref: 262 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.765748:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff9401d0a4a100) 00010000:00010000:3.0:1763343267.765751:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343267.765755:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e90400, rc 0) 00000100:00100000:3.0:1763343267.787580:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.794347:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399531648 00000100:00100000:3.0:1763343267.794357:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399531648 00000100:00100000:3.0:1763343267.802493:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399531904 00000100:00100000:3.0:1763343267.802499:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399531904 00010000:00010000:3.0:1763343267.802533:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba7709e76a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d08 expref: 268 pid: 33856 timeout: 1160 lvb_type: 0 00000100:00100000:3.0:1763343267.802572:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3171 00000100:00100000:3.0:1763343267.802580:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+268:2408:x1848998399531904:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343267.802592:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343267.802600:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba7709e76a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d08 expref: 268 pid: 33856 timeout: 1160 lvb_type: 0 00010000:00010000:3.0:1763343267.802614:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba7709e76a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d08 expref: 268 pid: 33856 timeout: 1160 lvb_type: 0 00010000:00010000:3.0:1763343267.802638:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba7709e76a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d08 expref: 268 pid: 33856 timeout: 1160 lvb_type: 0 00010000:00010000:3.0:1763343267.802653:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff9401d0a4a100) 00010000:00010000:3.0:1763343267.802660:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba7709e77f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.802678:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba7709e77f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.802687:0:7904:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba7709e77f lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.802726:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343267.802751:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+266:2408:x1848998399531904:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 172us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343267.802759:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3171 00000100:00100000:3.0:1763343267.810855:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412868992:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343267.811670:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412869248 00000100:00100000:3.0:1763343267.811676:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412869248 00010000:00010000:3.0:1763343267.812011:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba7709e77f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d0f expref: 255 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.812039:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff9401d0a4a100) 00010000:00010000:3.0:1763343267.812043:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763343267.812058:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba7709e778 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d0f expref: 255 pid: 33856 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763343267.812080:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba7709e77f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d0f expref: 254 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.812124:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff9401d0a4a100) 00010000:00010000:3.0:1763343267.812127:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763343267.812129:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c589ba00, rc 0) 00000100:00100000:3.0:1763343267.812175:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+254:55884:x1848998399531392:12345-192.168.201.40@tcp:101:bash.0 Request processed in 21757us (24596us total) trans 4294972864 rc 0/0 00000100:00100000:3.0:1763343267.812184:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9827 00000100:00100000:3.0:1763343267.812339:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6561 00000100:00100000:3.0:1763343267.812349:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+28:3660:x1848998412869376:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343267.812538:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+30:3660:x1848998412869376:12345-0@lo:2:osp-syn-1-1.0 Request processed in 190us (1600us total) trans 17179871631 rc 0/0 00000100:00100000:3.0:1763343267.812551:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6561 00000100:00100000:3.0:1763343267.812565:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412869760 00000100:00100000:3.0:1763343267.812569:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412869760 00000100:00100000:3.0:1763343267.812592:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6564 00000100:00100000:3.0:1763343267.812599:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+29:3661:x1848998412869120:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763343267.812614:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:612 count 1 00010000:00010000:3.0:1763343267.812627:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e78d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.812643:0:35266:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba7709e636 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47ca6 expref: 21 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.812653:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343267.812655:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343267.812658:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e78d lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.812678:0:35266:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba7709e636 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47ca6 expref: 21 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.812687:0:35266:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba7709e636 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47ca6 expref: 21 pid: 35266 timeout: 1160 lvb_type: 0 00000100:00100000:3.0:1763343267.812696:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c8bc2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412870144:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343267.812840:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9540 going to sleep for 11 seconds 00000004:00080000:3.0:1763343267.813004:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c8bc2680/2, rc 0, transno 21474838900 00000100:00100000:3.0:1763343267.813114:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c8bc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412869760:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763343267.813130:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c8bc1180/2, rc 0, transno 21474838901 00000100:00100000:3.0:1763343267.813134:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c8bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412869888:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763343267.813183:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c4789c00/2, rc 0, transno 17179871632 00000100:00100000:3.0:1763343267.813188:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4789c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412869248:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763343267.813197:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c4789880/2, rc 0, transno 17179871631 00000100:00100000:3.0:1763343267.813200:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412869376:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343267.816801:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399532160 00000100:00100000:3.0:1763343267.816810:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399532160 00000100:00100000:3.0:1763343267.817047:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c8bc2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412870144:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343267.817114:0:35266:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e78d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343267.817150:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399532288 00000100:00100000:3.0:1763343267.817156:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399532288 00010000:00010000:3.0:1763343267.817184:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba7709e556 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x263:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47c59 expref: 23 pid: 28561 timeout: 1160 lvb_type: 1 00000100:00100000:3.0:1763343267.817228:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3172 00000100:00100000:3.0:1763343267.817238:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2410:x1848998399532416:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343267.817253:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343267.817258:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba7709e636 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47ca6 expref: 23 pid: 35266 timeout: 1160 lvb_type: 0 00010000:00010000:3.0:1763343267.817275:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba7709e636 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47ca6 expref: 23 pid: 35266 timeout: 1160 lvb_type: 0 00010000:00010000:3.0:1763343267.817299:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba7709e636 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47ca6 expref: 23 pid: 35266 timeout: 1160 lvb_type: 0 00010000:00010000:3.0:1763343267.817314:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343267.817316:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343267.817321:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e78d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.817330:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e78d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.817351:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343267.817417:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2410:x1848998399532416:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 178us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343267.817432:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3172 00000100:00100000:3.0:1763343267.817455:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3174 00000100:00100000:3.0:1763343267.817467:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399532672:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343267.817478:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343267.817486:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c89a2e00/0x9104b1ba7709e61a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x263:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47c98 expref: 14 pid: 28561 timeout: 1160 lvb_type: 0 00010000:00010000:3.0:1763343267.817498:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c89a2e00/0x9104b1ba7709e61a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x263:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47c98 expref: 14 pid: 28561 timeout: 1160 lvb_type: 0 00010000:00010000:3.0:1763343267.817520:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343267.817524:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343267.817528:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9401c1660000/0x9104b1ba7709e79b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x263:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.817536:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401c1660000/0x9104b1ba7709e79b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x263:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.817556:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343267.817580:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399532672:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 113us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343267.817594:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3174 00010000:00010000:3.0:1763343267.817621:0:35266:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e78d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.817630:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e78d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.817642:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e78d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.817649:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e78d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.817676:0:35266:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343267.818072:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+29:3661:x1848998412869120:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5470us (6958us total) trans 17179871633 rc 0/0 00000100:00100000:3.0:1763343267.818095:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6564 00000100:00100000:3.0:1763343267.818116:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399532544 00000100:00100000:3.0:1763343267.818174:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399532544 00000100:00100000:3.0:1763343267.818210:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6569 00000100:00100000:3.0:1763343267.818218:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:55884:x1848998399532544:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343267.818231:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343267.818247:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709e7a2 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47d1d expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.818271:0:35266:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e91800/0x9104b1ba7709e72b lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x267:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47cf3 expref: 22 pid: 28561 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343267.818278:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343267.818281:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343267.818285:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709e7a2 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d1d expref: 22 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.818313:0:35266:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5e91800/0x9104b1ba7709e72b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x267:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47cf3 expref: 22 pid: 28561 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343267.818331:0:35266:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e91800/0x9104b1ba7709e72b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x267:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47cf3 expref: 22 pid: 28561 timeout: 1160 lvb_type: 1 00000100:00100000:3.0:1763343267.818349:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c8bc2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412870528:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343267.818421:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f96c0 going to sleep for 11 seconds 00010000:00010000:3.0:1763343267.818436:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343267.818442:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd8e00/0x9104b1ba7709e794 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.818454:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd8e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343267.818459:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd8e00/0x9104b1ba7709e794 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.818466:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd8e00/0x9104b1ba7709e794 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.818479:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd8e00/0x9104b1ba7709e794 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.818486:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd8e00/0x9104b1ba7709e794 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.818502:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343267.818505:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343267.818511:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343267.818540:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9828 00000100:00100000:3.0:1763343267.818551:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+254:56977:x1848998399532160:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343267.818562:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343267.818579:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709e7a9 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47d16 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.818653:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e7b0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343267.818663:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e7b0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.818676:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e7b0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.818700:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709e7b7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343267.818707:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709e7b7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.818712:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709e7b7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.818811:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709e7be lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343267.818821:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709e7be lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.818828:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709e7be lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:3.0:1763343267.818837:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c4:0x0]: returning size 2 00010000:00010000:3.0:1763343267.818912:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e7b0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.818920:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e7b0 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.818925:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e7b0 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.818930:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e90600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343267.818933:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e7b0 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.818940:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e7b0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.818948:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d0a4af00) 00010000:00010000:3.0:1763343267.818951:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343267.818955:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e7b0 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.818959:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e7b0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.818969:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709e7b7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.818974:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709e7b7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.818979:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709e7b7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.818984:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e90400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343267.818987:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709e7b7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.818992:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709e7b7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.818998:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d0a4a000) 00010000:00010000:3.0:1763343267.819000:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343267.819003:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709e7b7 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.819008:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709e7b7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.819075:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709e7a9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d16 expref: 257 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.819091:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709e7be lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d16 expref: 256 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.819098:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff9401d0a4a100) 00010000:00010000:3.0:1763343267.819100:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1763343267.819103:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e90a00, rc 0) 00000100:00100000:3.0:1763343267.819140:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+256:56977:x1848998399532160:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 591us (2398us total) trans 4294972865 rc 0/0 00000100:00100000:3.0:1763343267.819147:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9828 00000100:00100000:3.0:1763343267.822321:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.830331:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.837739:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.837776:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.848958:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399533824 00000100:00100000:3.0:1763343267.848970:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399533824 00000100:00100000:3.0:1763343267.849145:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9829 00000100:00100000:3.0:1763343267.849157:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+257:56977:x1848998399533824:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343267.849183:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343267.849209:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709e7da lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47d32 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343267.855811:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399534080 00000100:00100000:3.0:1763343267.855824:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399534080 00000100:00100000:3.0:1763343267.856608:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3445 00000100:00100000:3.0:1763343267.856623:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8546850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+259:39285:x1848998399534080:12345-192.168.201.40@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1763343267.856932:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8546850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+260:39285:x1848998399534080:12345-192.168.201.40@tcp:35:ldlm_bl.0 Request processed in 313us (1429us total) trans 4294972867 rc 0/0 00000100:00100000:3.0:1763343267.856940:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3445 00000100:00100000:3.0:1763343267.874780:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399534976 00000100:00100000:3.0:1763343267.874793:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399534976 00000100:00100000:3.0:1763343267.874874:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9832 00000100:00100000:3.0:1763343267.874888:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+261:56978:x1848998399534976:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:3.0:1763343267.874952:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1763343267.874986:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba7709e77f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d0f expref: 261 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.875009:0:9827:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7a00/0x9104b1ba7709e7ef lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d32 expref: 260 pid: 33856 timeout: 1160 lvb_type: 0 00010000:00010000:3.0:1763343267.875054:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709e7be lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d16 expref: 260 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.875068:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660400/0x9104b1ba7709e739 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47cec expref: 259 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.875079:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff9401d0a4a100) 00010000:00010000:3.0:1763343267.875083:0:9827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba7709e819 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.875091:0:9827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba7709e819 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.875102:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343267.875138:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709e820 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343267.875153:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709e820 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.875164:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709e820 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.875176:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e827 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343267.875183:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e827 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.875189:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e827 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.875270:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709e82e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343267.875279:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba7709e819 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.875286:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709e82e lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.875304:0:9827:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba7709e819 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.875315:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709e82e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:3.0:1763343267.880784:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399534720 00000100:00100000:3.0:1763343267.880795:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399534720 00010000:00010000:3.0:1763343267.880838:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba7709e80b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d39 expref: 259 pid: 33856 timeout: 1160 lvb_type: 0 00000100:00100000:3.0:1763343267.881131:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3178 00000100:00100000:3.0:1763343267.881143:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+258:2408:x1848998399534720:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343267.881161:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343267.881168:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba7709e80b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d39 expref: 258 pid: 33856 timeout: 1160 lvb_type: 0 00010000:00010000:3.0:1763343267.881181:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba7709e80b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d39 expref: 258 pid: 33856 timeout: 1160 lvb_type: 0 00010000:00010000:3.0:1763343267.881205:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba7709e80b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d39 expref: 258 pid: 33856 timeout: 1160 lvb_type: 0 00010000:00010000:3.0:1763343267.881218:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff9401d0a4a100) 00010000:00010000:3.0:1763343267.881221:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba7709e819 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.881229:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba7709e819 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.881236:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba7709e819 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.881243:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709e82e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.881254:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709e82e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.881281:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343267.882047:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+258:2408:x1848998399534720:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 879us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343267.882074:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3178 00010000:00010000:3.0:1763343267.886207:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709e82e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343267.886215:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709e82e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 9827 initiator: MDT1 00000100:00100000:3.0:1763343267.902782:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399535872 00000100:00100000:3.0:1763343267.902793:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399535872 00002000:00100000:3.0:1763343267.902845:0:28390:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x2c0000400:0x267:0x0] (0->4) req@ffff9400c5b28700 x1848998399535872/t0(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:8/0 lens 496/0 e 0 to 0 dl 1763343278 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343267.902857:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b28700 with x1848998399535872 ext(0->4) 00010000:00010000:3.0:1763343267.902867:0:28390:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709e7a2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d1d expref: 22 pid: 35266 timeout: 1161 lvb_type: 0 00010000:00010000:3.0:1763343267.902895:0:28390:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709e7a2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d1d expref: 22 pid: 35266 timeout: 1161 lvb_type: 0 00002000:00010000:3.0:1763343267.902902:0:28390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9400c5b28700 00000100:00100000:3.0:1763343267.902937:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 106 00000100:00100000:3.0:1763343267.902948:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2408:x1848998399535872:12345-192.168.201.40@tcp:4:bash.0 00000100:00100000:3.0:1763343267.907081:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.920486:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.922490:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412871680:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343267.922536:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343267.922919:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343267.922926:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412871808:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343267.922952:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763343267.923612:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c59b4700/2, rc 0, transno 21474838905 00000100:00100000:3.0:1763343267.923619:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412871680:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763343267.924684:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c59b4000/2, rc 0, transno 21474838906 00000100:00100000:3.0:1763343267.924691:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412871808:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343267.931176:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.940126:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399537920 00000100:00100000:3.0:1763343267.940137:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399537920 00000100:00100000:3.0:1763343267.940364:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3446 00000100:00100000:3.0:1763343267.949473:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.974450:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399539072 00000100:00100000:3.0:1763343267.974457:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399539072 00010000:00010000:3.0:1763343267.978526:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba7709e954 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c5:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47da9 expref: 257 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.978536:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c5:0x0].0x0 (ffff9401cb9f2500) 00010000:00010000:3.0:1763343267.978538:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763343267.978551:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba7709e94d lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47da9 expref: 257 pid: 33856 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763343267.978565:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba7709e954 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47da9 expref: 256 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.978592:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c5:0x0].0x0 (ffff9401cb9f2500) 00010000:00010000:3.0:1763343267.978594:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763343267.978596:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940202040c00, rc 0) 00000100:00100000:3.0:1763343267.979191:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412872448 00000100:00100000:3.0:1763343267.979200:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412872448 00000100:00100000:3.0:1763343267.979374:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6579 00000100:00100000:3.0:1763343267.979408:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+16:3660:x1848998412872320:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343267.979584:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+17:3660:x1848998412872320:12345-0@lo:2:osp-syn-0-1.0 Request processed in 200us (582us total) trans 21474838907 rc 0/0 00000100:00100000:3.0:1763343267.979592:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6579 00000100:00100000:3.0:1763343267.979610:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6582 00000100:00100000:3.0:1763343267.979618:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401fd1ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+32:3662:x1848998412872192:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343267.979721:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401fd1ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+33:3662:x1848998412872192:12345-0@lo:2:osp-syn-1-1.0 Request processed in 103us (566us total) trans 17179871639 rc 0/0 00000100:00100000:3.0:1763343267.979727:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6582 00000004:00080000:3.0:1763343267.979769:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c7918380/2, rc 0, transno 21474838907 00000100:00100000:3.0:1763343267.979775:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412872320:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763343267.979791:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c4b22a00/2, rc 0, transno 17179871639 00000100:00100000:3.0:1763343267.979794:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4b22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412872192:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343267.979840:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+256:55884:x1848998399539328:12345-192.168.201.40@tcp:101:bash.0 Request processed in 6579us (6867us total) trans 4294972879 rc 0/0 00000100:00100000:3.0:1763343267.979847:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9848 00000100:00100000:3.0:1763343267.979902:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.979919:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399539456 00000100:00100000:3.0:1763343267.979922:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399539456 00000100:00100000:3.0:1763343267.979953:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6583 00000100:00100000:3.0:1763343267.979961:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2407:x1848998399539456:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:3.0:1763343267.980010:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2407:x1848998399539456:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 50us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343267.980016:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6583 00000100:00100000:3.0:1763343267.984896:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.985609:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343267.988143:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399539968 00000100:00100000:3.0:1763343267.988152:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399539968 00000100:00100000:3.0:1763343267.988204:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9849 00000100:00100000:3.0:1763343267.988215:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+256:56977:x1848998399539968:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343267.988343:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343267.988373:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709e970 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47dbe expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.988418:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91800/0x9104b1ba7709e977 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343267.988445:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91800/0x9104b1ba7709e977 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.988458:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91800/0x9104b1ba7709e977 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343267.988574:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709e970 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47dbe expref: 258 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.988642:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91800/0x9104b1ba7709e977 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47dbe expref: 257 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.988652:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff9401d0a4a100) 00010000:00010000:3.0:1763343267.988655:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343267.988658:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e91800, rc 0) 00000100:00100000:3.0:1763343267.988724:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+257:56977:x1848998399539968:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 510us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343267.988731:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9849 00000100:00100000:3.0:1763343267.993623:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399540352 00000100:00100000:3.0:1763343267.993635:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399540352 00000100:00100000:3.0:1763343267.993722:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1598 00000100:00100000:3.0:1763343267.993736:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998399540352:12345-192.168.201.40@tcp:4:lfs.0 00002000:00010000:3.0:1763343267.993845:0:8419:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x267:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343267.993855:0:8419:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e97e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.993870:0:8419:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343267.993872:0:8419:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343267.993878:0:8419:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e97e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.993890:0:8419:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e97e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343267.997585:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x267:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:3.0:1763343267.997590:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x267:0x0] updating lvb mtime from disk: 0 -> 1763343267 00002000:00010000:3.0:1763343267.997594:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x267:0x0] updating lvb ctime from disk: 0 -> 1763343267 00002000:00010000:3.0:1763343267.997596:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x267:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1763343267.997609:0:8419:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e97e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.997621:0:8419:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e97e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.997630:0:8419:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e97e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.997637:0:8419:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e91e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343267.997642:0:8419:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e97e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.997653:0:8419:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e97e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.997672:0:8419:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e97e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343267.997680:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e97e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343267.997783:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:2407:x1848998399540352:12345-192.168.201.40@tcp:4:lfs.0 Request processed in 4041us (4194us total) trans 21474838910 rc 0/0 00000100:00100000:3.0:1763343267.997795:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1598 00000100:00100000:3.0:1763343268.005547:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.010692:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399540992 00000100:00100000:3.0:1763343268.010706:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399540992 00000100:00100000:3.0:1763343268.010772:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9851 00000100:00100000:3.0:1763343268.010781:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+259:56980:x1848998399540992:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:3.0:1763343268.010841:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763343268.010879:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba7709e954 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c5:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47da9 expref: 259 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.010906:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2600/0x9104b1ba7709e99a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47dc5 expref: 258 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.010920:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcd400/0x9104b1ba7709e938 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d9b expref: 257 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.010933:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c5:0x0].0x0 (ffff9401cb9f2500) 00010000:00010000:3.0:1763343268.010944:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343268.010977:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e9a1 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.010989:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e9a1 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.010998:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e9a1 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.011017:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709e9a8 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.011042:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709e9a8 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.011049:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709e9a8 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.011132:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709e9af lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.011143:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709e9af lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.011149:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709e9af lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000040:00080000:3.0:1763343268.011427:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1504, 64 off126216 00000040:00080000:3.0:1763343268.011455:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1512, 64 off126912 00000040:00080000:3.0:1763343268.011466:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1513, 64 off126976 00000040:00080000:3.0:1763343268.011474:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1505, 64 off126280 00010000:00010000:3.0:1763343268.011527:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e9b6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.011536:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e9b6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.011543:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e9b6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.011550:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e9b6 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.011555:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e9b6 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.011560:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e9b6 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.011595:0:6525:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343268.011614:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709e9af lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.011620:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709e9af lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.011629:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709e9af lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.011635:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e91600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.011639:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709e9af lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.011646:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709e9af lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.011655:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c5:0x0].0x0 (ffff9401d0a4aa00) 00010000:00010000:3.0:1763343268.011657:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763343268.011661:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709e9af lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.011665:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709e9af lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.011788:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e9a1 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.011795:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e9a1 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.011800:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e9a1 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.011806:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e9a1 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.011811:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e91e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.011814:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e9a1 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.011823:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e9a1 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.011831:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d0a4a300) 00010000:00010000:3.0:1763343268.011833:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.011836:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e9a1 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.011841:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e9a1 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00000004:00010000:3.0:1763343268.011852:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004b67c07a reply state 0000000043be80e0 transno 4294972881 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709e9a8 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.011862:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709e9a8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.011868:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d0a4a700) 00010000:00010000:3.0:1763343268.011870:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343268.011872:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343268.013521:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+260:56980:x1848998399540992:12345-192.168.201.40@tcp:36:rm.0 Request processed in 1176us (1891us total) trans 4294972881 rc 0/0 00000100:00100000:3.0:1763343268.013532:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9851 00000100:00100000:3.0:1763343268.023480:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399541632 00000100:00100000:3.0:1763343268.023490:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399541632 00000100:00100000:3.0:1763343268.023544:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9853 00000100:00100000:3.0:1763343268.023554:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+259:56981:x1848998399541632:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343268.023578:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.023608:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e9d2 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47dda expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.023679:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709e9d9 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343268.023691:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709e9d9 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.023703:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709e9d9 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.023712:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709e9e0 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343268.023718:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709e9e0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.023723:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709e9e0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.023764:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709e9d9 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.023772:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709e9d9 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.023778:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709e9d9 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.023784:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e91600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.023788:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709e9d9 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.023795:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709e9d9 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.023810:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d0a4a300) 00010000:00010000:3.0:1763343268.023813:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.023818:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709e9d9 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.023824:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709e9d9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.023850:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709e9e0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.023856:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709e9e0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.023862:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709e9e0 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.023867:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e90c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.023870:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709e9e0 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.023875:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709e9e0 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.023881:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d0a4a700) 00010000:00010000:3.0:1763343268.023884:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.023887:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709e9e0 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.023892:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709e9e0 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.023918:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e9d2 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47dda expref: 260 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.023927:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d0a4a300) 00010000:00010000:3.0:1763343268.023929:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.023932:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e9d2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47dda expref: 260 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.023943:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e91e00, rc 0) 00000100:00100000:3.0:1763343268.025649:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+259:56981:x1848998399541632:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2086us (2293us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343268.025661:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9853 00000100:00100000:3.0:1763343268.026191:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399541760 00000100:00100000:3.0:1763343268.026200:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399541760 00002000:00010000:3.0:1763343268.026238:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/615 (5->18446744073709551615) 00002000:00100000:3.0:1763343268.026243:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c2f85500 with x1848998399541760 ext(5->18446744073709551615) 00002000:00010000:3.0:1763343268.026255:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c2f85500. 00000100:00100000:3.0:1763343268.026272:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399541888 00000100:00100000:3.0:1763343268.026275:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399541888 00002000:00010000:3.0:1763343268.026287:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/616 (0->18446744073709551615) 00002000:00100000:3.0:1763343268.026291:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c2f87b80 with x1848998399541888 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343268.026297:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c2f87b80. 00000100:00100000:3.0:1763343268.026314:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1599 00000100:00100000:3.0:1763343268.026322:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2407:x1848998399541760:12345-192.168.201.40@tcp:10:lfs.0 00002000:00010000:3.0:1763343268.026663:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x267:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:3.0:1763343268.026668:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x267:0x0] updating lvb mtime from disk: 1763343267 -> 1763343267 00002000:00010000:3.0:1763343268.026670:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x267:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343268.026673:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x267:0x0] updating lvb ctime from disk: 1763343267 -> 1763343267 00002000:00010000:3.0:1763343268.026677:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x267:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343268.026723:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399541760:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 399us (894us total) trans 21474838911 rc 0/0 00000100:00100000:3.0:1763343268.026730:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1599 00002000:00010000:3.0:1763343268.026734:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/615 (5->18446744073709551615) 00002000:00100000:3.0:1763343268.026737:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c2f85500 with x1848998399541760 ext(5->18446744073709551615) 00002000:00010000:3.0:1763343268.026741:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c2f85500. 00000100:00100000:3.0:1763343268.026757:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1600 00000100:00100000:3.0:1763343268.026764:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2407:x1848998399541888:12345-192.168.201.40@tcp:10:lfs.0 00000100:00100000:3.0:1763343268.030552:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399542016 00000100:00100000:3.0:1763343268.030563:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399542016 00000100:00100000:3.0:1763343268.030619:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9854 00000100:00100000:3.0:1763343268.030628:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+259:56981:x1848998399542016:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343268.030649:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.030673:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709e9e7 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47de1 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.030745:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709e9ee lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343268.030759:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709e9ee lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.030770:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709e9ee lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.030780:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e9f5 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343268.030791:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e9f5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.030796:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e9f5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.030831:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709e9ee lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.030838:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709e9ee lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.030844:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709e9ee lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.030850:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e90800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.030854:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709e9ee lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.030860:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709e9ee lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.030920:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d0a4a800) 00010000:00010000:3.0:1763343268.030924:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.030929:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709e9ee lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.030936:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709e9ee lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.030949:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e9f5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.030955:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e9f5 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.030961:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e9f5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.030965:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e90600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.030968:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e9f5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.030973:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e9f5 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.030980:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d0a4a700) 00010000:00010000:3.0:1763343268.030982:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.030985:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e9f5 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.030989:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709e9f5 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.031017:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709e9e7 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47de1 expref: 260 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.031079:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d0a4a800) 00010000:00010000:3.0:1763343268.031081:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.031086:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709e9e7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47de1 expref: 260 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.031097:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e90400, rc 0) 00000100:00100000:3.0:1763343268.031151:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+259:56981:x1848998399542016:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 524us (866us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343268.031159:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9854 00000100:00100000:3.0:1763343268.033638:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9855 00000100:00100000:3.0:1763343268.033652:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+259:56977:x1848998399542272:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:3.0:1763343268.033736:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e9fc lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343268.033753:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e9fc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.033764:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709e9fc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:3.0:1763343268.034492:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399542400 00000100:00100000:3.0:1763343268.034498:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399542400 00000100:00100000:3.0:1763343268.034550:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9856 00000100:00100000:3.0:1763343268.034558:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+261:56981:x1848998399542400:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343268.034568:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.034583:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ea03 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47de8 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.034623:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ea0a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.034778:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ea0a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.034789:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ea0a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000100:00100000:3.0:1763343268.040788:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399542912 00000100:00100000:3.0:1763343268.040792:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399542912 00000100:00100000:3.0:1763343268.040834:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9857 00000100:00100000:3.0:1763343268.040842:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+263:56981:x1848998399542912:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343268.040852:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.040870:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ea11 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47def expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.040914:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ea1f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.040923:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ea1f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.040931:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ea1f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.040940:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ea26 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.040946:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ea26 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.040953:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ea26 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.040985:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ea1f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.040992:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ea1f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.040997:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ea1f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.041003:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ea1f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.041007:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e90600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.041012:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ea1f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.041018:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ea1f lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.041048:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d0a4a300) 00010000:00010000:3.0:1763343268.041052:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.041056:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ea1f lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.041063:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ea1f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.041075:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ea26 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.041080:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ea26 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.041086:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ea26 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.041091:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e90800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.041093:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ea26 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.041100:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ea26 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.041108:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d0a4a700) 00010000:00010000:3.0:1763343268.041111:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.041114:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ea26 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.041128:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ea26 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.041153:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ea11 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47def expref: 264 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.041162:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d0a4a300) 00010000:00010000:3.0:1763343268.041164:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.041167:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ea11 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47def expref: 264 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.041175:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e90400, rc 0) 00000100:00100000:3.0:1763343268.041220:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+263:56981:x1848998399542912:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 378us (603us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343268.041228:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9857 00000100:00100000:3.0:1763343268.044257:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399543040 00000100:00100000:3.0:1763343268.044263:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399543040 00010000:00010000:3.0:1763343268.044303:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba7709e8dd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d78 expref: 264 pid: 9827 timeout: 1161 lvb_type: 0 00000100:00100000:3.0:1763343268.044339:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3182 00000100:00100000:3.0:1763343268.044350:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+264:2407:x1848998399543040:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343268.044364:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343268.044375:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba7709e8dd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d78 expref: 264 pid: 9827 timeout: 1161 lvb_type: 0 00010000:00010000:3.0:1763343268.044401:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba7709e8dd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d78 expref: 263 pid: 9827 timeout: 1161 lvb_type: 0 00010000:00010000:3.0:1763343268.044421:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba7709e8dd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d78 expref: 263 pid: 9827 timeout: 1161 lvb_type: 0 00010000:00010000:3.0:1763343268.044435:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff9401d0a4a100) 00010000:00010000:3.0:1763343268.044442:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba7709ea18 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343268.044453:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba7709ea18 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343268.044461:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba7709ea18 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343268.044484:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343268.044533:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+263:2407:x1848998399543040:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 184us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343268.044547:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3182 00000100:00100000:3.0:1763343268.047514:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.048053:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343268.048065:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412872832:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343268.048102:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343268.048138:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412873088:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343268.048162:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343268.048229:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343268.048235:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412872960:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343268.048251:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343268.048274:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412872832 00000100:00100000:3.0:1763343268.048280:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412872832 00000100:00100000:3.0:1763343268.048309:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412873088 00000100:00100000:3.0:1763343268.048314:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412873088 00000100:00100000:3.0:1763343268.048332:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412872960 00000100:00100000:3.0:1763343268.048336:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412872960 00000100:00100000:3.0:1763343268.048352:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6589 00000100:00100000:3.0:1763343268.048359:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+36:3662:x1848998412872704:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763343268.048378:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:617 count 1 00010000:00010000:3.0:1763343268.048411:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ea57 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.048429:0:35266:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c3bcca00/0x9104b1ba7709e969 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47db7 expref: 27 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.048446:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343268.048450:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343268.048455:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ea57 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.048490:0:35266:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c3bcca00/0x9104b1ba7709e969 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47db7 expref: 27 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.048505:0:35266:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c3bcca00/0x9104b1ba7709e969 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47db7 expref: 27 pid: 8414 timeout: 1161 lvb_type: 0 00000100:00100000:3.0:1763343268.048526:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4789180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412873344:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343268.048581:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343268.048604:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6590 00000100:00100000:3.0:1763343268.048756:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+36:3661:x1848998412872832:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763343268.048784:0:27798:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:618 count 1 00002000:00010000:3.0:1763343268.048807:0:27798:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x26a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343268.048813:0:27798:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ea65 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.048821:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343268.048823:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343268.048827:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ea65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.048838:0:27798:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ea65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.048847:0:27798:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ea65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.048853:0:27798:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ea65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.048871:0:27798:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343268.049236:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+37:3661:x1848998412872832:12345-0@lo:6:osp-syn-1-1.0 Request processed in 482us (1133us total) trans 17179871644 rc 0/0 00000100:00100000:3.0:1763343268.049248:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6590 00000100:00100000:3.0:1763343268.049281:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412873728 00000100:00100000:3.0:1763343268.049287:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412873728 00000100:00100000:3.0:1763343268.049315:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412873856 00000100:00100000:3.0:1763343268.049319:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412873856 00000100:00100000:3.0:1763343268.049339:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6591 00000100:00100000:3.0:1763343268.049346:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+36:3660:x1848998412873088:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763343268.049432:0:27798:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x268:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343268.049436:0:27798:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x268:0x0] updating lvb mtime from disk: 1763343267 -> 1763343267 00002000:00010000:3.0:1763343268.049438:0:27798:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x268:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343268.049440:0:27798:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x268:0x0] updating lvb ctime from disk: 1763343267 -> 1763343267 00002000:00010000:3.0:1763343268.049443:0:27798:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x268:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343268.049467:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+37:3660:x1848998412873088:12345-0@lo:2:osp-syn-1-1.0 Request processed in 121us (1302us total) trans 17179871645 rc 0/0 00000100:00100000:3.0:1763343268.050521:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6591 00000100:00100000:3.0:1763343268.050547:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6594 00000100:00100000:3.0:1763343268.050560:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+6:3659:x1848998412873856:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763343268.050639:0:27798:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x267:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763343268.050644:0:27798:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x267:0x0] updating lvb mtime from disk: 1763343267 -> 1763343267 00002000:00010000:3.0:1763343268.050648:0:27798:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x267:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343268.050652:0:27798:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x267:0x0] updating lvb ctime from disk: 1763343267 -> 1763343267 00002000:00010000:3.0:1763343268.050657:0:27798:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x267:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343268.050702:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:3659:x1848998412873856:12345-0@lo:2:osp-syn-0-1.0 Request processed in 146us (1392us total) trans 21474838912 rc 0/0 00000100:00100000:3.0:1763343268.050707:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6594 00000100:00100000:3.0:1763343268.051270:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412873600 00000100:00100000:3.0:1763343268.051277:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412873600 00000100:00100000:3.0:1763343268.051317:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412873472 00000100:00100000:3.0:1763343268.051321:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412873472 00000100:00100000:3.0:1763343268.051440:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6596 00000100:00100000:3.0:1763343268.051452:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+8:3662:x1848998412873472:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343268.051467:0:35281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:616 count 1 00010000:00010000:3.0:1763343268.051480:0:35281:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ea73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x268:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.051493:0:35281:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcc200/0x9104b1ba7709e95b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x268:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47db0 expref: 13 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.051500:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343268.051502:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343268.051505:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ea73 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x268:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.051533:0:35281:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcc200/0x9104b1ba7709e95b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x268:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47db0 expref: 13 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.051545:0:35281:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcc200/0x9104b1ba7709e95b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x268:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47db0 expref: 13 pid: 8414 timeout: 1161 lvb_type: 0 00000100:00100000:3.0:1763343268.051558:0:35281:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c478ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35281:1848998412873984:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343268.051622:0:35281:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9180 going to sleep for 11 seconds 00010000:00010000:3.0:1763343268.053823:0:35266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c3bcca00/0x9104b1ba7709e969 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47db7 expref: 27 pid: 8414 timeout: 1161 lvb_type: 0 00000100:00100000:3.0:1763343268.053844:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4789180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412873344:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343268.053861:0:35266:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ea57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.053875:0:35266:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ea57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.053889:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ea57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.053905:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ea57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.053919:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ea57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.053943:0:35266:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343268.054157:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+37:3662:x1848998412872704:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5797us (6083us total) trans 17179871647 rc 0/0 00000100:00100000:3.0:1763343268.054169:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6589 00000100:00100000:3.0:1763343268.055324:0:35281:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c478ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35281:1848998412873984:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343268.055345:0:35281:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ea73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x268:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343268.056336:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:3.0:1763343268.057412:0:35281:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ea73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.057423:0:35281:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ea73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.057442:0:35281:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ea73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.057450:0:35281:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ea73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.057472:0:35281:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343268.057698:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+9:3662:x1848998412873472:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6249us (6534us total) trans 21474838915 rc 0/0 00000100:00100000:3.0:1763343268.057706:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6596 00000100:00100000:3.0:1763343268.060627:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.062288:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.067008:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.067075:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.068642:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399545472 00000100:00100000:3.0:1763343268.068649:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399545472 00000100:00100000:3.0:1763343268.068963:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9862 00000100:00100000:3.0:1763343268.068975:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+260:56977:x1848998399545472:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343268.069003:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.069042:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709eab2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47e19 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.069155:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709eab9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343268.069172:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709eab9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.069184:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709eab9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:3.0:1763343268.069234:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c7:0x0]: returning size 0 00000004:00200000:3.0:1763343268.069240:0:33856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343268.069259:0:33856:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709eab9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.069965:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709eab2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47e19 expref: 262 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.069994:0:33856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709eab9 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47e19 expref: 261 pid: 33856 timeout: 1161 lvb_type: 0 00010000:00010000:3.0:1763343268.070004:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709eab9 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47e19 expref: 261 pid: 33856 timeout: 1161 lvb_type: 0 00010000:00010000:3.0:1763343268.070137:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:3.0:1763343268.070142:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343268.070145:0:33856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa400/0x9104b1ba7709eac7 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1c7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.070153:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e90c00, rc 0) 00000100:00100000:3.0:1763343268.074752:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399545600 00000100:00100000:3.0:1763343268.074757:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399545600 00000100:00100000:3.0:1763343268.074798:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6597 00000100:00100000:3.0:1763343268.074805:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2408:x1848998399545600:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343268.074820:0:35281:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.074839:0:35281:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709eace lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47e20 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343268.074859:0:35281:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x26b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343268.074875:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343268.074877:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343268.074886:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709eace lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47e20 expref: 28 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343268.074900:0:35281:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709eace lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47e20 expref: 28 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343268.074912:0:35281:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e90400, rc 0) 00000100:00100000:3.0:1763343268.074936:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2408:x1848998399545600:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 132us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343268.074943:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6597 00000100:00100000:3.0:1763343268.077811:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.080811:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.082633:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399546240 00000100:00100000:3.0:1763343268.082641:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399546240 00000100:00100000:3.0:1763343268.082690:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3453 00000100:00100000:3.0:1763343268.082700:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+262:56977:x1848998399546240:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343268.083884:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+263:56977:x1848998399546240:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1178us (1330us total) trans 4294972892 rc 0/0 00000100:00100000:3.0:1763343268.083895:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3453 00000100:00100000:3.0:1763343268.084348:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399546496 00000100:00100000:3.0:1763343268.084358:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399546496 00000100:00100000:3.0:1763343268.084439:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9866 00000100:00100000:3.0:1763343268.084455:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+263:55884:x1848998399546496:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:3.0:1763343268.084690:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709eaf1 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.084710:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709eaf1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.084721:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709eaf1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000001:00080000:3.0:1763343268.084769:0:6525:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972893 00000004:00010000:3.0:1763343268.084792:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f52a903b reply state 000000007d060536 transno 4294972894 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709eaf1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.084804:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709eaf1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.084811:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:3.0:1763343268.084814:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343268.084818:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343268.084896:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+266:55884:x1848998399546496:12345-192.168.201.40@tcp:36:bash.0 Request processed in 447us (937us total) trans 4294972894 rc 0/0 00000100:00100000:3.0:1763343268.084903:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9866 00000020:00080000:3.0:1763343268.084906:0:6525:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343268.089006:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.094342:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412874240 00000100:00100000:3.0:1763343268.094353:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412874240 00000100:00100000:3.0:1763343268.094419:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412874752 00000100:00100000:3.0:1763343268.094425:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412874752 00000100:00100000:3.0:1763343268.094473:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6598 00000100:00100000:3.0:1763343268.094489:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+38:3659:x1848998412874496:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763343268.094679:0:35266:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x26b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343268.094683:0:35266:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x26b:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343268.094685:0:35266:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x26b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343268.094688:0:35266:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x26b:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343268.094690:0:35266:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x26b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343268.094757:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+39:3659:x1848998412874496:12345-0@lo:2:osp-syn-1-1.0 Request processed in 273us (2076us total) trans 17179871648 rc 0/0 00000100:00100000:3.0:1763343268.094764:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6598 00000100:00100000:3.0:1763343268.094784:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6599 00000100:00100000:3.0:1763343268.094791:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+10:3659:x1848998412875008:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343268.094879:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+11:3659:x1848998412875008:12345-0@lo:2:osp-syn-0-1.0 Request processed in 89us (2138us total) trans 21474838916 rc 0/0 00000100:00100000:3.0:1763343268.094886:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6599 00000100:00100000:3.0:1763343268.094899:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6600 00000100:00100000:3.0:1763343268.094904:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+38:3661:x1848998412874240:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763343268.094918:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:615 count 1 00010000:00010000:3.0:1763343268.094937:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709eb29 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.094957:0:35266:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba7709e900 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x267:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d8d expref: 27 pid: 27798 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343268.094965:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343268.094967:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343268.094971:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709eb29 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.095007:0:35266:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba7709e900 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x267:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d8d expref: 27 pid: 27798 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343268.095195:0:35266:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba7709e900 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x267:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d8d expref: 27 pid: 27798 timeout: 1161 lvb_type: 1 00000100:00100000:3.0:1763343268.095214:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5951180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412875264:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343268.095284:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343268.095316:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6601 00000100:00100000:3.0:1763343268.095325:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+10:3661:x1848998412874752:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343268.095338:0:8414:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:614 count 1 00010000:00010000:3.0:1763343268.095351:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90800/0x9104b1ba7709eb30 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x266:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.095363:0:8414:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9401c1661c00/0x9104b1ba7709e7d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x266:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d2b expref: 12 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.095369:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343268.095371:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343268.095374:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90800/0x9104b1ba7709eb30 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x266:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.095402:0:8414:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9401c1661c00/0x9104b1ba7709e7d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x266:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d2b expref: 12 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.095411:0:8414:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9401c1661c00/0x9104b1ba7709e7d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x266:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47d2b expref: 12 pid: 28562 timeout: 1161 lvb_type: 0 00000100:00100000:3.0:1763343268.095421:0:8414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5950380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1848998412875392:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343268.095448:0:8414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9180 going to sleep for 11 seconds 00000100:00100000:3.0:1763343268.096650:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.099394:0:8412:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6488000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998412875648:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343268.099408:0:8412:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6800/0x9104b1ba7709eb3e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x267:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343268.099445:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.100072:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:3.0:1763343268.101144:0:8412:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6800/0x9104b1ba7709eb3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.101152:0:8412:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6800/0x9104b1ba7709eb3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.101162:0:8412:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6800/0x9104b1ba7709eb3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.101170:0:8412:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6800/0x9104b1ba7709eb3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.101186:0:8412:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343268.101563:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+13:3661:x1848998412874880:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5424us (5668us total) trans 21474838918 rc 0/0 00000100:00100000:3.0:1763343268.101571:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6604 00010000:00010000:3.0:1763343268.101590:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1763343268.101596:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6800/0x9104b1ba7709eb3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.101603:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a6800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343268.101607:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6800/0x9104b1ba7709eb3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.101616:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6800/0x9104b1ba7709eb3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.101629:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6800/0x9104b1ba7709eb3e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.101637:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6800/0x9104b1ba7709eb3e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.101652:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763343268.101655:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709eb29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.101662:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e90600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343268.101665:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709eb29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.101672:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709eb29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.101682:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709eb29 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.101688:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709eb29 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.101703:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343268.101705:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343268.101707:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343268.101734:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.101759:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:3.0:1763343268.102421:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343268.102426:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9401c1660400/0x9104b1ba7709eb37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.102433:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c1660400 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343268.102437:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9401c1660400/0x9104b1ba7709eb37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.102443:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9401c1660400/0x9104b1ba7709eb37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.102455:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9401c1660400/0x9104b1ba7709eb37 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.102461:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401c1660400/0x9104b1ba7709eb37 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.102474:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343268.102476:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343268.102477:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343268.112220:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.116474:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.116517:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.119692:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.129759:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.137228:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.147830:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399550592 00000100:00100000:3.0:1763343268.147843:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399550592 00000100:00100000:3.0:1763343268.147911:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9874 00000100:00100000:3.0:1763343268.147925:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f648a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+261:56982:x1848998399550592:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343268.147953:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.147972:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ebca lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47e6d expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.148106:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709ebd1 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343268.148121:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709ebd1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.148131:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709ebd1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:3.0:1763343268.148143:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c7:0x0]: returning size 5 00010000:00010000:3.0:1763343268.148270:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ebca lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47e6d expref: 264 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.148302:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709ebd1 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47e6d expref: 263 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.148310:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff9400c48a8400) 00010000:00010000:3.0:1763343268.148313:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763343268.148318:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e91e00, rc 0) 00000100:00100000:3.0:1763343268.148752:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f648a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+263:56982:x1848998399550592:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 829us (996us total) trans 4294972903 rc 0/0 00000100:00100000:3.0:1763343268.148762:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9874 00000100:00100000:3.0:1763343268.156511:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.156559:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.156591:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399550848 00000100:00100000:3.0:1763343268.156597:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399550848 00000100:00100000:3.0:1763343268.156641:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9875 00000100:00100000:3.0:1763343268.156655:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+263:56984:x1848998399550848:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343268.156676:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.156701:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709ebe6 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47e74 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.156779:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ebed lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343268.156801:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ebed lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.156819:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ebed lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.156834:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ebf4 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343268.156844:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ebf4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.156850:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ebf4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.156896:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ebed lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.156904:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ebed lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.156912:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ebed lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.156920:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ebed lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.156925:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e90400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.156929:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ebed lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.156936:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ebed lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.156947:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d0a4ab00) 00010000:00010000:3.0:1763343268.156950:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.156955:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ebed lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.156961:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ebed lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.156974:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ebf4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.156981:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ebf4 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.156987:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ebf4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.156994:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e90800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.156997:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ebf4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.157003:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ebf4 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.157011:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8e00) 00010000:00010000:3.0:1763343268.157014:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.157017:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ebf4 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.157815:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ebf4 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.157858:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709ebe6 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47e74 expref: 264 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.157867:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d0a4ab00) 00010000:00010000:3.0:1763343268.157870:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.157873:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709ebe6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47e74 expref: 264 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.157885:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e90a00, rc 0) 00000100:00100000:3.0:1763343268.161084:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.163807:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.167845:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.169472:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.177074:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c8bc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412876544:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343268.177327:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412876416:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343268.177370:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343268.177433:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412876288 00000100:00100000:3.0:1763343268.177441:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412876288 00000100:00100000:3.0:1763343268.177487:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412876416 00000100:00100000:3.0:1763343268.177492:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412876416 00000100:00100000:3.0:1763343268.177517:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412876672 00000100:00100000:3.0:1763343268.177521:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412876672 00000100:00100000:3.0:1763343268.177555:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6610 00000100:00100000:3.0:1763343268.177564:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+14:3662:x1848998412876416:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763343268.177677:0:8414:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x26a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343268.177681:0:8414:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x26a:0x0] updating lvb mtime from disk: 1763343267 -> 1763343267 00002000:00010000:3.0:1763343268.177685:0:8414:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x26a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343268.177687:0:8414:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x26a:0x0] updating lvb ctime from disk: 1763343267 -> 1763343267 00002000:00010000:3.0:1763343268.177690:0:8414:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x26a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343268.177735:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+15:3662:x1848998412876416:12345-0@lo:2:osp-syn-0-1.0 Request processed in 171us (367us total) trans 21474838921 rc 0/0 00000100:00100000:3.0:1763343268.177744:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6610 00000004:00080000:3.0:1763343268.177788:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6488000/2, rc 0, transno 21474838921 00000100:00100000:3.0:1763343268.177794:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412876416:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343268.177809:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343268.179856:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.179944:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.185443:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399552512 00000100:00100000:3.0:1763343268.185451:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399552512 00010000:00010000:3.0:1763343268.185493:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba7709ec4f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47e90 expref: 261 pid: 6525 timeout: 1161 lvb_type: 0 00000100:00100000:3.0:1763343268.185731:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3195 00000100:00100000:3.0:1763343268.185742:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+263:2407:x1848998399552512:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343268.185757:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343268.185764:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba7709ec4f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47e90 expref: 262 pid: 6525 timeout: 1161 lvb_type: 0 00010000:00010000:3.0:1763343268.185785:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba7709ec4f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47e90 expref: 262 pid: 6525 timeout: 1161 lvb_type: 0 00010000:00010000:3.0:1763343268.185805:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba7709ec4f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47e90 expref: 262 pid: 6525 timeout: 1161 lvb_type: 0 00010000:00010000:3.0:1763343268.185818:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c8:0x0].0x0 (ffff9401d1e1a600) 00010000:00010000:3.0:1763343268.185822:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba7709ec64 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.185830:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba7709ec64 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.185836:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba7709ec64 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1c8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.186395:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343268.186435:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+260:2407:x1848998399552512:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 694us (1730us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343268.186443:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3195 00000100:00100000:3.0:1763343268.198326:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399553280 00000100:00100000:3.0:1763343268.198339:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399553280 00000100:00100000:3.0:1763343268.233791:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9887 00000100:00100000:3.0:1763343268.233805:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+266:55884:x1848998399554048:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343268.233829:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.233851:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709ecc6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47ec1 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.233912:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709ecc6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47ec1 expref: 267 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.233930:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709ecc6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47ec1 expref: 267 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.233949:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c8:0x0].0x0 (ffff9401d1e1a000) 00010000:00010000:3.0:1763343268.233952:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343268.233956:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e90a00, rc 0) 00000100:00100000:3.0:1763343268.234107:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+267:55884:x1848998399554048:12345-192.168.201.40@tcp:101:bash.0 Request processed in 306us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343268.234115:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9887 00000100:00100000:3.0:1763343268.240536:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399554304 00000100:00100000:3.0:1763343268.240548:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399554304 00000100:00100000:3.0:1763343268.240623:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9888 00000100:00100000:3.0:1763343268.240636:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+267:55884:x1848998399554304:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343268.240657:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.240661:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343268.240689:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709ecc6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47ec1 expref: 267 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.240711:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c8:0x0].0x0 (ffff9401d1e1a000) 00010000:00010000:3.0:1763343268.240717:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343268.240730:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709eccd lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1c8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47ec8 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.240781:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ecd4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343268.240793:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ecd4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.240802:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ecd4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000040:00080000:3.0:1763343268.241087:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1514, 88 off127024 00000004:00080000:3.0:1763343268.241095:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1061365070204ns, next at 1061297905442ns, rc = 0 00000040:00080000:3.0:1763343268.241134:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1522, 88 off127720 00000004:00080000:3.0:1763343268.241140:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1061365115160ns, next at 1061297873018ns, rc = 0 00000040:00080000:3.0:1763343268.241189:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1523, 88 off127808 00000004:00080000:3.0:1763343268.241194:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1061365169745ns, next at 1061297873018ns, rc = 0 00000040:00080000:3.0:1763343268.241215:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1515, 88 off127112 00000004:00080000:3.0:1763343268.241220:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1061365194815ns, next at 1061297905442ns, rc = 0 00000100:00100000:3.0:1763343268.245175:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c859b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412877056:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343268.245243:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763343268.246285:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c859b100/2, rc 0, transno 21474838923 00000100:00100000:3.0:1763343268.246289:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c859b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412877056:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343268.246296:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343268.246301:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c8599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412876928:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343268.246326:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343268.246371:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412876928 00000100:00100000:3.0:1763343268.246375:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412876928 00000100:00100000:3.0:1763343268.246406:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6617 00000100:00100000:3.0:1763343268.246411:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401ede6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+16:3662:x1848998412876928:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343268.246479:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401ede6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+17:3662:x1848998412876928:12345-0@lo:2:osp-syn-0-1.0 Request processed in 67us (151us total) trans 21474838924 rc 0/0 00000100:00100000:3.0:1763343268.246484:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6617 00000004:00080000:3.0:1763343268.246870:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c8599180/2, rc 0, transno 21474838924 00000100:00100000:3.0:1763343268.246874:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c8599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412876928:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343268.256418:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.257420:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.257797:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.258855:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1605 00000100:00100000:3.0:1763343268.258867:0:8417:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+30:2408:x1848998399555200:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:3.0:1763343268.258963:0:8417:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x26d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343268.258966:0:8417:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x26d:0x0] updating lvb mtime from disk: 0 -> 1763343267 00002000:00010000:3.0:1763343268.258968:0:8417:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x26d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343268.258970:0:8417:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x26d:0x0] updating lvb ctime from disk: 0 -> 1763343267 00002000:00010000:3.0:1763343268.258972:0:8417:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x26d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343268.259002:0:8417:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+31:2408:x1848998399555200:12345-192.168.201.40@tcp:10:bash.0 Request processed in 139us (1205us total) trans 17179871658 rc 0/0 00000100:00100000:3.0:1763343268.259009:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1605 00002000:00010000:3.0:1763343268.259012:0:8417:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/621 (0->18446744073709551615) 00002000:00100000:3.0:1763343268.259016:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c8598380 with x1848998399555200 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343268.259036:0:8417:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401c8598380. 00000100:00100000:3.0:1763343268.263786:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399555328 00000100:00100000:3.0:1763343268.263799:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399555328 00000100:00100000:3.0:1763343268.263879:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9889 00000100:00100000:3.0:1763343268.263890:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+258:56982:x1848998399555328:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343268.263915:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.263938:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ecf0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47edd expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.263975:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709ecf7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343268.263990:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709ecf7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.264002:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709ecf7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.264469:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ecf0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47edd expref: 262 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.264487:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90a00/0x9104b1ba7709ecf7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47edd expref: 261 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.264496:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff9400c48a8400) 00010000:00010000:3.0:1763343268.264499:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343268.264503:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e90a00, rc 0) 00000100:00100000:3.0:1763343268.264687:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+260:56982:x1848998399555328:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 799us (1900us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343268.264693:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9889 00000100:00100000:3.0:1763343268.274659:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399555840 00000100:00100000:3.0:1763343268.274671:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399555840 00000100:00100000:3.0:1763343268.274739:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9890 00000100:00100000:3.0:1763343268.274752:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+260:56985:x1848998399555840:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:3.0:1763343268.274779:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.274803:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ed05 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47ee4 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.274877:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed0c lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343268.274890:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed0c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.274901:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed0c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.274913:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ed13 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343268.274920:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ed13 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.274926:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ed13 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.274998:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ed1a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343268.275007:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ed1a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.275013:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ed1a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:3.0:1763343268.275074:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c8:0x0]: returning size 5 00000004:00200000:3.0:1763343268.275079:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343268.275100:0:9827:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ed1a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.275111:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ed1a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.275120:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed0c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.275126:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed0c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.275132:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed0c lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.275137:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed0c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.275143:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e91600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.275147:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed0c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.275154:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed0c lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.275165:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401c63d6f00) 00010000:00010000:3.0:1763343268.275167:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.275171:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed0c lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.275177:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed0c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.275189:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ed13 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.275197:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ed13 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.275203:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ed13 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.275207:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e90c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.275214:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ed13 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.275219:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ed13 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.275224:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401c63d6900) 00010000:00010000:3.0:1763343268.275226:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.275229:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ed13 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.275234:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ed13 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.276089:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ed05 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47ee4 expref: 262 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.276111:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ed1a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47ee4 expref: 261 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.276118:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c8:0x0].0x0 (ffff9401d1e1a000) 00010000:00010000:3.0:1763343268.276120:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343268.276123:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e90800, rc 0) 00000100:00100000:3.0:1763343268.295991:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399556608 00000100:00100000:3.0:1763343268.295997:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399556608 00000100:00100000:3.0:1763343268.296067:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9893 00000100:00100000:3.0:1763343268.296077:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+261:56986:x1848998399556608:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343268.296100:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.296121:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ed44 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47ef2 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.296184:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ed4b lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.296197:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ed4b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.296208:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ed4b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.296219:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed52 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.296227:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed52 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.296233:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed52 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.296271:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ed4b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.296285:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ed4b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.296292:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ed4b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.296303:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ed4b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.296308:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e90c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.296312:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ed4b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.296318:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ed4b lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.296329:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401c63d6f00) 00010000:00010000:3.0:1763343268.296332:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.296337:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ed4b lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.296343:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ed4b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.296355:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed52 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.296361:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed52 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.296366:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed52 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.296371:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e91600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.296374:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed52 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.296390:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed52 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.296401:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f669e000) 00010000:00010000:3.0:1763343268.296403:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.296406:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed52 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.296411:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed52 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.296437:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ed44 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47ef2 expref: 262 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.296446:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401c63d6f00) 00010000:00010000:3.0:1763343268.296449:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.296452:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ed44 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47ef2 expref: 262 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.296466:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e90600, rc 0) 00000100:00100000:3.0:1763343268.296534:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+261:56986:x1848998399556608:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 459us (953us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343268.296543:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9893 00000100:00100000:3.0:1763343268.299113:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.299736:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.305122:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.307059:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399557632 00000100:00100000:3.0:1763343268.307067:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399557632 00000100:00100000:3.0:1763343268.307119:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9897 00000100:00100000:3.0:1763343268.307128:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+264:56986:x1848998399557632:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343268.307145:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.307164:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ed91 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47f0e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.307225:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ed98 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.307236:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ed98 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.307246:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ed98 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.307255:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed9f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.307262:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed9f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.307267:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed9f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.307773:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ed98 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.307780:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ed98 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.307785:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ed98 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.307791:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ed98 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.307796:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e90600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.307800:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ed98 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.307806:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ed98 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.307819:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadba00) 00010000:00010000:3.0:1763343268.307821:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.307826:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ed98 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.307831:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ed98 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.307845:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed9f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.307850:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed9f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.307854:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed9f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.307858:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e91600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.307861:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed9f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.307865:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed9f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.307871:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f669e000) 00010000:00010000:3.0:1763343268.307873:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.307876:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed9f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.307881:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ed9f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.307908:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ed91 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f0e expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.307918:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadba00) 00010000:00010000:3.0:1763343268.307920:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.307924:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ed91 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f0e expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.307931:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e90800, rc 0) 00000100:00100000:3.0:1763343268.307997:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+264:56986:x1848998399557632:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 870us (1239us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343268.308005:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9897 00000100:00100000:3.0:1763343268.311280:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399558272 00000100:00100000:3.0:1763343268.311291:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399558272 00000100:00100000:3.0:1763343268.311424:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9898 00000100:00100000:3.0:1763343268.311438:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5179180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+264:56986:x1848998399558272:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343268.311466:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.311470:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343268.311500:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709ed83 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f07 expref: 264 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.311519:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadba00) 00010000:00010000:3.0:1763343268.311528:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343268.311545:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709eda6 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47f15 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.311665:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709edad lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.311680:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709edad lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.311691:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709edad lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.311703:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba7709edb4 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.311710:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba7709edb4 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.311716:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba7709edb4 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.312349:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba7709edc2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.312814:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba7709edc2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.312825:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba7709edc2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:3.0:1763343268.312836:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ca:0x0]: returning size 0 00010000:00010000:3.0:1763343268.312868:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709edad lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.312874:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709edad lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.312880:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709edad lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.312887:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709edad lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.312893:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e90400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.312898:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709edad lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.312904:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709edad lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.312914:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401c63d6f00) 00010000:00010000:3.0:1763343268.312917:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.312921:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709edad lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.312927:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709edad lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00000004:00010000:3.0:1763343268.312941:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009f53b3bf reply state 00000000c1ebd239 transno 4294972917 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba7709edb4 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.312951:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba7709edb4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.312957:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f669e000) 00010000:00010000:3.0:1763343268.312959:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343268.312962:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343268.312989:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709eda6 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f15 expref: 267 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.313005:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba7709edc2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f15 expref: 266 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.313011:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ca:0x0].0x0 (ffff9401c63d6900) 00010000:00010000:3.0:1763343268.313013:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343268.313015:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a6800, rc 0) 00000100:00100000:3.0:1763343268.318439:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399558400 00000100:00100000:3.0:1763343268.318447:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399558400 00010000:00010000:3.0:1763343268.318487:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709ec6b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47e97 expref: 267 pid: 33856 timeout: 1161 lvb_type: 0 00000100:00100000:3.0:1763343268.318570:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3196 00000100:00100000:3.0:1763343268.318581:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+267:2408:x1848998399558400:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343268.318596:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343268.318604:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709ec6b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47e97 expref: 267 pid: 33856 timeout: 1161 lvb_type: 0 00010000:00010000:3.0:1763343268.318618:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709ec6b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47e97 expref: 267 pid: 33856 timeout: 1161 lvb_type: 0 00010000:00010000:3.0:1763343268.318641:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709ec6b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47e97 expref: 267 pid: 33856 timeout: 1161 lvb_type: 0 00010000:00010000:3.0:1763343268.318659:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff9400c48a8400) 00010000:00010000:3.0:1763343268.318664:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba7709edbb lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343268.318675:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba7709edbb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343268.318683:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba7709edbb lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343268.318840:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343268.319572:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+266:2408:x1848998399558400:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 989us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343268.319582:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3196 00000100:00100000:3.0:1763343268.321841:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399558656 00000100:00100000:3.0:1763343268.321853:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399558656 00000100:00100000:3.0:1763343268.321908:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9899 00000100:00100000:3.0:1763343268.321923:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+267:56986:x1848998399558656:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343268.321945:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.321967:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba7709edd0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47f1c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.322177:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7a00/0x9104b1ba7709edd7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.322193:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba7709edc2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f15 expref: 268 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.322203:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7a00/0x9104b1ba7709edd7 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.322244:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba7709edc2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f15 expref: 268 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.322258:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba7709edc2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f15 expref: 268 pid: 6525 timeout: 1161 lvb_type: 0 00000100:00100000:3.0:1763343268.322274:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c8599f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998412877568:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343268.326280:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399558784 00000100:00100000:3.0:1763343268.326289:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399558784 00010000:00010000:3.0:1763343268.326325:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba7709edc2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f15 expref: 269 pid: 6525 timeout: 1161 lvb_type: 0 00000100:00100000:3.0:1763343268.326354:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3197 00000100:00100000:3.0:1763343268.326363:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+269:2407:x1848998399558784:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343268.326386:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343268.326393:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba7709edc2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f15 expref: 269 pid: 6525 timeout: 1161 lvb_type: 0 00010000:00010000:3.0:1763343268.326407:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba7709edc2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f15 expref: 269 pid: 6525 timeout: 1161 lvb_type: 0 00010000:00010000:3.0:1763343268.326429:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba7709edc2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f15 expref: 269 pid: 6525 timeout: 1161 lvb_type: 0 00010000:00010000:3.0:1763343268.326447:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ca:0x0].0x0 (ffff9401c63d6900) 00010000:00010000:3.0:1763343268.326453:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7a00/0x9104b1ba7709edd7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.326462:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7a00/0x9104b1ba7709edd7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.326470:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7a00/0x9104b1ba7709edd7 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.326645:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343268.326709:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+268:2407:x1848998399558784:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 346us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343268.326718:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3197 00000100:00100000:3.0:1763343268.328506:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412877824:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343268.330390:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343268.330420:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c8599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412878336:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343268.330446:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343268.330484:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412877824 00000100:00100000:3.0:1763343268.330489:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412877824 00000100:00100000:3.0:1763343268.330524:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412878336 00000100:00100000:3.0:1763343268.330527:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412878336 00000100:00100000:3.0:1763343268.330549:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6627 00000100:00100000:3.0:1763343268.330556:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+47:3659:x1848998412877952:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763343268.330705:0:28561:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x26b:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763343268.330709:0:28561:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x26b:0x0] updating lvb mtime from disk: 1763343267 -> 1763343267 00002000:00010000:3.0:1763343268.330711:0:28561:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x26b:0x0] updating lvb atime from disk: 1763343267 -> 1763343267 00002000:00010000:3.0:1763343268.330714:0:28561:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x26b:0x0] updating lvb ctime from disk: 1763343267 -> 1763343267 00002000:00010000:3.0:1763343268.330717:0:28561:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x26b:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343268.332273:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+50:3659:x1848998412877952:12345-0@lo:2:osp-syn-1-1.0 Request processed in 1715us (2937us total) trans 17179871661 rc 0/0 00000100:00100000:3.0:1763343268.332289:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6627 00000100:00100000:3.0:1763343268.332318:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6631 00000100:00100000:3.0:1763343268.332331:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+49:3659:x1848998412878080:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763343268.332415:0:28561:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x26c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343268.332422:0:28561:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x26c:0x0] updating lvb mtime from disk: 1763343267 -> 1763343267 00002000:00010000:3.0:1763343268.332429:0:28561:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x26c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343268.332434:0:28561:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x26c:0x0] updating lvb ctime from disk: 1763343267 -> 1763343267 00002000:00010000:3.0:1763343268.332439:0:28561:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x26c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343268.332474:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+50:3659:x1848998412878080:12345-0@lo:2:osp-syn-1-1.0 Request processed in 147us (1156us total) trans 17179871663 rc 0/0 00000100:00100000:3.0:1763343268.332494:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6631 00010000:00010000:3.0:1763343268.332518:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343268.332525:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb2a00/0x9104b1ba7709edfa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.332546:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb2a00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343268.332552:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb2a00/0x9104b1ba7709edfa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.332572:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb2a00/0x9104b1ba7709edfa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.332599:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb2a00/0x9104b1ba7709edfa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.332608:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb2a00/0x9104b1ba7709edfa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.332631:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343268.332636:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343268.332638:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343268.332668:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5dc8e00/2, rc 0, transno 17179871663 00000100:00100000:3.0:1763343268.332678:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412878080:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763343268.333732:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c7ef6680/2, rc 0, transno 21474838930 00000100:00100000:3.0:1763343268.333740:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c7ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412878592:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763343268.333761:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5dcb480/2, rc 0, transno 17179871661 00000100:00100000:3.0:1763343268.333766:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412877952:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763343268.333774:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c7ef4e00/2, rc 0, transno 21474838928 00000100:00100000:3.0:1763343268.333777:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c7ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412878464:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343268.337472:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399559424 00000100:00100000:3.0:1763343268.337477:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399559424 00000100:00100000:3.0:1763343268.337516:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9900 00000100:00100000:3.0:1763343268.337525:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+257:56982:x1848998399559424:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343268.337548:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.337571:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ee01 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47f23 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.337623:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ee01 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f23 expref: 259 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.337639:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90c00/0x9104b1ba7709ee01 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f23 expref: 259 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.337659:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff9400c48a8400) 00010000:00010000:3.0:1763343268.337663:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343268.337667:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e90c00, rc 0) 00000100:00100000:3.0:1763343268.337695:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+259:56982:x1848998399559424:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 171us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343268.337701:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9900 00000100:00100000:3.0:1763343268.341352:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c517b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8626:1848998412878720:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343268.341400:0:8626:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709ede5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.341877:0:8626:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709ede5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.341888:0:8626:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709ede5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.341896:0:8626:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709ede5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.341906:0:8626:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709ede5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.342264:0:8626:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343268.342748:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3661:x1848998412878208:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12853us (13468us total) trans 21474838931 rc 0/0 00000100:00100000:3.0:1763343268.342764:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6626 00010000:00010000:3.0:1763343268.342794:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763343268.342802:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709ede5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.342810:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb3e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343268.342814:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709ede5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.342824:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709ede5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.342846:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709ede5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.342853:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709ede5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.342874:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343268.342877:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9401fd2df600/0x9104b1ba7709edec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.342884:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fd2df600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343268.342887:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9401fd2df600/0x9104b1ba7709edec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.342894:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9401fd2df600/0x9104b1ba7709edec lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.342906:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9401fd2df600/0x9104b1ba7709edec lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.342914:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401fd2df600/0x9104b1ba7709edec lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.342928:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343268.342932:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343268.342936:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343268.343137:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343268.343153:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399559936 00000100:00100000:3.0:1763343268.343159:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399559936 00000100:00100000:3.0:1763343268.343206:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9901 00000100:00100000:3.0:1763343268.343217:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+258:55884:x1848998399559936:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343268.343239:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.343260:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ee08 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47f2a expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.343369:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ee0f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343268.343397:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ee0f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.343406:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ee0f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.343417:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ee16 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343268.343423:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ee16 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.343765:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ee16 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.343828:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ee1d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343268.343842:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ee1d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.343853:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ee1d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:3.0:1763343268.343869:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ca:0x0]: returning size 0 00010000:00010000:3.0:1763343268.343945:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ee0f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.343953:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ee0f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.343958:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ee0f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.343964:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ee0f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.343968:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e90800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.343972:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ee0f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.343979:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ee0f lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.343990:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401c63d6f00) 00010000:00010000:3.0:1763343268.343993:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.343998:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ee0f lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.344004:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709ee0f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.344014:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ee16 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.344021:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ee16 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.344051:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ee16 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.344056:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e91600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.344059:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ee16 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.344065:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ee16 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.344077:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401c63d6600) 00010000:00010000:3.0:1763343268.344080:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.344083:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ee16 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.344088:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ee16 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.344133:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ee08 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f2a expref: 262 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.344154:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ee1d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f2a expref: 261 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.344167:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ca:0x0].0x0 (ffff9401c63d6a00) 00010000:00010000:3.0:1763343268.344170:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343268.344174:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e90600, rc 0) 00000100:00100000:3.0:1763343268.344237:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+262:55884:x1848998399559936:12345-192.168.201.40@tcp:101:bash.0 Request processed in 1020us (1117us total) trans 4294972922 rc 0/0 00000100:00100000:3.0:1763343268.344254:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9901 00010000:00010000:3.0:1763343268.347004:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343268.347017:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2a00/0x9104b1ba7709ee2b lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343268.347058:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb2a00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343268.347062:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2a00/0x9104b1ba7709ee2b lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343268.347071:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2a00/0x9104b1ba7709ee2b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343268.347089:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff9400c48a8400) 00010000:00010000:3.0:1763343268.347092:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343268.347097:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2a00/0x9104b1ba7709ee2b lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343268.347103:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2a00/0x9104b1ba7709ee2b lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343268.347117:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343268.347119:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343268.347121:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343268.349356:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399560320 00000100:00100000:3.0:1763343268.349366:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399560320 00000100:00100000:3.0:1763343268.380296:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399562368 00000100:00100000:3.0:1763343268.380310:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399562368 00010000:00010000:3.0:1763343268.380354:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709ee7f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f4d expref: 271 pid: 9827 timeout: 1161 lvb_type: 0 00000100:00100000:3.0:1763343268.380402:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3200 00000100:00100000:3.0:1763343268.380412:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+271:2408:x1848998399562368:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343268.380429:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343268.380436:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709ee7f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f4d expref: 271 pid: 9827 timeout: 1161 lvb_type: 0 00010000:00010000:3.0:1763343268.380449:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709ee7f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f4d expref: 271 pid: 9827 timeout: 1161 lvb_type: 0 00010000:00010000:3.0:1763343268.380472:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709ee7f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f4d expref: 271 pid: 9827 timeout: 1161 lvb_type: 0 00010000:00010000:3.0:1763343268.380488:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ca:0x0].0x0 (ffff9401c63d6a00) 00010000:00010000:3.0:1763343268.380493:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba7709ee94 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.380504:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba7709ee94 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.380511:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba7709ee94 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.380542:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343268.380600:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+270:2408:x1848998399562368:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 189us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343268.380607:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3200 00010000:00010000:3.0:1763343268.387585:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709ee63 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.387599:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709ee63 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.387609:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709ee63 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.387617:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3b4aa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.387623:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709ee63 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.387631:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709ee63 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.387652:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ca:0x0].0x0 (ffff9401c63d6a00) 00010000:00010000:3.0:1763343268.387657:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.387663:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709ee63 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.387670:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709ee63 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000100:00100000:3.0:1763343268.387704:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399562624 00000100:00100000:3.0:1763343268.387712:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399562624 00000100:00100000:3.0:1763343268.387765:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9907 00000100:00100000:3.0:1763343268.387774:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+258:56987:x1848998399562624:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343268.387793:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.387813:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ee9b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47f5b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.387894:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709eea2 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.387906:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709eea2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.387916:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709eea2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.387928:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709eea9 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.387938:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709eea9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.387944:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709eea9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.388101:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709eeb0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.388111:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709eeb0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.388118:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709eeb0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:3.0:1763343268.388128:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ca:0x0]: returning size 2 00010000:00010000:3.0:1763343268.388213:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709eeb0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.388219:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709eeb0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.388225:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709eeb0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.388230:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e90600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.388233:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709eeb0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.388239:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709eeb0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.388246:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ca:0x0].0x0 (ffff9401c63d6a00) 00010000:00010000:3.0:1763343268.388250:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1763343268.388253:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709eeb0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.388258:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709eeb0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.388271:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709eea2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.388276:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709eea2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.388281:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709eea2 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.388287:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709eea2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.388291:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e91600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.388293:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709eea2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.388299:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709eea2 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.388305:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401c63d6f00) 00010000:00010000:3.0:1763343268.388307:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.388309:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709eea2 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.388314:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709eea2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.388322:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709eea9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.388328:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709eea9 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.388333:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709eea9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.388338:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e90800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.388340:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709eea9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.388345:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709eea9 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.388352:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401c63d6600) 00010000:00010000:3.0:1763343268.388354:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.388357:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709eea9 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.388362:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709eea9 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.388419:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ee9b lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f5b expref: 260 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.388430:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401c63d6f00) 00010000:00010000:3.0:1763343268.388433:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343268.388437:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709ee9b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f5b expref: 260 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.388447:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e90400, rc 0) 00000100:00100000:3.0:1763343268.388517:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+259:56987:x1848998399562624:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 743us (1009us total) trans 4294972931 rc 301/301 00000100:00100000:3.0:1763343268.388524:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9907 00000100:00100000:3.0:1763343268.388871:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412879104 00000100:00100000:3.0:1763343268.389711:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412879104 00000100:00100000:3.0:1763343268.389745:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6636 00000100:00100000:3.0:1763343268.389751:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+52:3661:x1848998412879232:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763343268.389768:0:8626:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:620 count 1 00010000:00010000:3.0:1763343268.389786:0:8626:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709eebe lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x26c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.389805:0:8626:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fca00/0x9104b1ba7709ed67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f00 expref: 33 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.389813:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343268.389815:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343268.389819:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709eebe lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x26c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.389854:0:8626:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fca00/0x9104b1ba7709ed67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x26c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f00 expref: 33 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.389869:0:8626:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fca00/0x9104b1ba7709ed67 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x26c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f00 expref: 33 pid: 8626 timeout: 1161 lvb_type: 0 00000100:00100000:3.0:1763343268.389882:0:8626:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c2f87800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998412879616:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343268.391755:0:8626:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9540 going to sleep for 11 seconds 00000100:00100000:3.0:1763343268.391849:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399562752 00000100:00100000:3.0:1763343268.391855:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399562752 00000100:00100000:3.0:1763343268.395370:0:28561:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c517b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998412879744:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343268.395423:0:28561:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba7709eec5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x26b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343268.397676:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399562880 00000100:00100000:3.0:1763343268.397684:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399562880 00010000:00010000:3.0:1763343268.397716:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba7709ec87 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x26b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47eac expref: 35 pid: 8626 timeout: 1161 lvb_type: 1 00000100:00100000:3.0:1763343268.397768:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3202 00000100:00100000:3.0:1763343268.397784:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+35:2408:x1848998399562880:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343268.397804:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343268.397811:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba7709ec87 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x26b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47eac expref: 35 pid: 8626 timeout: 1161 lvb_type: 1 00010000:00010000:3.0:1763343268.397825:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba7709ec87 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x26b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47eac expref: 35 pid: 8626 timeout: 1161 lvb_type: 1 00010000:00010000:3.0:1763343268.397850:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba7709ec87 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x26b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47eac expref: 36 pid: 8626 timeout: 1161 lvb_type: 1 00010000:00010000:3.0:1763343268.397865:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343268.397869:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343268.397877:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba7709eec5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.397895:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba7709eec5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x26b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.397935:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343268.397967:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+35:2408:x1848998399562880:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 187us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343268.397982:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3202 00010000:00010000:3.0:1763343268.398013:0:28561:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba7709eec5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.398049:0:28561:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba7709eec5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.398062:0:28561:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba7709eec5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.398081:0:28561:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba7709eec5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.398112:0:28561:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343268.398446:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+53:3661:x1848998412879104:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7802us (9803us total) trans 17179871667 rc 0/0 00000100:00100000:3.0:1763343268.398460:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6637 00000100:00100000:3.0:1763343268.399068:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c2f87800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998412879616:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343268.399088:0:8626:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709eebe lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x26c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343268.399258:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399563520 00000100:00100000:3.0:1763343268.399264:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399563520 00000100:00100000:3.0:1763343268.399325:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6644 00000100:00100000:3.0:1763343268.399333:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+34:55884:x1848998399563520:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343268.399346:0:28561:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.399356:0:28561:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709eeef lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47f70 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.399372:0:28561:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9401c0031400/0x9104b1ba7709eee8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x26f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f69 expref: 35 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343268.399390:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343268.399392:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343268.399396:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709eeef lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f70 expref: 35 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.399421:0:28561:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9401c0031400/0x9104b1ba7709eee8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x26f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f69 expref: 35 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343268.399445:0:28561:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9401c0031400/0x9104b1ba7709eee8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x26f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f69 expref: 35 pid: 8412 timeout: 1161 lvb_type: 1 00000100:00100000:3.0:1763343268.399473:0:28561:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c2f87800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998412880640:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343268.399525:0:28561:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9540 going to sleep for 11 seconds 00000100:00100000:3.0:1763343268.402059:0:28561:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c2f87800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998412880640:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343268.402090:0:28561:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709eeef lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f70 expref: 34 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.402116:0:28561:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e90400, rc 0) 00000100:00100000:3.0:1763343268.402146:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+34:55884:x1848998399563520:12345-192.168.201.40@tcp:101:bash.0 Request processed in 2812us (2963us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343268.402156:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6644 00000100:00100000:3.0:1763343268.407490:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399564032 00000100:00100000:3.0:1763343268.407500:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399564032 00000100:00100000:3.0:1763343268.407561:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6645 00000100:00100000:3.0:1763343268.407571:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:55884:x1848998399564032:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343268.407589:0:28561:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.407612:0:28561:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90800/0x9104b1ba7709eef6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47f77 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343268.407641:0:28561:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x26e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343268.407663:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343268.407666:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343268.407676:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90800/0x9104b1ba7709eef6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f77 expref: 13 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.407692:0:28561:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90800/0x9104b1ba7709eef6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f77 expref: 13 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.407706:0:28561:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e90800, rc 0) 00000100:00100000:3.0:1763343268.407735:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:55884:x1848998399564032:12345-192.168.201.40@tcp:101:bash.0 Request processed in 164us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343268.407744:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6645 00000100:00100000:3.0:1763343268.433373:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.438983:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399565312 00000100:00100000:3.0:1763343268.438995:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399565312 00000100:00100000:3.0:1763343268.439259:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399565440 00000100:00100000:3.0:1763343268.439263:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399565440 00000100:00100000:3.0:1763343268.439608:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9911 00000100:00100000:3.0:1763343268.439619:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+264:56989:x1848998399565312:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:3.0:1763343268.439674:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763343268.439705:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba7709ee94 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ca:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f54 expref: 264 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.439732:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba7709eee1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f62 expref: 263 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.440292:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba7709ee39 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f31 expref: 262 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.440306:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ca:0x0].0x0 (ffff9401c63d6a00) 00010000:00010000:3.0:1763343268.440311:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343268.440342:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ef2e lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.440354:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ef2e lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.440364:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709ef2e lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.440386:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ef35 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.440397:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ef35 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.440404:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709ef35 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.440481:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709ef3c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.440943:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba7709ef20 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1ca:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f85 expref: 261 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.440955:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709ef3c lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.441315:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba7709ef20 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ca:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f85 expref: 262 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.441330:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba7709ef20 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1ca:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f85 expref: 262 pid: 9827 timeout: 1161 lvb_type: 0 00000100:00100000:3.0:1763343268.441345:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c2f86300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998412880896:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343268.441501:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9540 going to sleep for 11 seconds 00000100:00100000:3.0:1763343268.450874:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c2f86300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998412880896:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343268.450903:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709ef3c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.451151:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709ef3c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.451166:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709ef3c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.464281:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343268.464288:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba7709ef51 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1ca:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343268.464296:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fdc00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343268.464300:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba7709ef51 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1ca:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343268.464307:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba7709ef51 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1ca:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343268.464321:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ca:0x0].0x0 (ffff9401c63d6a00) 00010000:00010000:3.0:1763343268.464324:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343268.464329:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba7709ef51 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1ca:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343268.464334:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba7709ef51 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1ca:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343268.464344:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343268.464346:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343268.464347:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343268.475996:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399566080 00000100:00100000:3.0:1763343268.476008:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399566080 00000100:00100000:3.0:1763343268.476111:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9914 00000100:00100000:3.0:1763343268.476121:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+263:56990:x1848998399566080:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343268.476146:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.476175:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba7709ef6d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47f9a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.476484:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba7709ef74 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.476497:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba7709ef74 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.476508:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba7709ef74 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.476518:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba7709ef7b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.476524:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba7709ef7b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.476530:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba7709ef7b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.476569:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba7709ef74 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.476576:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba7709ef74 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.476582:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba7709ef74 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.476587:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba7709ef74 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.476594:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85ab400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.476598:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba7709ef74 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.476608:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba7709ef74 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.476618:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401c63d6800) 00010000:00010000:3.0:1763343268.476621:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.476625:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba7709ef74 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.476631:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba7709ef74 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.476644:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba7709ef7b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.476650:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba7709ef7b lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.476655:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba7709ef7b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.476659:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85abe00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.476662:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba7709ef7b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.476668:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba7709ef7b lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.476674:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401c63d6400) 00010000:00010000:3.0:1763343268.476677:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.476679:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba7709ef7b lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.476685:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba7709ef7b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.476711:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba7709ef6d lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f9a expref: 264 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.476722:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401c63d6800) 00010000:00010000:3.0:1763343268.476724:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.476728:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba7709ef6d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f9a expref: 264 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.476741:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fd2dea00, rc 0) 00000100:00100000:3.0:1763343268.477368:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+263:56990:x1848998399566080:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1244us (1506us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343268.477386:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9914 00000100:00100000:3.0:1763343268.485875:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399566336 00000100:00100000:3.0:1763343268.485886:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399566336 00000100:00100000:3.0:1763343268.485950:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399566208 00000100:00100000:3.0:1763343268.485955:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399566208 00000100:00100000:3.0:1763343268.486952:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9915 00000100:00100000:3.0:1763343268.486969:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+264:56990:x1848998399566336:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343268.486990:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.487016:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba7709ef82 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47fa8 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.487107:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba7709ef89 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.488258:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba7709ef89 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.488277:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba7709ef89 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:3.0:1763343268.488332:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763343268.488336:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1763343268.488806:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba7709ef82 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47fa8 expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.488820:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba7709ef89 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47fa8 expref: 264 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.488827:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401c63d6800) 00010000:00010000:3.0:1763343268.488829:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763343268.488831:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c85ab400, rc 0) 00000100:00100000:3.0:1763343268.488853:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+264:56990:x1848998399566336:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1891us (3217us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343268.488859:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9915 00000100:00100000:3.0:1763343268.496448:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399566592 00000100:00100000:3.0:1763343268.496462:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399566592 00000100:00100000:3.0:1763343268.496533:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9917 00000100:00100000:3.0:1763343268.496544:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+264:56990:x1848998399566592:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343268.496568:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.496571:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343268.496602:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba7709ef89 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47fa8 expref: 264 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.496622:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401c63d6800) 00010000:00010000:3.0:1763343268.496632:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343268.496648:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa400/0x9104b1ba7709efa5 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47faf expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.496761:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba7709efac lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.496773:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba7709efac lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.496782:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba7709efac lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.496792:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba7709efb3 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.496798:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba7709efb3 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.496804:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba7709efb3 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.497241:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba7709efba lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.497251:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba7709efba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.497258:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba7709efba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:3.0:1763343268.497267:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1cc:0x0]: returning size 0 00010000:00010000:3.0:1763343268.497294:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba7709efac lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.497301:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba7709efac lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.497312:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba7709efac lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.497318:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba7709efac lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.497324:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85aa600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.497328:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba7709efac lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.497335:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba7709efac lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.497343:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401c63d6c00) 00010000:00010000:3.0:1763343268.497346:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.497349:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba7709efac lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.497354:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba7709efac lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00000004:00010000:3.0:1763343268.497364:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000cbf2e40f reply state 0000000091c21e66 transno 4294972937 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba7709efb3 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.497386:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba7709efb3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.497392:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401c63d6400) 00010000:00010000:3.0:1763343268.497395:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343268.497397:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343268.497423:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa400/0x9104b1ba7709efa5 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47faf expref: 266 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.497443:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba7709efba lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47faf expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.497449:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff9401c63d6d00) 00010000:00010000:3.0:1763343268.497452:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343268.497454:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c7bb3800, rc 0) 00000100:00100000:3.0:1763343268.497518:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+266:56990:x1848998399566592:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 975us (1186us total) trans 4294972937 rc 0/0 00000100:00100000:3.0:1763343268.497525:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9917 00000100:00100000:3.0:1763343268.508458:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.514053:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.515826:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.520437:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.521259:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.525527:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.529091:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399568384 00000100:00100000:3.0:1763343268.529101:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399568384 00000100:00100000:3.0:1763343268.529165:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9920 00000100:00100000:3.0:1763343268.529176:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+271:55884:x1848998399568384:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343268.529196:0:6526:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.529200:0:6526:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343268.529226:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba7709eff2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47fbd expref: 271 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.529245:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff9401f669e400) 00010000:00010000:3.0:1763343268.529256:0:6526:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343268.529281:0:6526:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f007 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47fcb expref: -99 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.529402:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba7709f00e lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343268.529415:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba7709f00e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1cc:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.529423:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba7709f00e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1cc:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00000004:00200000:3.0:1763343268.529434:0:6526:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1cc:0x0]: returning size 0 00010000:00010000:3.0:1763343268.529543:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f007 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1cc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47fcb expref: 273 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.529557:0:6526:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba7709f00e lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1cc:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47fcb expref: 272 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.529564:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff9401c63d6c00) 00010000:00010000:3.0:1763343268.529567:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:3.0:1763343268.529569:0:6526:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c7bb2400, rc 0) 00000100:00100000:3.0:1763343268.529625:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+272:55884:x1848998399568384:12345-192.168.201.40@tcp:101:bash.0 Request processed in 451us (640us total) trans 4294972943 rc 0/0 00000100:00100000:3.0:1763343268.529632:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9920 00000100:00100000:3.0:1763343268.537513:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399568768 00000100:00100000:3.0:1763343268.537523:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399568768 00000100:00100000:3.0:1763343268.537576:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9922 00000100:00100000:3.0:1763343268.537585:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+273:55884:x1848998399568768:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343268.537609:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.537631:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f03f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b47fd9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.537669:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2a00/0x9104b1ba7709f046 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343268.537682:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2a00/0x9104b1ba7709f046 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.537693:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2a00/0x9104b1ba7709f046 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.537771:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f03f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47fd9 expref: 277 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.537786:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2a00/0x9104b1ba7709f046 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47fd9 expref: 276 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.537795:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff9401c63d6c00) 00010000:00010000:3.0:1763343268.537798:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343268.537801:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c7bb2a00, rc 0) 00000100:00100000:3.0:1763343268.537843:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+276:55884:x1848998399568768:12345-192.168.201.40@tcp:101:bash.0 Request processed in 259us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343268.537850:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9922 00000100:00100000:3.0:1763343268.543194:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399569536 00000100:00100000:3.0:1763343268.543204:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399569536 00000100:00100000:3.0:1763343268.543256:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399569408 00000100:00100000:3.0:1763343268.543259:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399569408 00000100:00100000:3.0:1763343268.543828:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9924 00000100:00100000:3.0:1763343268.543837:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:55884:x1848998399569408:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:3.0:1763343268.543861:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343268.543875:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba7709f00e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1cc:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47fcb expref: 278 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.543885:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff9401c63d6c00) 00010000:00010000:3.0:1763343268.543888:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343268.550613:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399569792 00000100:00100000:3.0:1763343268.550626:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399569792 00000100:00100000:3.0:1763343268.550726:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3475 00000100:00100000:3.0:1763343268.550744:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+279:56991:x1848998399569792:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343268.559471:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399570304 00000100:00100000:3.0:1763343268.559477:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399570304 00000100:00100000:3.0:1763343268.559513:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3476 00000100:00100000:3.0:1763343268.559521:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:56991:x1848998399570304:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:3.0:1763343268.559670:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:56991:x1848998399570304:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 149us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343268.559680:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3476 00000100:00100000:3.0:1763343268.567544:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9dc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412882304:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343268.567573:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343268.567757:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6653 00000100:00100000:3.0:1763343268.567773:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+15:3662:x1848998412882048:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343268.567788:0:35281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:622 count 1 00010000:00010000:3.0:1763343268.567804:0:35281:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba7709f0a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.567820:0:35281:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90800/0x9104b1ba7709eef6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f77 expref: 14 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.567832:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343268.567834:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343268.567837:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba7709f0a1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.569974:0:35281:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90800/0x9104b1ba7709eef6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f77 expref: 14 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.570084:0:35281:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90800/0x9104b1ba7709eef6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f77 expref: 14 pid: 28561 timeout: 1161 lvb_type: 0 00000100:00100000:3.0:1763343268.570101:0:35281:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35281:1848998412882688:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343268.570182:0:35281:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343268.577834:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.577869:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399570560 00000100:00100000:3.0:1763343268.577878:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399570560 00010000:00010000:3.0:1763343268.578061:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709eeef lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f70 expref: 35 pid: 28561 timeout: 1161 lvb_type: 0 00000100:00100000:3.0:1763343268.578114:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3210 00000100:00100000:3.0:1763343268.578130:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+35:2407:x1848998399570560:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343268.578146:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343268.578157:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709eeef lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f70 expref: 35 pid: 28561 timeout: 1161 lvb_type: 0 00010000:00010000:3.0:1763343268.578188:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709eeef lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f70 expref: 34 pid: 28561 timeout: 1161 lvb_type: 0 00010000:00010000:3.0:1763343268.578213:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90400/0x9104b1ba7709eeef lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f70 expref: 34 pid: 28561 timeout: 1161 lvb_type: 0 00010000:00010000:3.0:1763343268.578242:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343268.578247:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343268.578254:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ac00/0x9104b1ba7709f093 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.578266:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ac00/0x9104b1ba7709f093 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.578294:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343268.578361:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+33:2407:x1848998399570560:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 234us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343268.578391:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3210 00010000:00010000:3.0:1763343268.578429:0:28561:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ac00/0x9104b1ba7709f093 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.578442:0:28561:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ac00/0x9104b1ba7709f093 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.578458:0:28561:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ac00/0x9104b1ba7709f093 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.578468:0:28561:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ac00/0x9104b1ba7709f093 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.578493:0:28561:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1763343268.580080:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+59:3662:x1848998412881280:12345-0@lo:6:osp-syn-1-1.0 Request processed in 13897us (14368us total) trans 17179871674 rc 0/0 00000100:00100000:3.0:1763343268.580092:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6649 00010000:00010000:3.0:1763343268.580122:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343268.581382:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c9dcbb80/2, rc 0, transno 21474838939 00000100:00100000:3.0:1763343268.581392:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9dcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412882176:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1763343268.584527:0:35281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90800/0x9104b1ba7709eef6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b47f77 expref: 13 pid: 28561 timeout: 1161 lvb_type: 0 00000100:00100000:3.0:1763343268.584549:0:35281:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35281:1848998412882688:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343268.584575:0:35281:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba7709f0a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.584586:0:35281:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba7709f0a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.584594:0:35281:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba7709f0a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.584605:0:35281:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba7709f0a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.584614:0:35281:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba7709f0a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.584652:0:35281:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343268.584902:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+17:3662:x1848998412882048:12345-0@lo:6:osp-syn-0-1.0 Request processed in 17133us (17469us total) trans 21474838940 rc 0/0 00000100:00100000:3.0:1763343268.584910:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6653 00000004:00080000:3.0:1763343268.584954:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6275880/2, rc 0, transno 21474838940 00000100:00100000:3.0:1763343268.585164:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6275880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412882048:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343268.592006:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:3.0:1763343268.603238:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343268.609095:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.609127:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.634743:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399573120 00000100:00100000:3.0:1763343268.634753:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399573120 00000100:00100000:3.0:1763343268.634904:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9931 00000100:00100000:3.0:1763343268.634916:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+267:56993:x1848998399573120:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343268.634947:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.634965:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f11f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4801f expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.635336:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba7709f126 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343268.635352:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba7709f126 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.635363:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba7709f126 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.638644:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba7709f126 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.638658:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba7709f126 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:3.0:1763343268.638718:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1cc:0x0]: returning size 5 00000004:00200000:3.0:1763343268.638724:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343268.638748:0:9827:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba7709f126 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343268.638790:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f11f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1cc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4801f expref: 268 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.638811:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba7709f126 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4801f expref: 267 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.638820:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff9401c63d6c00) 00010000:00010000:3.0:1763343268.638825:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343268.638831:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c7bb2400, rc 0) 00000100:00100000:3.0:1763343268.638890:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+267:56993:x1848998399573120:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3961us (4629us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343268.638901:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9931 00000100:00100000:3.0:1763343268.643823:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399573632 00000100:00100000:3.0:1763343268.643833:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399573632 00000100:00100000:3.0:1763343268.643904:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 444 00000100:00100000:3.0:1763343268.643915:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+266:2409:x1848998399573632:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343268.643933:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343268.643961:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba7709f126 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4801f expref: 266 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.643987:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff9401c63d6c00) 00010000:00010000:3.0:1763343268.643992:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343268.644074:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+265:2409:x1848998399573632:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 161us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343268.644083:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 444 00000100:00100000:3.0:1763343268.647993:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399574144 00000100:00100000:3.0:1763343268.648003:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399574144 00000100:00100000:3.0:1763343268.659170:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.667414:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.686589:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000001:00080000:3.0:1763343268.692754:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972959 is committed 00000004:00080000:3.0:1763343268.692768:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 981 committed 00000004:00080000:3.0:1763343268.692781:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 989 committed 00000004:00080000:3.0:1763343268.692792:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 988 committed 00000004:00080000:3.0:1763343268.692794:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 980 committed 00000100:00100000:3.0:1763343268.693445:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9dcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412883584:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343268.693501:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343268.693544:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343268.693551:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9dc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412883712:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343268.693570:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343268.693601:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412883584 00000100:00100000:3.0:1763343268.693609:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412883584 00000100:00100000:3.0:1763343268.693645:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412883712 00000100:00100000:3.0:1763343268.693647:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412883712 00000100:00100000:3.0:1763343268.693665:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6659 00000100:00100000:3.0:1763343268.693673:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+59:3661:x1848998412883584:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763343268.693815:0:8626:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x271:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343268.693820:0:8626:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x271:0x0] updating lvb mtime from disk: 1763343267 -> 1763343267 00002000:00010000:3.0:1763343268.693823:0:8626:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x271:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343268.693826:0:8626:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x271:0x0] updating lvb ctime from disk: 1763343267 -> 1763343267 00002000:00010000:3.0:1763343268.693828:0:8626:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x271:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343268.693857:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+60:3661:x1848998412883584:12345-0@lo:2:osp-syn-1-1.0 Request processed in 185us (356us total) trans 17179871676 rc 0/0 00000100:00100000:3.0:1763343268.693864:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6659 00000004:00080000:3.0:1763343268.693902:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c9dcaa00/2, rc 0, transno 17179871676 00000100:00100000:3.0:1763343268.693907:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9dcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412883584:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343268.693923:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6660 00000100:00100000:3.0:1763343268.693930:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+59:3661:x1848998412883712:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343268.694000:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+60:3661:x1848998412883712:12345-0@lo:2:osp-syn-1-1.0 Request processed in 70us (428us total) trans 17179871677 rc 0/0 00000100:00100000:3.0:1763343268.694007:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6660 00000004:00080000:3.0:1763343268.694060:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c9dc8380/2, rc 0, transno 17179871677 00000100:00100000:3.0:1763343268.694066:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9dc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412883712:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343268.698361:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.698409:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.706557:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.706612:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.706850:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9943 00000100:00100000:3.0:1763343268.706866:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+262:56995:x1848998399576192:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343268.706881:0:6526:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.706895:0:6526:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba7709f1ea lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48065 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.706989:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f1f8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343268.707000:0:6526:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba7709f1ce lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48050 expref: 264 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.707008:0:6526:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f1f8 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.707057:0:6526:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba7709f1ce lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48050 expref: 264 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.707071:0:6526:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba7709f1ce lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48050 expref: 264 pid: 6525 timeout: 1161 lvb_type: 0 00000100:00100000:3.0:1763343268.707085:0:6526:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5953b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6526:1848998412884096:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343268.707162:0:6526:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9540 going to sleep for 11 seconds 00010000:00010000:3.0:1763343268.716263:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba7709f1ce lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48050 expref: 263 pid: 6525 timeout: 1161 lvb_type: 0 00000100:00100000:3.0:1763343268.716283:0:6526:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5953b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6526:1848998412884096:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343268.716305:0:6526:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f1f8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.716314:0:6526:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f1f8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.716320:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f1f8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00000004:00200000:3.0:1763343268.716345:0:6526:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1cd:0x0]: returning size 0 00000004:00080000:3.0:1763343268.716574:0:6526:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x273:0x0], index 1: 0 00000004:00080000:3.0:1763343268.716581:0:6526:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x272:0x0], index 0: 0 00000004:00080000:3.0:1763343268.716586:0:6526:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x273:0x0], index 0: 0 00000004:00080000:3.0:1763343268.716589:0:6526:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x274:0x0], index 1: 0 00010000:00010000:3.0:1763343268.716717:0:6526:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f1f8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.716725:0:6526:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f1f8 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.716731:0:6526:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f1f8 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.716737:0:6526:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb3e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.716741:0:6526:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f1f8 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.716748:0:6526:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f1f8 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.716762:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cd:0x0].0x0 (ffff9401f669e800) 00010000:00010000:3.0:1763343268.716764:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343268.716768:0:6526:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f1f8 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.716774:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f1f8 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.716820:0:6526:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba7709f1ea lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1cd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48065 expref: 263 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.716836:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cd:0x0].0x0 (ffff9401f669e800) 00010000:00010000:3.0:1763343268.716839:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343268.716843:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba7709f1ea lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1cd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48065 expref: 263 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.716857:0:6526:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c7bb2400, rc 0) 00000100:00100000:3.0:1763343268.719650:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+262:56995:x1848998399576192:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 12779us (13027us total) trans 4294972961 rc 301/301 00000100:00100000:3.0:1763343268.719667:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9943 00000100:00100000:3.0:1763343268.752157:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.777306:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399577728 00000100:00100000:3.0:1763343268.777314:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399577728 00000100:00100000:3.0:1763343268.777378:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9946 00000100:00100000:3.0:1763343268.777388:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+267:55884:x1848998399577728:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:3.0:1763343268.777442:0:6526:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343268.777469:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba7709f222 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48073 expref: 267 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.777485:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cd:0x0].0x0 (ffff9401f669d800) 00010000:00010000:3.0:1763343268.777490:0:6526:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343268.777664:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f23e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343268.777679:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f23e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.777688:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f23e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00000001:00080000:3.0:1763343268.777731:0:6526:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972965 00000004:00010000:3.0:1763343268.777753:0:6526:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000084bb5be2 reply state 00000000b47f70ae transno 4294972966 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f23e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.777765:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f23e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.777771:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cd:0x0].0x0 (ffff9401f669d800) 00010000:00010000:3.0:1763343268.777774:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343268.777777:0:6526:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343268.777871:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+269:55884:x1848998399577728:12345-192.168.201.40@tcp:36:bash.0 Request processed in 484us (638us total) trans 4294972966 rc 0/0 00000100:00100000:3.0:1763343268.777878:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9946 00000020:00080000:3.0:1763343268.777883:0:6526:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343268.791230:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c8bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412884480:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343268.791276:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343268.791304:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343268.791310:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c8bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412884352:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343268.791329:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343268.791356:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412884480 00000100:00100000:3.0:1763343268.791363:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412884480 00000100:00100000:3.0:1763343268.791402:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412884352 00000100:00100000:3.0:1763343268.791405:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412884352 00000100:00100000:3.0:1763343268.791423:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6667 00000100:00100000:3.0:1763343268.791430:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+21:3662:x1848998412884480:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343268.791610:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+22:3662:x1848998412884480:12345-0@lo:2:osp-syn-0-1.0 Request processed in 180us (333us total) trans 21474838946 rc 0/0 00000100:00100000:3.0:1763343268.791617:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6667 00000004:00080000:3.0:1763343268.791656:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c8bc2a00/2, rc 0, transno 21474838946 00000100:00100000:3.0:1763343268.791662:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c8bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412884480:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343268.791677:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6668 00000100:00100000:3.0:1763343268.791684:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+21:3662:x1848998412884352:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343268.791756:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+22:3662:x1848998412884352:12345-0@lo:2:osp-syn-0-1.0 Request processed in 73us (426us total) trans 21474838947 rc 0/0 00000100:00100000:3.0:1763343268.791763:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6668 00000004:00080000:3.0:1763343268.791784:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c8bc0000/2, rc 0, transno 21474838947 00000100:00100000:3.0:1763343268.791788:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c8bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412884352:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343268.793154:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412884608:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343268.793410:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399578496 00000100:00100000:3.0:1763343268.793418:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399578496 00000100:00100000:3.0:1763343268.793515:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9949 00000100:00100000:3.0:1763343268.793524:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+261:56993:x1848998399578496:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343268.793546:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.793568:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba7709f261 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4808f expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.793606:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2a00/0x9104b1ba7709f268 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343268.793623:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2a00/0x9104b1ba7709f268 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.793636:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2a00/0x9104b1ba7709f268 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.793782:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba7709f261 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4808f expref: 263 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.793802:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2a00/0x9104b1ba7709f268 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4808f expref: 262 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.793810:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff9401c63d6c00) 00010000:00010000:3.0:1763343268.793813:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343268.793816:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c7bb2a00, rc 0) 00000100:00100000:3.0:1763343268.793869:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+262:56993:x1848998399578496:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 345us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343268.793876:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9949 00000004:00080000:3.0:1763343268.796913:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6280a80/2, rc 0, transno 17179871679 00000100:00100000:3.0:1763343268.796921:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412884608:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343268.797984:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399578752 00000100:00100000:3.0:1763343268.797991:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399578752 00000001:00080000:3.0:1763343268.803105:0:25994:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871680 is committed 00000001:00080000:3.0:1763343268.803117:0:25994:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871679 is committed 00000100:00100000:3.0:1763343268.811469:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399579136 00000100:00100000:3.0:1763343268.811474:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399579136 00002000:00010000:3.0:1763343268.811506:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/626 (0->18446744073709551615) 00002000:00100000:3.0:1763343268.811512:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b18380 with x1848998399579136 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343268.811528:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5b18380. 00000100:00100000:3.0:1763343268.811676:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1615 00000100:00100000:3.0:1763343268.811686:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2408:x1848998399579008:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:3.0:1763343268.811884:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x273:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343268.811888:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x273:0x0] updating lvb mtime from disk: 0 -> 1763343268 00002000:00010000:3.0:1763343268.811891:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x273:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343268.811894:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x273:0x0] updating lvb ctime from disk: 0 -> 1763343268 00002000:00010000:3.0:1763343268.811896:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x273:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343268.812165:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399579008:12345-192.168.201.40@tcp:10:bash.0 Request processed in 479us (1072us total) trans 17179871681 rc 0/0 00000100:00100000:3.0:1763343268.812174:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1615 00002000:00010000:3.0:1763343268.812179:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/627 (0->18446744073709551615) 00002000:00100000:3.0:1763343268.812181:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b1b100 with x1848998399579008 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343268.812186:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5b1b100. 00000100:00100000:3.0:1763343268.841658:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399579520 00000100:00100000:3.0:1763343268.841670:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399579520 00000100:00100000:3.0:1763343268.844510:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399579904 00000100:00100000:3.0:1763343268.844519:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399579904 00000100:00100000:3.0:1763343268.844619:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6673 00000100:00100000:3.0:1763343268.844628:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:56993:x1848998399579904:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343268.844644:0:35281:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.844662:0:35281:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba7709f2a7 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b480ab expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343268.844683:0:35281:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x272:0x0] initial LVB size: 4096, mtime: 0x691a7ba4, atime: 0x0, ctime: 0x691a7ba4, blocks: 0x8 00010000:00010000:3.0:1763343268.844703:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343268.844705:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343268.844712:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba7709f2a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b480ab expref: 15 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.844725:0:35281:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba7709f2a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b480ab expref: 15 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.844737:0:35281:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c7bb2400, rc 0) 00000100:00100000:3.0:1763343268.845275:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:56993:x1848998399579904:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 645us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343268.845283:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6673 00010000:00010000:3.0:1763343268.851427:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343268.851436:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba7709f2c3 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1cd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.851444:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401ed154800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343268.851448:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba7709f2c3 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1cd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.851455:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba7709f2c3 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1cd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.851544:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cd:0x0].0x0 (ffff9401c85ccb00) 00010000:00010000:3.0:1763343268.851549:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343268.851552:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba7709f2c3 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1cd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.851558:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba7709f2c3 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1cd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343268.851572:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343268.851574:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343268.851577:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343268.859311:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399580416 00000100:00100000:3.0:1763343268.859322:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399580416 00002000:00010000:3.0:1763343268.859377:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/626 (5->18446744073709551615) 00002000:00100000:3.0:1763343268.859382:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6281500 with x1848998399580416 ext(5->18446744073709551615) 00002000:00010000:3.0:1763343268.859395:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c6281500. 00000100:00100000:3.0:1763343268.870519:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1617 00000100:00100000:3.0:1763343268.870544:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6281500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998399580416:12345-192.168.201.40@tcp:10:lfs.0 00002000:00010000:3.0:1763343268.870869:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x272:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:3.0:1763343268.870874:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x272:0x0] updating lvb mtime from disk: 1763343268 -> 1763343268 00002000:00010000:3.0:1763343268.870877:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x272:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343268.870880:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x272:0x0] updating lvb ctime from disk: 1763343268 -> 1763343268 00002000:00010000:3.0:1763343268.870882:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x272:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343268.871491:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6281500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399580416:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 956us (12751us total) trans 17179871682 rc 0/0 00000100:00100000:3.0:1763343268.871498:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1617 00002000:00010000:3.0:1763343268.871501:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/626 (5->18446744073709551615) 00002000:00100000:3.0:1763343268.871504:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6281500 with x1848998399580416 ext(5->18446744073709551615) 00002000:00010000:3.0:1763343268.871509:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c6281500. 00000100:00100000:3.0:1763343268.883492:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9954 00000100:00100000:3.0:1763343268.883507:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+265:56997:x1848998399580800:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343268.883528:0:6526:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.883558:0:6526:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba7709f2e6 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b480c0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.883815:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f2f4 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343268.883823:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f2f4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.883830:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f2f4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.883839:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0031800/0x9104b1ba7709f2fb lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343268.883850:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0031800/0x9104b1ba7709f2fb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.883856:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0031800/0x9104b1ba7709f2fb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.883889:0:6526:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f2f4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.883895:0:6526:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f2f4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.883900:0:6526:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f2f4 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.883906:0:6526:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f2f4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.883911:0:6526:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb3e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.883915:0:6526:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f2f4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.883921:0:6526:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f2f4 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.883930:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b300) 00010000:00010000:3.0:1763343268.883932:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.883935:0:6526:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f2f4 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.883939:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba7709f2f4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.883952:0:6526:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0031800/0x9104b1ba7709f2fb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.883957:0:6526:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0031800/0x9104b1ba7709f2fb lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.883962:0:6526:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0031800/0x9104b1ba7709f2fb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.883967:0:6526:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c0031800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.883970:0:6526:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0031800/0x9104b1ba7709f2fb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.883976:0:6526:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0031800/0x9104b1ba7709f2fb lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.883981:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401c85cca00) 00010000:00010000:3.0:1763343268.883983:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.883986:0:6526:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0031800/0x9104b1ba7709f2fb lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.883991:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0031800/0x9104b1ba7709f2fb lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343268.884011:0:6526:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba7709f2e6 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b480c0 expref: 267 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.884020:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b300) 00010000:00010000:3.0:1763343268.884037:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.884042:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba7709f2e6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b480c0 expref: 267 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.884053:0:6526:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c7bb3800, rc 0) 00000100:00100000:3.0:1763343268.884074:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+266:56997:x1848998399580800:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 573us (2538us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343268.884080:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9954 00010000:00010000:3.0:1763343268.907003:0:28561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90400/0x9104b1ba7709f1ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x270:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4806c expref: 22 pid: 8626 timeout: 1162 lvb_type: 1 00000100:00100000:3.0:1763343268.907015:0:28561:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6282680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28561:1848998412884864:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343268.907087:0:28561:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9401ed154800/0x9104b1ba7709f310 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x270:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b480c7 expref: 21 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.907098:0:28561:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401ed154800, rc 0) 00000100:00100000:3.0:1763343268.907138:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:56993:x1848998399581184:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 11937us (12660us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343268.907145:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6675 00000100:00100000:3.0:1763343268.920497:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399581696 00000100:00100000:3.0:1763343268.920510:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399581696 00000100:00100000:3.0:1763343268.920634:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6676 00000100:00100000:3.0:1763343268.920645:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2408:x1848998399581696:12345-192.168.201.40@tcp:2:lfs.0 00002000:00010000:3.0:1763343268.920808:0:28561:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x270:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763343268.920812:0:28561:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x270:0x0] updating lvb mtime from disk: 1763343267 -> 1763343267 00002000:00010000:3.0:1763343268.920815:0:28561:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x270:0x0] updating lvb atime from disk: 0 -> 1763343267 00002000:00010000:3.0:1763343268.920818:0:28561:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x270:0x0] updating lvb ctime from disk: 1763343267 -> 1763343268 00002000:00010000:3.0:1763343268.920820:0:28561:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x270:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343268.920886:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399581696:12345-192.168.201.40@tcp:2:lfs.0 Request processed in 242us (1746us total) trans 21474838950 rc 0/0 00000100:00100000:3.0:1763343268.920895:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6676 00000100:00100000:3.0:1763343268.924654:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.932533:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000004:00080000:3.0:1763343268.946163:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c9830a80/2, rc 0, transno 21474838952 00000100:00100000:3.0:1763343268.946168:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412886272:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343268.950764:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412886016 00000100:00100000:3.0:1763343268.950769:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412886016 00000100:00100000:3.0:1763343268.957198:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3221 00000100:00100000:3.0:1763343268.957208:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399583488:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343268.957217:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343268.957222:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9401ed154e00/0x9104b1ba7709f27d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x272:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4809d expref: 21 pid: 28561 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343268.957231:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9401ed154e00/0x9104b1ba7709f27d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x272:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4809d expref: 21 pid: 28561 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343268.957247:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401ed154e00/0x9104b1ba7709f27d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x272:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4809d expref: 21 pid: 28561 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343268.957258:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343268.957260:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343268.957264:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9401fd2dea00/0x9104b1ba7709f379 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x272:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.957281:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401fd2dea00/0x9104b1ba7709f379 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x272:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.957309:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343268.957331:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2408:x1848998399583488:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 125us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343268.957340:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3221 00010000:00010000:3.0:1763343268.960596:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343268.961141:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399583616 00000100:00100000:3.0:1763343268.961149:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399583616 00000100:00100000:3.0:1763343268.961208:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9960 00000100:00100000:3.0:1763343268.961217:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c511ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+260:56993:x1848998399583616:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343268.961240:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.961263:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0031400/0x9104b1ba7709f387 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b480ea expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.961322:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0031400/0x9104b1ba7709f387 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1cc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b480ea expref: 261 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.961337:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0031400/0x9104b1ba7709f387 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1cc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b480ea expref: 261 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.961354:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff9401c63d6c00) 00010000:00010000:3.0:1763343268.961358:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343268.961361:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c0031400, rc 0) 00000100:00100000:3.0:1763343268.961421:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c511ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+261:56993:x1848998399583616:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 205us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343268.961427:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9960 00000100:00100000:3.0:1763343268.965652:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399583872 00000100:00100000:3.0:1763343268.965657:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399583872 00000100:00100000:3.0:1763343268.965694:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9961 00000100:00100000:3.0:1763343268.965702:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+262:55884:x1848998399583872:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343268.965713:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343268.965738:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba7709f38e lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b480f1 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.965829:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0031800/0x9104b1ba7709f395 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343268.965842:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0031800/0x9104b1ba7709f395 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.965854:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0031800/0x9104b1ba7709f395 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.965868:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba7709f39c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343268.965875:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba7709f39c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.965881:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba7709f39c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.965922:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba7709f3aa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343268.965928:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba7709f3aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.965935:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba7709f3aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:3.0:1763343268.965946:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1cf:0x0]: returning size 0 00010000:00010000:3.0:1763343268.965992:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0031800/0x9104b1ba7709f395 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.965999:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0031800/0x9104b1ba7709f395 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.966005:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0031800/0x9104b1ba7709f395 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.966010:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c0031800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.966014:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0031800/0x9104b1ba7709f395 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.966048:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0031800/0x9104b1ba7709f395 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.966062:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b300) 00010000:00010000:3.0:1763343268.966064:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.966070:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0031800/0x9104b1ba7709f395 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.966075:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0031800/0x9104b1ba7709f395 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.966085:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba7709f39c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.966090:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba7709f39c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.966095:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba7709f39c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.966100:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401ed154e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343268.966103:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba7709f39c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.966108:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba7709f39c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.966117:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c488b600) 00010000:00010000:3.0:1763343268.966119:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343268.966121:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba7709f39c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.966126:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba7709f39c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343268.966156:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba7709f38e lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b480f1 expref: 266 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.966171:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba7709f3aa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b480f1 expref: 265 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343268.966178:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cf:0x0].0x0 (ffff9400c488bb00) 00010000:00010000:3.0:1763343268.966180:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343268.966182:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401ed155000, rc 0) 00000100:00100000:3.0:1763343268.966205:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+264:55884:x1848998399583872:12345-192.168.201.40@tcp:101:bash.0 Request processed in 505us (972us total) trans 4294972978 rc 0/0 00000100:00100000:3.0:1763343268.966211:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9961 00000100:00100000:3.0:1763343268.972794:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.978232:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343268.994106:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:3.0:1763343268.999964:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba7709f3e9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48106 expref: 271 pid: 6526 timeout: 1162 lvb_type: 0 00000100:00100000:3.0:1763343268.999989:0:6526:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c39b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6526:1848998412886656:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343269.000014:0:6526:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba7709f3f7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1cf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343269.000065:0:6526:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba7709f3f7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1cf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343269.000072:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba7709f3f7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1cf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00000100:00100000:3.0:1763343269.010010:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c39b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412886784:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343269.010169:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343269.010239:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343269.010254:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c39b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412886912:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343269.010326:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1763343269.010452:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1763343269.010483:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6686 00000100:00100000:3.0:1763343269.010502:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+28:3661:x1848998412886784:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343269.010550:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:624 count 1 00010000:00010000:3.0:1763343269.010586:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401ed155600/0x9104b1ba7709f405 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x270:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.010627:0:8413:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9401ed154800/0x9104b1ba7709f310 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x270:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b480c7 expref: 20 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.010637:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343269.010640:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343269.010644:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401ed155600/0x9104b1ba7709f405 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x270:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.010683:0:8413:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9401ed154800/0x9104b1ba7709f310 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x270:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b480c7 expref: 20 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.010707:0:8413:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9401ed154800/0x9104b1ba7709f310 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x270:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b480c7 expref: 20 pid: 28561 timeout: 1162 lvb_type: 0 00000100:00100000:3.0:1763343269.010723:0:8413:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4789500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412887296:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343269.010815:0:8413:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9180 going to sleep for 11 seconds 00000100:00100000:3.0:1763343269.010843:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6688 00000100:00100000:3.0:1763343269.010854:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401ede6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+29:3661:x1848998412886912:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343269.010869:0:28562:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:625 count 1 00010000:00010000:3.0:1763343269.010881:0:28562:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401ed155400/0x9104b1ba7709f40c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x271:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.010895:0:28562:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba7709f2ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x271:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b480b2 expref: 20 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.010903:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343269.010906:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343269.010909:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401ed155400/0x9104b1ba7709f40c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x271:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343269.010931:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412887424:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343269.011798:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1763343269.011860:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1763343269.011878:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343269.011935:0:28562:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba7709f2ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x271:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b480b2 expref: 20 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.011956:0:28562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba7709f2ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x271:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b480b2 expref: 20 pid: 35281 timeout: 1162 lvb_type: 0 00000100:00100000:3.0:1763343269.011974:0:28562:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c478bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28562:1848998412887936:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343269.012079:0:28562:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9540 going to sleep for 11 seconds 00000100:00100000:3.0:1763343269.013586:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00080000:3.0:1763343269.014852:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1763343269.025856:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c39b4e00/2, rc 0, transno 21474838957 00000100:00100000:3.0:1763343269.025871:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c39b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412886912:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1763343269.025887:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c39b7800/2, rc 0, transno 21474838958 00000100:00100000:3.0:1763343269.025891:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c39b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412886784:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343269.030216:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399586560 00000100:00100000:3.0:1763343269.030232:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399586560 00010000:00010000:3.0:1763343269.030296:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3de00/0x9104b1ba7709f0d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48003 expref: 14 pid: 8626 timeout: 1162 lvb_type: 0 00000100:00100000:3.0:1763343269.030358:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3226 00000100:00100000:3.0:1763343269.030390:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399586560:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343269.030412:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343269.030420:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3de00/0x9104b1ba7709f0d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48003 expref: 14 pid: 8626 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.030442:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3de00/0x9104b1ba7709f0d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48003 expref: 14 pid: 8626 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.030513:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3de00/0x9104b1ba7709f0d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48003 expref: 14 pid: 8626 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.030604:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.030608:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.030616:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba7709f41a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.030634:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba7709f41a lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.030680:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343269.030765:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2407:x1848998399586560:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 382us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343269.030786:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3226 00010000:00010000:3.0:1763343269.030836:0:8626:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba7709f41a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.030848:0:8626:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba7709f41a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.030860:0:8626:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba7709f41a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.030869:0:8626:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba7709f41a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.030908:0:8626:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343269.031230:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3661:x1848998412887424:12345-0@lo:6:osp-syn-1-1.0 Request processed in 18352us (19441us total) trans 17179871690 rc 0/0 00000100:00100000:3.0:1763343269.031239:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6693 00000004:00080000:3.0:1763343269.031305:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c59b6a00/2, rc 0, transno 17179871690 00000100:00100000:3.0:1763343269.031313:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412887424:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343269.037831:0:8413:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412888320:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343269.037883:0:8413:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d600/0x9104b1ba7709f444 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x274:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48122 expref: 20 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.037905:0:8413:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5b3d600, rc 0) 00000100:00100000:3.0:1763343269.037950:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:55884:x1848998399586176:12345-192.168.201.40@tcp:101:bash.0 Request processed in 7481us (7797us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343269.037958:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6694 00000100:00100000:3.0:1763343269.060284:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399587200 00000100:00100000:3.0:1763343269.060296:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399587200 00000100:00100000:3.0:1763343269.060448:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6695 00000100:00100000:3.0:1763343269.060459:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:55884:x1848998399587200:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343269.060477:0:8413:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343269.060500:0:8413:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401ed154e00/0x9104b1ba7709f44b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48129 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343269.060524:0:8413:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x275:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343269.060547:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.060550:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.060558:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401ed154e00/0x9104b1ba7709f44b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48129 expref: 14 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.060574:0:8413:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9401ed154e00/0x9104b1ba7709f44b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48129 expref: 14 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.060585:0:8413:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401ed154e00, rc 0) 00000100:00100000:3.0:1763343269.061113:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:55884:x1848998399587200:12345-192.168.201.40@tcp:101:bash.0 Request processed in 652us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343269.061121:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6695 00000100:00100000:3.0:1763343269.065899:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399587456 00000100:00100000:3.0:1763343269.065912:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399587456 00000100:00100000:3.0:1763343269.065975:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9968 00000100:00100000:3.0:1763343269.065986:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+263:56998:x1848998399587456:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343269.066017:0:6526:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343269.066069:0:6526:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155400/0x9104b1ba7709f452 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48130 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.066190:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba7709f459 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343269.066206:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba7709f459 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1cf:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343269.066218:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba7709f459 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1cf:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00000004:00200000:3.0:1763343269.066229:0:6526:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1cf:0x0]: returning size 2 00010000:00010000:3.0:1763343269.066339:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155400/0x9104b1ba7709f452 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48130 expref: 266 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.066359:0:6526:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba7709f459 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1cf:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48130 expref: 265 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.066378:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cf:0x0].0x0 (ffff9400c488bb00) 00010000:00010000:3.0:1763343269.066381:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1763343269.066385:0:6526:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401ed155600, rc 0) 00000100:00100000:3.0:1763343269.066449:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+265:56998:x1848998399587456:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 465us (723us total) trans 4294972986 rc 0/0 00000100:00100000:3.0:1763343269.066456:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9968 00000100:00100000:3.0:1763343269.074209:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.074265:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.086483:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.089966:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.092409:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.101636:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.106593:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399589248 00000100:00100000:3.0:1763343269.106604:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399589248 00010000:00010000:3.0:1763343269.106656:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589b400/0x9104b1ba7709f46e lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1cf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48137 expref: 268 pid: 33856 timeout: 1162 lvb_type: 0 00000100:00100000:3.0:1763343269.106693:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3229 00000100:00100000:3.0:1763343269.106701:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+268:2407:x1848998399589248:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343269.106715:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343269.106720:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589b400/0x9104b1ba7709f46e lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1cf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48137 expref: 268 pid: 33856 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.106734:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589b400/0x9104b1ba7709f46e lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1cf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48137 expref: 268 pid: 33856 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.106755:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589b400/0x9104b1ba7709f46e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1cf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48137 expref: 268 pid: 33856 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.106771:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cf:0x0].0x0 (ffff9400c488bb00) 00010000:00010000:3.0:1763343269.106775:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba7709f48a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1cf:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.106783:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba7709f48a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1cf:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.106789:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba7709f48a lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1cf:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.106794:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba7709f498 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343269.106798:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba7709f498 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343269.106801:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba7709f498 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343269.106821:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343269.106871:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+267:2407:x1848998399589248:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 170us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343269.106876:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3229 00000100:00100000:3.0:1763343269.126665:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399589632 00000100:00100000:3.0:1763343269.126798:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399589632 00000100:00100000:3.0:1763343269.127061:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6696 00000100:00100000:3.0:1763343269.127073:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399589632:12345-192.168.201.40@tcp:1:lfs.0 00010000:00010000:3.0:1763343269.127128:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401ed155400/0x9104b1ba7709f4b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x274:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.127150:0:8413:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d600/0x9104b1ba7709f444 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48122 expref: 20 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.127159:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343269.127162:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343269.127166:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401ed155400/0x9104b1ba7709f4b4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.127209:0:8413:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d600/0x9104b1ba7709f444 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48122 expref: 20 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.127225:0:8413:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d600/0x9104b1ba7709f444 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48122 expref: 20 pid: 8413 timeout: 1162 lvb_type: 0 00000100:00100000:3.0:1763343269.127243:0:8413:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c2f84380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412888832:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343269.132607:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399590016 00000100:00100000:3.0:1763343269.132611:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399590016 00002000:00100000:3.0:1763343269.132642:0:8419:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x274:0x0] (0->4) req@ffff9400c5b1ad80 x1848998399590016/t0(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:10/0 lens 496/0 e 0 to 0 dl 1763343280 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343269.132652:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b1ad80 with x1848998399590016 ext(0->4) 00010000:00010000:3.0:1763343269.132658:0:8419:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d600/0x9104b1ba7709f444 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48122 expref: 21 pid: 8413 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.132673:0:8419:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d600/0x9104b1ba7709f444 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48122 expref: 21 pid: 8413 timeout: 1162 lvb_type: 0 00002000:00010000:3.0:1763343269.132682:0:8419:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9400c5b1ad80 00000100:00100000:3.0:1763343269.132709:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 109 00000100:00100000:3.0:1763343269.132717:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399590016:12345-192.168.201.40@tcp:4:bash.0 00000100:00100000:3.0:1763343269.134311:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2408:x1848998399590016:12345-192.168.201.40@tcp:4:bash.0 Request processed in 1583us (2067us total) trans 21474838960 rc 0/0 00000100:00100000:3.0:1763343269.134325:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 109 00002000:00100000:3.0:1763343269.134338:0:8419:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x274:0x0] (0->4) req@ffff9400c5b1ad80 x1848998399590016/t21474838960(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:10/0 lens 496/448 e 0 to 0 dl 1763343280 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343269.134349:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b1ad80 with x1848998399590016 ext(0->4) 00010000:00010000:3.0:1763343269.134358:0:8419:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d600/0x9104b1ba7709f444 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48122 expref: 23 pid: 8413 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.134386:0:8419:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d600/0x9104b1ba7709f444 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48122 expref: 23 pid: 8413 timeout: 1162 lvb_type: 0 00002000:00010000:3.0:1763343269.134395:0:8419:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9400c5b1ad80 00000100:00100000:3.0:1763343269.140842:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399590272 00000100:00100000:3.0:1763343269.140848:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399590272 00010000:00010000:3.0:1763343269.140876:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d600/0x9104b1ba7709f444 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48122 expref: 23 pid: 8413 timeout: 1162 lvb_type: 0 00000100:00100000:3.0:1763343269.150696:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399590912 00000100:00100000:3.0:1763343269.150711:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399590912 00000100:00100000:3.0:1763343269.150791:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9978 00000100:00100000:3.0:1763343269.150804:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+271:57000:x1848998399590912:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343269.150831:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343269.150835:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343269.150872:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba7709f4ec lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4815a expref: 271 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.150896:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f669e000) 00010000:00010000:3.0:1763343269.150909:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343269.150928:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba7709f50f lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48168 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.151403:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba7709f516 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343269.151419:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba7709f516 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.151493:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba7709f516 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000001:00080000:3.0:1763343269.153130:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972992 is committed 00000004:00080000:3.0:1763343269.153138:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 989 committed 00000004:00080000:3.0:1763343269.153148:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 997 committed 00000004:00080000:3.0:1763343269.153156:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 996 committed 00000004:00080000:3.0:1763343269.153159:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 988 committed 00000004:00010000:3.0:1763343269.153222:0:6526:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002b434481 reply state 00000000df1daef7 transno 4294972992 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba7709f4f3 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343269.153235:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba7709f4f3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343269.153241:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cf:0x0].0x0 (ffff9400c488bb00) 00010000:00010000:3.0:1763343269.153244:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1763343269.153246:0:6526:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1763343269.153286:0:6526:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763343269.153302:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+264:56998:x1848998399590528:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 9010us (9284us total) trans 4294972992 rc 0/0 00000100:00100000:3.0:1763343269.153309:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9976 00000100:00100000:3.0:1763343269.155361:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343269.155387:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c39b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412889088:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343269.155474:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763343269.157414:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c39b5f80/2, rc 0, transno 21474838961 00000100:00100000:3.0:1763343269.157420:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c39b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412889088:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343269.158812:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412889344 00000100:00100000:3.0:1763343269.158818:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412889344 00000100:00100000:3.0:1763343269.158856:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6700 00000100:00100000:3.0:1763343269.158865:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+31:3660:x1848998412889344:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343269.159016:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+32:3660:x1848998412889344:12345-0@lo:2:osp-syn-0-1.0 Request processed in 153us (1407us total) trans 21474838962 rc 0/0 00000100:00100000:3.0:1763343269.159053:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6700 00000100:00100000:3.0:1763343269.163125:0:6526:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6526:1848998412889472:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343269.163147:0:6526:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba7709f539 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343269.164604:0:6526:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba7709f539 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343269.164615:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba7709f539 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00000004:00200000:3.0:1763343269.164639:0:6526:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1d1:0x0]: returning size 0 00000004:00080000:3.0:1763343269.164800:0:6526:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x277:0x0], index 1: 0 00000004:00080000:3.0:1763343269.164806:0:6526:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x276:0x0], index 0: 0 00000004:00080000:3.0:1763343269.164809:0:6526:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x277:0x0], index 0: 0 00000004:00080000:3.0:1763343269.164813:0:6526:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x278:0x0], index 1: 0 00010000:00010000:3.0:1763343269.164911:0:6526:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba7709f539 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343269.164918:0:6526:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba7709f539 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343269.164924:0:6526:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba7709f539 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343269.164930:0:6526:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3916200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343269.164934:0:6526:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba7709f539 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343269.164941:0:6526:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba7709f539 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343269.164953:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1d1:0x0].0x0 (ffff9401edc53500) 00010000:00010000:3.0:1763343269.164955:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343269.164959:0:6526:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba7709f539 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343269.164964:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba7709f539 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343269.165012:0:6526:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916400/0x9104b1ba7709f532 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1d1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4816f expref: 264 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.165053:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1d1:0x0].0x0 (ffff9401edc53500) 00010000:00010000:3.0:1763343269.165056:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343269.165060:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916400/0x9104b1ba7709f532 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1d1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4816f expref: 264 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.165076:0:6526:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3916400, rc 0) 00000100:00100000:3.0:1763343269.165127:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+263:57000:x1848998399591168:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 6699us (7491us total) trans 4294972994 rc 301/301 00000100:00100000:3.0:1763343269.165135:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9979 00000100:00100000:3.0:1763343269.169691:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399591808 00000100:00100000:3.0:1763343269.169699:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399591808 00000100:00100000:3.0:1763343269.171432:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399592064 00000100:00100000:3.0:1763343269.171438:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399592064 00000100:00100000:3.0:1763343269.171473:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3493 00000100:00100000:3.0:1763343269.171481:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+265:57000:x1848998399592064:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343269.171639:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+266:57000:x1848998399592064:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 159us (555us total) trans 4294972996 rc 0/0 00000100:00100000:3.0:1763343269.171645:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3493 00000100:00100000:3.0:1763343269.180242:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399592192 00000100:00100000:3.0:1763343269.180252:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399592192 00000100:00100000:3.0:1763343269.180514:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6701 00000100:00100000:3.0:1763343269.180527:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399592192:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343269.180547:0:35281:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343269.180574:0:35281:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401ed155c00/0x9104b1ba7709f55c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48184 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343269.180605:0:35281:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x274:0x0] initial LVB size: 5, mtime: 0x691a7ba4, atime: 0x0, ctime: 0x691a7ba4, blocks: 0x8 00010000:00010000:3.0:1763343269.180628:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.180631:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.180643:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401ed155c00/0x9104b1ba7709f55c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48184 expref: 22 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343269.180660:0:35281:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9401ed155c00/0x9104b1ba7709f55c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48184 expref: 22 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343269.180675:0:35281:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401ed155c00, rc 0) 00000100:00100000:3.0:1763343269.181741:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2408:x1848998399592192:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1208us (2721us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343269.181752:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6701 00000001:00080000:3.0:1763343269.217945:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973000 is committed 00000004:00080000:3.0:1763343269.217956:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 999 committed 00000004:00080000:3.0:1763343269.217972:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 991 committed 00000004:00080000:3.0:1763343269.217984:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 990 committed 00000004:00080000:3.0:1763343269.217987:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 998 committed 00000100:00100000:3.0:1763343269.231555:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399593472 00000100:00100000:3.0:1763343269.231566:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399593472 00000100:00100000:3.0:1763343269.240063:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399593728 00000100:00100000:3.0:1763343269.240069:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399593728 00002000:00010000:3.0:1763343269.240097:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/631 (0->18446744073709551615) 00002000:00100000:3.0:1763343269.240103:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c9dca300 with x1848998399593728 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343269.240117:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401c9dca300. 00000100:00100000:3.0:1763343269.240146:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1621 00000100:00100000:3.0:1763343269.240157:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2410:x1848998399593728:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:3.0:1763343269.240359:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x277:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343269.240374:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x277:0x0] updating lvb mtime from disk: 0 -> 1763343268 00002000:00010000:3.0:1763343269.240380:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x277:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343269.240384:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x277:0x0] updating lvb ctime from disk: 0 -> 1763343268 00002000:00010000:3.0:1763343269.240392:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x277:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343269.255265:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.255309:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.260846:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:3.0:1763343269.261893:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343269.261900:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba7709f60b lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1d1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.261906:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508aa00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343269.261909:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba7709f60b lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1d1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.261916:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba7709f60b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1d1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.261935:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1d1:0x0].0x0 (ffff9401edc53600) 00010000:00010000:3.0:1763343269.261937:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343269.261940:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba7709f60b lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1d1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.261945:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba7709f60b lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1d1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.261957:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343269.261960:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343269.261962:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1763343269.262198:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x276:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:3.0:1763343269.262202:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x276:0x0] updating lvb mtime from disk: 0 -> 1763343268 00002000:00010000:3.0:1763343269.262205:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x276:0x0] updating lvb ctime from disk: 0 -> 1763343268 00002000:00010000:3.0:1763343269.262207:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x276:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1763343269.262214:0:8419:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba7709f5d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.262221:0:8419:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba7709f5d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.262227:0:8419:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba7709f5d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.262233:0:8419:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3916200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343269.262236:0:8419:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba7709f5d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.262243:0:8419:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba7709f5d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.262257:0:8419:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba7709f5d3 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.262262:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba7709f5d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343269.262298:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2408:x1848998399594752:12345-192.168.201.40@tcp:4:lfs.0 Request processed in 6829us (7045us total) trans 17179871697 rc 0/0 00000100:00100000:3.0:1763343269.262306:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1624 00000100:00100000:3.0:1763343269.282200:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.282240:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.285514:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.285559:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.285600:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.289219:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399596288 00000100:00100000:3.0:1763343269.289228:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399596288 00000100:00100000:3.0:1763343269.289491:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 9994 00000100:00100000:3.0:1763343269.289499:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c511ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+267:56998:x1848998399596288:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:3.0:1763343269.289564:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba7709f658 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343269.289579:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba7709f658 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.289591:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba7709f658 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00010000:3.0:1763343269.289708:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d1d6977d reply state 000000005193a2d4 transno 4294973004 ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba7709f658 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.289723:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba7709f658 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.289730:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cf:0x0].0x0 (ffff9400c488bb00) 00010000:00010000:3.0:1763343269.289733:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343269.289737:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343269.289850:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c511ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+270:56998:x1848998399596288:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 351us (931us total) trans 4294973004 rc 0/0 00000100:00100000:3.0:1763343269.289857:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 9994 00000100:00100000:3.0:1763343269.292838:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.301590:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.306160:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.310729:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412890368:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343269.310782:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343269.310811:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343269.310818:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412890496:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343269.310844:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343269.311871:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6718 00000100:00100000:3.0:1763343269.311884:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+35:3659:x1848998412891264:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763343269.311956:0:35266:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x275:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343269.311960:0:35266:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x275:0x0] updating lvb mtime from disk: 1763343268 -> 1763343268 00002000:00010000:3.0:1763343269.311963:0:35266:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x275:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343269.311966:0:35266:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x275:0x0] updating lvb ctime from disk: 1763343268 -> 1763343268 00002000:00010000:3.0:1763343269.311968:0:35266:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x275:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343269.312004:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+36:3659:x1848998412891264:12345-0@lo:2:osp-syn-0-1.0 Request processed in 123us (864us total) trans 21474838969 rc 0/0 00000100:00100000:3.0:1763343269.312015:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6718 00000004:00080000:3.0:1763343269.312733:0:9930:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 4 in progress, 2 in flight, 11 done 00000100:00100000:3.0:1763343269.312756:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412890880:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343269.312819:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412891008 00000100:00100000:3.0:1763343269.312825:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412891008 00000100:00100000:3.0:1763343269.313413:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6720 00000100:00100000:3.0:1763343269.313423:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5953100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+37:3661:x1848998412890880:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343269.313436:0:35281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:630 count 1 00010000:00010000:3.0:1763343269.313450:0:35281:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401ed155400/0x9104b1ba7709f6c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x276:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.313482:0:35281:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c589be00/0x9104b1ba7709f5b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x276:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b481ae expref: 26 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.313490:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343269.313493:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343269.313498:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401ed155400/0x9104b1ba7709f6c8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x276:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.313535:0:35281:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c589be00/0x9104b1ba7709f5b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x276:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b481ae expref: 26 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.313548:0:35281:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c589be00/0x9104b1ba7709f5b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x276:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b481ae expref: 26 pid: 8414 timeout: 1162 lvb_type: 0 00000100:00100000:3.0:1763343269.313567:0:35281:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35281:1848998412891520:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343269.314116:0:35281:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9180 going to sleep for 11 seconds 00010000:00010000:3.0:1763343269.319008:0:35281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c589be00/0x9104b1ba7709f5b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x276:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b481ae expref: 26 pid: 8414 timeout: 1162 lvb_type: 0 00000100:00100000:3.0:1763343269.319021:0:35281:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35281:1848998412891520:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343269.319072:0:35281:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9401ed155400/0x9104b1ba7709f6c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.319081:0:35281:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9401ed155400/0x9104b1ba7709f6c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.319093:0:35281:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401ed155400/0x9104b1ba7709f6c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.319101:0:35281:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401ed155400/0x9104b1ba7709f6c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.319108:0:35281:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401ed155400/0x9104b1ba7709f6c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.319125:0:35281:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343269.319296:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5953100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+38:3661:x1848998412890880:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5874us (6169us total) trans 21474838971 rc 0/0 00000100:00100000:3.0:1763343269.319305:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6720 00000100:00100000:3.0:1763343269.323570:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3498 00000100:00100000:3.0:1763343269.323583:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+263:57002:x1848998399598848:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343269.323774:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+264:57002:x1848998399598848:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 195us (816us total) trans 4294973009 rc 0/0 00000100:00100000:3.0:1763343269.323783:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3498 00010000:00010000:3.0:1763343269.324775:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343269.324783:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709f6dd lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1cf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343269.324791:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e90800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343269.324795:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709f6dd lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1cf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343269.324806:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709f6dd lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1cf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343269.324820:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cf:0x0].0x0 (ffff9400c488bb00) 00010000:00010000:3.0:1763343269.324823:0:7451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343269.324828:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709f6dd lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1cf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343269.324834:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709f6dd lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1cf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343269.324846:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343269.324848:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343269.324850:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343269.334132:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399599232 00000100:00100000:3.0:1763343269.334143:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399599232 00000100:00100000:3.0:1763343269.334211:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6721 00000100:00100000:3.0:1763343269.334223:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2408:x1848998399599232:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343269.334243:0:35281:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343269.334266:0:35281:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401ed155600/0x9104b1ba7709f707 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48209 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343269.334294:0:35281:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x278:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343269.334506:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.334509:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.334520:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401ed155600/0x9104b1ba7709f707 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48209 expref: 27 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343269.334538:0:35281:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9401ed155600/0x9104b1ba7709f707 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48209 expref: 27 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343269.334552:0:35281:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401ed155600, rc 0) 00000100:00100000:3.0:1763343269.334616:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2408:x1848998399599232:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 395us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343269.334623:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6721 00000100:00100000:3.0:1763343269.334872:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399599488 00000100:00100000:3.0:1763343269.334878:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399599488 00000100:00100000:3.0:1763343269.334919:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10000 00000100:00100000:3.0:1763343269.334927:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+266:55884:x1848998399599488:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343269.334941:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343269.334944:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343269.334966:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba7709f6f9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48202 expref: 266 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.334987:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1d3:0x0].0x0 (ffff9401edc53f00) 00010000:00010000:3.0:1763343269.334997:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343269.335009:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155400/0x9104b1ba7709f70e lrc: 2/0,0 mode: --/CW res: [0x240000404:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48210 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.335162:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba7709f715 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343269.335174:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba7709f715 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1d3:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.335184:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba7709f715 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1d3:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:3.0:1763343269.335198:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1d3:0x0]: returning size 0 00010000:00010000:3.0:1763343269.335306:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155400/0x9104b1ba7709f70e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48210 expref: 268 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.335320:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba7709f715 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1d3:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48210 expref: 267 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.335327:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1d3:0x0].0x0 (ffff9401c9896300) 00010000:00010000:3.0:1763343269.335330:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:3.0:1763343269.335332:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401ed154800, rc 0) 00000100:00100000:3.0:1763343269.335378:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+267:55884:x1848998399599488:12345-192.168.201.40@tcp:101:bash.0 Request processed in 451us (668us total) trans 4294973012 rc 0/0 00000100:00100000:3.0:1763343269.335384:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10000 00000100:00100000:3.0:1763343269.348266:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399600128 00000100:00100000:3.0:1763343269.348277:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399600128 00000100:00100000:3.0:1763343269.348960:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399600384 00000100:00100000:3.0:1763343269.348967:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399600384 00000100:00100000:3.0:1763343269.349081:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10003 00000100:00100000:3.0:1763343269.349210:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+270:56998:x1848998399600384:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343269.349224:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343269.349242:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba7709f738 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4821e expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.349305:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155400/0x9104b1ba7709f73f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343269.349315:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155400/0x9104b1ba7709f73f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.349327:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155400/0x9104b1ba7709f73f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.349348:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba7709f746 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343269.349372:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba7709f746 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.349382:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba7709f746 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.349478:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba7709f74d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343269.349487:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba7709f74d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.349494:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba7709f74d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:3.0:1763343269.349503:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1d3:0x0]: returning size 0 00010000:00010000:3.0:1763343269.349554:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155400/0x9104b1ba7709f73f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.349561:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155400/0x9104b1ba7709f73f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.349566:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155400/0x9104b1ba7709f73f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.349572:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155400/0x9104b1ba7709f73f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.349577:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401ed155400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343269.349581:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155400/0x9104b1ba7709f73f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.349591:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155400/0x9104b1ba7709f73f lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.349599:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401c9896600) 00010000:00010000:3.0:1763343269.349601:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343269.349605:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155400/0x9104b1ba7709f73f lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.349611:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155400/0x9104b1ba7709f73f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.349622:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba7709f746 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.349628:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba7709f746 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.349808:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba7709f746 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.350345:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fd2dfa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343269.350349:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba7709f746 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.350357:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba7709f746 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.350376:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401c9896200) 00010000:00010000:3.0:1763343269.350378:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343269.350381:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba7709f746 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.350387:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba7709f746 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000100:00100000:3.0:1763343269.366124:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412892032:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343269.366172:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343269.366196:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343269.366206:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412891904:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343269.366233:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343269.366271:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412891648 00000100:00100000:3.0:1763343269.366279:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412891648 00000100:00100000:3.0:1763343269.366803:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412892032 00000100:00100000:3.0:1763343269.366808:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412892032 00000100:00100000:3.0:1763343269.368960:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6726 00000100:00100000:3.0:1763343269.368973:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+42:3660:x1848998412891904:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343269.368984:0:35281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:628 count 1 00010000:00010000:3.0:1763343269.368995:0:35281:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c589b400/0x9104b1ba7709f785 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x274:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.369006:0:35281:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9401ed155c00/0x9104b1ba7709f55c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48184 expref: 26 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343269.369013:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.369015:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.369017:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c589b400/0x9104b1ba7709f785 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.369053:0:35281:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9401ed155c00/0x9104b1ba7709f55c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48184 expref: 26 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343269.369061:0:35281:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9401ed155c00/0x9104b1ba7709f55c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48184 expref: 26 pid: 35281 timeout: 1162 lvb_type: 1 00000100:00100000:3.0:1763343269.369071:0:35281:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b55500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35281:1848998412893056:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343269.369811:0:35281:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9540 going to sleep for 11 seconds 00000100:00100000:3.0:1763343269.369843:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412892416:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343269.369879:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763343269.370564:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b1a680/2, rc 0, transno 17179871703 00000100:00100000:3.0:1763343269.370572:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412892416:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343269.370583:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343269.370588:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412892544:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343269.370610:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763343269.370793:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6b55180/2, rc 0, transno 21474838973 00000100:00100000:3.0:1763343269.370799:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412892288:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763343269.370806:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6b57100/2, rc 0, transno 21474838972 00000100:00100000:3.0:1763343269.370809:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412892160:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763343269.374649:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6400a80/2, rc 0, transno 17179871704 00000100:00100000:3.0:1763343269.374667:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412892544:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343269.380785:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.380821:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.380840:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.381006:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.381044:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399601408 00000100:00100000:3.0:1763343269.381047:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399601408 00010000:00010000:3.0:1763343269.381064:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9401ed154e00/0x9104b1ba7709f44b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x275:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48129 expref: 15 pid: 8413 timeout: 1162 lvb_type: 0 00000100:00100000:3.0:1763343269.381094:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399601664 00000100:00100000:3.0:1763343269.381097:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399601664 00010000:00010000:3.0:1763343269.381111:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9401fd2dea00/0x9104b1ba7709f620 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x275:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b481d1 expref: 27 pid: 8414 timeout: 1162 lvb_type: 0 00000100:00100000:3.0:1763343269.381125:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3236 00000100:00100000:3.0:1763343269.381134:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998399601280:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343269.381148:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343269.381153:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba7709f619 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b481c3 expref: 15 pid: 11289 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.381163:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba7709f619 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b481c3 expref: 15 pid: 11289 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.381183:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba7709f619 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b481c3 expref: 15 pid: 11289 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.381198:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.381200:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.381205:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709f777 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.381215:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709f777 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.381236:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343269.381849:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2407:x1848998399601280:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 715us (1542us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343269.381856:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3236 00000100:00100000:3.0:1763343269.381875:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3239 00000100:00100000:3.0:1763343269.381881:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2408:x1848998399601536:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343269.381888:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343269.381892:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9401ed155c00/0x9104b1ba7709f55c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x274:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48184 expref: 27 pid: 35281 timeout: 1162 lvb_type: 1 00010000:00010000:3.0:1763343269.381901:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9401ed155c00/0x9104b1ba7709f55c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x274:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48184 expref: 27 pid: 35281 timeout: 1162 lvb_type: 1 00010000:00010000:3.0:1763343269.381913:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401ed155c00/0x9104b1ba7709f55c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x274:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48184 expref: 27 pid: 35281 timeout: 1162 lvb_type: 1 00010000:00010000:3.0:1763343269.381922:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.381923:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.381926:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c589b400/0x9104b1ba7709f785 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.381933:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c589b400/0x9104b1ba7709f785 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.381948:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343269.383412:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2408:x1848998399601536:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1529us (2587us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343269.383470:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3239 00010000:00010000:3.0:1763343269.383494:0:35281:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c589b400/0x9104b1ba7709f785 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.383502:0:35281:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c589b400/0x9104b1ba7709f785 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.383509:0:35281:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c589b400/0x9104b1ba7709f785 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.383515:0:35281:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c589b400/0x9104b1ba7709f785 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.383527:0:35281:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763343269.383912:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+42:3660:x1848998412891904:12345-0@lo:6:osp-syn-0-1.0 Request processed in 14945us (17678us total) trans 21474838974 rc 0/0 00000100:00100000:3.0:1763343269.383918:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6726 00000004:00080000:3.0:1763343269.383950:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6b54380/2, rc 0, transno 21474838974 00000100:00100000:3.0:1763343269.383954:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412891904:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1763343269.384200:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763343269.384205:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c589b400/0x9104b1ba7709f785 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.384212:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c589b400 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343269.384215:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c589b400/0x9104b1ba7709f785 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.384221:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c589b400/0x9104b1ba7709f785 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.384236:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c589b400/0x9104b1ba7709f785 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.384243:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c589b400/0x9104b1ba7709f785 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.384258:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343269.384261:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90800/0x9104b1ba7709f77e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.384267:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e90800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343269.384546:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90800/0x9104b1ba7709f77e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.384555:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90800/0x9104b1ba7709f77e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.384565:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90800/0x9104b1ba7709f77e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.384573:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90800/0x9104b1ba7709f77e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.384586:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343269.384587:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343269.384589:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343269.384608:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6b56d80/2, rc 0, transno 21474838975 00000100:00100000:3.0:1763343269.384613:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412892032:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343269.387998:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399602304 00000100:00100000:3.0:1763343269.388006:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399602304 00000100:00100000:3.0:1763343269.388065:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6731 00000100:00100000:3.0:1763343269.388075:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2408:x1848998399602304:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343269.388089:0:35281:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343269.388107:0:35281:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ac00/0x9104b1ba7709f7b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x278:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48241 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343269.388721:0:35281:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b54e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35281:1848998412893312:192.168.201.40@tcp:106: 00000100:00100000:3.0:1763343269.388817:0:35281:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9540 going to sleep for 11 seconds 00002000:00010000:3.0:1763343269.391094:0:35281:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x278:0x0] updating lvb mtime: 0 -> 1763343268 00002000:00010000:3.0:1763343269.391099:0:35281:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x278:0x0] updating lvb atime: 0 -> 1763343268 00002000:00010000:3.0:1763343269.391101:0:35281:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x278:0x0] updating lvb ctime: 0 -> 1763343268 00000100:00100000:3.0:1763343269.391118:0:35281:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b54e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35281:1848998412893312:192.168.201.40@tcp:106: 00010000:00010000:3.0:1763343269.391879:0:35281:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ac00/0x9104b1ba7709f7b6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x278:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48241 expref: 26 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343269.391896:0:35281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ac00/0x9104b1ba7709f7b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x278:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48241 expref: 26 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343269.391908:0:35281:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3b4ac00, rc 0) 00000100:00100000:3.0:1763343269.391943:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2408:x1848998399602304:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3870us (4104us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343269.391950:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6731 00000100:00100000:3.0:1763343269.395706:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1628 00000100:00100000:3.0:1763343269.395716:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2408:x1848998399602560:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:3.0:1763343269.395902:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x278:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343269.395906:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x278:0x0] updating lvb mtime from disk: 1763343268 -> 1763343268 00002000:00010000:3.0:1763343269.395910:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x278:0x0] updating lvb atime from disk: 1763343268 -> 0 00002000:00010000:3.0:1763343269.395913:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x278:0x0] updating lvb ctime from disk: 1763343268 -> 1763343268 00002000:00010000:3.0:1763343269.395916:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x278:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343269.396381:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2408:x1848998399602560:12345-192.168.201.40@tcp:10:bash.0 Request processed in 665us (1435us total) trans 21474838976 rc 0/0 00000100:00100000:3.0:1763343269.396388:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1628 00002000:00010000:3.0:1763343269.396391:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/632 (0->18446744073709551615) 00002000:00100000:3.0:1763343269.396393:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6e8f100 with x1848998399602560 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343269.396398:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c6e8f100. 00000100:00100000:3.0:1763343269.413598:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10008 00000100:00100000:3.0:1763343269.413615:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+267:57004:x1848998399603712:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:3.0:1763343269.413666:0:6526:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763343269.413692:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2600/0x9104b1ba7709f769 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1d3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4822c expref: 268 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.413711:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba7709f7a1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48233 expref: 267 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.413725:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba7709f72a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1d3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48217 expref: 266 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.413734:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1d3:0x0].0x0 (ffff9401c9896300) 00010000:00010000:3.0:1763343269.413740:0:6526:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343269.413761:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ac00/0x9104b1ba7709f7d2 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343269.413773:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ac00/0x9104b1ba7709f7d2 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343269.413784:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ac00/0x9104b1ba7709f7d2 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343269.413800:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709f7d9 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343269.413809:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709f7d9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343269.413815:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709f7d9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343269.413889:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba7709f7e7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343269.413899:0:6526:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba7709f7cb lrc: 2/0,1 mode: CW/CW res: [0x240000404:0x1d3:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.413906:0:6526:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba7709f7e7 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 00000100:00100000:3.0:1763343269.434568:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.436954:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.439425:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.442511:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399604864 00000100:00100000:3.0:1763343269.442519:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399604864 00002000:00100000:3.0:1763343269.442568:0:28386:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000400:0x278:0x0] (0->4) req@ffff9401f6402300 x1848998399604864/t0(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:10/0 lens 496/0 e 0 to 0 dl 1763343280 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343269.442585:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401f6402300 with x1848998399604864 ext(0->4) 00010000:00010000:3.0:1763343269.442594:0:28386:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90600/0x9104b1ba7709f7af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x278:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4823a expref: 27 pid: 35281 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.442614:0:28386:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90600/0x9104b1ba7709f7af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x278:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4823a expref: 27 pid: 35281 timeout: 1162 lvb_type: 0 00002000:00010000:3.0:1763343269.442629:0:28386:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9401f6402300 00000100:00100000:3.0:1763343269.449441:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.455926:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399605760 00000100:00100000:3.0:1763343269.455933:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399605760 00000100:00100000:3.0:1763343269.455979:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10017 00000100:00100000:3.0:1763343269.455989:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+272:57003:x1848998399605760:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:3.0:1763343269.456020:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343269.456062:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2000/0x9104b1ba7709f7fc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1d3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4825d expref: 272 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.456076:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1d3:0x0].0x0 (ffff9401c9896300) 00010000:00010000:3.0:1763343269.456080:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343269.456101:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709f881 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343269.456111:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709f881 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1d3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.456119:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709f881 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1d3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000040:00080000:3.0:1763343269.456318:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1552, 88 off130032 00000004:00080000:3.0:1763343269.456326:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1062580301346ns, next at 1063447876487ns, rc = 0 00000040:00080000:3.0:1763343269.456378:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1560, 88 off130728 00000004:00080000:3.0:1763343269.456384:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1062580359159ns, next at 1063447907327ns, rc = 0 00000040:00080000:3.0:1763343269.456438:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1561, 88 off130816 00000004:00080000:3.0:1763343269.456443:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1062580418520ns, next at 1063447907327ns, rc = 0 00000040:00080000:3.0:1763343269.456462:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1553, 88 off130120 00000004:00080000:3.0:1763343269.456466:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1062580441165ns, next at 1063447876487ns, rc = 0 00000001:00080000:3.0:1763343269.461975:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973026 is committed 00000004:00080000:3.0:1763343269.461991:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 998 committed 00000004:00080000:3.0:1763343269.462004:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1006 committed 00000004:00080000:3.0:1763343269.462014:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1005 committed 00000004:00080000:3.0:1763343269.462017:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 997 committed 00000100:00100000:3.0:1763343269.462161:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412893952:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343269.462228:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763343269.463544:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6b57b80/2, rc 0, transno 17179871709 00000100:00100000:3.0:1763343269.463552:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412893952:0@lo:2:osp-syn-1-1.0 00000004:00010000:3.0:1763343269.463592:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001a455fbe reply state 00000000e5fcb497 transno 4294973025 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709f881 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1d3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.463610:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709f881 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1d3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.463618:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1d3:0x0].0x0 (ffff9401c9896300) 00010000:00010000:3.0:1763343269.463621:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1763343269.463623:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1763343269.463713:0:6525:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763343269.463729:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+264:57003:x1848998399605760:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 7741us (7880us total) trans 4294973025 rc 0/0 00000100:00100000:3.0:1763343269.463738:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10017 00000004:00080000:3.0:1763343269.466809:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6e8c380/2, rc 0, transno 21474838978 00000100:00100000:3.0:1763343269.466817:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6e8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412894208:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763343269.469449:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6e8ce00/2, rc 0, transno 21474838979 00000100:00100000:3.0:1763343269.469456:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412894080:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343269.473385:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6403800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998412894336:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343269.473411:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3e00/0x9104b1ba7709f89d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.474262:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3e00/0x9104b1ba7709f89d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.474269:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3e00/0x9104b1ba7709f89d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:3.0:1763343269.474293:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1d4:0x0]: returning size 0 00000004:00080000:3.0:1763343269.474503:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x27b:0x0], index 1: 0 00000004:00080000:3.0:1763343269.474511:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x27a:0x0], index 0: 0 00000004:00080000:3.0:1763343269.474516:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x27b:0x0], index 0: 0 00000004:00080000:3.0:1763343269.474520:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x27c:0x0], index 1: 0 00010000:00010000:3.0:1763343269.474679:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3e00/0x9104b1ba7709f89d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.474688:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3e00/0x9104b1ba7709f89d lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.474694:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3e00/0x9104b1ba7709f89d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.474705:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343269.474708:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3e00/0x9104b1ba7709f89d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.474715:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3e00/0x9104b1ba7709f89d lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.474725:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1d4:0x0].0x0 (ffff9401d1e1a000) 00010000:00010000:3.0:1763343269.474728:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343269.474732:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3e00/0x9104b1ba7709f89d lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.474737:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3e00/0x9104b1ba7709f89d lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.474781:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba7709f896 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4828e expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.474791:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1d4:0x0].0x0 (ffff9401d1e1a000) 00010000:00010000:3.0:1763343269.474793:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343269.474797:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba7709f896 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4828e expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.474810:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba2c00, rc 0) 00000100:00100000:3.0:1763343269.474892:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+264:57005:x1848998399606016:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 8830us (8915us total) trans 4294973027 rc 301/301 00000100:00100000:3.0:1763343269.474899:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10018 00000100:00100000:3.0:1763343269.477322:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.495861:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399607168 00000100:00100000:3.0:1763343269.495873:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399607168 00000100:00100000:3.0:1763343269.512165:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.523880:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412894720 00000100:00100000:3.0:1763343269.523886:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412894720 00000100:00100000:3.0:1763343269.523927:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412894848 00000100:00100000:3.0:1763343269.523930:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412894848 00000100:00100000:3.0:1763343269.523955:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6743 00000100:00100000:3.0:1763343269.523962:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+45:3659:x1848998412894720:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343269.524092:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+46:3659:x1848998412894720:12345-0@lo:2:osp-syn-0-1.0 Request processed in 130us (434us total) trans 21474838980 rc 0/0 00000100:00100000:3.0:1763343269.524098:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6743 00000100:00100000:3.0:1763343269.524112:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6744 00000100:00100000:3.0:1763343269.524118:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+45:3659:x1848998412894848:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343269.524185:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+46:3659:x1848998412894848:12345-0@lo:2:osp-syn-0-1.0 Request processed in 67us (476us total) trans 21474838981 rc 0/0 00000100:00100000:3.0:1763343269.524191:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6744 00000004:00080000:3.0:1763343269.524219:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c3728a80/2, rc 0, transno 21474838981 00000100:00100000:3.0:1763343269.524224:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c3728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412894848:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763343269.524232:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6e8df80/2, rc 0, transno 21474838980 00000100:00100000:3.0:1763343269.524235:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6e8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412894720:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343269.534663:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000001:00080000:3.0:1763343269.537838:0:25994:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871713 is committed 00000001:00080000:3.0:1763343269.537853:0:25994:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871711 is committed 00000100:00100000:3.0:1763343269.552985:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.571949:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.574430:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.576052:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.577309:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.577337:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.581089:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.581170:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.584130:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.584348:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.595338:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399612288 00000100:00100000:3.0:1763343269.595345:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399612288 00000100:00100000:3.0:1763343269.595396:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10035 00000100:00100000:3.0:1763343269.595408:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+275:57007:x1848998399612288:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343269.595429:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343269.595448:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709f9fb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4830c expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.595555:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fa02 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343269.595653:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2000/0x9104b1ba7709f9ed lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48305 expref: 276 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.595663:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fa02 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343269.595695:0:33856:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2000/0x9104b1ba7709f9ed lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48305 expref: 276 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.595708:0:33856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2000/0x9104b1ba7709f9ed lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48305 expref: 276 pid: 33856 timeout: 1162 lvb_type: 0 00000100:00100000:3.0:1763343269.595722:0:33856:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b2ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412895104:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343269.595802:0:33856:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343269.601280:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412895488:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343269.602810:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412895232 00000100:00100000:3.0:1763343269.602819:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412895232 00000100:00100000:3.0:1763343269.603690:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412895744 00000100:00100000:3.0:1763343269.603698:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412895744 00000004:00080000:3.0:1763343269.606141:0:9930:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 4 in progress, 3 in flight, 12 done 00000100:00100000:3.0:1763343269.607200:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.609454:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399612544 00000100:00100000:3.0:1763343269.609462:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399612544 00000100:00100000:3.0:1763343269.609499:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10036 00000100:00100000:3.0:1763343269.609508:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+263:57003:x1848998399612544:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343269.609529:0:6526:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343269.609548:0:6526:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ac00/0x9104b1ba7709fa25 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48313 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.609595:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ac00/0x9104b1ba7709fa25 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1d3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48313 expref: 264 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.609663:0:6526:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ac00/0x9104b1ba7709fa25 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1d3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48313 expref: 264 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.609684:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1d3:0x0].0x0 (ffff9401c9896300) 00010000:00010000:3.0:1763343269.609687:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343269.609690:0:6526:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3b4ac00, rc 0) 00000100:00100000:3.0:1763343269.609737:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+264:57003:x1848998399612544:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 231us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343269.609745:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10036 00000100:00100000:3.0:1763343269.611243:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399612800 00000100:00100000:3.0:1763343269.611250:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399612800 00010000:00010000:3.0:1763343269.611282:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0000/0x9104b1ba7709f922 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b482c6 expref: 33 pid: 8413 timeout: 1162 lvb_type: 0 00000100:00100000:3.0:1763343269.611314:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399612672 00000100:00100000:3.0:1763343269.611317:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399612672 00010000:00010000:3.0:1763343269.611332:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba7709f90d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x27b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b482bf expref: 15 pid: 8413 timeout: 1162 lvb_type: 0 00000100:00100000:3.0:1763343269.611347:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3246 00000100:00100000:3.0:1763343269.611363:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+33:2407:x1848998399612800:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343269.611376:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343269.611381:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0000/0x9104b1ba7709f922 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b482c6 expref: 33 pid: 8413 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.611390:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0000/0x9104b1ba7709f922 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b482c6 expref: 33 pid: 8413 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.611411:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0000/0x9104b1ba7709f922 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b482c6 expref: 33 pid: 8413 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.611425:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.611427:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.611431:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2c00/0x9104b1ba7709fa1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.611442:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2c00/0x9104b1ba7709fa1e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.611464:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343269.611498:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+32:2407:x1848998399612800:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 144us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343269.612533:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3246 00000100:00100000:3.0:1763343269.616104:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399613056 00000100:00100000:3.0:1763343269.616114:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399613056 00000100:00100000:3.0:1763343269.616283:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399613312 00000100:00100000:3.0:1763343269.616287:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399613312 00000100:00100000:3.0:1763343269.616303:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3508 00000100:00100000:3.0:1763343269.616312:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6276300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+264:57003:x1848998399613056:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:3.0:1763343269.616566:0:6528:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1d3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1763343269.616642:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1560, 64 off130664 00000040:00080000:3.0:1763343269.616666:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1569, 64 off131440 00000040:00080000:3.0:1763343269.616676:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1570, 64 off131504 00000040:00080000:3.0:1763343269.616686:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1561, 64 off130728 00010000:00010000:3.0:1763343269.616741:0:6528:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba7709fa33 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 00010000:00010000:3.0:1763343269.616758:0:6528:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba7709fa33 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1d3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343269.616769:0:6528:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba7709fa33 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1d3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343269.616776:0:6528:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba7709fa33 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1d3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343269.616781:0:6528:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba7709fa33 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1d3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343269.616792:0:6528:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba7709fa33 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1d3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343269.616805:0:6528:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343269.616958:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6276300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+265:57003:x1848998399613056:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 647us (3789us total) trans 4294973041 rc 0/0 00000100:00100000:3.0:1763343269.616964:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3508 00010000:00010000:3.0:1763343269.616979:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343269.616983:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba7709fa33 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1d3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343269.616990:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3b4b600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343269.616992:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba7709fa33 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1d3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343269.616997:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba7709fa33 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1d3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343269.617006:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1d3:0x0].0x0 (ffff9401c9896300) 00010000:00010000:3.0:1763343269.617009:0:7451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343269.617013:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba7709fa33 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1d3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343269.617017:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba7709fa33 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1d3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343269.617044:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343269.617046:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343269.617048:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343269.620959:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.628603:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.633986:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.635385:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.637279:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.640687:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.645075:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399615616 00000100:00100000:3.0:1763343269.645082:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399615616 00000100:00100000:3.0:1763343269.645127:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10043 00000100:00100000:3.0:1763343269.645141:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+276:55884:x1848998399615616:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343269.645159:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343269.645162:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343269.645189:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba7709fa80 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48336 expref: 276 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.645204:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1d6:0x0].0x0 (ffff9400c48a8e00) 00010000:00010000:3.0:1763343269.645209:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343269.645222:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba7709fabf lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4834b expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.645262:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fac6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343269.645287:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fac6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.645298:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fac6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000040:00080000:3.0:1763343269.645507:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1562, 88 off130816 00000004:00080000:3.0:1763343269.645515:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1062769489486ns, next at 1063447876487ns, rc = 0 00000040:00080000:3.0:1763343269.645548:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1571, 88 off131592 00000004:00080000:3.0:1763343269.645554:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1062769528948ns, next at 1063447907327ns, rc = 0 00000040:00080000:3.0:1763343269.645583:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1572, 88 off131680 00000004:00080000:3.0:1763343269.645588:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1062769563878ns, next at 1063447907327ns, rc = 0 00000040:00080000:3.0:1763343269.645598:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1563, 88 off130904 00000004:00080000:3.0:1763343269.645602:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1062769577185ns, next at 1063447876487ns, rc = 0 00000001:00080000:3.0:1763343269.647887:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973050 is committed 00000004:00080000:3.0:1763343269.647896:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1004 committed 00000004:00080000:3.0:1763343269.647913:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1012 committed 00000004:00080000:3.0:1763343269.647930:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1011 committed 00000004:00080000:3.0:1763343269.647934:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1003 committed 00010000:00010000:3.0:1763343269.648517:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fac6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4834b expref: 266 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.648529:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1d6:0x0].0x0 (ffff9400c48a8e00) 00010000:00010000:3.0:1763343269.648531:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763343269.648545:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba7709fabf lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4834b expref: 266 pid: 9827 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763343269.648562:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fac6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1d6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4834b expref: 265 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.648590:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1d6:0x0].0x0 (ffff9400c48a8e00) 00010000:00010000:3.0:1763343269.648592:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763343269.648595:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3b4aa00, rc 0) 00000100:00100000:3.0:1763343269.649018:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412896768 00000100:00100000:3.0:1763343269.649040:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412896768 00000100:00100000:3.0:1763343269.649075:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6761 00000100:00100000:3.0:1763343269.649087:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3662:x1848998412897152:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763343269.649101:0:8626:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:634 count 1 00010000:00010000:3.0:1763343269.649119:0:8626:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fad4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.649134:0:8626:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba7709f96f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b482db expref: 14 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.649613:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343269.649616:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343269.649619:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fad4 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.649644:0:8626:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba7709f96f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b482db expref: 14 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.649654:0:8626:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba7709f96f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b482db expref: 14 pid: 8412 timeout: 1162 lvb_type: 0 00000100:00100000:3.0:1763343269.649666:0:8626:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b56680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998412897664:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343269.649692:0:8626:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9540 going to sleep for 11 seconds 00000100:00100000:3.0:1763343269.649708:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412897408 00000100:00100000:3.0:1763343269.649713:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412897408 00000100:00100000:3.0:1763343269.649738:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6764 00000100:00100000:3.0:1763343269.649749:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+11:3661:x1848998412897024:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763343269.649765:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:633 count 1 00010000:00010000:3.0:1763343269.649782:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c589b400/0x9104b1ba7709fae2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x279:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.649808:0:35266:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba7709f7bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48248 expref: 14 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.649829:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343269.649831:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343269.649834:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c589b400/0x9104b1ba7709fae2 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.649862:0:35266:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba7709f7bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48248 expref: 14 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.649886:0:35266:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba7709f7bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48248 expref: 14 pid: 8413 timeout: 1162 lvb_type: 0 00000100:00100000:3.0:1763343269.649907:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412897920:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343269.649959:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343269.650095:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+265:55884:x1848998399615616:12345-192.168.201.40@tcp:101:bash.0 Request processed in 4957us (5319us total) trans 4294973050 rc 0/0 00000100:00100000:3.0:1763343269.650104:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10043 00000004:00080000:3.0:1763343269.651193:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c9831880/2, rc 0, transno 21474838990 00000100:00100000:3.0:1763343269.651200:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412896896:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763343269.651212:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c517b800/2, rc 0, transno 17179871719 00000100:00100000:3.0:1763343269.651221:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c517b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412897408:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343269.653380:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b56680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998412897664:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343269.653406:0:8626:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fad4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343269.653562:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412897920:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343269.653577:0:35266:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c589b400/0x9104b1ba7709fae2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343269.654916:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399616384 00000100:00100000:3.0:1763343269.654922:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399616384 00010000:00010000:3.0:1763343269.654946:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0600/0x9104b1ba7709f8b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x278:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4829c expref: 34 pid: 8413 timeout: 1162 lvb_type: 1 00000100:00100000:3.0:1763343269.656335:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3250 00000100:00100000:3.0:1763343269.656344:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+32:2410:x1848998399616384:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343269.656365:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343269.656372:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0600/0x9104b1ba7709f8b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x278:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4829c expref: 32 pid: 8413 timeout: 1162 lvb_type: 1 00010000:00010000:3.0:1763343269.656384:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0600/0x9104b1ba7709f8b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x278:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4829c expref: 32 pid: 8413 timeout: 1162 lvb_type: 1 00010000:00010000:3.0:1763343269.656403:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0600/0x9104b1ba7709f8b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x278:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4829c expref: 32 pid: 8413 timeout: 1162 lvb_type: 1 00010000:00010000:3.0:1763343269.656423:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.656425:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.656429:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90600/0x9104b1ba7709fadb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x278:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.656443:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90600/0x9104b1ba7709fadb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x278:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.656471:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343269.656936:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+31:2410:x1848998399616384:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 590us (2180us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343269.656951:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3250 00010000:00010000:3.0:1763343269.656977:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343269.658470:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399616256 00000100:00100000:3.0:1763343269.658479:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399616256 00010000:00010000:3.0:1763343269.658515:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba7709f96f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b482db expref: 14 pid: 8412 timeout: 1162 lvb_type: 0 00000100:00100000:3.0:1763343269.658555:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3251 00000100:00100000:3.0:1763343269.658572:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6276d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2409:x1848998399616256:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343269.658590:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343269.658595:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba7709f96f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b482db expref: 14 pid: 8412 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.658607:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba7709f96f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b482db expref: 14 pid: 8412 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.658630:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba7709f96f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b482db expref: 14 pid: 8412 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.658648:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.658650:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.658654:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fad4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.658661:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fad4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.658692:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343269.658740:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6276d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2409:x1848998399616256:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 170us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343269.658756:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3251 00000100:00100000:3.0:1763343269.664297:0:8417:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399616896 00000100:00100000:3.0:1763343269.664307:0:8417:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399616896 00002000:00010000:3.0:1763343269.664351:0:8417:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/636 (0->18446744073709551615) 00002000:00100000:3.0:1763343269.664369:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6275180 with x1848998399616896 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343269.664381:0:8417:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c6275180. 00000100:00100000:3.0:1763343269.664419:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1635 00000100:00100000:3.0:1763343269.664428:0:8417:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6275180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+32:2407:x1848998399616896:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:3.0:1763343269.664608:0:8417:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x27c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343269.664612:0:8417:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x27c:0x0] updating lvb mtime from disk: 0 -> 1763343268 00002000:00010000:3.0:1763343269.664614:0:8417:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x27c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343269.664616:0:8417:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x27c:0x0] updating lvb ctime from disk: 0 -> 1763343268 00002000:00010000:3.0:1763343269.664618:0:8417:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x27c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343269.664680:0:8417:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6275180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+33:2407:x1848998399616896:12345-192.168.201.40@tcp:10:bash.0 Request processed in 252us (586us total) trans 21474838993 rc 0/0 00000100:00100000:3.0:1763343269.664691:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1635 00002000:00010000:3.0:1763343269.664697:0:8417:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/636 (0->18446744073709551615) 00002000:00100000:3.0:1763343269.664700:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6275180 with x1848998399616896 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343269.664705:0:8417:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c6275180. 00000100:00100000:3.0:1763343269.666570:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399617280 00000100:00100000:3.0:1763343269.666578:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399617280 00000100:00100000:3.0:1763343269.666630:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10044 00000100:00100000:3.0:1763343269.666639:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c372bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+265:57008:x1848998399617280:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343269.666662:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343269.666684:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba7709faf7 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48360 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.666761:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba7709fafe lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343269.666775:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba7709fafe lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.666786:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba7709fafe lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.666798:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589b400/0x9104b1ba7709fb05 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343269.666805:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589b400/0x9104b1ba7709fb05 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.666810:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589b400/0x9104b1ba7709fb05 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.667395:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fb0c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343269.667408:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fb0c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.667417:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fb0c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:3.0:1763343269.667427:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1d6:0x0]: returning size 2 00010000:00010000:3.0:1763343269.667507:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba7709fafe lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.667515:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba7709fafe lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.667521:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba7709fafe lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.667528:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba7709fafe lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.667535:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c589be00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343269.667539:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba7709fafe lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.667546:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba7709fafe lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.667558:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b800) 00010000:00010000:3.0:1763343269.667560:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343269.667565:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba7709fafe lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.667571:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba7709fafe lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.667585:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589b400/0x9104b1ba7709fb05 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.667591:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589b400/0x9104b1ba7709fb05 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.667596:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589b400/0x9104b1ba7709fb05 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.667601:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c589b400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343269.667603:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589b400/0x9104b1ba7709fb05 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.667607:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589b400/0x9104b1ba7709fb05 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.667613:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c488b300) 00010000:00010000:3.0:1763343269.667616:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343269.667618:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589b400/0x9104b1ba7709fb05 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.667623:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589b400/0x9104b1ba7709fb05 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.667667:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba7709faf7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48360 expref: 268 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.667683:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fb0c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48360 expref: 267 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.667690:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1d6:0x0].0x0 (ffff9400c48a8e00) 00010000:00010000:3.0:1763343269.667693:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343269.667696:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3b4ba00, rc 0) 00000100:00100000:3.0:1763343269.667748:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c372bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+267:57008:x1848998399617280:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1110us (1265us total) trans 4294973052 rc 0/0 00000100:00100000:3.0:1763343269.667755:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10044 00000100:00100000:3.0:1763343269.680909:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:3.0:1763343269.686847:0:9827:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.40@tcp) returned -22 from blocking AST (req@00000000d8b24c76 x1848998412898048) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fb0c lrc: 1/0,0 mode: --/PR res: [0x240000404:0x1d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48360 expref: 270 pid: 9827 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.686872:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fb0c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48360 expref: 270 pid: 9827 timeout: 1162 lvb_type: 0 00000100:00100000:3.0:1763343269.686889:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c859a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412898048:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343269.686912:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1d6:0x0].0x0 (ffff9400c48a8e00) 00010000:00010000:3.0:1763343269.686918:0:9827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba7709fb36 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1d6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343269.686926:0:9827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba7709fb36 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1d6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343269.686935:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba7709fb21 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.686943:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba7709fb21 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.686948:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba7709fb21 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 9827 initiator: MDT1 00000004:00200000:3.0:1763343269.686974:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1d6:0x0]: returning size 5 00010000:00010000:3.0:1763343269.687160:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba7709fb1a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1d6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48367 expref: 271 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.687181:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba7709fb21 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1d6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48367 expref: 270 pid: 9827 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.687190:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba7709fb21 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1d6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48367 expref: 270 pid: 9827 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.687196:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401ed154e00, rc 0) 00000100:00100000:3.0:1763343269.687251:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+270:57008:x1848998399618048:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 6394us (6942us total) trans 4294973056 rc 0/0 00000100:00100000:3.0:1763343269.687259:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10045 00000100:00100000:3.0:1763343269.690436:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.690553:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:3.0:1763343269.691303:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba7709fb36 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1d6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343269.691311:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba7709fb36 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1d6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00080000:3.0:1763343269.691566:0:33856:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x1d6:0x0] is inserted into orphan list, open count = 1 00010000:00010000:3.0:1763343269.691654:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba7709fb36 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1d6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343269.691665:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba7709fb36 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1d6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343269.691672:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba7709fb36 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1d6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343269.691678:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343269.691682:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba7709fb36 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1d6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343269.691689:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba7709fb36 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1d6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343269.691698:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1d6:0x0].0x0 (ffff9400c48a8e00) 00010000:00010000:3.0:1763343269.691701:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763343269.691704:0:33856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba7709fb4b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1d6:0x0].0x0 bits 0x12/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.691710:0:33856:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba7709fb4b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1d6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.691716:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba7709fb4b lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1d6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00000100:00100000:3.0:1763343269.699069:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.705181:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c372b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8626:1848998412898176:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343269.705214:0:8626:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c4515600/0x9104b1ba7709fb67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343269.713321:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399619840 00000100:00100000:3.0:1763343269.713331:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399619840 00000100:00100000:3.0:1763343269.713419:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10052 00000100:00100000:3.0:1763343269.713435:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+274:57010:x1848998399619840:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343269.713457:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343269.713485:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fb98 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4838a expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.713542:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba7709fb9f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343269.713557:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba7709fb9f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343269.713579:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba7709fb9f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:3.0:1763343269.713621:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763343269.713627:0:33856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1763343269.713658:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fb98 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4838a expref: 275 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.713672:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba7709fb9f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4838a expref: 274 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.713679:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b800) 00010000:00010000:3.0:1763343269.713681:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763343269.713684:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3b4b600, rc 0) 00000100:00100000:3.0:1763343269.713751:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+274:57010:x1848998399619840:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 320us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343269.713759:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10052 00000100:00100000:3.0:1763343269.716953:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399619968 00000100:00100000:3.0:1763343269.716963:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399619968 00000100:00100000:3.0:1763343269.717039:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10053 00000100:00100000:3.0:1763343269.717052:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+275:57010:x1848998399619968:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343269.717071:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343269.717293:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fbad lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48391 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.717378:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709fbb4 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343269.717392:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709fbb4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.717403:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709fbb4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.717414:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709fbbb lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343269.717421:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709fbbb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.717427:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709fbbb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.717462:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709fbb4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.717469:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709fbb4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.717475:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709fbb4 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.717482:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709fbb4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.717515:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e90800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343269.717519:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709fbb4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.717532:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709fbb4 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.717548:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b800) 00010000:00010000:3.0:1763343269.717551:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343269.717556:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709fbb4 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.717562:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba7709fbb4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.717575:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709fbbb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.717581:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709fbbb lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.717587:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709fbbb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.717592:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e90600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343269.717594:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709fbbb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.717600:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709fbbb lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.717605:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401c85cc800) 00010000:00010000:3.0:1763343269.717608:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343269.717610:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709fbbb lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.717616:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba7709fbbb lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.717641:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fbad lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48391 expref: 276 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.717651:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b800) 00010000:00010000:3.0:1763343269.717653:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343269.717657:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fbad lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48391 expref: 276 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.717667:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3b4aa00, rc 0) 00000100:00100000:3.0:1763343269.717766:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+275:57010:x1848998399619968:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 717us (924us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343269.717774:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10053 00000001:00080000:3.0:1763343269.720709:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973059 is committed 00000004:00080000:3.0:1763343269.720719:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1006 committed 00000004:00080000:3.0:1763343269.720727:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1014 committed 00000004:00080000:3.0:1763343269.720736:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1013 committed 00000004:00080000:3.0:1763343269.720737:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1005 committed 00000100:00100000:3.0:1763343269.721249:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c3728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412898304:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343269.721299:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343269.721328:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343269.721332:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c3728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412898432:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343269.721351:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343269.721396:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412898304 00000100:00100000:3.0:1763343269.721401:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412898304 00000100:00100000:3.0:1763343269.721434:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412898432 00000100:00100000:3.0:1763343269.721438:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412898432 00000100:00100000:3.0:1763343269.721463:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6772 00000100:00100000:3.0:1763343269.721469:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+14:3661:x1848998412898432:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763343269.721559:0:35266:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x27e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343269.721564:0:35266:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x27e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343269.721568:0:35266:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x27e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343269.721571:0:35266:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x27e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343269.721574:0:35266:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x27e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343269.721618:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+16:3661:x1848998412898432:12345-0@lo:2:osp-syn-1-1.0 Request processed in 148us (264us total) trans 17179871724 rc 0/0 00000100:00100000:3.0:1763343269.721629:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6772 00000004:00080000:3.0:1763343269.721673:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c3728700/2, rc 0, transno 17179871724 00000100:00100000:3.0:1763343269.721680:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c3728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412898432:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763343269.721694:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c3728380/2, rc 0, transno 17179871725 00000100:00100000:3.0:1763343269.721702:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c3728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412898304:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343269.728564:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399620736 00000100:00100000:3.0:1763343269.728572:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399620736 00000100:00100000:3.0:1763343269.728620:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10057 00000100:00100000:3.0:1763343269.728637:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+269:57010:x1848998399620736:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343269.728655:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343269.728669:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fbfa lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b483ad expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.728912:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fc01 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343269.728925:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba7709fbd7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48398 expref: 270 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.728933:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fc01 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.728964:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba7709fbd7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48398 expref: 270 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.728976:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba7709fbd7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48398 expref: 270 pid: 6525 timeout: 1162 lvb_type: 0 00000100:00100000:3.0:1763343269.728989:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b56300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998412898816:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343269.729084:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9540 going to sleep for 11 seconds 00000100:00100000:3.0:1763343269.732139:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b56300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998412898816:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343269.732171:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fc01 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000100:00100000:3.0:1763343269.733321:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399620992 00000100:00100000:3.0:1763343269.733330:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399620992 00010000:00010000:3.0:1763343269.733396:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba7709fbd7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48398 expref: 270 pid: 6525 timeout: 1162 lvb_type: 0 00000100:00100000:3.0:1763343269.733446:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3254 00000100:00100000:3.0:1763343269.733455:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+270:2408:x1848998399620992:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343269.733470:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343269.733476:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba7709fbd7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48398 expref: 270 pid: 6525 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.733489:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba7709fbd7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48398 expref: 270 pid: 6525 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.733511:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba7709fbd7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48398 expref: 270 pid: 6525 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.733527:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1d7:0x0].0x0 (ffff9401d816a200) 00010000:00010000:3.0:1763343269.733533:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fc01 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.733541:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fc01 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.733549:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fc01 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343269.733575:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343269.733627:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+269:2408:x1848998399620992:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 173us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343269.733634:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3254 00000001:00080000:3.0:1763343269.770543:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973067 is committed 00000004:00080000:3.0:1763343269.770550:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1016 committed 00000004:00080000:3.0:1763343269.770562:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1008 committed 00000004:00080000:3.0:1763343269.770572:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1007 committed 00000004:00080000:3.0:1763343269.770575:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1015 committed 00000100:00100000:3.0:1763343269.771787:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.772436:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c7ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412899200:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343269.772470:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763343269.773079:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c7ef6300/2, rc 0, transno 17179871726 00000100:00100000:3.0:1763343269.773117:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c7ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412899328:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343269.774174:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.774206:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.776596:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.777967:0:8417:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399623168 00000100:00100000:3.0:1763343269.777973:0:8417:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399623168 00000100:00100000:3.0:1763343269.778040:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1637 00000100:00100000:3.0:1763343269.778051:0:8417:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+37:2408:x1848998399623168:12345-192.168.201.40@tcp:3:lfs.0 00010000:00010000:3.0:1763343269.778093:0:8417:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fc71 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x27c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.778103:0:8417:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.778104:0:8417:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.778108:0:8417:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fc71 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x27c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.778118:0:8417:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fc71 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x27c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.778207:0:8417:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fc71 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x27c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.778216:0:8417:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fc71 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x27c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.778237:0:8417:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fc71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.778244:0:8417:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3b4ba00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343269.778248:0:8417:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fc71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.778256:0:8417:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fc71 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x27c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.778280:0:8417:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fc71 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x27c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.778290:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fc71 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x27c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343269.778344:0:8417:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+36:2408:x1848998399623168:12345-192.168.201.40@tcp:3:lfs.0 Request processed in 295us (440us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1763343269.778404:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1637 00000100:00100000:3.0:1763343269.780631:0:8417:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399623424 00000100:00100000:3.0:1763343269.780640:0:8417:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399623424 00002000:00010000:3.0:1763343269.780675:0:8417:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/638 (0->18446744073709551615) 00002000:00100000:3.0:1763343269.780680:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c8bc1880 with x1848998399623424 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343269.780690:0:8417:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c8bc1880. 00000100:00100000:3.0:1763343269.780713:0:8417:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399623296 00000100:00100000:3.0:1763343269.780716:0:8417:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399623296 00002000:00010000:3.0:1763343269.780730:0:8417:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/639 (0->18446744073709551615) 00002000:00100000:3.0:1763343269.780734:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c8bc1f80 with x1848998399623296 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343269.780741:0:8417:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c8bc1f80. 00000100:00100000:3.0:1763343269.780758:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1638 00000100:00100000:3.0:1763343269.780766:0:8417:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+36:2408:x1848998399623424:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:3.0:1763343269.780926:0:8417:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x27e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343269.780930:0:8417:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x27e:0x0] updating lvb mtime from disk: 0 -> 1763343269 00002000:00010000:3.0:1763343269.780933:0:8417:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x27e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343269.780935:0:8417:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x27e:0x0] updating lvb ctime from disk: 0 -> 1763343269 00002000:00010000:3.0:1763343269.780937:0:8417:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x27e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343269.780984:0:8417:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+37:2408:x1848998399623424:12345-192.168.201.40@tcp:10:bash.0 Request processed in 219us (1019us total) trans 21474838999 rc 0/0 00000100:00100000:3.0:1763343269.780991:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1638 00002000:00010000:3.0:1763343269.780995:0:8417:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/638 (0->18446744073709551615) 00002000:00100000:3.0:1763343269.780998:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c8bc1880 with x1848998399623424 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343269.781003:0:8417:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c8bc1880. 00000100:00100000:3.0:1763343269.781085:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1639 00000100:00100000:3.0:1763343269.781093:0:8417:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399623296:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:3.0:1763343269.781190:0:8417:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x27f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343269.781193:0:8417:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x27f:0x0] updating lvb mtime from disk: 0 -> 1763343269 00002000:00010000:3.0:1763343269.781195:0:8417:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x27f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343269.781197:0:8417:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x27f:0x0] updating lvb ctime from disk: 0 -> 1763343269 00002000:00010000:3.0:1763343269.781199:0:8417:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x27f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343269.781221:0:8417:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998399623296:12345-192.168.201.40@tcp:10:bash.0 Request processed in 129us (1083us total) trans 17179871728 rc 0/0 00000100:00100000:3.0:1763343269.781228:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1639 00002000:00010000:3.0:1763343269.781230:0:8417:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/639 (0->18446744073709551615) 00002000:00100000:3.0:1763343269.781233:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c8bc1f80 with x1848998399623296 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343269.781236:0:8417:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c8bc1f80. 00000100:00100000:3.0:1763343269.784872:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399623936 00000100:00100000:3.0:1763343269.784882:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399623936 00000100:00100000:3.0:1763343269.785003:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3518 00000100:00100000:3.0:1763343269.785013:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+268:55884:x1848998399623936:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:3.0:1763343269.785497:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+269:55884:x1848998399623936:12345-192.168.201.40@tcp:35:bash.0 Request processed in 484us (698us total) trans 4294973068 rc 0/0 00000100:00100000:3.0:1763343269.785509:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3518 00000100:00100000:3.0:1763343269.788277:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399624064 00000100:00100000:3.0:1763343269.788287:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399624064 00010000:00010000:3.0:1763343269.788330:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e91600/0x9104b1ba7709fa5d lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x27e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48321 expref: 18 pid: 8412 timeout: 1162 lvb_type: 1 00000001:00080000:3.0:1763343269.792434:0:25994:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871729 is committed 00000001:00080000:3.0:1763343269.792453:0:25994:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871727 is committed 00000100:00100000:3.0:1763343269.810165:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.810203:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.813338:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.814633:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.815347:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.820368:0:35278:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6401500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35278:1848998412899712:192.168.201.40@tcp:105: 00010000:00010000:3.0:1763343269.820396:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343269.820453:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+37:2408:x1848998399625344:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 2639us (2764us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343269.820466:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3256 00000100:00100000:3.0:1763343269.825245:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.829893:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399626112 00000100:00100000:3.0:1763343269.829904:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399626112 00000100:00100000:3.0:1763343269.830748:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10072 00000100:00100000:3.0:1763343269.830817:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+272:57012:x1848998399626368:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343269.830833:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343269.830837:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343269.830859:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba7709fd0b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4840f expref: 272 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.830883:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401c7da4b00) 00010000:00010000:3.0:1763343269.830894:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343269.830911:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fd2e lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4841d expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.830987:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fd35 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343269.830998:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fd35 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343269.831006:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fd35 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343269.831018:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba7709fd3c lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343269.831420:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba7709fd3c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343269.831430:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba7709fd3c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343269.831740:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba7709fd43 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1d9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343269.831750:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba7709fd43 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343269.831757:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba7709fd43 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:3.0:1763343269.831765:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1d9:0x0]: returning size 0 00010000:00010000:3.0:1763343269.831789:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fd35 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343269.831796:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fd35 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343269.831802:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fd35 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343269.831808:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3b4aa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343269.831812:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fd35 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343269.831819:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fd35 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343269.831828:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401c9896e00) 00010000:00010000:3.0:1763343269.831831:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343269.831834:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fd35 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343269.831839:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fd35 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:3.0:1763343269.831849:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000014b76088 reply state 00000000ce7babfe transno 4294973072 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba7709fd3c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343269.831857:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba7709fd3c lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343269.831862:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401c7da4500) 00010000:00010000:3.0:1763343269.831864:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343269.831866:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343269.831890:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fd2e lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4841d expref: 276 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.831913:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba7709fd43 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4841d expref: 275 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.831920:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1d9:0x0].0x0 (ffff9401c9896900) 00010000:00010000:3.0:1763343269.831922:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343269.831925:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a4000, rc 0) 00000100:00100000:3.0:1763343269.831974:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+276:57012:x1848998399626368:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1216us (2165us total) trans 4294973072 rc 0/0 00000100:00100000:3.0:1763343269.831981:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10072 00000100:00100000:3.0:1763343269.833427:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.835520:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.837226:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399626880 00000100:00100000:3.0:1763343269.837235:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399626880 00010000:00010000:3.0:1763343269.837265:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3e00/0x9104b1ba7709fc0f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b483b4 expref: 40 pid: 28562 timeout: 1162 lvb_type: 1 00000100:00100000:3.0:1763343269.837295:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3257 00000100:00100000:3.0:1763343269.837303:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+40:2407:x1848998399626880:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343269.837315:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343269.837332:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3e00/0x9104b1ba7709fc0f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x27c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b483b4 expref: 40 pid: 28562 timeout: 1162 lvb_type: 1 00010000:00010000:3.0:1763343269.837346:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3e00/0x9104b1ba7709fc0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x27c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b483b4 expref: 40 pid: 28562 timeout: 1162 lvb_type: 1 00010000:00010000:3.0:1763343269.837379:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3e00/0x9104b1ba7709fc0f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x27c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b483b4 expref: 40 pid: 28562 timeout: 1162 lvb_type: 1 00010000:00010000:3.0:1763343269.837397:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.837400:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.837410:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3200/0x9104b1ba7709fd51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48424 expref: 39 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.838145:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3200/0x9104b1ba7709fd51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48424 expref: 39 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.838181:0:35278:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3200/0x9104b1ba7709fd51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48424 expref: 39 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343269.838194:0:35278:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35278:1848998412900096:192.168.201.40@tcp:105: 00000100:00100000:3.0:1763343269.838380:0:35278:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9540 going to sleep for 11 seconds 00000100:00100000:3.0:1763343269.840823:0:35278:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35278:1848998412900096:192.168.201.40@tcp:105: 00010000:00010000:3.0:1763343269.840843:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343269.840897:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+38:2407:x1848998399626880:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 3595us (3743us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343269.840907:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3257 00000100:00100000:3.0:1763343269.841486:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399627008 00000100:00100000:3.0:1763343269.841495:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399627008 00010000:00010000:3.0:1763343269.841524:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba7709fd43 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4841d expref: 277 pid: 33856 timeout: 1162 lvb_type: 0 00000100:00100000:3.0:1763343269.841558:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3258 00000100:00100000:3.0:1763343269.841569:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+277:2408:x1848998399627008:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343269.841586:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343269.841594:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba7709fd43 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4841d expref: 277 pid: 33856 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.841608:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba7709fd43 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4841d expref: 277 pid: 33856 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.841635:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba7709fd43 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4841d expref: 277 pid: 33856 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.841653:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1d9:0x0].0x0 (ffff9401c9896900) 00010000:00010000:3.0:1763343269.841660:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba7709fd5f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.841673:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba7709fd5f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.841682:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba7709fd5f lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.841709:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343269.841743:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+276:2408:x1848998399627008:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 175us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343269.841750:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3258 00000100:00100000:3.0:1763343269.844746:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399627392 00000100:00100000:3.0:1763343269.844750:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399627392 00000100:00100000:3.0:1763343269.844833:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3519 00000100:00100000:3.0:1763343269.844844:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+276:57008:x1848998399627392:12345-192.168.201.40@tcp:35:lfs.0 00000004:00010000:3.0:1763343269.844908:0:6527:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x1d6:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155400/0x9104b1ba7709fb59 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48375 expref: 276 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.844956:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba7709fd6d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343269.844970:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba7709fbe5 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4839f expref: 276 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.844978:0:6527:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba7709fd6d lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343269.845010:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba7709fbe5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4839f expref: 276 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.845113:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba7709fbe5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4839f expref: 277 pid: 33856 timeout: 1162 lvb_type: 0 00000100:00100000:3.0:1763343269.845132:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6527:1848998412900224:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343269.845529:0:6527:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343269.848640:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6527:1848998412900224:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343269.848667:0:6527:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba7709fd6d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00000100:00100000:3.0:1763343269.848726:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399628032 00000100:00100000:3.0:1763343269.848731:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399628032 00010000:00010000:3.0:1763343269.848752:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba7709fbe5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4839f expref: 278 pid: 33856 timeout: 1162 lvb_type: 0 00000100:00100000:3.0:1763343269.848824:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3259 00000100:00100000:3.0:1763343269.848832:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:2408:x1848998399628032:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343269.848844:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343269.848850:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba7709fbe5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4839f expref: 278 pid: 33856 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.848862:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba7709fbe5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4839f expref: 278 pid: 33856 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.848883:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba7709fbe5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4839f expref: 278 pid: 33856 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.848896:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1d6:0x0].0x0 (ffff9400c48a8e00) 00010000:00010000:3.0:1763343269.848901:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba7709fd6d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343269.848910:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba7709fd6d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343269.848917:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba7709fd6d lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343269.849194:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343269.849230:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+277:2408:x1848998399628032:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 397us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343269.849238:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3259 00000100:00100000:3.0:1763343269.851806:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412900864:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343269.851870:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343269.852210:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412901120:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343269.852241:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343269.852264:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343269.852272:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412901248:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343269.852295:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:3.0:1763343269.852344:0:6527:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000051954c18 reply state 00000000ca7950cc transno 4294973076 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba7709fd6d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343269.852372:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba7709fd6d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343269.852379:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1d6:0x0].0x0 (ffff9400c48a8e00) 00010000:00010000:3.0:1763343269.852382:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1763343269.852385:0:6527:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343269.852390:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1d6:0x0].0x0 (ffff9400c48a8e00) 00010000:00010000:3.0:1763343269.852392:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763343269.852398:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155400/0x9104b1ba7709fb59 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1d6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48375 expref: 265 pid: 9827 timeout: 0 lvb_type: 0 00010000:00080000:3.0:1763343269.852479:0:6527:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763343269.852490:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+265:57008:x1848998399627392:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 7650us (8268us total) trans 4294973076 rc 0/0 00000100:00100000:3.0:1763343269.852497:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3519 00000100:00100000:3.0:1763343269.853492:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412900352 00000100:00100000:3.0:1763343269.853497:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412900352 00000100:00100000:3.0:1763343269.853522:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6792 00000100:00100000:3.0:1763343269.853527:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+60:3661:x1848998412900352:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343269.853541:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:638 count 1 00010000:00010000:3.0:1763343269.853557:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a4000/0x9104b1ba7709fd74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.853574:0:8413:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9401fd2df600/0x9104b1ba7709fc6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b483de expref: 38 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.853586:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343269.853589:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343269.853592:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a4000/0x9104b1ba7709fd74 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.853621:0:8413:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9401fd2df600/0x9104b1ba7709fc6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b483de expref: 38 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.853634:0:8413:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9401fd2df600/0x9104b1ba7709fc6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b483de expref: 38 pid: 27798 timeout: 1162 lvb_type: 0 00000100:00100000:3.0:1763343269.853645:0:8413:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412901376:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343269.853691:0:8413:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343269.854889:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6795 00000100:00100000:3.0:1763343269.854909:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+8:3661:x1848998412900992:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763343269.854932:0:8414:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:640 count 1 00002000:00010000:3.0:1763343269.854955:0:8414:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x280:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343269.854964:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fd89 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.854989:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.854992:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.854996:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fd89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.855008:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fd89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.855020:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fd89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.855116:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fd89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.855151:0:8414:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343269.855323:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+9:3661:x1848998412900992:12345-0@lo:6:osp-syn-1-1.0 Request processed in 419us (932us total) trans 17179871733 rc 0/0 00000100:00100000:3.0:1763343269.855334:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6795 00000100:00100000:3.0:1763343269.862516:0:8413:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412901376:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343269.862549:0:8413:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a4000/0x9104b1ba7709fd74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343269.865246:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3261 00000100:00100000:3.0:1763343269.865259:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+39:2408:x1848998399628672:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343269.865269:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343269.865275:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9401fd2df600/0x9104b1ba7709fc6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b483de expref: 39 pid: 27798 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.865289:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9401fd2df600/0x9104b1ba7709fc6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b483de expref: 39 pid: 27798 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.865304:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401fd2df600/0x9104b1ba7709fc6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b483de expref: 39 pid: 27798 timeout: 1162 lvb_type: 0 00010000:00010000:3.0:1763343269.865318:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.865320:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.865324:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a4000/0x9104b1ba7709fd74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.865333:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a4000/0x9104b1ba7709fd74 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.865363:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343269.866329:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+38:2408:x1848998399628672:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1070us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343269.866337:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3261 00010000:00010000:3.0:1763343269.867739:0:8413:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a4000/0x9104b1ba7709fd74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.867749:0:8413:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a4000/0x9104b1ba7709fd74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.867758:0:8413:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a4000/0x9104b1ba7709fd74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.867765:0:8413:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a4000/0x9104b1ba7709fd74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.867784:0:8413:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343269.867951:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+62:3661:x1848998412900352:12345-0@lo:6:osp-syn-0-1.0 Request processed in 14421us (14566us total) trans 21474839005 rc 0/0 00000100:00100000:3.0:1763343269.867963:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6792 00000100:00100000:3.0:1763343269.876896:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399629696 00000100:00100000:3.0:1763343269.876902:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399629696 00000100:00100000:3.0:1763343269.883074:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399630080 00000100:00100000:3.0:1763343269.883081:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399630080 00000100:00100000:3.0:1763343269.886367:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399630336 00000100:00100000:3.0:1763343269.886374:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399630336 00010000:00010000:3.0:1763343269.886408:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba7709fdf2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48447 expref: 274 pid: 6526 timeout: 1163 lvb_type: 0 00000100:00100000:3.0:1763343269.886441:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3262 00000100:00100000:3.0:1763343269.886450:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+274:2408:x1848998399630336:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343269.886464:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343269.886470:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba7709fdf2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48447 expref: 274 pid: 6526 timeout: 1163 lvb_type: 0 00010000:00010000:3.0:1763343269.886483:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba7709fdf2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48447 expref: 274 pid: 6526 timeout: 1163 lvb_type: 0 00010000:00010000:3.0:1763343269.886505:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba7709fdf2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48447 expref: 274 pid: 6526 timeout: 1163 lvb_type: 0 00010000:00010000:3.0:1763343269.886522:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1d9:0x0].0x0 (ffff9401c85cc900) 00010000:00010000:3.0:1763343269.886526:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba7709fe07 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343269.886535:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba7709fe07 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343269.886546:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba7709fe07 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343269.886578:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343269.886629:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+273:2408:x1848998399630336:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 179us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343269.886637:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3262 00000100:00100000:3.0:1763343269.890247:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412902016 00000100:00100000:3.0:1763343269.890254:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412902016 00000100:00100000:3.0:1763343269.890294:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412901760 00000100:00100000:3.0:1763343269.890296:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412901760 00000100:00100000:3.0:1763343269.890309:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412901888 00000100:00100000:3.0:1763343269.890310:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412901888 00000100:00100000:3.0:1763343269.890328:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6798 00000100:00100000:3.0:1763343269.890336:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+65:3659:x1848998412902016:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343269.891098:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+67:3659:x1848998412902016:12345-0@lo:2:osp-syn-0-1.0 Request processed in 762us (1109us total) trans 21474839006 rc 0/0 00000100:00100000:3.0:1763343269.891105:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6798 00000004:00080000:3.0:1763343269.891788:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400cc5dfb80/2, rc 0, transno 21474839007 00000100:00100000:3.0:1763343269.891793:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412902144:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343269.893623:0:6526:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc18000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6526:1848998412903040:192.168.201.40@tcp:105: 00010000:00010000:3.0:1763343269.893663:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba7709fe00 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48455 expref: 268 pid: 6526 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763343269.893685:0:6526:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba7709fe07 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48455 expref: 267 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.893723:0:6526:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c6b99600, rc 0) 00000100:00100000:3.0:1763343269.893764:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+267:55884:x1848998399629952:12345-192.168.201.40@tcp:101:bash.0 Request processed in 11956us (12135us total) trans 4294973082 rc 0/0 00000100:00100000:3.0:1763343269.893772:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10080 00000100:00100000:3.0:1763343269.894901:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399630848 00000100:00100000:3.0:1763343269.894908:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399630848 00000100:00100000:3.0:1763343269.894944:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3523 00000100:00100000:3.0:1763343269.894953:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+267:57008:x1848998399630848:12345-192.168.201.40@tcp:49:lfs.0 00000100:00100000:3.0:1763343269.895057:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+267:57008:x1848998399630848:12345-192.168.201.40@tcp:49:lfs.0 Request processed in 105us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343269.895065:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3523 00000004:00080000:3.0:1763343269.895936:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6280700/2, rc 0, transno 17179871737 00000100:00100000:3.0:1763343269.895941:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6280700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412902400:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343269.897712:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399631232 00000100:00100000:3.0:1763343269.897718:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399631232 00000100:00100000:3.0:1763343269.897750:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3524 00000100:00100000:3.0:1763343269.897762:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8545850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+267:55884:x1848998399631232:12345-192.168.201.40@tcp:49:bash.0 00000100:00100000:3.0:1763343269.897853:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8545850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+267:55884:x1848998399631232:12345-192.168.201.40@tcp:49:bash.0 Request processed in 95us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343269.897859:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3524 00000100:00100000:3.0:1763343269.900379:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399631488 00000100:00100000:3.0:1763343269.900387:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399631488 00000100:00100000:3.0:1763343269.900432:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6807 00000100:00100000:3.0:1763343269.900441:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+38:55884:x1848998399631488:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343269.900457:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343269.900474:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fe46 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x280:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48478 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.900502:0:28562:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba7709fe3f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x280:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48471 expref: 39 pid: 28561 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343269.900509:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.900512:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.900516:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fe46 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x280:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48478 expref: 39 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.900552:0:28562:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba7709fe3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x280:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48471 expref: 39 pid: 28561 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343269.900565:0:28562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba7709fe3f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x280:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48471 expref: 39 pid: 28561 timeout: 1163 lvb_type: 1 00000100:00100000:3.0:1763343269.900580:0:28562:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28562:1848998412903424:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343269.900996:0:28562:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9540 going to sleep for 11 seconds 00000100:00100000:3.0:1763343269.902749:0:28562:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28562:1848998412903424:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343269.902779:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fe46 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x280:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48478 expref: 39 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.902797:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3b4aa00, rc 0) 00000100:00100000:3.0:1763343269.902847:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+39:55884:x1848998399631488:12345-192.168.201.40@tcp:101:bash.0 Request processed in 2406us (2545us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343269.902857:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6807 00000100:00100000:3.0:1763343269.904220:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399631872 00000100:00100000:3.0:1763343269.904226:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399631872 00010000:00010000:3.0:1763343269.904250:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba7709fe3f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x280:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48471 expref: 39 pid: 28561 timeout: 1163 lvb_type: 1 00000100:00100000:3.0:1763343269.904280:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3267 00000100:00100000:3.0:1763343269.904287:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7e39450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+39:2407:x1848998399631872:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343269.904297:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343269.904302:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba7709fe3f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x280:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48471 expref: 39 pid: 28561 timeout: 1163 lvb_type: 1 00010000:00010000:3.0:1763343269.904312:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba7709fe3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x280:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48471 expref: 39 pid: 28561 timeout: 1163 lvb_type: 1 00010000:00010000:3.0:1763343269.904327:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba7709fe3f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x280:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48471 expref: 39 pid: 28561 timeout: 1163 lvb_type: 1 00010000:00010000:3.0:1763343269.904337:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.904339:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343269.904346:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fe46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x280:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48478 expref: 38 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.904368:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fe46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x280:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48478 expref: 38 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.904407:0:35278:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fe46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x280:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48478 expref: 38 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343269.904421:0:35278:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5dce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35278:1848998412903552:192.168.201.40@tcp:105: 00000100:00100000:3.0:1763343269.904489:0:35278:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9540 going to sleep for 11 seconds 00000100:00100000:3.0:1763343269.907179:0:35278:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5dce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35278:1848998412903552:192.168.201.40@tcp:105: 00010000:00010000:3.0:1763343269.907203:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343269.907498:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7e39450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+38:2407:x1848998399631872:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 3211us (4186us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343269.907507:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3267 00000100:00100000:3.0:1763343269.907624:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399632512 00000100:00100000:3.0:1763343269.907629:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399632512 00000100:00100000:3.0:1763343269.907657:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3526 00000100:00100000:3.0:1763343269.907664:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+270:57008:x1848998399632512:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343269.907854:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+271:57008:x1848998399632512:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 189us (275us total) trans 4294973085 rc 0/0 00000100:00100000:3.0:1763343269.907860:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3526 00000100:00100000:3.0:1763343269.912603:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399632896 00000100:00100000:3.0:1763343269.912613:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399632896 00000100:00100000:3.0:1763343269.912669:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3527 00000100:00100000:3.0:1763343269.912679:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+271:57008:x1848998399632896:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:3.0:1763343269.913604:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+271:57008:x1848998399632896:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 921us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343269.913614:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3527 00000100:00100000:3.0:1763343269.918548:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.926570:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399633664 00000100:00100000:3.0:1763343269.926587:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399633664 00000100:00100000:3.0:1763343269.926677:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3528 00000100:00100000:3.0:1763343269.926687:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6277b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+271:57008:x1848998399633664:12345-192.168.201.40@tcp:35:lfs.0 00000004:00010000:3.0:1763343269.926767:0:19639:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x1d9:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916400/0x9104b1ba7709fe93 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1d9:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4848d expref: 271 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343269.926811:0:19639:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fea1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19639 initiator: MDT0 00010000:00010000:3.0:1763343269.926823:0:19639:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fea1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1d9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343269.926831:0:19639:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fea1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1d9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00000004:00020000:3.0:1763343269.926977:0:19639:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0001-mdtlov: can not set all stale mirrors for [0x240000404:0x1d9:0x0]: rc = -1 00010000:00010000:3.0:1763343269.927011:0:19639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fea1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1d9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343269.927018:0:19639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fea1 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1d9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343269.927065:0:19639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fea1 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1d9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343269.927072:0:19639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3b4ba00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343269.927077:0:19639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fea1 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1d9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343269.927084:0:19639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fea1 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1d9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343269.927094:0:19639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1d9:0x0].0x0 (ffff9401c85ccb00) 00010000:00010000:3.0:1763343269.927099:0:19639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1763343269.927104:0:19639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fea1 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1d9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343269.927109:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709fea1 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1d9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343269.927119:0:19639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1d9:0x0].0x0 (ffff9401c85ccb00) 00010000:00010000:3.0:1763343269.927121:0:19639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763343269.927124:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916400/0x9104b1ba7709fe93 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1d9:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4848d expref: 271 pid: 9827 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343269.929175:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.938602:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.973883:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399635584 00000100:00100000:3.0:1763343269.973896:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399635584 00010000:00010000:3.0:1763343269.973943:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba7709ff18 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1db:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b484b7 expref: 279 pid: 6525 timeout: 1163 lvb_type: 0 00000100:00100000:3.0:1763343269.973991:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3268 00000100:00100000:3.0:1763343269.974003:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+279:2407:x1848998399635584:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343269.974019:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343269.974056:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba7709ff18 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1db:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b484b7 expref: 279 pid: 6525 timeout: 1163 lvb_type: 0 00010000:00010000:3.0:1763343269.974070:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba7709ff18 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1db:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b484b7 expref: 279 pid: 6525 timeout: 1163 lvb_type: 0 00010000:00010000:3.0:1763343269.974100:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba7709ff18 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1db:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b484b7 expref: 279 pid: 6525 timeout: 1163 lvb_type: 0 00010000:00010000:3.0:1763343269.974125:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1db:0x0].0x0 (ffff9401c85cc900) 00010000:00010000:3.0:1763343269.974130:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba7709ff3b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1db:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.974140:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba7709ff3b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1db:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.974225:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba7709ff3b lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1db:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343269.974255:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343269.974300:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:2407:x1848998399635584:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 300us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343269.974307:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3268 00000100:00100000:3.0:1763343269.979570:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.985652:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.988217:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343269.988272:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399636608 00000100:00100000:3.0:1763343269.988280:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399636608 00000100:00100000:3.0:1763343269.988335:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3532 00000100:00100000:3.0:1763343269.988344:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57014:x1848998399636608:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343269.988565:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57014:x1848998399636608:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 221us (355us total) trans 4294973095 rc 0/0 00000100:00100000:3.0:1763343269.988573:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3532 00000100:00100000:3.0:1763343269.994631:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.001865:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.009961:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399637504 00000100:00100000:3.0:1763343270.009971:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399637504 00000100:00100000:3.0:1763343270.015247:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399638016 00000100:00100000:3.0:1763343270.015258:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399638016 00000100:00100000:3.0:1763343270.015423:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399637760 00000100:00100000:3.0:1763343270.015427:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399637760 00000100:00100000:3.0:1763343270.015451:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10097 00000100:00100000:3.0:1763343270.015461:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:55884:x1848998399638016:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:3.0:1763343270.015521:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343270.015553:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba7709ff88 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1db:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b484da expref: 288 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.015572:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1db:0x0].0x0 (ffff9401edc53500) 00010000:00010000:3.0:1763343270.015577:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343270.015761:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba7709ffc0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343270.015781:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155400/0x9104b1ba7709ffb9 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x1db:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.015790:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba7709ffc0 lrc: 4/0,1 mode: --/PW res: [0x240000404:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343270.015809:0:33856:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155400/0x9104b1ba7709ffb9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1db:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.015820:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba7709ffc0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:3.0:1763343270.031544:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.031590:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.045142:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399638784 00000100:00100000:3.0:1763343270.045156:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399638784 00000100:00100000:3.0:1763343270.059006:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412904576:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343270.059061:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343270.059082:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343270.059087:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412904704:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343270.059108:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343270.059129:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412904576 00000100:00100000:3.0:1763343270.059133:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412904576 00000100:00100000:3.0:1763343270.059152:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412904704 00000100:00100000:3.0:1763343270.059154:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412904704 00000100:00100000:3.0:1763343270.059164:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6811 00000100:00100000:3.0:1763343270.059170:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+69:3662:x1848998412903808:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343270.059188:0:8414:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:640 count 1 00010000:00010000:3.0:1763343270.059209:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709ffdc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x280:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.059225:0:8414:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fe46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x280:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48478 expref: 38 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.059246:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343270.059249:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343270.059251:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709ffdc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x280:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.059275:0:8414:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fe46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x280:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48478 expref: 38 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.059289:0:8414:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4aa00/0x9104b1ba7709fe46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x280:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48478 expref: 38 pid: 28562 timeout: 1163 lvb_type: 0 00000100:00100000:3.0:1763343270.059312:0:8414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1848998412904832:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343270.059372:0:8414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9180 going to sleep for 11 seconds 00000100:00100000:3.0:1763343270.059396:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6812 00000100:00100000:3.0:1763343270.059408:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+69:3659:x1848998412904064:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343270.059566:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+70:3659:x1848998412904064:12345-0@lo:2:osp-syn-0-1.0 Request processed in 161us (910us total) trans 21474839011 rc 0/0 00000100:00100000:3.0:1763343270.059573:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6812 00000100:00100000:3.0:1763343270.059589:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6813 00000100:00100000:3.0:1763343270.059595:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+69:3659:x1848998412904192:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343270.059657:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+70:3659:x1848998412904192:12345-0@lo:2:osp-syn-0-1.0 Request processed in 62us (963us total) trans 21474839012 rc 0/0 00000100:00100000:3.0:1763343270.059663:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6813 00000100:00100000:3.0:1763343270.059673:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6814 00000100:00100000:3.0:1763343270.059679:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+14:3659:x1848998412904576:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763343270.059741:0:8626:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x283:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343270.059744:0:8626:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x283:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343270.059746:0:8626:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x283:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343270.059748:0:8626:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x283:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343270.059750:0:8626:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x283:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343270.059769:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+15:3659:x1848998412904576:12345-0@lo:2:osp-syn-1-1.0 Request processed in 91us (708us total) trans 17179871740 rc 0/0 00000100:00100000:3.0:1763343270.059774:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6814 00000100:00100000:3.0:1763343270.059784:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6815 00000100:00100000:3.0:1763343270.059789:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+14:3659:x1848998412904704:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343270.059838:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+15:3659:x1848998412904704:12345-0@lo:2:osp-syn-1-1.0 Request processed in 48us (728us total) trans 17179871741 rc 0/0 00000100:00100000:3.0:1763343270.059843:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6815 00000100:00100000:3.0:1763343270.059860:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412904448:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343270.059877:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343270.059912:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343270.059916:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412904320:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343270.059931:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343270.059943:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412904448 00000100:00100000:3.0:1763343270.059946:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412904448 00000100:00100000:3.0:1763343270.059958:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412904320 00000100:00100000:3.0:1763343270.059960:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412904320 00000100:00100000:3.0:1763343270.059968:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6816 00000100:00100000:3.0:1763343270.059972:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+16:3662:x1848998412904448:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763343270.059981:0:8626:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:642 count 1 00010000:00010000:3.0:1763343270.059993:0:8626:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c4515600/0x9104b1ba7709ffe3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x282:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.060004:0:8626:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba7709fe15 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4845c expref: 15 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343270.060010:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343270.060012:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343270.060014:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c4515600/0x9104b1ba7709ffe3 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.060056:0:8626:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba7709fe15 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4845c expref: 15 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343270.060066:0:8626:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba7709fe15 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4845c expref: 15 pid: 8414 timeout: 1163 lvb_type: 1 00000100:00100000:3.0:1763343270.060077:0:8626:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998412904960:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343270.060101:0:8626:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c7e54900 going to sleep for 11 seconds 00000100:00100000:3.0:1763343270.060119:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6817 00000100:00100000:3.0:1763343270.060126:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+16:3662:x1848998412904320:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763343270.060137:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:641 count 1 00010000:00010000:3.0:1763343270.060149:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c4514a00/0x9104b1ba7709ffea lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x281:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.060160:0:8413:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba7709fe70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48486 expref: 15 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.060167:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343270.060168:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343270.060171:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c4514a00/0x9104b1ba7709ffea lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.060188:0:8413:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba7709fe70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48486 expref: 15 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.060197:0:8413:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba7709fe70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48486 expref: 15 pid: 28562 timeout: 1163 lvb_type: 0 00000100:00100000:3.0:1763343270.060206:0:8413:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8413:1848998412905088:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343270.060227:0:8413:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401d84deb40 going to sleep for 11 seconds 00000100:00100000:3.0:1763343270.060277:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.067491:0:8414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1848998412904832:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343270.067512:0:8414:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709ffdc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x280:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343270.067542:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998412904960:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343270.067555:0:8626:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c4515600/0x9104b1ba7709ffe3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.069916:0:8414:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709ffdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.069932:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709ffdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.069942:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709ffdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.069950:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ba00/0x9104b1ba7709ffdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.069966:0:8414:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763343270.071615:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+70:3662:x1848998412903808:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12439us (13000us total) trans 21474839013 rc 0/0 00000100:00100000:3.0:1763343270.071633:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6811 00000004:00080000:3.0:1763343270.071694:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400cc5ddf80/2, rc 0, transno 17179871742 00000100:00100000:3.0:1763343270.071701:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412904320:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1763343270.071712:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400cc5dd500/2, rc 0, transno 17179871743 00000100:00100000:3.0:1763343270.071715:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412904448:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1763343270.071728:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c8bc0380/2, rc 0, transno 21474839013 00000100:00100000:3.0:1763343270.071732:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c8bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412903808:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343270.074389:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399639936 00000100:00100000:3.0:1763343270.074399:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399639936 00010000:00010000:3.0:1763343270.074439:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba7709fe0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48463 expref: 38 pid: 28562 timeout: 1163 lvb_type: 1 00000100:00100000:3.0:1763343270.074482:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3273 00000100:00100000:3.0:1763343270.074493:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6507b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+38:2408:x1848998399639936:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343270.074507:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343270.074857:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba7709fe0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x281:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48463 expref: 38 pid: 28562 timeout: 1163 lvb_type: 1 00010000:00010000:3.0:1763343270.074874:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba7709fe0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x281:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48463 expref: 38 pid: 28562 timeout: 1163 lvb_type: 1 00010000:00010000:3.0:1763343270.074898:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba7709fe0e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x281:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48463 expref: 38 pid: 28562 timeout: 1163 lvb_type: 1 00010000:00010000:3.0:1763343270.074912:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343270.074916:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343270.074922:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c3917e00/0x9104b1ba770a0014 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.074937:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3917e00/0x9104b1ba770a0014 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.074963:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343270.074991:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6507b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+37:2408:x1848998399639936:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 499us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343270.074998:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3273 00000100:00100000:3.0:1763343270.086199:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.086260:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.092193:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.101984:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399641216 00000100:00100000:3.0:1763343270.101996:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399641216 00000100:00100000:3.0:1763343270.102797:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10101 00000100:00100000:3.0:1763343270.102809:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+272:57019:x1848998399641216:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:3.0:1763343270.102876:0:6526:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763343270.102905:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba7709ffd5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1db:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b484f6 expref: 272 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.102928:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0006 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1db:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b484fd expref: 271 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.102940:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916400/0x9104b1ba7709ff9d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1db:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b484e8 expref: 270 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.102951:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1db:0x0].0x0 (ffff9401edc53500) 00010000:00010000:3.0:1763343270.102960:0:6526:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343270.102985:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a0029 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343270.102997:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a0029 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.103006:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a0029 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.103017:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514c00/0x9104b1ba770a0030 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343270.104818:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514c00/0x9104b1ba770a0030 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.104841:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514c00/0x9104b1ba770a0030 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.105967:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a004c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343270.105988:0:6526:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a003e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1db:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48512 expref: 270 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.105997:0:6526:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a004c lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1db:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.106782:0:6526:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a003e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1db:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48512 expref: 271 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.106799:0:6526:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a003e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1db:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48512 expref: 271 pid: 9827 timeout: 1163 lvb_type: 0 00000100:00100000:3.0:1763343270.106815:0:6526:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b2c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6526:1848998412905600:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343270.107265:0:6526:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401d84deb40 going to sleep for 11 seconds 00010000:00010000:3.0:1763343270.117308:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343270.117320:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a0061 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343270.117329:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a6800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343270.117333:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a0061 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343270.117341:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a0061 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343270.117369:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1db:0x0].0x0 (ffff9401edc53000) 00010000:00010000:3.0:1763343270.117372:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343270.117377:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a0061 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343270.117383:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a0061 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343270.117398:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343270.117400:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343270.117402:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343270.122625:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.136956:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.151639:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.173723:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.192756:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399643264 00000100:00100000:3.0:1763343270.192768:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399643264 00000100:00100000:3.0:1763343270.192832:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10112 00000100:00100000:3.0:1763343270.192843:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+276:57020:x1848998399643264:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343270.192870:0:6526:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343270.192891:0:6526:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a0117 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48558 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.193003:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a011e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343270.193018:0:6526:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0109 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1dc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48551 expref: 277 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.193047:0:6526:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a011e lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.193080:0:6526:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0109 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1dc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48551 expref: 277 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.193093:0:6526:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0109 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1dc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48551 expref: 277 pid: 9827 timeout: 1163 lvb_type: 0 00000100:00100000:3.0:1763343270.193107:0:6526:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b2d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6526:1848998412905728:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343270.193200:0:6526:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401d84deb40 going to sleep for 11 seconds 00000100:00100000:3.0:1763343270.194892:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.196183:0:6526:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6526:1848998412905728:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343270.196209:0:6526:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a011e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00000100:00100000:3.0:1763343270.199306:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.205616:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:3.0:1763343270.206064:0:6526:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a011e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.206073:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a011e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00000004:00200000:3.0:1763343270.206096:0:6526:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1dc:0x0]: returning size 0 00000004:00080000:3.0:1763343270.207494:0:6526:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x284:0x0], index 0: 0 00000004:00080000:3.0:1763343270.207503:0:6526:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x285:0x0], index 1: 0 00000004:00080000:3.0:1763343270.207507:0:6526:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x286:0x0], index 1: 0 00000004:00080000:3.0:1763343270.207511:0:6526:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x285:0x0], index 0: 0 00010000:00010000:3.0:1763343270.207607:0:6526:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a011e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.207616:0:6526:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a011e lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.207622:0:6526:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a011e lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.207627:0:6526:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fd2df600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343270.207631:0:6526:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a011e lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.207637:0:6526:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a011e lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.207648:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1dc:0x0].0x0 (ffff9401edc53100) 00010000:00010000:3.0:1763343270.207651:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343270.207654:0:6526:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a011e lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.207659:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a011e lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.207709:0:6526:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a0117 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1dc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48558 expref: 279 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.207718:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1dc:0x0].0x0 (ffff9401edc53100) 00010000:00010000:3.0:1763343270.207720:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343270.207723:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a0117 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1dc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48558 expref: 279 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.207736:0:6526:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fd2dea00, rc 0) 00000100:00100000:3.0:1763343270.207787:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:57020:x1848998399643264:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 14946us (15149us total) trans 4294973113 rc 301/301 00000100:00100000:3.0:1763343270.207796:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10112 00000100:00100000:3.0:1763343270.207819:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399644160 00000100:00100000:3.0:1763343270.207825:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399644160 00000100:00100000:3.0:1763343270.214221:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399644288 00000100:00100000:3.0:1763343270.214232:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399644288 00000100:00100000:3.0:1763343270.214275:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399644416 00000100:00100000:3.0:1763343270.214278:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399644416 00000100:00100000:3.0:1763343270.214300:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6820 00000100:00100000:3.0:1763343270.214309:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998399644288:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343270.214330:0:35281:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343270.214365:0:35281:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a0164 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4856d expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343270.214388:0:35281:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x286:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343270.214407:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343270.214409:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343270.214418:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a0164 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4856d expref: 16 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343270.214434:0:35281:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a0164 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4856d expref: 16 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343270.214446:0:35281:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fd2dfa00, rc 0) 00000100:00100000:3.0:1763343270.214509:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399644288:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 201us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343270.214516:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6820 00000100:00100000:3.0:1763343270.214534:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6821 00000100:00100000:3.0:1763343270.214540:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+39:2408:x1848998399644416:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343270.214549:0:35281:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343270.214560:0:35281:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c4514400/0x9104b1ba770a016b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48574 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343270.214574:0:35281:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x285:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343270.214584:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343270.214591:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343270.214595:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c4514400/0x9104b1ba770a016b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48574 expref: 40 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343270.214616:0:35281:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c4514400/0x9104b1ba770a016b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48574 expref: 40 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343270.214625:0:35281:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4514400, rc 0) 00000100:00100000:3.0:1763343270.214644:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+40:2408:x1848998399644416:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 105us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343270.214650:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6821 00000100:00100000:3.0:1763343270.221694:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399644928 00000100:00100000:3.0:1763343270.221703:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399644928 00000100:00100000:3.0:1763343270.221750:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399645184 00000100:00100000:3.0:1763343270.221752:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399645184 00000100:00100000:3.0:1763343270.221765:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3541 00000100:00100000:3.0:1763343270.221773:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82d5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57020:x1848998399644928:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343270.221958:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82d5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57020:x1848998399644928:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 185us (385us total) trans 4294973116 rc 0/0 00000100:00100000:3.0:1763343270.221965:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3541 00000100:00100000:3.0:1763343270.222012:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3542 00000100:00100000:3.0:1763343270.222019:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57024:x1848998399645184:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343270.222117:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57024:x1848998399645184:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 97us (487us total) trans 4294973117 rc 0/0 00000100:00100000:3.0:1763343270.222123:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3542 00000100:00100000:3.0:1763343270.227634:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.228187:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.236491:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399645824 00000100:00100000:3.0:1763343270.236496:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399645824 00000100:00100000:3.0:1763343270.236535:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 445 00000100:00100000:3.0:1763343270.236543:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:2409:x1848998399645824:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343270.236553:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343270.236579:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a018e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1dc:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4857b expref: 287 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.236602:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1dc:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:3.0:1763343270.236607:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343270.236628:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:2409:x1848998399645824:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 87us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343270.236634:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 445 00000100:00100000:3.0:1763343270.240650:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.249637:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.254268:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399646592 00000100:00100000:3.0:1763343270.254279:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399646592 00000001:00080000:3.0:1763343270.281558:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973125 is committed 00000004:00080000:3.0:1763343270.281575:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1016 committed 00000004:00080000:3.0:1763343270.281595:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1024 committed 00000004:00080000:3.0:1763343270.281608:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1023 committed 00000004:00080000:3.0:1763343270.281610:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1015 committed 00000100:00100000:3.0:1763343270.291826:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.303381:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.304183:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.304838:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.311085:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.319636:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.321732:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.326566:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.332489:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399650432 00000100:00100000:3.0:1763343270.332500:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399650432 00000100:00100000:3.0:1763343270.332559:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3550 00000100:00100000:3.0:1763343270.332571:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+274:57025:x1848998399650432:12345-192.168.201.40@tcp:35:lfs.0 00000004:00010000:3.0:1763343270.332644:0:19639:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x1dc:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a0283 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1dc:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b485c8 expref: 274 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.332684:0:19639:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a0291 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19639 initiator: MDT0 00010000:00010000:3.0:1763343270.332696:0:19639:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a0291 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1dc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343270.332705:0:19639:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a0291 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1dc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00000004:00020000:3.0:1763343270.332837:0:19639:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0001-mdtlov: can not set all stale mirrors for [0x240000404:0x1dc:0x0]: rc = -1 00010000:00010000:3.0:1763343270.332865:0:19639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a0291 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1dc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343270.332872:0:19639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a0291 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1dc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343270.332878:0:19639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a0291 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1dc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343270.333776:0:19639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4515600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343270.333781:0:19639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a0291 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1dc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343270.333789:0:19639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a0291 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1dc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343270.333802:0:19639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1dc:0x0].0x0 (ffff9400ccadba00) 00010000:00010000:3.0:1763343270.333805:0:19639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1763343270.333810:0:19639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a0291 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1dc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343270.333816:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a0291 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1dc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343270.333829:0:19639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1dc:0x0].0x0 (ffff9400ccadba00) 00010000:00010000:3.0:1763343270.333831:0:19639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763343270.333838:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a0283 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1dc:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b485c8 expref: 274 pid: 9827 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343270.338823:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.344678:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.344772:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.351328:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.366483:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.378719:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399652096 00000100:00100000:3.0:1763343270.378725:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399652096 00010000:00010000:3.0:1763343270.378762:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a0308 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b485f2 expref: 281 pid: 6525 timeout: 1163 lvb_type: 0 00000100:00100000:3.0:1763343270.378966:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3279 00000100:00100000:3.0:1763343270.378977:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4789180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:2407:x1848998399652096:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343270.378993:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343270.379000:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a0308 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b485f2 expref: 281 pid: 6525 timeout: 1163 lvb_type: 0 00010000:00010000:3.0:1763343270.379013:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a0308 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b485f2 expref: 281 pid: 6525 timeout: 1163 lvb_type: 0 00010000:00010000:3.0:1763343270.379400:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a0308 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b485f2 expref: 281 pid: 6525 timeout: 1163 lvb_type: 0 00010000:00010000:3.0:1763343270.379424:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1dd:0x0].0x0 (ffff9400c48a8800) 00010000:00010000:3.0:1763343270.379430:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a031d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343270.379439:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a031d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343270.379446:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a031d lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00000100:00100000:3.0:1763343270.391597:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.391642:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.391677:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399652608 00000100:00100000:3.0:1763343270.391688:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399652608 00000100:00100000:3.0:1763343270.398161:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3552 00000100:00100000:3.0:1763343270.398192:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+279:57027:x1848998399652608:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343270.398547:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57027:x1848998399652608:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 369us (6901us total) trans 4294973136 rc 0/0 00000100:00100000:3.0:1763343270.398556:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3552 00000100:00100000:3.0:1763343270.405589:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.409920:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399652992 00000100:00100000:3.0:1763343270.409929:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399652992 00000100:00100000:3.0:1763343270.410017:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6833 00000100:00100000:3.0:1763343270.410049:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+41:2408:x1848998399652992:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343270.410066:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343270.410090:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c4515600/0x9104b1ba770a034e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48607 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343270.410132:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x287:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343270.410152:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343270.410156:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343270.410168:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c4515600/0x9104b1ba770a034e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48607 expref: 42 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343270.410197:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c4515600/0x9104b1ba770a034e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48607 expref: 42 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343270.410221:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4515600, rc 0) 00000100:00100000:3.0:1763343270.410562:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+42:2408:x1848998399652992:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 513us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343270.410569:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6833 00000100:00100000:3.0:1763343270.420085:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399653376 00000100:00100000:3.0:1763343270.420096:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399653376 00000100:00100000:3.0:1763343270.420301:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399653504 00000100:00100000:3.0:1763343270.420307:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399653504 00000100:00100000:3.0:1763343270.420373:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10134 00000100:00100000:3.0:1763343270.420384:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57029:x1848998399653504:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343270.420412:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343270.420433:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a035c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4861c expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.420488:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a035c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4861c expref: 285 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.420503:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a035c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4861c expref: 285 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.420521:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1dd:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:3.0:1763343270.420525:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343270.420528:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4514200, rc 0) 00000100:00100000:3.0:1763343270.420588:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57029:x1848998399653504:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 206us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343270.420596:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10134 00000100:00100000:3.0:1763343270.427013:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399653760 00000100:00100000:3.0:1763343270.427437:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399653760 00000100:00100000:3.0:1763343270.427749:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3554 00000100:00100000:3.0:1763343270.427762:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57029:x1848998399653760:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343270.436937:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.443553:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.446445:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.449629:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399655040 00000100:00100000:3.0:1763343270.449635:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399655040 00010000:00010000:3.0:1763343270.449668:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0000/0x9104b1ba770a03a2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4862a expref: 293 pid: 6525 timeout: 1163 lvb_type: 0 00000100:00100000:3.0:1763343270.449694:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3280 00000100:00100000:3.0:1763343270.449702:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7e38c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:2407:x1848998399655040:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343270.449714:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343270.449720:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0000/0x9104b1ba770a03a2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4862a expref: 293 pid: 6525 timeout: 1163 lvb_type: 0 00010000:00010000:3.0:1763343270.449731:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0000/0x9104b1ba770a03a2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4862a expref: 293 pid: 6525 timeout: 1163 lvb_type: 0 00010000:00010000:3.0:1763343270.449753:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0000/0x9104b1ba770a03a2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4862a expref: 293 pid: 6525 timeout: 1163 lvb_type: 0 00010000:00010000:3.0:1763343270.449766:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1dd:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:3.0:1763343270.449771:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a03b7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1dd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.449780:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a03b7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1dd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.449787:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a03b7 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1dd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.449803:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343270.453426:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7e38c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:2407:x1848998399655040:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 3712us (3860us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343270.453442:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3280 00000100:00100000:3.0:1763343270.459393:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399655552 00000100:00100000:3.0:1763343270.459405:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399655552 00000100:00100000:3.0:1763343270.459465:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3556 00000100:00100000:3.0:1763343270.459476:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57029:x1848998399655552:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343270.459692:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57029:x1848998399655552:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 217us (865us total) trans 4294973147 rc 0/0 00000100:00100000:3.0:1763343270.459699:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3556 00000100:00100000:3.0:1763343270.463353:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412908672:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343270.463392:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343270.463417:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343270.463423:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412908544:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343270.463442:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343270.463465:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412908672 00000100:00100000:3.0:1763343270.463470:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412908672 00000100:00100000:3.0:1763343270.463496:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412908544 00000100:00100000:3.0:1763343270.463499:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412908544 00000100:00100000:3.0:1763343270.463516:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6839 00000100:00100000:3.0:1763343270.463522:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+75:3660:x1848998412908672:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763343270.466480:0:35266:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x287:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343270.466488:0:35266:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x287:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343270.466490:0:35266:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x287:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343270.466492:0:35266:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x287:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343270.466494:0:35266:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x287:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343270.466565:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+78:3660:x1848998412908672:12345-0@lo:2:osp-syn-0-1.0 Request processed in 3039us (3170us total) trans 21474839022 rc 0/0 00000100:00100000:3.0:1763343270.466577:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6839 00000004:00080000:3.0:1763343270.466656:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b18700/2, rc 0, transno 21474839021 00000100:00100000:3.0:1763343270.466662:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412908544:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763343270.466671:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b18000/2, rc 0, transno 21474839022 00000100:00100000:3.0:1763343270.466674:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412908672:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343270.468575:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.468825:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.468862:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.468889:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399655936 00000100:00100000:3.0:1763343270.468894:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399655936 00010000:00010000:3.0:1763343270.468918:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a0164 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x286:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4856d expref: 19 pid: 35281 timeout: 1163 lvb_type: 1 00000100:00100000:3.0:1763343270.469272:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3282 00000100:00100000:3.0:1763343270.469281:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998399655936:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343270.469290:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343270.469296:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a0164 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x286:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4856d expref: 18 pid: 35281 timeout: 1163 lvb_type: 1 00010000:00010000:3.0:1763343270.469306:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a0164 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x286:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4856d expref: 18 pid: 35281 timeout: 1163 lvb_type: 1 00010000:00010000:3.0:1763343270.469319:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343270.469321:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343270.469324:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a03e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x286:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.469332:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a03e8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x286:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.469357:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343270.470270:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399655936:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 989us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343270.470279:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3282 00000100:00100000:3.0:1763343270.470353:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.470382:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399656064 00000100:00100000:3.0:1763343270.470388:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399656064 00010000:00010000:3.0:1763343270.470411:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c85abe00/0x9104b1ba770a022f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x284:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b485ac expref: 42 pid: 8626 timeout: 1163 lvb_type: 0 00000100:00100000:3.0:1763343270.470443:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3283 00000100:00100000:3.0:1763343270.470452:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+42:2410:x1848998399656064:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343270.470463:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343270.470468:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c85abe00/0x9104b1ba770a022f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x284:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b485ac expref: 42 pid: 8626 timeout: 1163 lvb_type: 0 00010000:00010000:3.0:1763343270.470479:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c85abe00/0x9104b1ba770a022f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x284:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b485ac expref: 42 pid: 8626 timeout: 1163 lvb_type: 0 00010000:00010000:3.0:1763343270.470495:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c85abe00/0x9104b1ba770a022f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x284:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b485ac expref: 42 pid: 8626 timeout: 1163 lvb_type: 0 00010000:00010000:3.0:1763343270.470505:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343270.470507:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343270.470510:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a03ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x284:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.470518:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a03ef lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x284:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.470545:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343270.470573:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+41:2410:x1848998399656064:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 123us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343270.470580:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3283 00000100:00100000:3.0:1763343270.470675:0:8414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c3728700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1848998412908928:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343270.470692:0:8414:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c3916400/0x9104b1ba770a03f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x285:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343270.470739:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.470757:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399656192 00000100:00100000:3.0:1763343270.470761:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399656192 00010000:00010000:3.0:1763343270.470778:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c4514400/0x9104b1ba770a016b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x285:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48574 expref: 41 pid: 35281 timeout: 1163 lvb_type: 1 00000100:00100000:3.0:1763343270.470818:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3284 00000100:00100000:3.0:1763343270.470828:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+41:2408:x1848998399656192:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343270.470838:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343270.470847:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c4514400/0x9104b1ba770a016b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x285:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48574 expref: 41 pid: 35281 timeout: 1163 lvb_type: 1 00010000:00010000:3.0:1763343270.470863:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c4514400/0x9104b1ba770a016b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x285:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48574 expref: 41 pid: 35281 timeout: 1163 lvb_type: 1 00010000:00010000:3.0:1763343270.470878:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c4514400/0x9104b1ba770a016b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x285:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48574 expref: 41 pid: 35281 timeout: 1163 lvb_type: 1 00010000:00010000:3.0:1763343270.470895:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343270.470899:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343270.470905:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c3916400/0x9104b1ba770a03f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x285:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.470920:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3916400/0x9104b1ba770a03f6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x285:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.470944:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343270.470967:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+40:2408:x1848998399656192:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 141us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343270.470977:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3284 00010000:00010000:3.0:1763343270.471002:0:8414:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c3916400/0x9104b1ba770a03f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.471012:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c3916400/0x9104b1ba770a03f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.471045:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c3916400/0x9104b1ba770a03f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.471053:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3916400/0x9104b1ba770a03f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.471081:0:8414:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000100:00100000:3.0:1763343270.471237:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+78:3661:x1848998412908416:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7277us (7540us total) trans 21474839023 rc 0/0 00000100:00100000:3.0:1763343270.471246:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6842 00010000:00010000:3.0:1763343270.471269:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343270.471310:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.471325:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399656320 00000100:00100000:3.0:1763343270.471328:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399656320 00000100:00100000:3.0:1763343270.471371:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6843 00000100:00100000:3.0:1763343270.471383:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:55884:x1848998399656320:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343270.471404:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343270.471421:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a03fd lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4863f expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343270.471445:0:8414:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x287:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343270.471459:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343270.471461:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343270.471468:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a03fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4863f expref: 17 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.471482:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a03fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4863f expref: 17 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.471492:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4514200, rc 0) 00000100:00100000:3.0:1763343270.471515:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:55884:x1848998399656320:12345-192.168.201.40@tcp:101:bash.0 Request processed in 135us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343270.471522:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6843 00000100:00100000:3.0:1763343270.479588:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.482598:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1650 00000100:00100000:3.0:1763343270.487674:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399656960 00000100:00100000:3.0:1763343270.487695:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399656960 00000100:00100000:3.0:1763343270.487757:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3558 00000100:00100000:3.0:1763343270.487767:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+271:55884:x1848998399656960:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:3.0:1763343270.488136:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+272:55884:x1848998399656960:12345-192.168.201.40@tcp:35:bash.0 Request processed in 368us (1326us total) trans 4294973148 rc 0/0 00000100:00100000:3.0:1763343270.488144:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3558 00000100:00100000:3.0:1763343270.499326:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399657472 00000100:00100000:3.0:1763343270.499348:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399657472 00000100:00100000:3.0:1763343270.499421:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3559 00000100:00100000:3.0:1763343270.499431:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+274:57030:x1848998399657472:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343270.499741:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+274:57030:x1848998399657472:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 308us (661us total) trans 4294973150 rc 0/0 00000100:00100000:3.0:1763343270.499757:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3559 00000100:00100000:3.0:1763343270.517981:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.531451:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10146 00000100:00100000:3.0:1763343270.531464:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+275:57033:x1848998399658368:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343270.531485:0:6526:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343270.531512:0:6526:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a0489 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48669 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.531598:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a0490 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343270.531613:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a0490 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.531626:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a0490 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.531638:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514c00/0x9104b1ba770a0497 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343270.531644:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514c00/0x9104b1ba770a0497 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.531651:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514c00/0x9104b1ba770a0497 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.531691:0:6526:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a0490 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.531699:0:6526:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a0490 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.531705:0:6526:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a0490 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.531711:0:6526:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a0490 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.531718:0:6526:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343270.531722:0:6526:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a0490 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.531728:0:6526:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a0490 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.531740:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488bc00) 00010000:00010000:3.0:1763343270.531744:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343270.531748:0:6526:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a0490 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.531755:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a0490 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.531767:0:6526:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514c00/0x9104b1ba770a0497 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.531773:0:6526:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514c00/0x9104b1ba770a0497 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.531777:0:6526:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514c00/0x9104b1ba770a0497 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.531782:0:6526:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343270.531785:0:6526:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514c00/0x9104b1ba770a0497 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.531791:0:6526:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514c00/0x9104b1ba770a0497 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.531797:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadb200) 00010000:00010000:3.0:1763343270.531799:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343270.531802:0:6526:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514c00/0x9104b1ba770a0497 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.531808:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514c00/0x9104b1ba770a0497 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.531834:0:6526:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a0489 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48669 expref: 276 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.531844:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488bc00) 00010000:00010000:3.0:1763343270.531846:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343270.531849:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a0489 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48669 expref: 276 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.531861:0:6526:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4514400, rc 0) 00000100:00100000:3.0:1763343270.531914:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+275:57033:x1848998399658368:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 452us (1625us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343270.531920:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10146 00000100:00100000:3.0:1763343270.531940:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10147 00000100:00100000:3.0:1763343270.531946:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+274:57032:x1848998399658496:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343270.531954:0:6526:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343270.531964:0:6526:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a049e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48670 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.531995:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a04a5 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343270.532002:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a04a5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.532009:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a04a5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00000004:00200000:3.0:1763343270.532064:0:6526:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763343270.532069:0:6526:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1763343270.532095:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a049e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48670 expref: 276 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.532108:0:6526:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a04a5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48670 expref: 275 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.532115:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b400) 00010000:00010000:3.0:1763343270.532117:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763343270.532119:0:6526:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d1e9ea00, rc 0) 00000100:00100000:3.0:1763343270.532139:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+275:57032:x1848998399658496:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 193us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343270.532146:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10147 00000100:00100000:3.0:1763343270.545247:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399659008 00000100:00100000:3.0:1763343270.545263:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399659008 00000100:00100000:3.0:1763343270.546124:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10149 00000100:00100000:3.0:1763343270.546140:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+277:57032:x1848998399659008:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343270.546166:0:6526:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343270.546189:0:6526:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a04cf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1de:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4867e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.546508:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a04d6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1de:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343270.546524:0:6526:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a04c1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1de:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48677 expref: 278 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.546533:0:6526:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a04d6 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1de:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.546567:0:6526:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a04c1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1de:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48677 expref: 278 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.546579:0:6526:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a04c1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1de:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48677 expref: 278 pid: 6525 timeout: 1163 lvb_type: 0 00000100:00100000:3.0:1763343270.546591:0:6526:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c791a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6526:1848998412909056:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343270.547113:0:6526:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c926ac00 going to sleep for 11 seconds 00010000:00010000:3.0:1763343270.550737:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a04c1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1de:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48677 expref: 278 pid: 6525 timeout: 1163 lvb_type: 0 00000100:00100000:3.0:1763343270.550761:0:6526:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c791a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6526:1848998412909056:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343270.550787:0:6526:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a04d6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1de:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.550801:0:6526:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a04d6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1de:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.550807:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a04d6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1de:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 00000004:00200000:3.0:1763343270.550837:0:6526:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1de:0x0]: returning size 0 00000004:00080000:3.0:1763343270.551078:0:6526:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x288:0x0], index 0: 0 00000004:00080000:3.0:1763343270.551087:0:6526:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x289:0x0], index 1: 0 00000004:00080000:3.0:1763343270.551093:0:6526:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x28a:0x0], index 1: 0 00000004:00080000:3.0:1763343270.551096:0:6526:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x289:0x0], index 0: 0 00010000:00010000:3.0:1763343270.551210:0:6526:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a04d6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1de:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.551218:0:6526:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a04d6 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1de:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.551224:0:6526:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a04d6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1de:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.551230:0:6526:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343270.551234:0:6526:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a04d6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1de:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.551242:0:6526:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a04d6 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1de:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.551253:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1de:0x0].0x0 (ffff9401c7da4200) 00010000:00010000:3.0:1763343270.551256:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343270.551260:0:6526:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a04d6 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1de:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.551269:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a04d6 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1de:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT1 00010000:00010000:3.0:1763343270.551328:0:6526:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a04cf lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1de:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4867e expref: 278 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.551349:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1de:0x0].0x0 (ffff9401c7da4200) 00010000:00010000:3.0:1763343270.551352:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343270.551356:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a04cf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1de:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4867e expref: 278 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.551371:0:6526:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d1e9ec00, rc 0) 00000100:00100000:3.0:1763343270.551416:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+277:57032:x1848998399659008:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 5282us (7815us total) trans 4294973153 rc 301/301 00000100:00100000:3.0:1763343270.551423:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10149 00000100:00100000:3.0:1763343270.555856:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.564797:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399659904 00000100:00100000:3.0:1763343270.564804:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399659904 00000100:00100000:3.0:1763343270.564845:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3561 00000100:00100000:3.0:1763343270.564858:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57032:x1848998399659904:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343270.565086:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57032:x1848998399659904:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 231us (706us total) trans 4294973156 rc 0/0 00000100:00100000:3.0:1763343270.565094:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3561 00000100:00100000:3.0:1763343270.570130:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.574818:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399660928 00000100:00100000:3.0:1763343270.574828:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399660928 00000100:00100000:3.0:1763343270.575056:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10152 00000100:00100000:3.0:1763343270.575069:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5179180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57034:x1848998399660928:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343270.575093:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1763343270.603658:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.610420:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.610466:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.620850:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.620903:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.631667:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c7ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412909824:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343270.631706:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343270.631732:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343270.631740:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412909696:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343270.631766:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343270.631791:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412909824 00000100:00100000:3.0:1763343270.631797:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412909824 00000100:00100000:3.0:1763343270.631824:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412909696 00000100:00100000:3.0:1763343270.631828:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412909696 00000100:00100000:3.0:1763343270.631849:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6848 00000100:00100000:3.0:1763343270.631858:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+28:3662:x1848998412909440:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763343270.631876:0:8412:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:647 count 1 00010000:00010000:3.0:1763343270.631894:0:8412:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a05af lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.631910:0:8412:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a03fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4863f expref: 18 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.631918:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343270.631920:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343270.631923:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a05af lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.631948:0:8412:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a03fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4863f expref: 18 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.631963:0:8412:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a03fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4863f expref: 18 pid: 8414 timeout: 1163 lvb_type: 0 00000100:00100000:3.0:1763343270.631977:0:8412:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7919f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8412:1848998412910080:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343270.632001:0:8412:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c926ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1763343270.632018:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6850 00000100:00100000:3.0:1763343270.632051:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+28:3660:x1848998412909696:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343270.632170:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+29:3660:x1848998412909696:12345-0@lo:2:osp-syn-1-1.0 Request processed in 144us (402us total) trans 17179871755 rc 0/0 00000100:00100000:3.0:1763343270.632177:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6850 00000004:00080000:3.0:1763343270.632224:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b2df80/2, rc 0, transno 17179871755 00000100:00100000:3.0:1763343270.632231:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412909696:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343270.632311:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412910592:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343270.632335:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343270.632365:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343270.632370:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c791b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412910464:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343270.632391:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343270.632411:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412910592 00000100:00100000:3.0:1763343270.632415:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412910592 00000100:00100000:3.0:1763343270.632442:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412910464 00000100:00100000:3.0:1763343270.632445:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412910464 00000100:00100000:3.0:1763343270.632469:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6851 00000100:00100000:3.0:1763343270.632478:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+79:3660:x1848998412910592:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763343270.632553:0:27798:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x289:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343270.632557:0:27798:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x289:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343270.632559:0:27798:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x289:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343270.632561:0:27798:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x289:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343270.632564:0:27798:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x289:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343270.632592:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+81:3660:x1848998412910592:12345-0@lo:2:osp-syn-0-1.0 Request processed in 116us (255us total) trans 21474839026 rc 0/0 00000100:00100000:3.0:1763343270.632600:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6851 00000004:00080000:3.0:1763343270.632640:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c791b800/2, rc 0, transno 21474839027 00000100:00100000:3.0:1763343270.632647:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c791b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412910464:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763343270.632656:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c7918e00/2, rc 0, transno 21474839026 00000100:00100000:3.0:1763343270.632660:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412910592:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763343270.632668:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c7ef6300/2, rc 0, transno 17179871756 00000100:00100000:3.0:1763343270.632672:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c7ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412909824:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343270.632685:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c791a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412910336:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343270.632706:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343270.632730:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343270.632735:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412910208:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343270.632754:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343270.632773:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412910336 00000100:00100000:3.0:1763343270.632776:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412910336 00000100:00100000:3.0:1763343270.632792:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412910208 00000100:00100000:3.0:1763343270.632794:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412910208 00000100:00100000:3.0:1763343270.632809:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6853 00000100:00100000:3.0:1763343270.632815:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+81:3662:x1848998412910336:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343270.632827:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:647 count 1 00010000:00010000:3.0:1763343270.632838:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a05b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x287:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.632850:0:8413:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c4515600/0x9104b1ba770a034e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48607 expref: 42 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343270.632857:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343270.632859:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343270.632862:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a05b6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.632882:0:8413:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c4515600/0x9104b1ba770a034e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48607 expref: 42 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343270.632892:0:8413:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c4515600/0x9104b1ba770a034e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48607 expref: 42 pid: 35266 timeout: 1163 lvb_type: 1 00000100:00100000:3.0:1763343270.632903:0:8413:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dcb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412910720:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343270.632933:0:8413:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c4df1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1763343270.632947:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6854 00000100:00100000:3.0:1763343270.632954:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+81:3662:x1848998412910208:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343270.632966:0:35281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:646 count 1 00010000:00010000:3.0:1763343270.632976:0:35281:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c4514400/0x9104b1ba770a05bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x286:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.632992:0:35281:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a0404 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48646 expref: 42 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.632999:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343270.633001:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343270.633004:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c4514400/0x9104b1ba770a05bd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x286:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.633044:0:35281:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a0404 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48646 expref: 42 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.633055:0:35281:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a0404 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48646 expref: 42 pid: 8413 timeout: 1163 lvb_type: 0 00000100:00100000:3.0:1763343270.633065:0:35281:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35281:1848998412910848:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343270.633087:0:35281:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c845af00 going to sleep for 11 seconds 00000100:00100000:3.0:1763343270.644497:0:8412:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7919f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8412:1848998412910080:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343270.644517:0:8412:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a05af lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343270.644546:0:35281:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35281:1848998412910848:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343270.644558:0:35281:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c4514400/0x9104b1ba770a05bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x286:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343270.644581:0:8413:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dcb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412910720:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343270.645091:0:8413:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a05b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.645496:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343270.645502:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a05a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.645510:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85ab400 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343270.645515:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a05a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.645523:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a05a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.645536:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a05a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.645543:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a05a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.645560:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343270.645561:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343270.645563:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343270.645648:0:8413:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a05b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.645656:0:8413:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a05b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.645667:0:8413:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a05b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.645674:0:8413:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a05b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.645689:0:8413:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343270.646771:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+82:3662:x1848998412910336:12345-0@lo:6:osp-syn-0-1.0 Request processed in 13954us (14062us total) trans 21474839028 rc 0/0 00000100:00100000:3.0:1763343270.646777:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6853 00010000:00010000:3.0:1763343270.646798:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343270.646804:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a05b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.646813:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ea00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343270.646816:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a05b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.646824:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a05b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.646836:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a05b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.646842:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a05b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.646861:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343270.646863:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343270.646865:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343270.646875:0:35281:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c4514400/0x9104b1ba770a05bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.646882:0:35281:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c4514400/0x9104b1ba770a05bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.646888:0:35281:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c4514400/0x9104b1ba770a05bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.646894:0:35281:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c4514400/0x9104b1ba770a05bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.646910:0:35281:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343270.647038:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+82:3662:x1848998412910208:12345-0@lo:6:osp-syn-0-1.0 Request processed in 14067us (14265us total) trans 21474839029 rc 0/0 00000100:00100000:3.0:1763343270.647045:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6854 00010000:00010000:3.0:1763343270.647062:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343270.647067:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c4514400/0x9104b1ba770a05bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.647074:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514400 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343270.647077:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c4514400/0x9104b1ba770a05bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.647087:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c4514400/0x9104b1ba770a05bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.647097:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c4514400/0x9104b1ba770a05bd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.647104:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c4514400/0x9104b1ba770a05bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.647117:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343270.647119:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343270.647120:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343270.647154:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c7918380/2, rc 0, transno 21474839029 00000100:00100000:3.0:1763343270.647161:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412910208:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1763343270.647171:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c791a680/2, rc 0, transno 21474839028 00000100:00100000:3.0:1763343270.647174:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c791a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412910336:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1763343270.647187:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c39b4000/2, rc 0, transno 17179871757 00000100:00100000:3.0:1763343270.647191:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c39b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412909568:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763343270.648799:0:8412:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a05af lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.648808:0:8412:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a05af lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.648817:0:8412:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a05af lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.648833:0:8412:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a05af lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.648851:0:8412:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343270.649068:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+29:3662:x1848998412909440:12345-0@lo:6:osp-syn-1-1.0 Request processed in 17210us (17452us total) trans 17179871758 rc 0/0 00000100:00100000:3.0:1763343270.649076:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6848 00010000:00010000:3.0:1763343270.649100:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343270.649106:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a05af lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.649114:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ec00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343270.649118:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a05af lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.649127:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a05af lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.649142:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a05af lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.649149:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a05af lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.649168:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343270.649170:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343270.649173:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343270.649201:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c39b7b80/2, rc 0, transno 17179871758 00000100:00100000:3.0:1763343270.649207:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c39b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412909440:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763343270.651199:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343270.672700:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.695457:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:3.0:1763343270.696456:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343270.696464:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a0634 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1de:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343270.696472:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3916200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343270.696475:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a0634 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1de:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343270.696483:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a0634 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1de:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343270.696496:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1de:0x0].0x0 (ffff9400ccadb000) 00010000:00010000:3.0:1763343270.696499:0:7451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343270.696504:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a0634 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1de:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343270.696509:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a0634 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1de:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343270.696520:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343270.696522:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343270.696524:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343270.711163:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.716715:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.741315:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399667584 00000100:00100000:3.0:1763343270.741328:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399667584 00000100:00100000:3.0:1763343270.741401:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3569 00000100:00100000:3.0:1763343270.741412:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82d4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+279:57038:x1848998399667584:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343270.741829:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82d4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57038:x1848998399667584:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 417us (1239us total) trans 4294973175 rc 0/0 00000100:00100000:3.0:1763343270.741838:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3569 00000100:00100000:3.0:1763343270.745719:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.745891:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399668096 00000100:00100000:3.0:1763343270.745896:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399668096 00000100:00100000:3.0:1763343270.745939:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10170 00000100:00100000:3.0:1763343270.745947:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f648a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57039:x1848998399668096:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343270.745958:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343270.745991:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a06d5 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48726 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.746103:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a06dc lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343270.746119:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a06dc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343270.746136:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a06dc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:3.0:1763343270.750395:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399668224 00000100:00100000:3.0:1763343270.750401:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399668224 00000100:00100000:3.0:1763343270.750444:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10171 00000100:00100000:3.0:1763343270.750452:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:55884:x1848998399668224:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343270.750469:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343270.750481:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a0706 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1df:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4872d expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.750512:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a070d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1df:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343270.750523:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a070d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1df:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343270.750534:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a070d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1df:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343270.750648:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a0706 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1df:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4872d expref: 285 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.750664:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a070d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1df:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4872d expref: 284 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.750672:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1df:0x0].0x0 (ffff9401edc53400) 00010000:00010000:3.0:1763343270.750675:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343270.750679:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4515600, rc 0) 00000100:00100000:3.0:1763343270.751162:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:55884:x1848998399668224:12345-192.168.201.40@tcp:101:bash.0 Request processed in 709us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343270.751169:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10171 00000100:00100000:3.0:1763343270.760620:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.760659:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.771235:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399669632 00000100:00100000:3.0:1763343270.771242:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399669632 00000100:00100000:3.0:1763343270.771294:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10177 00000100:00100000:3.0:1763343270.771304:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57039:x1848998399669632:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343270.771331:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343270.771369:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a0761 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1df:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4875e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.771554:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514c00/0x9104b1ba770a0768 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1df:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343270.771570:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a075a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1df:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343270.771578:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514c00/0x9104b1ba770a0768 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1df:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.771598:0:6525:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a075a lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1df:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343270.771609:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514c00/0x9104b1ba770a0768 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1df:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.771889:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a075a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1df:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343270.771897:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a075a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1df:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 9827 initiator: MDT1 00000040:00080000:3.0:1763343270.772208:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1603, 88 off134072 00000004:00080000:3.0:1763343270.772219:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1063896193408ns, next at 1064470181035ns, rc = 0 00000040:00080000:3.0:1763343270.772264:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1595, 88 off133376 00000004:00080000:3.0:1763343270.772270:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1063896245029ns, next at 1064470143068ns, rc = 0 00000040:00080000:3.0:1763343270.772300:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1596, 88 off133464 00000004:00080000:3.0:1763343270.772305:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1063896280880ns, next at 1064470143068ns, rc = 0 00000040:00080000:3.0:1763343270.772320:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1604, 88 off134160 00000004:00080000:3.0:1763343270.772325:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1063896300478ns, next at 1064470181035ns, rc = 0 00000100:00100000:3.0:1763343270.779919:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412912640:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343270.779954:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343270.779977:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343270.779986:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412912512:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343270.780017:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343270.780072:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412912256 00000100:00100000:3.0:1763343270.780079:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412912256 00000100:00100000:3.0:1763343270.780112:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412912640 00000100:00100000:3.0:1763343270.780115:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412912640 00000100:00100000:3.0:1763343270.780130:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412912384 00000100:00100000:3.0:1763343270.780133:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412912384 00000100:00100000:3.0:1763343270.780149:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412912512 00000100:00100000:3.0:1763343270.780152:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412912512 00000100:00100000:3.0:1763343270.780171:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6864 00000100:00100000:3.0:1763343270.780178:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+85:3661:x1848998412912256:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343270.780199:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:648 count 1 00010000:00010000:3.0:1763343270.780221:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c4514400/0x9104b1ba770a077d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x288:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.780239:0:8413:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90600/0x9104b1ba770a05e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b486d2 expref: 43 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.780247:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343270.780249:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343270.780252:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c4514400/0x9104b1ba770a077d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.780277:0:8413:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90600/0x9104b1ba770a05e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b486d2 expref: 43 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.780290:0:8413:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90600/0x9104b1ba770a05e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b486d2 expref: 43 pid: 28562 timeout: 1163 lvb_type: 0 00000100:00100000:3.0:1763343270.780303:0:8413:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7918000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412912768:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343270.780367:0:8413:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c926ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1763343270.780385:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6866 00000100:00100000:3.0:1763343270.780393:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+85:3661:x1848998412912384:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343270.780407:0:27798:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:649 count 1 00010000:00010000:3.0:1763343270.780418:0:27798:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c4514a00/0x9104b1ba770a0784 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x289:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.780430:0:27798:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c85abe00/0x9104b1ba770a050e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x289:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48693 expref: 43 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343270.780436:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343270.780437:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343270.780440:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c4514a00/0x9104b1ba770a0784 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x289:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.780461:0:27798:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c85abe00/0x9104b1ba770a050e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x289:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48693 expref: 43 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343270.780480:0:27798:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c85abe00/0x9104b1ba770a050e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x289:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48693 expref: 43 pid: 8413 timeout: 1163 lvb_type: 1 00000100:00100000:3.0:1763343270.780491:0:27798:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7919880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27798:1848998412912896:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343270.783289:0:27798:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c4532b40 going to sleep for 11 seconds 00000100:00100000:3.0:1763343270.785276:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.785312:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:3.0:1763343270.785841:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343270.785847:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba770a076f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.785854:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3916200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343270.785859:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba770a076f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.785869:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba770a076f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.785880:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba770a076f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.785888:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba770a076f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.785906:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343270.785907:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343270.785909:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343270.785917:0:28561:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9401c1660400/0x9104b1ba770a0776 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.785923:0:28561:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401c1660400/0x9104b1ba770a0776 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.785930:0:28561:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401c1660400/0x9104b1ba770a0776 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.785937:0:28561:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9401c1660400/0x9104b1ba770a0776 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.785951:0:28561:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343270.786155:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+33:3661:x1848998412911616:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7479us (8032us total) trans 17179871763 rc 0/0 00000100:00100000:3.0:1763343270.786161:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6863 00010000:00010000:3.0:1763343270.786177:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343270.786182:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9401c1660400/0x9104b1ba770a0776 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.786190:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c1660400 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343270.786193:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9401c1660400/0x9104b1ba770a0776 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.786200:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9401c1660400/0x9104b1ba770a0776 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.786210:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9401c1660400/0x9104b1ba770a0776 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.786216:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401c1660400/0x9104b1ba770a0776 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.786229:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343270.786230:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343270.786233:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343270.786267:0:8413:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7918000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412912768:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343270.786283:0:8413:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c4514400/0x9104b1ba770a077d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343270.786315:0:27798:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7919880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27798:1848998412912896:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343270.786331:0:27798:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c4514a00/0x9104b1ba770a0784 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x289:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.786619:0:8413:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c4514400/0x9104b1ba770a077d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.786638:0:8413:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c4514400/0x9104b1ba770a077d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.786656:0:8413:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c4514400/0x9104b1ba770a077d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.786670:0:8413:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c4514400/0x9104b1ba770a077d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.786693:0:8413:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343270.786842:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+86:3661:x1848998412912256:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6664us (6935us total) trans 21474839033 rc 0/0 00000100:00100000:3.0:1763343270.786849:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6864 00010000:00010000:3.0:1763343270.786871:0:27798:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c4514a00/0x9104b1ba770a0784 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.786882:0:27798:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c4514a00/0x9104b1ba770a0784 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.786889:0:27798:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c4514a00/0x9104b1ba770a0784 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.786896:0:27798:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c4514a00/0x9104b1ba770a0784 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.787013:0:27798:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343270.787376:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+86:3661:x1848998412912384:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6983us (7400us total) trans 21474839034 rc 0/0 00000100:00100000:3.0:1763343270.787383:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6866 00000100:00100000:3.0:1763343270.788566:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399670400 00000100:00100000:3.0:1763343270.788573:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399670400 00000100:00100000:3.0:1763343270.788916:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6868 00000100:00100000:3.0:1763343270.788927:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:55884:x1848998399670400:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343270.788943:0:27798:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343270.788966:0:27798:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a078b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48765 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343270.788988:0:27798:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x28b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343270.789006:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343270.789008:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343270.789017:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a078b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48765 expref: 19 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.789065:0:27798:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a078b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48765 expref: 19 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.789079:0:27798:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c508b200, rc 0) 00000100:00100000:3.0:1763343270.789136:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:55884:x1848998399670400:12345-192.168.201.40@tcp:101:bash.0 Request processed in 211us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343270.789143:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6868 00000100:00100000:3.0:1763343270.795446:0:8417:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399670784 00000100:00100000:3.0:1763343270.795456:0:8417:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399670784 00002000:00010000:3.0:1763343270.795493:0:8417:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/651 (0->18446744073709551615) 00002000:00100000:3.0:1763343270.795500:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c2f87800 with x1848998399670784 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343270.795511:0:8417:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c2f87800. 00000100:00100000:3.0:1763343270.796934:0:8417:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399670912 00000100:00100000:3.0:1763343270.796941:0:8417:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399670912 00002000:00010000:3.0:1763343270.796969:0:8417:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/650 (0->18446744073709551615) 00002000:00100000:3.0:1763343270.796974:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c4b21880 with x1848998399670912 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343270.796981:0:8417:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c4b21880. 00000100:00100000:3.0:1763343270.797014:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1654 00000100:00100000:3.0:1763343270.797038:0:8417:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+43:2407:x1848998399670912:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:3.0:1763343270.797189:0:8417:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x28a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343270.797192:0:8417:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x28a:0x0] updating lvb mtime from disk: 0 -> 1763343270 00002000:00010000:3.0:1763343270.797194:0:8417:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x28a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343270.797196:0:8417:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x28a:0x0] updating lvb ctime from disk: 0 -> 1763343270 00002000:00010000:3.0:1763343270.797198:0:8417:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x28a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343270.797380:0:8417:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+44:2407:x1848998399670912:12345-192.168.201.40@tcp:10:bash.0 Request processed in 357us (662us total) trans 21474839035 rc 0/0 00000100:00100000:3.0:1763343270.797388:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1654 00002000:00010000:3.0:1763343270.797393:0:8417:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/650 (0->18446744073709551615) 00002000:00100000:3.0:1763343270.797395:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c4b21880 with x1848998399670912 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343270.797401:0:8417:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c4b21880. 00000100:00100000:3.0:1763343270.798906:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.804853:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.810952:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.811092:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.824750:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.826964:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.827159:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:3.0:1763343270.828809:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343270.828816:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0810 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343270.828822:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401ed155600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343270.828826:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0810 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343270.828833:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0810 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343270.828845:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1df:0x0].0x0 (ffff9400ccadbe00) 00010000:00010000:3.0:1763343270.828848:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343270.828851:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0810 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343270.828857:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0810 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343270.828872:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343270.828874:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343270.828876:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343270.840547:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399673344 00000100:00100000:3.0:1763343270.840564:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399673344 00000100:00100000:3.0:1763343270.840654:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10184 00000100:00100000:3.0:1763343270.840665:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+277:57041:x1848998399673344:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343270.840691:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343270.840717:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a082c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4879d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.840796:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a0833 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343270.840811:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a0833 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.840822:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a0833 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:3.0:1763343270.840874:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763343270.840879:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1763343270.840918:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a082c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4879d expref: 279 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.840937:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a0833 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4879d expref: 278 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.840948:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401c9896600) 00010000:00010000:3.0:1763343270.840952:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763343270.840956:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c508aa00, rc 0) 00000100:00100000:3.0:1763343270.842201:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:57041:x1848998399673344:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1530us (2953us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343270.842214:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10184 00000100:00100000:3.0:1763343270.846208:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.852926:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399673728 00000100:00100000:3.0:1763343270.852937:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399673728 00000100:00100000:3.0:1763343270.853000:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10186 00000100:00100000:3.0:1763343270.853011:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:57041:x1848998399673728:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343270.853048:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343270.853052:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343270.853077:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a0833 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4879d expref: 278 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.853096:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401c9896600) 00010000:00010000:3.0:1763343270.853109:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343270.853124:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a084f lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b487ab expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.853241:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a0856 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343270.853254:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a0856 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.853264:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a0856 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.853291:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a085d lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343270.853300:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a085d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.853307:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a085d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.853719:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a0864 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343270.853730:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a0864 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.853737:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a0864 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:3.0:1763343270.853747:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e0:0x0]: returning size 0 00010000:00010000:3.0:1763343270.853772:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a0856 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.853778:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a0856 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.853783:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a0856 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.853789:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a0856 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.853795:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ec00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343270.853798:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a0856 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.853805:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a0856 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.853817:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401c9896100) 00010000:00010000:3.0:1763343270.853820:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343270.853824:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a0856 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.853830:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a0856 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00000004:00010000:3.0:1763343270.853843:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fd456a44 reply state 00000000611509b5 transno 4294973189 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a085d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.853853:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a085d lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.853858:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadb700) 00010000:00010000:3.0:1763343270.853860:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343270.853863:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343270.853888:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a084f lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b487ab expref: 280 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.853902:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a0864 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b487ab expref: 279 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.853910:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e0:0x0].0x0 (ffff9401c9896b00) 00010000:00010000:3.0:1763343270.853912:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343270.853915:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c85abe00, rc 0) 00000100:00100000:3.0:1763343270.853992:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57041:x1848998399673728:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 983us (1165us total) trans 4294973189 rc 0/0 00000100:00100000:3.0:1763343270.854000:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10186 00000100:00100000:3.0:1763343270.858364:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399673984 00000100:00100000:3.0:1763343270.858376:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399673984 00000100:00100000:3.0:1763343270.866168:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399674496 00000100:00100000:3.0:1763343270.866178:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399674496 00000100:00100000:3.0:1763343270.866231:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3576 00000100:00100000:3.0:1763343270.866241:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57043:x1848998399674496:12345-192.168.201.40@tcp:35:lfs.0 00010000:00010000:0.0:1763343270.866319:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a0879 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343270.866329:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a0879 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343270.866360:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343270.866406:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:2407:x1848998399674624:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 156us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343270.866413:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3299 00000100:00100000:3.0:1763343270.866435:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57043:x1848998399674496:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 196us (498us total) trans 4294973191 rc 0/0 00000100:00100000:3.0:1763343270.866441:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3576 00000100:00100000:0.0:1763343270.869363:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343270.869409:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.869454:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399675136 00000100:00100000:3.0:1763343270.869465:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399675136 00000100:00100000:3.0:1763343270.869526:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10189 00000100:00100000:3.0:1763343270.869536:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57043:x1848998399675136:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343270.869561:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343270.869584:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa400/0x9104b1ba770a089c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b487c0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.869659:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a08a3 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343270.869671:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a08a3 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.869681:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a08a3 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.869691:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a08aa lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343270.869699:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a08aa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.869716:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a08aa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.869832:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a08b1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343270.869839:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a08b1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.869846:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a08b1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.869946:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a08a3 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.869953:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a08a3 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.869959:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a08a3 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.869965:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a08a3 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.869971:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85aa600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343270.869976:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a08a3 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.869983:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a08a3 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.869994:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401c9896100) 00010000:00010000:3.0:1763343270.869997:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343270.870002:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a08a3 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.870007:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a08a3 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.870020:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a08aa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.874394:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a08aa lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.874403:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a08aa lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.874409:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85ab400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343270.874414:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a08aa lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.874422:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a08aa lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.874437:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadb700) 00010000:00010000:3.0:1763343270.874440:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343270.874445:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a08aa lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.874451:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a08aa lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00000100:00100000:3.0:1763343270.875015:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399675392 00000100:00100000:3.0:1763343270.875058:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399675392 00000100:00100000:3.0:1763343270.875108:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3578 00000100:00100000:3.0:1763343270.875118:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57041:x1848998399675392:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343270.875307:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57041:x1848998399675392:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 190us (484us total) trans 4294973195 rc 0/0 00000100:00100000:3.0:1763343270.875315:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3578 00000100:00100000:0.0:1763343270.883063:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343270.887756:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343270.891571:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343270.897398:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.897572:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399676928 00000100:00100000:3.0:1763343270.897576:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399676928 00000100:00100000:3.0:1763343270.897655:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10193 00000100:00100000:3.0:1763343270.897666:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:55884:x1848998399676928:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:3.0:1763343270.897717:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343270.897737:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a08d4 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1e0:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b487d5 expref: 292 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.897753:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e0:0x0].0x0 (ffff9400c48a8000) 00010000:00010000:3.0:1763343270.897757:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343270.897905:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a090c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343270.897914:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a090c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.897920:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a090c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000001:00080000:3.0:1763343270.897960:0:6525:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973198 00000004:00010000:3.0:1763343270.897982:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007bf55928 reply state 00000000db9365b1 transno 4294973199 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a090c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.897993:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a090c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.898115:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e0:0x0].0x0 (ffff9400c48a8000) 00010000:00010000:3.0:1763343270.898120:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343270.898122:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343270.899133:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:55884:x1848998399676928:12345-192.168.201.40@tcp:36:bash.0 Request processed in 1465us (1695us total) trans 4294973199 rc 0/0 00000100:00100000:3.0:1763343270.899141:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10193 00000020:00080000:3.0:1763343270.899147:0:6525:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343270.902055:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.905001:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399677568 00000100:00100000:3.0:1763343270.905008:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399677568 00000100:00100000:3.0:1763343270.905086:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3581 00000100:00100000:3.0:1763343270.905098:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57043:x1848998399677568:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:3.0:1763343270.905248:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57043:x1848998399677568:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 152us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343270.905258:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3581 00000100:00100000:0.0:1763343270.905818:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:3.0:1763343270.906354:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a0928 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e0:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343270.906361:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a0928 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e0:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000040:00080000:3.0:1763343270.906613:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1599, 88 off133680 00000004:00080000:3.0:1763343270.906622:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1064030597346ns, next at 1064470143068ns, rc = 0 00000040:00080000:3.0:1763343270.906784:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1607, 88 off134376 00000004:00080000:3.0:1763343270.906791:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1064030766180ns, next at 1064470181035ns, rc = 0 00000040:00080000:3.0:1763343270.906818:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1608, 88 off134464 00000004:00080000:3.0:1763343270.906823:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1064030798185ns, next at 1064470181035ns, rc = 0 00000040:00080000:3.0:1763343270.906834:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1600, 88 off133768 00000004:00080000:3.0:1763343270.906838:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1064030813391ns, next at 1064470143068ns, rc = 0 00000001:00080000:0.0:1763343270.911964:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973202 is committed 00000004:00080000:0.0:1763343270.911983:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1025 committed 00000004:00080000:0.0:1763343270.912222:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1033 committed 00000004:00080000:0.0:1763343270.912400:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1032 committed 00000004:00080000:0.0:1763343270.912429:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1024 committed 00000100:00100000:0.0:1763343270.912476:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763343270.912495:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c2f86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412913920:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343270.912684:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343270.912726:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412913920 00000100:00100000:0.0:1763343270.912731:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412913536:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343270.912734:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412913920 00000100:00100000:0.0:1763343270.912752:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343270.912781:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412913536 00000100:00100000:0.0:1763343270.912785:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412913536 00000100:00100000:3.0:1763343270.912786:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6873 00000100:00100000:3.0:1763343270.912795:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+33:3661:x1848998412913920:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343270.912809:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6874 00000100:00100000:0.0:1763343270.912814:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+86:3661:x1848998412913536:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763343270.912828:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:650 count 1 00010000:00010000:0.0:1763343270.912847:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c3917e00/0x9104b1ba770a092f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343270.912864:0:8413:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9401c1661000/0x9104b1ba770a0792 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48773 expref: 44 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343270.912872:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343270.912874:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343270.912877:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3917e00/0x9104b1ba770a092f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343270.912901:0:8413:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9401c1661000/0x9104b1ba770a0792 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48773 expref: 44 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343270.912913:0:8413:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9401c1661000/0x9104b1ba770a0792 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48773 expref: 44 pid: 28561 timeout: 1164 lvb_type: 0 00000100:00100000:0.0:1763343270.912924:0:8413:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412914176:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343270.912978:0:8413:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc526c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343270.912989:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412913792 00000100:00100000:0.0:1763343270.912993:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412913792 00000100:00100000:0.0:1763343270.913076:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6875 00000100:00100000:0.0:1763343270.913085:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+35:3660:x1848998412913792:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763343270.913096:0:28561:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:652 count 1 00010000:00010000:0.0:1763343270.913109:0:28561:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0936 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x28c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343270.913126:0:28561:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a06ff lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x28c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4873b expref: 20 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343270.913132:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343270.913134:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343270.913137:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0936 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x28c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343270.913155:0:28561:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a06ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x28c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4873b expref: 20 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343270.913165:0:28561:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a06ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x28c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4873b expref: 20 pid: 8414 timeout: 1164 lvb_type: 1 00000100:00100000:0.0:1763343270.913175:0:28561:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b55c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998412914304:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343270.913204:0:28561:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc52780 going to sleep for 11 seconds 00000100:00100000:0.0:1763343270.913217:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343270.913469:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+37:3661:x1848998412913920:12345-0@lo:2:osp-syn-1-1.0 Request processed in 675us (785us total) trans 17179871765 rc 0/0 00000100:00100000:3.0:1763343270.913476:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6873 00000004:00080000:0.0:1763343270.913553:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c2f86300/2, rc 0, transno 17179871765 00000100:00100000:0.0:1763343270.913559:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c2f86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412913920:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763343270.913612:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c2f85c00/2, rc 0, transno 17179871766 00000100:00100000:3.0:1763343270.913616:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c2f85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412914048:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343270.914361:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412914560:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343270.914387:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343270.914411:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343270.914417:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4b21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412914688:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343270.914436:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343270.915785:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6879 00000100:00100000:0.0:1763343270.915796:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+89:3659:x1848998412914560:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763343270.915822:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:651 count 1 00010000:00010000:0.0:1763343270.915843:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a0944 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343270.915858:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6880 00010000:00010000:0.0:1763343270.915861:0:35266:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c589be00/0x9104b1ba770a06f8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48734 expref: 44 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343270.915869:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343270.915871:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343270.915874:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a0944 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343270.915905:0:35266:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c589be00/0x9104b1ba770a06f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48734 expref: 44 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343270.915918:0:35266:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c589be00/0x9104b1ba770a06f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48734 expref: 44 pid: 8412 timeout: 1164 lvb_type: 1 00000100:00100000:0.0:1763343270.915930:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b56680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35266:1848998412914944:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343270.916017:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc52a80 going to sleep for 11 seconds 00000100:00100000:0.0:1763343270.918386:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343270.918433:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343270.918462:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399677952 00000100:00100000:0.0:1763343270.918470:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399677952 00010000:00010000:0.0:1763343270.918502:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a06ff lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x28c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4873b expref: 21 pid: 8414 timeout: 1164 lvb_type: 1 00000100:00100000:0.0:1763343270.918538:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399677824 00000100:00100000:0.0:1763343270.918542:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399677824 00010000:00010000:0.0:1763343270.918553:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9401c1661000/0x9104b1ba770a0792 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48773 expref: 45 pid: 28561 timeout: 1164 lvb_type: 0 00000100:00100000:0.0:1763343270.918571:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3301 00000100:00100000:0.0:1763343270.918580:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399677952:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343270.918598:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343270.918607:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a06ff lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x28c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4873b expref: 21 pid: 8414 timeout: 1164 lvb_type: 1 00010000:00010000:0.0:1763343270.918622:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a06ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x28c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4873b expref: 21 pid: 8414 timeout: 1164 lvb_type: 1 00010000:00010000:0.0:1763343270.918661:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343270.918665:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343270.918671:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0936 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343270.918683:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0936 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x28c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343270.918706:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343270.918755:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399677952:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 175us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343270.918764:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3301 00000100:00100000:3.0:1763343270.920446:0:35281:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4b23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35281:1848998412914432:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343270.920464:0:35281:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a093d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343270.920482:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399678080 00000100:00100000:3.0:1763343270.920485:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399678080 00010000:00010000:3.0:1763343270.920502:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a078b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48765 expref: 20 pid: 27798 timeout: 1164 lvb_type: 0 00000100:00100000:3.0:1763343270.920520:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3303 00000100:00100000:3.0:1763343270.920526:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5953100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2409:x1848998399678080:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343270.920535:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343270.920539:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a078b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48765 expref: 20 pid: 27798 timeout: 1164 lvb_type: 0 00010000:00010000:3.0:1763343270.920552:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a078b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48765 expref: 20 pid: 27798 timeout: 1164 lvb_type: 0 00010000:00010000:3.0:1763343270.920568:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a078b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48765 expref: 20 pid: 27798 timeout: 1164 lvb_type: 0 00010000:00010000:3.0:1763343270.920579:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343270.920580:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343270.920584:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a093d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.920591:0:6511:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a093d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.920610:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343270.920630:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5953100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2409:x1848998399678080:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 104us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343270.920637:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3303 00010000:00010000:3.0:1763343270.920654:0:35281:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a093d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.920661:0:35281:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a093d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.920669:0:35281:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a093d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.920677:0:35281:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a093d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.920691:0:35281:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343270.920848:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+37:3659:x1848998412913664:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7573us (7752us total) trans 17179871768 rc 0/0 00000100:00100000:3.0:1763343270.920854:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6876 00010000:00010000:3.0:1763343270.920871:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343270.920877:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a093d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.920885:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8692c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343270.920889:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a093d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.920898:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a093d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.920909:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a093d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.920915:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a093d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.920929:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343270.920931:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343270.920933:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343270.920956:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c2f85f80/2, rc 0, transno 17179871768 00000100:00100000:3.0:1763343270.920962:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c2f85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412913664:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343270.922463:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b56680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35266:1848998412914944:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343270.922495:0:35266:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a0944 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343270.922603:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399678592 00000100:00100000:3.0:1763343270.922609:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399678592 00010000:00010000:3.0:1763343270.922634:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c589be00/0x9104b1ba770a06f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48734 expref: 45 pid: 8412 timeout: 1164 lvb_type: 1 00000100:00100000:0.0:1763343270.923593:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3304 00010000:00010000:0.0:1763343270.923883:0:35266:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a0944 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343270.923896:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a0944 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343270.923904:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a0944 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343270.923919:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a0944 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343270.923937:0:35266:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343270.924184:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+90:3659:x1848998412914560:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8390us (9794us total) trans 21474839039 rc 0/0 00000100:00100000:0.0:1763343270.924192:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6879 00000004:00080000:0.0:1763343270.924234:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b9c380/2, rc 0, transno 21474839039 00000100:00100000:0.0:1763343270.924240:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412914560:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343270.926887:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399678720 00000100:00100000:0.0:1763343270.926898:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399678720 00000100:00100000:0.0:1763343270.927170:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6882 00000100:00100000:0.0:1763343270.927181:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:55884:x1848998399678720:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343270.927200:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343270.927222:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a0975 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48806 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343270.927244:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x28d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343270.927265:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343270.927268:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343270.927278:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a0975 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48806 expref: 20 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343270.927295:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a0975 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48806 expref: 20 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343270.927309:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917e00, rc 0) 00000100:00100000:0.0:1763343270.927379:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:55884:x1848998399678720:12345-192.168.201.40@tcp:101:bash.0 Request processed in 199us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343270.927387:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6882 00000100:00100000:3.0:1763343270.934388:0:8417:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399679104 00000100:00100000:3.0:1763343270.934398:0:8417:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399679104 00002000:00010000:3.0:1763343270.934449:0:8417:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/652 (0->18446744073709551615) 00002000:00100000:3.0:1763343270.934455:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c9dcad80 with x1848998399679104 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343270.934467:0:8417:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9401c9dcad80. 00000100:00100000:3.0:1763343270.934499:0:8417:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399679232 00000100:00100000:3.0:1763343270.934503:0:8417:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399679232 00002000:00010000:3.0:1763343270.934515:0:8417:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/653 (0->18446744073709551615) 00002000:00100000:3.0:1763343270.934518:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c9dca680 with x1848998399679232 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343270.934525:0:8417:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401c9dca680. 00000100:00100000:3.0:1763343270.934551:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1655 00000100:00100000:3.0:1763343270.934560:0:8417:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+44:2407:x1848998399679104:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:3.0:1763343270.934743:0:8417:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x28c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343270.934747:0:8417:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x28c:0x0] updating lvb mtime from disk: 0 -> 1763343270 00002000:00010000:3.0:1763343270.934750:0:8417:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x28c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343270.934752:0:8417:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x28c:0x0] updating lvb ctime from disk: 0 -> 1763343270 00002000:00010000:3.0:1763343270.934754:0:8417:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x28c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343270.934809:0:8417:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+45:2407:x1848998399679104:12345-192.168.201.40@tcp:10:bash.0 Request processed in 250us (567us total) trans 21474839040 rc 0/0 00000100:00100000:3.0:1763343270.934821:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1655 00002000:00010000:3.0:1763343270.934826:0:8417:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/652 (0->18446744073709551615) 00002000:00100000:3.0:1763343270.934828:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c9dcad80 with x1848998399679104 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343270.934833:0:8417:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9401c9dcad80. 00000100:00100000:3.0:1763343270.934850:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1656 00000100:00100000:3.0:1763343270.934858:0:8417:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2408:x1848998399679232:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:3.0:1763343270.934936:0:8417:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x28d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343270.934939:0:8417:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x28d:0x0] updating lvb mtime from disk: 0 -> 1763343270 00002000:00010000:3.0:1763343270.934941:0:8417:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x28d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343270.934943:0:8417:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x28d:0x0] updating lvb ctime from disk: 0 -> 1763343270 00002000:00010000:3.0:1763343270.934945:0:8417:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x28d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343270.934967:0:8417:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399679232:12345-192.168.201.40@tcp:10:bash.0 Request processed in 110us (664us total) trans 17179871769 rc 0/0 00000100:00100000:3.0:1763343270.934974:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1656 00002000:00010000:3.0:1763343270.934977:0:8417:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/653 (0->18446744073709551615) 00002000:00100000:3.0:1763343270.934979:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c9dca680 with x1848998399679232 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343270.934983:0:8417:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401c9dca680. 00000100:00100000:3.0:1763343270.943559:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343270.944345:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399679488 00000100:00100000:0.0:1763343270.944351:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399679488 00000100:00100000:0.0:1763343270.954613:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.954985:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399680128 00000100:00100000:3.0:1763343270.954996:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399680128 00010000:00010000:3.0:1763343270.955194:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcd400/0x9104b1ba770a0967 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b487ff expref: 279 pid: 9827 timeout: 1164 lvb_type: 0 00000100:00100000:3.0:1763343270.961809:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399680384 00000100:00100000:3.0:1763343270.961821:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399680384 00000100:00100000:3.0:1763343270.961876:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10200 00000100:00100000:3.0:1763343270.961886:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57045:x1848998399680384:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343270.961911:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343270.961932:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a09c2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48822 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343270.962012:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399680512 00000100:00100000:0.0:1763343270.962018:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399680512 00010000:00010000:3.0:1763343270.962118:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a09c9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343270.962133:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a09c9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e0:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.962142:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a09c9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e0:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343270.962328:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0998 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48814 expref: 282 pid: 9827 timeout: 1164 lvb_type: 0 00000100:00100000:0.0:1763343270.962399:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3306 00000100:00100000:0.0:1763343270.962408:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:2408:x1848998399680512:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343270.962418:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343270.962425:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0998 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48814 expref: 282 pid: 9827 timeout: 1164 lvb_type: 0 00010000:00010000:0.0:1763343270.962442:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0998 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48814 expref: 282 pid: 9827 timeout: 1164 lvb_type: 0 00010000:00010000:0.0:1763343270.962462:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0998 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48814 expref: 282 pid: 9827 timeout: 1164 lvb_type: 0 00010000:00010000:0.0:1763343270.962477:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e0:0x0].0x0 (ffff9400c48a8000) 00010000:00010000:0.0:1763343270.962481:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a09bb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e0:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343270.962488:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a09bb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e0:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343270.962494:0:6511:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a09bb lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1e0:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343270.962500:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a09c9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e0:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343270.962506:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a09c9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343270.962511:0:6511:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a09c9 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343270.962545:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343270.962644:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:2408:x1848998399680512:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 237us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343270.962652:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3306 00010000:00010000:3.0:1763343270.962751:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a09c9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.962761:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a09c9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:3.0:1763343270.962788:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e0:0x0]: returning size 5 00000004:00200000:3.0:1763343270.962792:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343270.962804:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a09c9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343270.962838:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a09c2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48822 expref: 281 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.962862:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a09c9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48822 expref: 280 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343270.962882:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e0:0x0].0x0 (ffff9400c48a8000) 00010000:00010000:3.0:1763343270.962887:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343270.962890:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d1e9ec00, rc 0) 00000100:00100000:3.0:1763343270.962937:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57045:x1848998399680384:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1050us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343270.962950:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10200 00000100:00100000:0.0:1763343270.967912:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399680640 00000100:00100000:0.0:1763343270.967923:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399680640 00000100:00100000:0.0:1763343270.967999:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 446 00000100:00100000:0.0:1763343270.968010:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6401c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+279:2407:x1848998399680640:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343270.968055:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343270.968082:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a09c9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48822 expref: 279 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343270.968108:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e0:0x0].0x0 (ffff9400c48a8000) 00010000:00010000:0.0:1763343270.968113:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343270.968166:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6401c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:2407:x1848998399680640:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 158us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343270.968175:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 446 00000100:00100000:3.0:1763343270.968216:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399680896 00000100:00100000:3.0:1763343270.968223:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399680896 00000100:00100000:3.0:1763343270.968267:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3584 00000100:00100000:3.0:1763343270.970387:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:57045:x1848998399680896:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343270.970678:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+277:57045:x1848998399680896:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 951us (2840us total) trans 4294973208 rc 0/0 00000100:00100000:3.0:1763343270.970809:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3584 00000100:00100000:3.0:1763343270.977326:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399681280 00000100:00100000:3.0:1763343270.977348:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399681280 00010000:00010000:3.0:1763343270.977395:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a0983 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1e0:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4880d expref: 277 pid: 9827 timeout: 1164 lvb_type: 0 00000100:00100000:3.0:1763343270.977432:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3307 00000100:00100000:3.0:1763343270.977441:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+277:57045:x1848998399681280:12345-192.168.201.40@tcp:103:lfs.0 00010000:00010000:3.0:1763343270.977455:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343270.977462:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a0983 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1e0:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4880d expref: 277 pid: 9827 timeout: 1164 lvb_type: 0 00010000:00010000:3.0:1763343270.977472:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a0983 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1e0:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4880d expref: 277 pid: 9827 timeout: 1164 lvb_type: 0 00010000:00010000:3.0:1763343270.977492:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a0983 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e0:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4880d expref: 277 pid: 9827 timeout: 1164 lvb_type: 0 00010000:00010000:3.0:1763343270.977507:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e0:0x0].0x0 (ffff9400c48a8000) 00010000:00010000:3.0:1763343270.977512:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0031800/0x9104b1ba770a09de lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343270.977521:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0031800/0x9104b1ba770a09de lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343270.977529:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0031800/0x9104b1ba770a09de lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343270.977555:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343270.977602:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+276:57045:x1848998399681280:12345-192.168.201.40@tcp:103:lfs.0 Request processed in 162us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343270.977610:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3307 00000100:00100000:3.0:1763343270.992877:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.994228:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343270.996876:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.001118:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.001159:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00080000:3.0:1763343271.001780:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1763343271.002729:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1763343271.006748:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.006884:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.007104:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399682688 00000100:00100000:0.0:1763343271.007115:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399682688 00000100:00100000:0.0:1763343271.007178:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10207 00000100:00100000:0.0:1763343271.007187:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57047:x1848998399682688:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343271.007208:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.007231:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a0a40 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4884c expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.007299:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0a47 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343271.007313:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0a47 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.007324:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0a47 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.007344:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a0a4e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343271.007351:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a0a4e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.007358:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a0a4e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.007397:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0a47 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.007403:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0a47 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.007409:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0a47 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.007415:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0a47 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.007420:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.007425:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0a47 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.007431:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0a47 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.007443:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:0.0:1763343271.007446:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.007451:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0a47 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.007457:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0a47 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.007470:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a0a4e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.007476:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a0a4e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.007482:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a0a4e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.007488:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3916200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.007490:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a0a4e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.007495:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a0a4e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.007501:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8800) 00010000:00010000:0.0:1763343271.007504:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.007507:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a0a4e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.007512:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a0a4e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.007539:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a0a40 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4884c expref: 282 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.007548:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:0.0:1763343271.007551:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.007554:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a0a40 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4884c expref: 282 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.007562:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917a00, rc 0) 00000100:00100000:0.0:1763343271.007629:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57047:x1848998399682688:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 442us (745us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343271.007636:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10207 00000100:00100000:3.0:1763343271.014798:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.014889:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.015584:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10209 00000100:00100000:0.0:1763343271.015594:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57045:x1848998399683200:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:0.0:1763343271.015616:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343271.015630:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0a0f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48837 expref: 282 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.015641:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e0:0x0].0x0 (ffff9400c48a8a00) 00010000:00010000:0.0:1763343271.015645:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343271.015661:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a0a6a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343271.015669:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a0a6a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.015676:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a0a6a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000040:00080000:0.0:1763343271.015817:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1601, 88 off133856 00000004:00080000:0.0:1763343271.015825:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1064139800111ns, next at 1064470143068ns, rc = 0 00000040:00080000:0.0:1763343271.015856:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1609, 88 off134552 00000004:00080000:0.0:1763343271.015862:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1064139837087ns, next at 1064470181035ns, rc = 0 00000040:00080000:0.0:1763343271.015907:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1610, 88 off134640 00000004:00080000:0.0:1763343271.015911:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1064139886489ns, next at 1064470181035ns, rc = 0 00000040:00080000:0.0:1763343271.015928:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1602, 88 off133944 00000004:00080000:0.0:1763343271.015932:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1064139907811ns, next at 1064470143068ns, rc = 0 00000100:00100000:0.0:1763343271.024930:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000001:00080000:0.0:1763343271.027214:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973212 is committed 00000004:00080000:0.0:1763343271.027227:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1027 committed 00000004:00080000:0.0:1763343271.028343:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1035 committed 00000100:00100000:3.0:1763343271.028983:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5952680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412915712:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343271.029061:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1763343271.029126:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1034 committed 00000004:00080000:0.0:1763343271.029485:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1026 committed 00000004:00010000:0.0:1763343271.029623:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000310cb2c4 reply state 00000000ba6c01a5 transno 4294973212 ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a0a6a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.029642:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a0a6a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.029651:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e0:0x0].0x0 (ffff9400c48a8a00) 00010000:00010000:0.0:1763343271.029653:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763343271.029656:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343271.029808:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412915712 00000100:00100000:3.0:1763343271.029815:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412915712 00000100:00100000:3.0:1763343271.029863:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412915840 00000100:00100000:3.0:1763343271.029866:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412915840 00000100:00100000:3.0:1763343271.029884:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6884 00000100:00100000:3.0:1763343271.029892:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+90:3662:x1848998412915712:12345-0@lo:2:osp-syn-0-1.0 00010000:00080000:0.0:1763343271.030821:0:9827:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763343271.030835:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+274:57045:x1848998399683200:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 15241us (15944us total) trans 4294973212 rc 0/0 00000100:00100000:0.0:1763343271.030842:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10209 00000100:00100000:3.0:1763343271.031254:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+92:3662:x1848998412915712:12345-0@lo:2:osp-syn-0-1.0 Request processed in 1359us (2188us total) trans 21474839042 rc 0/0 00000100:00100000:3.0:1763343271.031264:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6884 00000100:00080000:3.0:1763343271.031374:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1763343271.031380:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1763343271.031711:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000004:00080000:3.0:1763343271.031962:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5952a00/2, rc 0, transno 21474839043 00000100:00100000:3.0:1763343271.031968:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412916096:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343271.033344:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.036760:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.049180:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399684480 00000100:00100000:3.0:1763343271.049186:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399684480 00000100:00100000:3.0:1763343271.049217:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3586 00000100:00100000:3.0:1763343271.049225:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82c9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+274:57047:x1848998399684480:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343271.049405:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82c9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+275:57047:x1848998399684480:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 180us (442us total) trans 4294973215 rc 0/0 00000100:00100000:3.0:1763343271.049412:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3586 00000100:00100000:0.0:1763343271.056863:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.066649:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399684864 00000100:00100000:0.0:1763343271.066660:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399684864 00000100:00100000:0.0:1763343271.066716:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10214 00000100:00100000:0.0:1763343271.066726:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+277:55884:x1848998399684864:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343271.066751:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.066773:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0ad3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4887d expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.066804:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a0ada lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343271.066819:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a0ada lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.066832:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a0ada lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.066942:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0ad3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4887d expref: 279 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.066961:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a0ada lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4887d expref: 278 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.066970:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e1:0x0].0x0 (ffff9400c48a8700) 00010000:00010000:0.0:1763343271.066973:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343271.066977:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401ed155000, rc 0) 00000100:00100000:0.0:1763343271.067074:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:55884:x1848998399684864:12345-192.168.201.40@tcp:101:bash.0 Request processed in 349us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.067084:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10214 00000100:00100000:0.0:1763343271.077101:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10215 00000100:00100000:0.0:1763343271.077116:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:55884:x1848998399685120:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:0.0:1763343271.077196:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343271.077230:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a0ac5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48876 expref: 278 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.077250:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e1:0x0].0x0 (ffff9400c48a8700) 00010000:00010000:0.0:1763343271.077256:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343271.077693:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0ae1 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343271.077709:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0ae1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.077719:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0ae1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000001:00080000:0.0:1763343271.077769:0:9827:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973217 00000004:00010000:0.0:1763343271.077794:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b99a9b88 reply state 00000000c8dd98a4 transno 4294973218 ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0ae1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.077806:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0ae1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.077812:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e1:0x0].0x0 (ffff9400c48a8700) 00010000:00010000:0.0:1763343271.077814:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343271.077817:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343271.077938:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:55884:x1848998399685120:12345-192.168.201.40@tcp:36:bash.0 Request processed in 824us (1279us total) trans 4294973218 rc 0/0 00000100:00100000:0.0:1763343271.077946:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10215 00000020:00080000:0.0:1763343271.077952:0:9827:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343271.081013:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399685248 00000100:00100000:0.0:1763343271.081039:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399685248 00000001:00080000:0.0:1763343271.098286:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973219 is committed 00000004:00080000:0.0:1763343271.098303:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1037 committed 00000004:00080000:0.0:1763343271.098704:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1029 committed 00000004:00080000:0.0:1763343271.098868:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1028 committed 00000100:00100000:3.0:1763343271.099521:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5951500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412916224:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343271.099546:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343271.100129:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c8599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412916608:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343271.100154:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343271.100179:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412916608 00000100:00100000:3.0:1763343271.100183:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412916608 00000100:00100000:3.0:1763343271.100205:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6892 00000100:00100000:3.0:1763343271.100210:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+93:3661:x1848998412916608:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343271.100285:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+94:3661:x1848998412916608:12345-0@lo:2:osp-syn-0-1.0 Request processed in 74us (129us total) trans 21474839045 rc 0/0 00000100:00100000:3.0:1763343271.100295:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6892 00000004:00080000:3.0:1763343271.100321:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5951500/2, rc 0, transno 17179871773 00000100:00100000:3.0:1763343271.100325:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5951500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412916224:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763343271.100363:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c8599880/2, rc 0, transno 21474839045 00000100:00100000:3.0:1763343271.100367:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c8599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412916608:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763343271.100526:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1036 committed 00000100:00100000:0.0:1763343271.108289:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.108355:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00080000:0.0:1763343271.109350:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1763343271.113960:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.115189:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.126875:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.127052:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399686400 00000100:00100000:0.0:1763343271.127064:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399686400 00000100:00100000:0.0:1763343271.127127:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1659 00000100:00100000:0.0:1763343271.127137:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+49:2407:x1848998399686400:12345-192.168.201.40@tcp:3:lfs.0 00010000:00010000:0.0:1763343271.127175:0:8419:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9401ed154e00/0x9104b1ba770a0b0b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x28c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.127190:0:8419:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.127192:0:8419:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.127197:0:8419:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401ed154e00/0x9104b1ba770a0b0b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x28c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.127211:0:8419:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401ed154e00/0x9104b1ba770a0b0b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x28c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.127323:0:8419:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9401ed154e00/0x9104b1ba770a0b0b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x28c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.127342:0:8419:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401ed154e00/0x9104b1ba770a0b0b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x28c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.127349:0:8419:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9401ed154e00/0x9104b1ba770a0b0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x28c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.127355:0:8419:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401ed154e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343271.127359:0:8419:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9401ed154e00/0x9104b1ba770a0b0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x28c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.127367:0:8419:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9401ed154e00/0x9104b1ba770a0b0b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x28c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.127389:0:8419:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9401ed154e00/0x9104b1ba770a0b0b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x28c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.127396:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401ed154e00/0x9104b1ba770a0b0b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x28c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343271.127466:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+49:2407:x1848998399686400:12345-192.168.201.40@tcp:3:lfs.0 Request processed in 330us (599us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763343271.127473:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1659 00000100:00100000:0.0:1763343271.130892:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.142600:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.148443:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.148447:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.156441:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000001:00080000:0.0:1763343271.161713:0:25994:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871775 is committed 00000001:00080000:0.0:1763343271.161733:0:25994:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871773 is committed 00000100:00100000:0.0:1763343271.166870:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.167741:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+276:57049:x1848998399687552:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343271.167768:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.167791:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0b5f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b488ae expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.167862:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0b66 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343271.167876:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0b66 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.167887:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0b66 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.167900:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0b6d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343271.167907:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0b6d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.167912:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0b6d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.167946:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0b66 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.167952:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0b66 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.167957:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0b66 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.167962:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401ed155c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.167967:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0b66 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.167974:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0b66 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.167983:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d816a200) 00010000:00010000:0.0:1763343271.167986:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.167990:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0b66 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.167995:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0b66 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.168006:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0b6d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.168011:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0b6d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.168017:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0b6d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.168021:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401ed154e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.168055:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0b6d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.168061:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0b6d lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.168068:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8800) 00010000:00010000:0.0:1763343271.168071:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.168073:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0b6d lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.168078:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0b6d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.168107:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0b5f lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b488ae expref: 277 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.168117:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d816a200) 00010000:00010000:0.0:1763343271.168119:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.168122:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0b5f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b488ae expref: 277 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.168135:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401ed154800, rc 0) 00000100:00100000:0.0:1763343271.168209:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+276:57049:x1848998399687552:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 532us (1348us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343271.168217:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10221 00000100:00100000:0.0:1763343271.170975:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.174177:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399687808 00000100:00100000:0.0:1763343271.174187:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399687808 00000100:00100000:0.0:1763343271.174245:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10223 00000100:00100000:0.0:1763343271.174256:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+276:57049:x1848998399687808:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343271.174284:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.174308:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0b89 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b488bc expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.174379:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0b90 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343271.174391:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0b90 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.174402:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0b90 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:0.0:1763343271.174446:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343271.174451:0:33856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343271.174481:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0b89 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b488bc expref: 278 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.174499:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0b90 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b488bc expref: 277 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.174507:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d816a600) 00010000:00010000:0.0:1763343271.174510:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343271.174514:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401ed155600, rc 0) 00000100:00100000:0.0:1763343271.174578:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+277:57049:x1848998399687808:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 324us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.174585:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10223 00000100:00100000:3.0:1763343271.186049:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399688320 00000100:00100000:3.0:1763343271.186066:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399688320 00000100:00100000:3.0:1763343271.186124:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6897 00000100:00100000:3.0:1763343271.186133:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:57045:x1848998399688320:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343271.186149:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343271.186169:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a0bb3 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b488ca expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343271.186190:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x28e:0x0] initial LVB size: 4096, mtime: 0x691a7ba6, atime: 0x0, ctime: 0x691a7ba6, blocks: 0x8 00010000:00010000:3.0:1763343271.186208:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343271.186210:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343271.186217:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a0bb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b488ca expref: 14 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.186233:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a0bb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b488ca expref: 14 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.186250:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d1e9ec00, rc 0) 00000100:00100000:3.0:1763343271.186314:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:57045:x1848998399688320:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 182us (1862us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343271.186321:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6897 00000100:00100000:0.0:1763343271.191180:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10226 00000100:00100000:0.0:1763343271.191191:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:57049:x1848998399688576:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343271.191216:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.191219:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343271.191245:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0b90 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b488bc expref: 278 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.191263:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d816a600) 00010000:00010000:0.0:1763343271.191280:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343271.191294:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0bba lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b488d1 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.191406:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0bc1 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343271.191418:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0bc1 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.191426:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0bc1 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.191434:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0bc8 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343271.191440:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0bc8 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.191450:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0bc8 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.191779:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a0bcf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343271.191787:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a0bcf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.191793:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a0bcf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:0.0:1763343271.191801:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e3:0x0]: returning size 0 00010000:00010000:0.0:1763343271.191819:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0bc1 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.191826:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0bc1 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.191831:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0bc1 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.191837:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0bc1 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.191842:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401ed154800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.191845:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0bc1 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.191851:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0bc1 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.191857:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d816a200) 00010000:00010000:0.0:1763343271.191860:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.191863:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0bc1 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.191869:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0bc1 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000004:00010000:0.0:1763343271.191878:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000422c2935 reply state 00000000befad73f transno 4294973223 ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0bc8 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.191886:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0bc8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.191891:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8800) 00010000:00010000:0.0:1763343271.191894:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343271.191896:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343271.191917:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0bba lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b488d1 expref: 280 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.191930:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a0bcf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b488d1 expref: 279 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.191936:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e3:0x0].0x0 (ffff9401d816af00) 00010000:00010000:0.0:1763343271.191938:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343271.191940:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401ed155000, rc 0) 00000100:00100000:0.0:1763343271.192008:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57049:x1848998399688576:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 818us (4072us total) trans 4294973223 rc 0/0 00000100:00100000:0.0:1763343271.192014:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10226 00000100:00100000:0.0:1763343271.194157:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399688704 00000100:00100000:0.0:1763343271.194168:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399688704 00000100:00100000:0.0:1763343271.194216:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6898 00000100:00100000:0.0:1763343271.194223:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+49:57045:x1848998399688704:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343271.194242:0:8413:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.194259:0:8413:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a0bdd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b488d8 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.194283:0:8413:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6800/0x9104b1ba770a08c6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b487ce expref: 50 pid: 28561 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343271.194291:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.194293:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.194297:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a0bdd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b488d8 expref: 50 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.194336:0:8413:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6800/0x9104b1ba770a08c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b487ce expref: 50 pid: 28561 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343271.194350:0:8413:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6800/0x9104b1ba770a08c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b487ce expref: 50 pid: 28561 timeout: 1164 lvb_type: 1 00000100:00100000:0.0:1763343271.194363:0:8413:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412916864:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343271.194433:0:8413:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc526c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343271.200457:0:8413:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412916864:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343271.200488:0:8413:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a0bdd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b488d8 expref: 50 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.200507:0:8413:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917a00, rc 0) 00000100:00100000:0.0:1763343271.200564:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+50:57045:x1848998399688704:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 6341us (7002us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.200574:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6898 00000100:00100000:3.0:1763343271.201616:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.202586:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.202683:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399689216 00000100:00100000:0.0:1763343271.202689:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399689216 00010000:00010000:0.0:1763343271.202710:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a0bcf lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b488d1 expref: 282 pid: 9827 timeout: 1164 lvb_type: 0 00000100:00100000:0.0:1763343271.202740:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3312 00000100:00100000:0.0:1763343271.202748:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:2408:x1848998399689216:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343271.202758:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343271.202764:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a0bcf lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b488d1 expref: 282 pid: 9827 timeout: 1164 lvb_type: 0 00010000:00010000:0.0:1763343271.202774:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a0bcf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b488d1 expref: 282 pid: 9827 timeout: 1164 lvb_type: 0 00010000:00010000:0.0:1763343271.202789:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a0bcf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b488d1 expref: 282 pid: 9827 timeout: 1164 lvb_type: 0 00010000:00010000:0.0:1763343271.202803:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e3:0x0].0x0 (ffff9401d816af00) 00010000:00010000:0.0:1763343271.202807:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a0beb lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.202815:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a0beb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.202820:0:6511:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a0beb lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.202844:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343271.202872:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:2408:x1848998399689216:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 125us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.202880:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3312 00010000:00010000:3.0:1763343271.203283:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a0beb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.203291:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a0beb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:3.0:1763343271.203320:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e3:0x0]: returning size 0 00000004:00080000:3.0:1763343271.203520:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x290:0x0], index 0: 0 00000004:00080000:3.0:1763343271.203528:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x291:0x0], index 1: 0 00000004:00080000:3.0:1763343271.203532:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x292:0x0], index 1: 0 00000004:00080000:3.0:1763343271.203536:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x291:0x0], index 0: 0 00010000:00010000:3.0:1763343271.203652:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a0beb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.203660:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a0beb lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.203665:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a0beb lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.203671:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5b3c400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343271.203675:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a0beb lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.203682:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a0beb lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.203692:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e3:0x0].0x0 (ffff9401d816af00) 00010000:00010000:3.0:1763343271.203694:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343271.203698:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a0beb lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.203704:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a0beb lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.203751:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a0be4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1e3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b488df expref: 281 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.203761:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e3:0x0].0x0 (ffff9401d816af00) 00010000:00010000:3.0:1763343271.203763:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343271.203767:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a0be4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b488df expref: 281 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.203781:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5b3d000, rc 0) 00000100:00100000:3.0:1763343271.203817:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57049:x1848998399688960:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 5177us (5376us total) trans 4294973224 rc 301/301 00000100:00100000:3.0:1763343271.203824:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10227 00000100:00100000:0.0:1763343271.204010:0:9931:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc2d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9931:1848998412917248:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1763343271.204075:0:9931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343271.204098:0:9931:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc526c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343271.204769:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412917248 00000100:00100000:3.0:1763343271.204777:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412917248 00000100:00100000:0.0:1763343271.207413:0:14071:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c8bc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:14071:1848998412917120:192.168.201.40@tcp:105: 00010000:00010000:0.0:1763343271.207444:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343271.208727:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4788e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+49:2407:x1848998399689088:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 6744us (7112us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.208737:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3311 00000100:00100000:0.0:1763343271.208970:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399689600 00000100:00100000:0.0:1763343271.208978:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399689600 00000100:00100000:0.0:1763343271.210140:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3588 00000100:00100000:0.0:1763343271.210148:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57049:x1848998399689600:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343271.210357:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57049:x1848998399689600:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 209us (1442us total) trans 4294973225 rc 0/0 00000100:00100000:0.0:1763343271.210363:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3588 00000100:00100000:3.0:1763343271.214255:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399689984 00000100:00100000:3.0:1763343271.214265:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399689984 00000100:00100000:0.0:1763343271.214408:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10228 00000100:00100000:0.0:1763343271.214419:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57045:x1848998399689984:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:0.0:1763343271.214512:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0bf9 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343271.214530:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0bf9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.214542:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0bf9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00010000:0.0:1763343271.214640:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008a16c577 reply state 0000000057b7ca54 transno 4294973226 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0bf9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.214653:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0bf9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.214660:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e0:0x0].0x0 (ffff9400c48a8a00) 00010000:00010000:0.0:1763343271.214663:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343271.214667:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343271.215005:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57045:x1848998399689984:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 587us (1016us total) trans 4294973226 rc 0/0 00000100:00100000:0.0:1763343271.215014:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10228 00000100:00100000:0.0:1763343271.216230:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.223510:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.225176:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.230444:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:0.0:1763343271.231615:0:19639:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a0c00 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343271.231624:0:19639:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a0c00 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00000040:00080000:0.0:1763343271.231834:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1607, 88 off134336 00000004:00080000:0.0:1763343271.231841:0:19639:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1064355816321ns, next at 1064470143068ns, rc = 0 00000040:00080000:0.0:1763343271.231877:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1615, 88 off135032 00000004:00080000:0.0:1763343271.231882:0:19639:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1064355857369ns, next at 1064470181035ns, rc = 0 00000040:00080000:0.0:1763343271.231905:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1616, 88 off135120 00000004:00080000:0.0:1763343271.231910:0:19639:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1064355885428ns, next at 1064470181035ns, rc = 0 00000040:00080000:0.0:1763343271.231921:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1608, 88 off134424 00000004:00080000:0.0:1763343271.231925:0:19639:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1064355900612ns, next at 1064470143068ns, rc = 0 00000100:00100000:3.0:1763343271.232580:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.232677:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399691136 00000100:00100000:3.0:1763343271.232686:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399691136 00000100:00100000:3.0:1763343271.232724:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10230 00000100:00100000:3.0:1763343271.232733:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:55884:x1848998399691136:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343271.232751:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343271.232768:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a0c2a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b488ed expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.232797:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a0c31 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343271.232808:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a0c31 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.232818:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a0c31 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.232912:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a0c2a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b488ed expref: 289 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.232927:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a0c31 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b488ed expref: 288 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.232935:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e3:0x0].0x0 (ffff9401f669d800) 00010000:00010000:3.0:1763343271.232938:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343271.232941:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3916200, rc 0) 00000100:00100000:3.0:1763343271.232982:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:55884:x1848998399691136:12345-192.168.201.40@tcp:101:bash.0 Request processed in 250us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343271.232988:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10230 00000100:00100000:3.0:1763343271.237421:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:3.0:1763343271.239904:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a0b4a lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.239917:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a0b4a lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.239923:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a0b4a lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.239940:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343271.239945:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a0b4a lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.239951:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a0b4a lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.239975:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8800) 00010000:00010000:3.0:1763343271.239981:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343271.239986:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a0b4a lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.239993:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a0b4a lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.240008:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a0b97 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.240014:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a0b97 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.240020:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a0b97 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.240046:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343271.240050:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a0b97 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.240056:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a0b97 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.240064:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e0:0x0].0x0 (ffff9400c48a8a00) 00010000:00010000:3.0:1763343271.240066:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343271.240069:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a0b97 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.240074:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a0b97 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.240084:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0bc8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.240089:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0bc8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.240100:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0bc8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.240110:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401ed154e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343271.240115:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0bc8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.240124:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0bc8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.240132:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8800) 00010000:00010000:3.0:1763343271.240134:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343271.240137:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0bc8 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.240142:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0bc8 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.240155:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0bf9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.240160:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0bf9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.240165:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0bf9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.240169:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343271.240172:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0bf9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.240176:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0bf9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.240181:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e0:0x0].0x0 (ffff9400c48a8a00) 00010000:00010000:3.0:1763343271.240183:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343271.240185:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0bf9 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.240189:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0bf9 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000100:00100000:0.0:1763343271.240450:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412918400:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343271.240483:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343271.240500:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763343271.240505:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412918272:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343271.240525:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343271.240551:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412918400 00000100:00100000:0.0:1763343271.240556:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412918400 00000100:00100000:0.0:1763343271.240583:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412918272 00000100:00100000:0.0:1763343271.240585:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412918272 00000100:00100000:0.0:1763343271.240600:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6905 00000100:00100000:0.0:1763343271.240606:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+95:3660:x1848998412918400:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763343271.240701:0:35266:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x28c:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763343271.240705:0:35266:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x28c:0x0] updating lvb mtime from disk: 1763343270 -> 1763343270 00002000:00010000:0.0:1763343271.240707:0:35266:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x28c:0x0] updating lvb atime from disk: 1763343270 -> 1763343270 00002000:00010000:0.0:1763343271.240709:0:35266:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x28c:0x0] updating lvb ctime from disk: 1763343270 -> 1763343270 00002000:00010000:0.0:1763343271.240711:0:35266:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x28c:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763343271.240741:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+96:3660:x1848998412918400:12345-0@lo:2:osp-syn-0-1.0 Request processed in 134us (256us total) trans 21474839049 rc 0/0 00000100:00100000:0.0:1763343271.240747:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6905 00000100:00100000:0.0:1763343271.240761:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6906 00000100:00100000:0.0:1763343271.240767:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+95:3660:x1848998412918272:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763343271.240778:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:655 count 1 00002000:00010000:0.0:1763343271.240797:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x28f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343271.240802:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401ed155600/0x9104b1ba770a0c4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.240816:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.240819:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.240823:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401ed155600/0x9104b1ba770a0c4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.240833:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401ed155600/0x9104b1ba770a0c4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.240840:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401ed155600/0x9104b1ba770a0c4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.240846:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401ed155600/0x9104b1ba770a0c4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.240860:0:35266:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343271.240975:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+96:3660:x1848998412918272:12345-0@lo:6:osp-syn-0-1.0 Request processed in 207us (447us total) trans 21474839050 rc 0/0 00000100:00100000:0.0:1763343271.240981:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6906 00000004:00080000:0.0:1763343271.241010:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401efc71500/2, rc 0, transno 21474839050 00000100:00100000:0.0:1763343271.241015:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412918272:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1763343271.241046:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401efc73800/2, rc 0, transno 21474839049 00000100:00100000:0.0:1763343271.241050:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412918400:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1763343271.241062:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343271.241066:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9401ed155600/0x9104b1ba770a0c4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.241078:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401ed155600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343271.241081:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9401ed155600/0x9104b1ba770a0c4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.241088:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9401ed155600/0x9104b1ba770a0c4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.241098:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9401ed155600/0x9104b1ba770a0c4d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.241105:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401ed155600/0x9104b1ba770a0c4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.241117:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343271.241118:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343271.241120:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:0.0:1763343271.241154:0:19639:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000049ce9e44 reply state 00000000aa0f5c74 transno 4294973229 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a0c00 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343271.241164:0:19639:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a0c00 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343271.241170:0:19639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e0:0x0].0x0 (ffff9400c48a8a00) 00010000:00010000:0.0:1763343271.241172:0:19639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763343271.241175:0:19639:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343271.241179:0:19639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e0:0x0].0x0 (ffff9400c48a8a00) 00010000:00010000:0.0:1763343271.241181:0:19639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343271.241186:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a09ec lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1e0:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48829 expref: 275 pid: 9827 timeout: 0 lvb_type: 0 00010000:00080000:0.0:1763343271.241245:0:19639:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763343271.241253:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+275:57045:x1848998399690624:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 16769us (17759us total) trans 4294973229 rc 0/0 00000100:00100000:0.0:1763343271.241260:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3590 00000100:00100000:3.0:1763343271.241361:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412918144:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343271.241385:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343271.241408:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343271.241413:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412918528:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343271.241427:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343271.241755:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412918144 00000100:00100000:0.0:1763343271.241761:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412918144 00000100:00100000:0.0:1763343271.241792:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412918528 00000100:00100000:0.0:1763343271.241795:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412918528 00000100:00100000:0.0:1763343271.241812:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6907 00000100:00100000:0.0:1763343271.241819:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+97:3662:x1848998412918144:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763343271.241833:0:11289:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:654 count 1 00010000:00010000:0.0:1763343271.241847:0:11289:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401ed155c00/0x9104b1ba770a0c54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.241859:0:11289:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a0b04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48899 expref: 50 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.241866:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343271.241867:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343271.241870:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401ed155c00/0x9104b1ba770a0c54 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.241896:0:11289:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a0b04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48899 expref: 50 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.241913:0:11289:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a0b04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48899 expref: 50 pid: 28561 timeout: 1164 lvb_type: 0 00000100:00100000:0.0:1763343271.241932:0:11289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11289:1848998412918656:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343271.241976:0:11289:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc52300 going to sleep for 11 seconds 00000100:00100000:0.0:1763343271.241994:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6908 00000100:00100000:0.0:1763343271.242000:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+97:3662:x1848998412918528:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763343271.242108:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x28d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343271.242112:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x28d:0x0] updating lvb mtime from disk: 1763343270 -> 1763343270 00002000:00010000:0.0:1763343271.242114:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x28d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343271.242116:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x28d:0x0] updating lvb ctime from disk: 1763343270 -> 1763343270 00002000:00010000:0.0:1763343271.242118:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x28d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343271.242163:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+98:3662:x1848998412918528:12345-0@lo:2:osp-syn-0-1.0 Request processed in 163us (733us total) trans 21474839051 rc 0/0 00000100:00100000:0.0:1763343271.242170:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6908 00000100:00100000:3.0:1763343271.245449:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.246080:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.248544:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399691776 00000100:00100000:3.0:1763343271.248552:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399691776 00000100:00100000:0.0:1763343271.248564:0:11289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11289:1848998412918656:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343271.248582:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a0afd lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48892 expref: 15 pid: 35266 timeout: 1164 lvb_type: 0 00010000:00010000:0.0:1763343271.248591:0:11289:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9401ed155c00/0x9104b1ba770a0c54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343271.248616:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399691904 00000100:00100000:3.0:1763343271.248620:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399691904 00010000:00010000:3.0:1763343271.248633:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a0b04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48899 expref: 51 pid: 28561 timeout: 1164 lvb_type: 0 00000100:00100000:3.0:1763343271.248660:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3315 00000100:00100000:3.0:1763343271.248674:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+51:2408:x1848998399691904:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343271.248687:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343271.248697:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a0b04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48899 expref: 51 pid: 28561 timeout: 1164 lvb_type: 0 00010000:00010000:3.0:1763343271.248722:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a0b04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48899 expref: 51 pid: 28561 timeout: 1164 lvb_type: 0 00010000:00010000:3.0:1763343271.248747:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a0b04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48899 expref: 51 pid: 28561 timeout: 1164 lvb_type: 0 00010000:00010000:3.0:1763343271.248760:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343271.248764:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343271.248770:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9401ed155c00/0x9104b1ba770a0c54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.248782:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401ed155c00/0x9104b1ba770a0c54 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.251510:0:11289:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9401ed155c00/0x9104b1ba770a0c54 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.251529:0:11289:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401ed155c00/0x9104b1ba770a0c54 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.251539:0:11289:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401ed155c00/0x9104b1ba770a0c54 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.251553:0:11289:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401ed155c00/0x9104b1ba770a0c54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.251575:0:11289:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343271.251587:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343271.251662:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+50:2408:x1848998399691904:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 2988us (3333us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343271.251678:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3315 00000100:00100000:0.0:1763343271.251814:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+98:3662:x1848998412918144:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9994us (10426us total) trans 21474839052 rc 0/0 00000100:00100000:0.0:1763343271.251824:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6907 00000004:00080000:3.0:1763343271.251856:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401efc71c00/2, rc 0, transno 21474839052 00000100:00100000:3.0:1763343271.251864:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412918144:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343271.253772:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399692160 00000100:00100000:3.0:1763343271.253782:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399692160 00000100:00100000:3.0:1763343271.253840:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10234 00000100:00100000:3.0:1763343271.253850:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+276:55884:x1848998399692160:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343271.253870:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343271.253874:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343271.253897:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a0c62 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b488fb expref: 276 pid: 6526 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.253913:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e3:0x0].0x0 (ffff9401f669d800) 00010000:00010000:3.0:1763343271.253918:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343271.253930:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a0c69 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48902 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.253976:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a0c70 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343271.253988:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a0c70 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e3:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.253996:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a0c70 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e3:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000040:00080000:3.0:1763343271.254243:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1609, 88 off134512 00000004:00080000:3.0:1763343271.254251:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1064378226385ns, next at 1064470143068ns, rc = 0 00000040:00080000:3.0:1763343271.254293:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1617, 88 off135208 00000004:00080000:3.0:1763343271.254299:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1064378274129ns, next at 1064470181035ns, rc = 0 00000040:00080000:3.0:1763343271.254355:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1618, 88 off135296 00000004:00080000:3.0:1763343271.254360:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1064378335291ns, next at 1064470181035ns, rc = 0 00000040:00080000:3.0:1763343271.254381:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1610, 88 off134600 00000004:00080000:3.0:1763343271.254385:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1064378360846ns, next at 1064470143068ns, rc = 0 00000100:00100000:0.0:1763343271.254833:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.256238:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399692416 00000100:00100000:3.0:1763343271.256251:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399692416 00000100:00100000:3.0:1763343271.256626:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3591 00000100:00100000:3.0:1763343271.256636:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82cac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:57045:x1848998399692416:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:3.0:1763343271.256853:0:19639:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1e0:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1763343271.256904:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1611, 64 off134664 00000040:00080000:3.0:1763343271.256921:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1619, 64 off135360 00000040:00080000:3.0:1763343271.256929:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1620, 64 off135424 00000040:00080000:3.0:1763343271.256939:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1612, 64 off134728 00010000:00010000:3.0:1763343271.256995:0:19639:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0c77 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19639 initiator: MDT0 00010000:00010000:3.0:1763343271.257011:0:19639:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0c77 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343271.257264:0:19639:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0c77 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343271.257275:0:19639:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0c77 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343271.257290:0:19639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0c77 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343271.257296:0:19639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0c77 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343271.257863:0:19639:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343271.258390:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82cac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+275:57045:x1848998399692416:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1754us (3557us total) trans 4294973233 rc 0/0 00000100:00100000:3.0:1763343271.258400:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3591 00000100:00100000:3.0:1763343271.258499:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343271.258508:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412919168:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343271.258533:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343271.258586:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a0c70 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1e3:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48902 expref: 275 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.258595:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e3:0x0].0x0 (ffff9401f669d800) 00010000:00010000:3.0:1763343271.258598:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763343271.258609:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a0c69 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48902 expref: 275 pid: 33856 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763343271.258623:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a0c70 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1e3:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48902 expref: 274 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.258648:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e3:0x0].0x0 (ffff9401f669d800) 00010000:00010000:3.0:1763343271.258653:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763343271.258657:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c589ba00, rc 0) 00000100:00100000:3.0:1763343271.258681:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+274:55884:x1848998399692160:12345-192.168.201.40@tcp:101:bash.0 Request processed in 4833us (5677us total) trans 4294973232 rc 0/0 00000100:00100000:3.0:1763343271.258689:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10234 00010000:00010000:0.0:1763343271.258937:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343271.258943:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0c77 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343271.258955:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343271.258959:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0c77 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343271.258968:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0c77 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343271.258977:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e0:0x0].0x0 (ffff9400c48a8a00) 00010000:00010000:0.0:1763343271.258980:0:7451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343271.258983:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0c77 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343271.258988:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0c77 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343271.258998:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343271.258999:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343271.259001:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343271.259036:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412919040:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343271.259064:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343271.259092:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763343271.259098:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6402680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412918912:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343271.259117:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343271.259147:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412919040 00000100:00100000:0.0:1763343271.259151:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412919040 00000100:00100000:0.0:1763343271.259178:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412918912 00000100:00100000:0.0:1763343271.259181:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412918912 00000100:00100000:0.0:1763343271.259199:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6911 00000100:00100000:0.0:1763343271.259211:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+12:3660:x1848998412919040:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343271.259299:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+13:3660:x1848998412919040:12345-0@lo:2:osp-syn-1-1.0 Request processed in 94us (234us total) trans 17179871783 rc 0/0 00000100:00100000:0.0:1763343271.259306:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6911 00000100:00100000:0.0:1763343271.259320:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6912 00000100:00100000:0.0:1763343271.259342:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+100:3660:x1848998412918912:12345-0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763343271.260994:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400cc5dce00/2, rc 0, transno 17179871782 00000100:00100000:0.0:1763343271.261194:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+100:3660:x1848998412918912:12345-0@lo:2:osp-syn-0-1.0 Request processed in 1867us (2075us total) trans 21474839054 rc 0/0 00000100:00100000:0.0:1763343271.261202:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6912 00000100:00100000:3.0:1763343271.261355:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412919168:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763343271.261380:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6401500/2, rc 0, transno 21474839053 00000100:00100000:3.0:1763343271.261383:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6401500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412918784:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343271.262548:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399692544 00000100:00100000:0.0:1763343271.262556:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399692544 00000100:00100000:0.0:1763343271.262806:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6913 00000100:00100000:0.0:1763343271.262817:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+50:55884:x1848998399692544:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343271.262833:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.262853:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401ed155000/0x9104b1ba770a0c7e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48909 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343271.262879:0:28562:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x290:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343271.262899:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.262901:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.262909:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401ed155000/0x9104b1ba770a0c7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48909 expref: 51 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.262925:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9401ed155000/0x9104b1ba770a0c7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48909 expref: 51 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.262937:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401ed155000, rc 0) 00000100:00100000:0.0:1763343271.263431:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+51:55884:x1848998399692544:12345-192.168.201.40@tcp:101:bash.0 Request processed in 613us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.263439:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6913 00000100:00100000:3.0:1763343271.265101:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399692800 00000100:00100000:3.0:1763343271.265112:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399692800 00000100:00100000:3.0:1763343271.267975:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.275698:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399693440 00000100:00100000:3.0:1763343271.275706:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399693440 00000100:00100000:3.0:1763343271.275751:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3592 00000100:00100000:3.0:1763343271.275760:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+276:57045:x1848998399693440:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343271.275942:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+277:57045:x1848998399693440:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 183us (312us total) trans 4294973235 rc 0/0 00000100:00100000:3.0:1763343271.275949:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3592 00000100:00100000:3.0:1763343271.282414:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399693824 00000100:00100000:3.0:1763343271.282424:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399693824 00000100:00100000:3.0:1763343271.282477:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10236 00000100:00100000:3.0:1763343271.282488:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+277:57045:x1848998399693824:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343271.282507:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343271.282528:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a0caf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4891e expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.282624:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a0cb6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343271.282643:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a0cb6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e3:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.282655:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a0cb6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e3:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:3.0:1763343271.282668:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e3:0x0]: returning size 2 00010000:00010000:3.0:1763343271.282765:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a0caf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e3:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4891e expref: 280 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.282783:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a0cb6 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1e3:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4891e expref: 279 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.282791:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e3:0x0].0x0 (ffff9401f669d800) 00010000:00010000:3.0:1763343271.282794:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763343271.282797:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d1e9ea00, rc 0) 00000100:00100000:3.0:1763343271.282851:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+279:57045:x1848998399693824:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 365us (739us total) trans 4294973236 rc 0/0 00000100:00100000:3.0:1763343271.282858:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10236 00000100:00100000:3.0:1763343271.285550:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399694336 00000100:00100000:3.0:1763343271.285558:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399694336 00000100:00100000:3.0:1763343271.285598:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3594 00000100:00100000:3.0:1763343271.285608:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:57045:x1848998399694336:12345-192.168.201.40@tcp:35:lfs.0 00000004:00010000:3.0:1763343271.285654:0:19639:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x1e3:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a0cb6 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1e3:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4891e expref: 278 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.285682:0:19639:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0cd9 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19639 initiator: MDT0 00010000:00010000:3.0:1763343271.285694:0:19639:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0cd9 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343271.285701:0:19639:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0cd9 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00000004:00020000:3.0:1763343271.285803:0:19639:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0001-mdtlov: can not set all stale mirrors for [0x240000404:0x1e3:0x0]: rc = -1 00010000:00010000:3.0:1763343271.285824:0:19639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0cd9 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343271.285831:0:19639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0cd9 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1e3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343271.285837:0:19639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0cd9 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1e3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343271.285842:0:19639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85aa600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343271.285846:0:19639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0cd9 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1e3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343271.285852:0:19639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0cd9 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1e3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343271.285860:0:19639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e3:0x0].0x0 (ffff9401f669d800) 00010000:00010000:3.0:1763343271.285862:0:19639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1763343271.285865:0:19639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0cd9 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1e3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343271.285870:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0cd9 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1e3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343271.285879:0:19639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e3:0x0].0x0 (ffff9401f669d800) 00010000:00010000:3.0:1763343271.285881:0:19639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763343271.285885:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a0cb6 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1e3:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4891e expref: 278 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343271.286012:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:57045:x1848998399694336:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 405us (617us total) trans 4294973238 rc -1/-1 00000100:00100000:3.0:1763343271.286020:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3594 00000100:00100000:3.0:1763343271.290774:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399694464 00000100:00100000:3.0:1763343271.290783:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399694464 00000100:00100000:3.0:1763343271.290845:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10238 00000100:00100000:3.0:1763343271.290856:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c511fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:57045:x1848998399694464:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343271.290880:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343271.290901:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa400/0x9104b1ba770a0ce0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48925 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.290954:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa400/0x9104b1ba770a0ce0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48925 expref: 279 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.290987:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa400/0x9104b1ba770a0ce0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48925 expref: 279 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.291005:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e3:0x0].0x0 (ffff9400c488b900) 00010000:00010000:3.0:1763343271.291008:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343271.291012:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c85aa400, rc 0) 00000100:00100000:0.0:1763343271.291459:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1848998412919424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1763343271.291516:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343271.291569:0:6530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412919296 00000100:00100000:0.0:1763343271.291575:0:6530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412919296 00000100:00100000:0.0:1763343271.291959:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:0.0:1763343271.291970:0:6530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3662:x1848998412919296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1763343271.291998:0:6530:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445888000 avail 1299648512 00000100:00100000:0.0:1763343271.292069:0:6530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3662:x1848998412919296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.292077:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00100000:0.0:1763343271.292134:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1848998412919424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1763343271.292154:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763343271.292163:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1848998412919552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1763343271.292189:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343271.293058:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412919296:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1763343271.293235:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1763343271.294497:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:3.0:1763343271.294512:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c511d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1848998412919936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763343271.295321:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:0.0:1763343271.295341:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c511ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1848998412920064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763343271.296439:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c511ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1848998412920064:12345-0@lo:400:kworker.0 Request processed in 1095us (2143us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.296450:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:3.0:1763343271.296478:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c511d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1848998412919936:12345-0@lo:400:kworker.0 Request processed in 1966us (2846us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.296482:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:3.0:1763343271.296492:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:0.0:1763343271.296499:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c511c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1848998412920576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763343271.296549:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c511c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1848998412920576:12345-0@lo:400:kworker.0 Request processed in 57us (2185us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.296555:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00080000:0.0:1763343271.296579:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1763343271.296584:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1763343271.296628:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.296676:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.296691:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399694592 00000100:00100000:0.0:1763343271.296698:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399694592 00000100:00100000:0.0:1763343271.296729:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10239 00000100:00100000:0.0:1763343271.296736:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+279:57051:x1848998399694592:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343271.296748:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.296770:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0ce7 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4892c expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.296833:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0cee lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343271.296847:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0cee lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.296858:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0cee lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.296869:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0cf5 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343271.296875:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0cf5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.296881:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0cf5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.296925:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0cee lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.296932:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0cee lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.296937:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0cee lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.296942:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0cee lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.296947:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401ed154800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.296951:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0cee lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.296958:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0cee lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.296972:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f669e300) 00010000:00010000:0.0:1763343271.296975:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.296979:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0cee lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.296985:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0cee lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.296999:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0cf5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.297004:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0cf5 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.297009:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0cf5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.297014:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401ed155600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.297016:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0cf5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.297021:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0cf5 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.297058:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadb200) 00010000:00010000:0.0:1763343271.297071:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.297075:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0cf5 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.297081:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0cf5 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.297111:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0ce7 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4892c expref: 280 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.297128:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f669e300) 00010000:00010000:0.0:1763343271.297131:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.297136:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0ce7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4892c expref: 280 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.297150:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401ed154e00, rc 0) 00000100:00100000:0.0:1763343271.297195:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+279:57051:x1848998399694592:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 458us (517us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343271.297207:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10239 00000100:00080000:0.0:1763343271.297299:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1763343271.298731:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399694848 00000100:00100000:3.0:1763343271.298741:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399694848 00000100:00100000:3.0:1763343271.298790:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3595 00000100:00100000:3.0:1763343271.298800:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+279:57045:x1848998399694848:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:3.0:1763343271.299076:0:6528:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1e3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1763343271.299127:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1613, 64 off134792 00000040:00080000:3.0:1763343271.299144:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1621, 64 off135488 00000040:00080000:3.0:1763343271.299152:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1622, 64 off135552 00000040:00080000:3.0:1763343271.299158:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1614, 64 off134856 00010000:00010000:3.0:1763343271.299207:0:6528:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0cfc lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 00010000:00010000:3.0:1763343271.299221:0:6528:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0cfc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343271.299231:0:6528:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0cfc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343271.299238:0:6528:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0cfc lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343271.299244:0:6528:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0cfc lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343271.299249:0:6528:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0cfc lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343271.299270:0:6528:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343271.299293:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343271.299302:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0cfc lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343271.299310:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85aa600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343271.299315:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0cfc lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343271.299322:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0cfc lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343271.299345:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e3:0x0].0x0 (ffff9400c488b900) 00010000:00010000:0.0:1763343271.299348:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343271.299353:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0cfc lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343271.299358:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0cfc lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343271.299372:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343271.299375:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343271.299378:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343271.299439:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57045:x1848998399694848:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 639us (2810us total) trans 4294973239 rc 0/0 00000100:00100000:3.0:1763343271.299446:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3595 00000100:00100000:0.0:1763343271.299872:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1848998412919680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1763343271.301868:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399694976 00000100:00100000:3.0:1763343271.301879:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399694976 00000100:00100000:3.0:1763343271.301942:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10240 00000100:00100000:3.0:1763343271.301953:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c511dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57051:x1848998399694976:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343271.301971:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343271.301994:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a0d03 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48933 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343271.306951:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399695104 00000100:00100000:0.0:1763343271.306963:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399695104 00000100:00100000:0.0:1763343271.307553:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10241 00000100:00100000:0.0:1763343271.307568:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57051:x1848998399695104:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343271.307594:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.307619:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0d18 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4893a expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.307684:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0d1f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343271.307700:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0d1f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.307712:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0d1f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:0.0:1763343271.307761:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343271.307767:0:33856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343271.307803:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0d18 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4893a expref: 282 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.307822:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0d1f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4893a expref: 281 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.307831:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f669e300) 00010000:00010000:0.0:1763343271.307834:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343271.307838:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401ed155600, rc 0) 00000100:00100000:0.0:1763343271.307909:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57051:x1848998399695104:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 345us (1710us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.307916:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10241 00000100:00100000:0.0:1763343271.311636:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.317831:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399695616 00000100:00100000:3.0:1763343271.317843:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399695616 00000100:00100000:3.0:1763343271.318064:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10243 00000100:00100000:3.0:1763343271.318075:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57051:x1848998399695616:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343271.318098:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343271.318102:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343271.318129:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0d1f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4893a expref: 281 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.319127:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f669e300) 00010000:00010000:3.0:1763343271.319146:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343271.319196:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a0d3b lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48948 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.319344:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0d42 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343271.319358:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0d42 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.319370:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0d42 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.319384:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a0d49 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343271.319391:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a0d49 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.319397:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a0d49 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.319729:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a0d50 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343271.319737:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a0d50 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.319743:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a0d50 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:3.0:1763343271.319752:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e5:0x0]: returning size 0 00010000:00010000:3.0:1763343271.319771:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0d42 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.319790:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0d42 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.319795:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0d42 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.319801:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85aa600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343271.319805:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0d42 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.319812:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0d42 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.319821:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b500) 00010000:00010000:3.0:1763343271.319824:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343271.319827:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0d42 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.319832:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a0d42 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:3.0:1763343271.319841:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000be4084eb reply state 00000000eb3abfe4 transno 4294973240 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a0d49 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.319850:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a0d49 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.319855:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadb200) 00010000:00010000:3.0:1763343271.319857:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343271.319859:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343271.319900:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a0d3b lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48948 expref: 283 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.319916:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a0d50 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48948 expref: 282 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.319923:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e5:0x0].0x0 (ffff9400c488b300) 00010000:00010000:3.0:1763343271.319926:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343271.319929:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d1e9ea00, rc 0) 00000100:00100000:3.0:1763343271.320092:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57051:x1848998399695616:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2017us (2909us total) trans 4294973240 rc 0/0 00000100:00100000:3.0:1763343271.320101:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10243 00000100:00100000:3.0:1763343271.324270:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.327667:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.327817:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399696000 00000100:00100000:3.0:1763343271.327825:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399696000 00010000:00010000:3.0:1763343271.327860:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a0d50 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48948 expref: 285 pid: 33856 timeout: 1164 lvb_type: 0 00000100:00100000:3.0:1763343271.327906:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3316 00000100:00100000:3.0:1763343271.327917:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:2408:x1848998399696000:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343271.327932:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343271.327939:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a0d50 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48948 expref: 285 pid: 33856 timeout: 1164 lvb_type: 0 00010000:00010000:3.0:1763343271.327951:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a0d50 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48948 expref: 285 pid: 33856 timeout: 1164 lvb_type: 0 00010000:00010000:3.0:1763343271.327973:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a0d50 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48948 expref: 285 pid: 33856 timeout: 1164 lvb_type: 0 00010000:00010000:3.0:1763343271.327988:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e5:0x0].0x0 (ffff9400c488b300) 00010000:00010000:3.0:1763343271.327993:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a0d65 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.328002:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a0d65 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.328009:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a0d65 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1e5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.328056:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343271.328115:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:2408:x1848998399696000:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 199us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343271.328127:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3316 00000100:00100000:3.0:1763343271.329077:0:8617:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b29500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8617:1848998412920832:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1763343271.329117:0:8617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343271.329150:0:8617:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc440300 going to sleep for 11 seconds 00000100:00100000:3.0:1763343271.333207:0:8617:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b29500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8617:1848998412920832:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1763343271.333224:0:8617:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x293:0x0]-[0x280000400:0x2c1:0x0] 00000100:00100000:0.0:1763343271.334204:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.334294:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399696384 00000100:00100000:3.0:1763343271.334303:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399696384 00000100:00100000:3.0:1763343271.334366:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3596 00000100:00100000:3.0:1763343271.334377:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82c8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57051:x1848998399696384:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343271.334641:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82c8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57051:x1848998399696384:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 265us (438us total) trans 4294973242 rc 0/0 00000100:00100000:3.0:1763343271.334650:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3596 00000100:00100000:3.0:1763343271.336888:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.336888:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.340322:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.340374:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.347092:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.347140:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.348270:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399697792 00000100:00100000:3.0:1763343271.348277:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399697792 00000100:00100000:3.0:1763343271.348667:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3598 00000100:00100000:3.0:1763343271.348677:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57053:x1848998399697792:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343271.349938:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57053:x1848998399697792:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1256us (2790us total) trans 4294973246 rc 0/0 00000100:00100000:3.0:1763343271.349948:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3598 00000100:00100000:0.0:1763343271.351171:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.361408:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412920960:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343271.361433:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a0dff lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e5:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:3.0:1763343271.361548:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.364186:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399699200 00000100:00100000:0.0:1763343271.364196:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399699200 00000100:00100000:0.0:1763343271.364251:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10252 00000100:00100000:0.0:1763343271.364262:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57053:x1848998399699200:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343271.364281:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.364303:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0e06 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4898e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.364393:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0e0d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343271.364406:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0e0d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.364417:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0e0d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.364428:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0e14 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343271.364435:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0e14 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.364442:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0e14 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.364526:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0e1b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343271.364535:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0e1b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e5:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.364704:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0e1b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e5:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:0.0:1763343271.364717:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e5:0x0]: returning size 2 00010000:00010000:0.0:1763343271.364789:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0e1b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e5:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.364797:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0e1b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1e5:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.364803:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0e1b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e5:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.364809:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401ed155c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.364812:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0e1b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e5:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.364819:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0e1b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e5:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.364830:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e5:0x0].0x0 (ffff9400ccadb900) 00010000:00010000:0.0:1763343271.364833:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1763343271.364838:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0e1b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1e5:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.364844:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0e1b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e5:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.364925:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0e0d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.364933:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0e0d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.364939:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0e0d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.364944:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0e0d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.364949:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401ed154800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.364951:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0e0d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.364957:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0e0d lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.364964:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f669ee00) 00010000:00010000:0.0:1763343271.364967:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.364970:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0e0d lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.364976:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0e0d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.364985:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0e14 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.364990:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0e14 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.364995:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0e14 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.364999:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401ed154e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.365002:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0e14 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.365007:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0e14 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.365014:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadb200) 00010000:00010000:0.0:1763343271.365017:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.365020:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0e14 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.365237:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0e14 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.365349:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0e06 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4898e expref: 299 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.365360:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f669ee00) 00010000:00010000:0.0:1763343271.365362:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343271.365367:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a0e06 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4898e expref: 299 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.365380:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401ed155600, rc 0) 00000100:00100000:0.0:1763343271.365486:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57053:x1848998399699200:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1225us (2168us total) trans 4294973252 rc 301/301 00000100:00100000:0.0:1763343271.365494:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10252 00000001:00080000:3.0:1763343271.366443:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973251 is committed 00000004:00080000:3.0:1763343271.366452:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1043 committed 00000004:00080000:3.0:1763343271.366463:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1035 committed 00000004:00080000:3.0:1763343271.366474:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1034 committed 00000004:00080000:3.0:1763343271.366476:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1042 committed 00000100:00100000:3.0:1763343271.367114:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c372b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412921088:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343271.367182:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343271.367234:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412921600:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343271.367268:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343271.367291:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1763343271.367298:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c3728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412921216:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343271.367335:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343271.367443:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412922240:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343271.367475:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c3728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412921472:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343271.368203:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412921216 00000100:00100000:0.0:1763343271.368209:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412921216 00000100:00100000:3.0:1763343271.368230:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412921728:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343271.368265:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763343271.368306:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5178000/2, rc 0, transno 17179871785 00000100:00100000:3.0:1763343271.368314:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412921600:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343271.368342:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412922112:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343271.369361:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412921728 00000100:00100000:0.0:1763343271.369369:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412921728 00000100:00100000:0.0:1763343271.369580:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412921344 00000100:00100000:0.0:1763343271.369584:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412921344 00000100:00100000:0.0:1763343271.369603:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412921856 00000100:00100000:0.0:1763343271.369606:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412921856 00000100:00100000:0.0:1763343271.369623:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6921 00000100:00100000:0.0:1763343271.369631:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+16:3661:x1848998412921728:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343271.369727:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6922 00000100:00100000:3.0:1763343271.369738:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+17:3659:x1848998412921344:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763343271.369753:0:35281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:657 count 1 00002000:00010000:0.0:1763343271.369763:0:11289:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x294:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343271.369768:0:11289:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x294:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343271.369770:0:11289:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x294:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343271.369772:0:11289:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x294:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343271.369775:0:11289:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x294:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:3.0:1763343271.369811:0:35281:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a0e37 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x291:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343271.369812:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+17:3661:x1848998412921728:12345-0@lo:2:osp-syn-1-1.0 Request processed in 181us (1550us total) trans 17179871786 rc 0/0 00000100:00100000:0.0:1763343271.369835:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6921 00010000:00010000:3.0:1763343271.369837:0:35281:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a0ca8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x291:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48917 expref: 16 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.369846:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343271.369848:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343271.369853:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a0e37 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x291:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343271.369857:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6923 00000100:00100000:0.0:1763343271.369874:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+101:3659:x1848998412921856:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1763343271.369886:0:35281:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a0ca8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x291:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48917 expref: 16 pid: 28562 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1763343271.369889:0:11289:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:652 count 1 00010000:00010000:3.0:1763343271.369900:0:35281:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a0ca8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x291:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48917 expref: 16 pid: 28562 timeout: 1164 lvb_type: 0 00010000:00010000:0.0:1763343271.369907:0:11289:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a0e3e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343271.369913:0:35281:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b2aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35281:1848998412922880:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343271.369928:0:11289:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a0aa9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x28c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4886f expref: 52 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343271.369935:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.369937:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.369940:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a0e3e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.369962:0:11289:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a0aa9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x28c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4886f expref: 52 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343271.369972:0:11289:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a0aa9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x28c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4886f expref: 52 pid: 35266 timeout: 1164 lvb_type: 1 00000100:00100000:0.0:1763343271.369983:0:11289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11289:1848998412923008:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343271.369985:0:35281:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc4406c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343271.370012:0:11289:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc520c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343271.370075:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399699456 00000100:00100000:0.0:1763343271.370080:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399699456 00000100:00100000:0.0:1763343271.370109:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3600 00000100:00100000:0.0:1763343271.370117:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+275:57053:x1848998399699456:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343271.370258:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+276:57053:x1848998399699456:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 140us (1749us total) trans 4294973253 rc 0/0 00000100:00100000:0.0:1763343271.370274:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3600 00010000:00010000:0.0:1763343271.372343:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343271.372351:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5089200/0x9104b1ba770a0e53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.372361:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343271.372365:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5089200/0x9104b1ba770a0e53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.372374:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5089200/0x9104b1ba770a0e53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.372386:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5089200/0x9104b1ba770a0e53 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.372392:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5089200/0x9104b1ba770a0e53 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.372409:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343271.372412:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343271.372415:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343271.372480:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399699584 00000100:00100000:0.0:1763343271.372485:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399699584 00000100:00100000:0.0:1763343271.372710:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6930 00000100:00100000:0.0:1763343271.372719:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:55884:x1848998399699584:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343271.372729:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.372741:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0e61 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48995 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343271.372755:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x293:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343271.372766:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.372768:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.372774:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0e61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48995 expref: 18 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.372786:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0e61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48995 expref: 18 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.372795:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917000, rc 0) 00000100:00100000:0.0:1763343271.372841:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:55884:x1848998399699584:12345-192.168.201.40@tcp:101:bash.0 Request processed in 124us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.372848:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6930 00000100:00100000:3.0:1763343271.373126:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.373147:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.373212:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399699712 00000100:00100000:0.0:1763343271.373217:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399699712 00010000:00010000:0.0:1763343271.373238:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a0975 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48806 expref: 18 pid: 35266 timeout: 1164 lvb_type: 0 00000100:00100000:0.0:1763343271.373276:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399699840 00000100:00100000:0.0:1763343271.373280:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399699840 00010000:00010000:0.0:1763343271.373295:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a0bb3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b488ca expref: 19 pid: 8412 timeout: 1164 lvb_type: 0 00000100:00100000:0.0:1763343271.373336:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3318 00000100:00100000:0.0:1763343271.373348:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2407:x1848998399699712:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343271.373359:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343271.373368:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a0975 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x28d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48806 expref: 19 pid: 35266 timeout: 1164 lvb_type: 0 00010000:00010000:0.0:1763343271.373381:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a0975 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x28d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48806 expref: 19 pid: 35266 timeout: 1164 lvb_type: 0 00010000:00010000:0.0:1763343271.373400:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a0975 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x28d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48806 expref: 19 pid: 35266 timeout: 1164 lvb_type: 0 00010000:00010000:0.0:1763343271.373412:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.373416:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.373420:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a0e29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.373430:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a0e29 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.373459:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343271.373488:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2407:x1848998399699712:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 142us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.373496:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3318 00000100:00100000:0.0:1763343271.373515:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3319 00000100:00100000:0.0:1763343271.373524:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2410:x1848998399699840:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343271.373534:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343271.373538:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a0bb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b488ca expref: 17 pid: 8412 timeout: 1164 lvb_type: 0 00010000:00010000:0.0:1763343271.373547:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a0bb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b488ca expref: 17 pid: 8412 timeout: 1164 lvb_type: 0 00010000:00010000:0.0:1763343271.373564:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a0bb3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b488ca expref: 17 pid: 8412 timeout: 1164 lvb_type: 0 00010000:00010000:0.0:1763343271.373579:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.373583:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.373588:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c589be00/0x9104b1ba770a0e30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.373599:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c589be00/0x9104b1ba770a0e30 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.373635:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343271.373660:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2410:x1848998399699840:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 136us (510us total) trans 0 rc 0/0 00010000:00010000:3.0:1763343271.373661:0:8413:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c589be00/0x9104b1ba770a0e30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343271.373673:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3319 00010000:00010000:3.0:1763343271.373677:0:8413:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c589be00/0x9104b1ba770a0e30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.373686:0:8413:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c589be00/0x9104b1ba770a0e30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.373698:0:8413:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c589be00/0x9104b1ba770a0e30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.374633:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763343271.374641:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a0e29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.374650:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5088a00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343271.374654:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a0e29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.374662:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a0e29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.374675:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a0e29 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.374682:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a0e29 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.374700:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343271.374702:0:8413:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1763343271.374704:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c589be00/0x9104b1ba770a0e30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.374712:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c589be00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343271.374715:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c589be00/0x9104b1ba770a0e30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.374722:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c589be00/0x9104b1ba770a0e30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.374731:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c589be00/0x9104b1ba770a0e30 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.374739:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c589be00/0x9104b1ba770a0e30 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.374752:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343271.374754:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343271.374757:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343271.375702:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c372b100/2, rc 0, transno 17179871788 00000100:00100000:0.0:1763343271.375710:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c372b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412921088:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343271.375759:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+18:3661:x1848998412921216:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7504us (8434us total) trans 17179871789 rc 0/0 00000100:00100000:3.0:1763343271.375770:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6920 00010000:00010000:3.0:1763343271.375791:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343271.376042:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c3728e00/2, rc 0, transno 17179871789 00000100:00100000:0.0:1763343271.376049:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c3728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412921216:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343271.377108:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.377128:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.377144:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.377156:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.377177:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.377195:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399699968 00000100:00100000:3.0:1763343271.377202:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399699968 00010000:00010000:3.0:1763343271.377232:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a0ca8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x291:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48917 expref: 16 pid: 28562 timeout: 1164 lvb_type: 0 00000100:00100000:0.0:1763343271.377247:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399700224 00000100:00100000:0.0:1763343271.377253:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399700224 00000100:00100000:3.0:1763343271.377258:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399700096 00000100:00100000:3.0:1763343271.377263:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399700096 00010000:00010000:3.0:1763343271.377279:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a0aa9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x28c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4886f expref: 54 pid: 35266 timeout: 1164 lvb_type: 1 00010000:00010000:0.0:1763343271.377279:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a0bdd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b488d8 expref: 54 pid: 8413 timeout: 1164 lvb_type: 0 00000100:00100000:0.0:1763343271.377314:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3320 00000100:00100000:0.0:1763343271.377341:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2409:x1848998399699968:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343271.377357:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343271.377363:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a0ca8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x291:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48917 expref: 16 pid: 28562 timeout: 1164 lvb_type: 0 00010000:00010000:0.0:1763343271.377375:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a0ca8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x291:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48917 expref: 16 pid: 28562 timeout: 1164 lvb_type: 0 00010000:00010000:0.0:1763343271.377399:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.377401:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.377405:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a0e37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x291:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.377415:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a0e37 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x291:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.377433:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343271.377480:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2409:x1848998399699968:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 157us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.377488:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3320 00000100:00100000:0.0:1763343271.377503:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3321 00000100:00100000:0.0:1763343271.377511:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+55:2409:x1848998399700224:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343271.377520:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343271.377524:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a0bdd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b488d8 expref: 55 pid: 8413 timeout: 1164 lvb_type: 0 00010000:00010000:0.0:1763343271.377533:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a0bdd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b488d8 expref: 55 pid: 8413 timeout: 1164 lvb_type: 0 00010000:00010000:0.0:1763343271.377545:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.377547:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.377550:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5089600/0x9104b1ba770a0e4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.377557:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089600/0x9104b1ba770a0e4c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.377572:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343271.377591:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+55:2409:x1848998399700224:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 81us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.377598:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3321 00000100:00100000:0.0:1763343271.377637:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3322 00000100:00100000:0.0:1763343271.377644:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6507800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+54:2409:x1848998399700096:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343271.377652:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343271.377656:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a0aa9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x28c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4886f expref: 54 pid: 35266 timeout: 1164 lvb_type: 1 00010000:00010000:0.0:1763343271.377665:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a0aa9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x28c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4886f expref: 54 pid: 35266 timeout: 1164 lvb_type: 1 00010000:00010000:0.0:1763343271.377676:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.377677:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.377680:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a0e3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.377688:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a0e3e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.377699:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343271.377717:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6507800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+54:2409:x1848998399700096:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 73us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.377723:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3322 00000100:00100000:0.0:1763343271.377737:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3323 00000100:00100000:0.0:1763343271.377744:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6506d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+53:2409:x1848998399700480:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343271.377751:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343271.377756:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9401ed155000/0x9104b1ba770a0c7e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x290:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48909 expref: 53 pid: 28562 timeout: 1164 lvb_type: 0 00010000:00010000:0.0:1763343271.377765:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9401ed155000/0x9104b1ba770a0c7e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x290:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48909 expref: 53 pid: 28562 timeout: 1164 lvb_type: 0 00010000:00010000:0.0:1763343271.377778:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.377780:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.377783:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400cbad3c00/0x9104b1ba770a0e5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x290:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.377790:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400cbad3c00/0x9104b1ba770a0e5a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x290:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.377804:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343271.377834:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6506d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+52:2409:x1848998399700480:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 81us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.377849:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3323 00010000:00010000:0.0:1763343271.378209:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343271.378217:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a0e3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.378228:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3916200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343271.378235:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a0e3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.378252:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a0e3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.378266:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a0e3e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.378273:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a0e3e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.378292:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343271.378295:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343271.378297:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343271.378340:0:35281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a0ca8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x291:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48917 expref: 15 pid: 28562 timeout: 1164 lvb_type: 0 00000100:00100000:0.0:1763343271.378355:0:35281:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35281:1848998412922880:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343271.378372:0:35281:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a0e37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.378381:0:35281:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a0e37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.378387:0:35281:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a0e37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.378395:0:35281:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a0e37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.378403:0:35281:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a0e37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.378422:0:35281:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343271.379103:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.379243:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+18:3659:x1848998412921344:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9496us (10948us total) trans 17179871790 rc 0/0 00000100:00100000:0.0:1763343271.379250:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6922 00000100:00100000:0.0:1763343271.379265:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399700608 00000100:00100000:0.0:1763343271.379269:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399700608 00000100:00100000:0.0:1763343271.379302:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6931 00000100:00100000:0.0:1763343271.379309:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+50:55884:x1848998399700608:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343271.379322:0:35281:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.379351:0:35281:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401ed155600/0x9104b1ba770a0e68 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4899c expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343271.379367:0:35281:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x292:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343271.379381:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.379383:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.379391:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401ed155600/0x9104b1ba770a0e68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4899c expref: 51 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.379404:0:35281:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9401ed155600/0x9104b1ba770a0e68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4899c expref: 51 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.379414:0:35281:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401ed155600, rc 0) 00000100:00100000:0.0:1763343271.379449:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+51:55884:x1848998399700608:12345-192.168.201.40@tcp:101:bash.0 Request processed in 140us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.379456:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6931 00000100:00100000:0.0:1763343271.379797:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399700352 00000100:00100000:0.0:1763343271.379802:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399700352 00000100:00100000:0.0:1763343271.379842:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3601 00000100:00100000:0.0:1763343271.379850:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+276:57053:x1848998399700352:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:0.0:1763343271.380652:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+276:57053:x1848998399700352:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 800us (3519us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.380660:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3601 00000100:00100000:0.0:1763343271.381790:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399700736 00000100:00100000:0.0:1763343271.381797:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399700736 00002000:00010000:0.0:1763343271.381820:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/659 (0->18446744073709551615) 00002000:00100000:0.0:1763343271.381823:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b2c700 with x1848998399700736 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343271.381831:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5b2c700. 00000100:00100000:3.0:1763343271.381833:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399700864 00000100:00100000:3.0:1763343271.381839:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399700864 00002000:00010000:3.0:1763343271.381858:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/658 (0->18446744073709551615) 00000100:00100000:0.0:1763343271.381862:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1665 00002000:00100000:3.0:1763343271.381864:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5178700 with x1848998399700864 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343271.381874:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5178700. 00000100:00100000:0.0:1763343271.381875:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998399700736:12345-192.168.201.40@tcp:10:bash.0 00000100:00100000:3.0:1763343271.381900:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1666 00000100:00100000:3.0:1763343271.381911:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+51:2408:x1848998399700864:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:3.0:1763343271.382104:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x292:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343271.382108:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x292:0x0] updating lvb mtime from disk: 0 -> 1763343270 00002000:00010000:3.0:1763343271.382111:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x292:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343271.382114:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x292:0x0] updating lvb ctime from disk: 0 -> 1763343270 00002000:00010000:3.0:1763343271.382116:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x292:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1763343271.382135:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x293:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343271.382139:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x293:0x0] updating lvb mtime from disk: 0 -> 1763343270 00002000:00010000:0.0:1763343271.382142:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x293:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343271.382144:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x293:0x0] updating lvb ctime from disk: 0 -> 1763343270 00002000:00010000:0.0:1763343271.382145:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x293:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343271.382183:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399700736:12345-192.168.201.40@tcp:10:bash.0 Request processed in 311us (472us total) trans 17179871791 rc 0/0 00000100:00100000:0.0:1763343271.382190:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1665 00002000:00010000:0.0:1763343271.382193:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/659 (0->18446744073709551615) 00002000:00100000:0.0:1763343271.382195:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b2c700 with x1848998399700736 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343271.382199:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5b2c700. 00000100:00100000:3.0:1763343271.383617:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+52:2408:x1848998399700864:12345-192.168.201.40@tcp:10:bash.0 Request processed in 1700us (1858us total) trans 21474839063 rc 0/0 00000100:00100000:3.0:1763343271.383629:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1666 00002000:00010000:3.0:1763343271.383633:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/658 (0->18446744073709551615) 00002000:00100000:3.0:1763343271.383637:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5178700 with x1848998399700864 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343271.383644:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5178700. 00000100:00100000:0.0:1763343271.391945:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399701120 00000100:00100000:0.0:1763343271.391956:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399701120 00000100:00100000:0.0:1763343271.392014:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3602 00000100:00100000:0.0:1763343271.392072:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82ca050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+276:55884:x1848998399701120:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:0.0:1763343271.392379:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82ca050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+277:55884:x1848998399701120:12345-192.168.201.40@tcp:35:bash.0 Request processed in 355us (794us total) trans 4294973254 rc 0/0 00000100:00100000:0.0:1763343271.392387:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3602 00000100:00100000:0.0:1763343271.401641:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399701632 00000100:00100000:0.0:1763343271.401652:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399701632 00000100:00100000:0.0:1763343271.401710:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3603 00000100:00100000:0.0:1763343271.401721:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57054:x1848998399701632:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343271.402009:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:57054:x1848998399701632:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 289us (578us total) trans 4294973256 rc 0/0 00000100:00100000:0.0:1763343271.402017:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3603 00010000:00010000:0.0:1763343271.405189:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343271.405200:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a0ea7 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1e5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.405207:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121fc00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343271.405210:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a0ea7 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1e5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.405216:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a0ea7 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1e5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.405225:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e5:0x0].0x0 (ffff9400ccadb400) 00010000:00010000:0.0:1763343271.405228:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343271.405230:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a0ea7 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1e5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.405235:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a0ea7 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1e5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.405249:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343271.405251:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343271.405253:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343271.418243:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.427522:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.436345:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f648b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+279:57056:x1848998399702528:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1507us (2678us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343271.436354:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10258 00000100:00100000:3.0:1763343271.441947:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.442011:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.442066:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399702656 00000100:00100000:0.0:1763343271.442080:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399702656 00000100:00100000:0.0:1763343271.442138:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399702784 00000100:00100000:0.0:1763343271.442142:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399702784 00000100:00100000:0.0:1763343271.442642:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10260 00000100:00100000:0.0:1763343271.442654:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57056:x1848998399702784:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343271.442668:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.442677:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0f17 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b489cd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.442712:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0f1e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343271.442719:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0f1e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.442727:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0f1e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:0.0:1763343271.442766:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343271.442771:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343271.442806:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0f17 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b489cd expref: 283 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.442823:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0f1e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b489cd expref: 282 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.442830:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb200) 00010000:00010000:0.0:1763343271.442833:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343271.442835:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401ed154800, rc 0) 00000100:00100000:0.0:1763343271.443650:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57056:x1848998399702784:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 994us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.443661:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10260 00000100:00100000:3.0:1763343271.456618:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.459556:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10261 00000100:00100000:0.0:1763343271.459571:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57056:x1848998399703040:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343271.459596:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.459599:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343271.459627:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0f1e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b489cd expref: 280 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.459650:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb200) 00010000:00010000:0.0:1763343271.459663:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343271.459684:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0f25 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b489d4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.459828:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0f2c lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343271.459839:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0f2c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.459848:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0f2c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.459857:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a0f33 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343271.459861:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a0f33 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.459867:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a0f33 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.460340:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a0f3a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343271.460350:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a0f3a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.460363:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a0f3a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:0.0:1763343271.460373:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e6:0x0]: returning size 0 00010000:00010000:0.0:1763343271.460400:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0f2c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.460407:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0f2c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.460413:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0f2c lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.460419:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0f2c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.460425:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401ed155c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.460429:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0f2c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.460436:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0f2c lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.460456:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f669ea00) 00010000:00010000:0.0:1763343271.460459:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.460464:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0f2c lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.460470:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0f2c lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000004:00010000:0.0:1763343271.460482:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000059621ca0 reply state 000000001d0895b0 transno 4294973258 ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a0f33 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.460496:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a0f33 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.460502:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadba00) 00010000:00010000:0.0:1763343271.460505:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343271.460507:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343271.460534:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0f25 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b489d4 expref: 282 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.460557:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a0f3a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b489d4 expref: 281 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.460564:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e6:0x0].0x0 (ffff9401f669ef00) 00010000:00010000:0.0:1763343271.460567:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343271.460569:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c589ba00, rc 0) 00000100:00100000:0.0:1763343271.460653:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57056:x1848998399703040:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1085us (4052us total) trans 4294973258 rc 0/0 00000100:00100000:0.0:1763343271.460661:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10261 00000100:00100000:3.0:1763343271.471749:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.471806:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.472176:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399703296 00000100:00100000:0.0:1763343271.472188:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399703296 00000100:00100000:0.0:1763343271.472246:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399703552 00000100:00100000:0.0:1763343271.472250:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399703552 00000100:00100000:0.0:1763343271.472273:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10262 00000100:00100000:0.0:1763343271.472283:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57056:x1848998399703296:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343271.472310:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.472349:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a0f48 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b489db expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.472471:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0f5d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343271.472615:0:6524:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a0f3a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b489d4 expref: 286 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.472624:0:6524:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a0f56 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.472631:0:6524:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0f5d lrc: 5/0,1 mode: --/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.472683:0:6524:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a0f56 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b489e2 expref: 286 pid: 9827 timeout: 1164 lvb_type: 0 00010000:00010000:0.0:1763343271.472698:0:6524:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a0f56 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b489e2 expref: 286 pid: 9827 timeout: 1164 lvb_type: 0 00000100:00100000:0.0:1763343271.472714:0:6524:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b18e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412923392:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343271.472812:0:6524:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a0f3a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b489d4 expref: 285 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.472823:0:6524:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a0f3a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b489d4 expref: 285 pid: 6524 timeout: 1164 lvb_type: 0 00000100:00100000:0.0:1763343271.472832:0:6524:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412923520:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343271.472855:0:6524:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc526c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343271.474652:0:6524:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b18e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412923392:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343271.475470:0:6524:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412923520:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343271.475503:0:6524:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0f5d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000100:00100000:3.0:1763343271.477142:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.477181:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:0.0:1763343271.478864:0:6524:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0f5d lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.478875:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0f5d lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:0.0:1763343271.478901:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e6:0x0]: returning size 0 00000004:00080000:0.0:1763343271.479107:0:6524:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x294:0x0], index 0: 0 00000004:00080000:0.0:1763343271.479114:0:6524:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x295:0x0], index 1: 0 00000004:00080000:0.0:1763343271.479119:0:6524:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x296:0x0], index 1: 0 00000004:00080000:0.0:1763343271.479123:0:6524:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x295:0x0], index 0: 0 00010000:00010000:0.0:1763343271.479225:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0f5d lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.479233:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0f5d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.479238:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0f5d lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.479244:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401ed154e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.479247:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0f5d lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.479253:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0f5d lrc: 5/0,0 mode: EX/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.479265:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e6:0x0].0x0 (ffff9401f669ef00) 00010000:00010000:0.0:1763343271.479268:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343271.479272:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a0f5d lrc: 3/0,0 mode: --/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.479314:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a0f48 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b489db expref: 285 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.479334:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e6:0x0].0x0 (ffff9401f669ef00) 00010000:00010000:0.0:1763343271.479336:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343271.479340:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a0f48 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b489db expref: 285 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.479351:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c589be00, rc 0) 00000100:00100000:0.0:1763343271.479410:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57056:x1848998399703296:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 7128us (7682us total) trans 4294973260 rc 301/301 00000100:00100000:0.0:1763343271.479418:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10262 00000100:00100000:3.0:1763343271.479795:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.484613:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.484667:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.485299:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10264 00000100:00100000:0.0:1763343271.485312:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57058:x1848998399704320:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343271.485336:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.485366:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0f72 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b489e9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.485433:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0f79 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343271.485448:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0f79 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.485463:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0f79 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.485474:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a0f80 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343271.485482:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a0f80 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.485489:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a0f80 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.485576:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a0f87 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343271.485584:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a0f87 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.485590:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a0f87 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:0.0:1763343271.485599:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e6:0x0]: returning size 0 00010000:00010000:0.0:1763343271.485653:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0f79 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.485660:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0f79 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.485666:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0f79 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.485672:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0f79 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.485678:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401ed155c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.485682:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0f79 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.485688:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0f79 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.485699:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f669ea00) 00010000:00010000:0.0:1763343271.485702:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.485707:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0f79 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.485713:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a0f79 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.485725:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a0f80 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.485730:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a0f80 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.485736:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a0f80 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.485740:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.485743:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a0f80 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.485829:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a0f80 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.485838:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadba00) 00010000:00010000:0.0:1763343271.485841:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.485844:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a0f80 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.485853:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a0f80 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.485884:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a0f72 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b489e9 expref: 288 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.485902:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a0f87 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b489e9 expref: 287 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.485910:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e6:0x0].0x0 (ffff9401f669e000) 00010000:00010000:0.0:1763343271.485912:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343271.485915:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3916200, rc 0) 00000100:00100000:0.0:1763343271.485954:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57058:x1848998399704320:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 647us (1354us total) trans 4294973263 rc 0/0 00000100:00100000:0.0:1763343271.485961:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10264 00000100:00100000:3.0:1763343271.487802:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.488487:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.488557:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.494502:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.499425:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.499493:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.499882:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10266 00000100:00100000:3.0:1763343271.499893:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57058:x1848998399705600:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343271.499902:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343271.499914:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a0fb1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b489fe expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.499967:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a0fb8 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343271.499985:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a0fb8 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1e6:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.499995:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a0fb8 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1e6:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:3.0:1763343271.500008:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e6:0x0]: returning size 0 00010000:00010000:3.0:1763343271.500153:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a0fb1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b489fe expref: 293 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.500167:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a0fb8 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1e6:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b489fe expref: 292 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.500173:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e6:0x0].0x0 (ffff9400ccadb800) 00010000:00010000:3.0:1763343271.500176:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:3.0:1763343271.500179:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8692c00, rc 0) 00000100:00100000:3.0:1763343271.500251:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57058:x1848998399705600:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 360us (758us total) trans 4294973266 rc 0/0 00000100:00100000:3.0:1763343271.500259:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10266 00000100:00100000:3.0:1763343271.504939:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.504985:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.505013:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.505228:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399706368 00000100:00100000:0.0:1763343271.505245:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399706368 00000100:00100000:0.0:1763343271.505293:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 447 00000100:00100000:0.0:1763343271.505303:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:2409:x1848998399706368:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343271.505317:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343271.505356:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a0fb8 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1e6:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b489fe expref: 294 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.505372:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e6:0x0].0x0 (ffff9400ccadb800) 00010000:00010000:0.0:1763343271.505379:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343271.505403:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:2409:x1848998399706368:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 103us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.505420:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 447 00000100:00100000:0.0:1763343271.508496:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.508831:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399706496 00000100:00100000:3.0:1763343271.508838:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399706496 00000100:00100000:3.0:1763343271.508875:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3609 00000100:00100000:3.0:1763343271.508883:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57058:x1848998399706496:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:3.0:1763343271.509155:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57058:x1848998399706496:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 271us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343271.509163:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3609 00000100:00100000:0.0:1763343271.513667:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.539913:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.543907:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399707520 00000100:00100000:3.0:1763343271.543917:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399707520 00010000:00010000:3.0:1763343271.543954:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a0ffe lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a1a expref: 299 pid: 6524 timeout: 1164 lvb_type: 0 00000100:00100000:3.0:1763343271.543989:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3326 00000100:00100000:3.0:1763343271.543999:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6488700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:2408:x1848998399707520:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343271.544015:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343271.544021:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a0ffe lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a1a expref: 299 pid: 6524 timeout: 1164 lvb_type: 0 00010000:00010000:3.0:1763343271.544063:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a0ffe lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a1a expref: 299 pid: 6524 timeout: 1164 lvb_type: 0 00010000:00010000:3.0:1763343271.544087:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a0ffe lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a1a expref: 299 pid: 6524 timeout: 1164 lvb_type: 0 00010000:00010000:3.0:1763343271.544102:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e6:0x0].0x0 (ffff9400ccadb800) 00010000:00010000:3.0:1763343271.544107:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1013 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343271.544116:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1013 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343271.544123:0:6511:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1013 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343271.544140:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343271.544192:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6488700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:2408:x1848998399707520:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 195us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343271.544199:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3326 00000100:00100000:0.0:1763343271.544273:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399707648 00000100:00100000:0.0:1763343271.544278:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399707648 00000100:00100000:0.0:1763343271.544316:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10272 00000100:00100000:0.0:1763343271.544333:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57059:x1848998399707648:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343271.544353:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.544368:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a101a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48a28 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.544410:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1013 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.544419:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a101a lrc: 4/0,0 mode: --/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a28 expref: 299 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.544434:0:33856:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1013 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.544445:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a101a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a28 expref: 299 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.544458:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e6:0x0].0x0 (ffff9400ccadb800) 00010000:00010000:0.0:1763343271.544461:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343271.544464:0:33856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a101a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a28 expref: 299 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.544476:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3916200, rc 0) 00000100:00100000:0.0:1763343271.544499:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57059:x1848998399707648:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 177us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.544505:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10272 00010000:00010000:0.0:1763343271.545021:0:6524:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1013 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343271.545083:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1013 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00000040:00080000:0.0:1763343271.545738:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1619, 88 off135248 00000004:00080000:0.0:1763343271.545746:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1064669720905ns, next at 1065528590468ns, rc = 0 00000040:00080000:0.0:1763343271.545963:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1627, 88 off135944 00000004:00080000:0.0:1763343271.545969:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1064669943887ns, next at 1065526239568ns, rc = 0 00000040:00080000:0.0:1763343271.546259:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1628, 88 off136032 00000004:00080000:0.0:1763343271.546265:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1064670240759ns, next at 1065526239568ns, rc = 0 00000040:00080000:0.0:1763343271.546392:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1620, 88 off135336 00000004:00080000:0.0:1763343271.546398:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1064670373483ns, next at 1065528590468ns, rc = 0 00000001:00080000:0.0:1763343271.560221:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973272 is committed 00000004:00080000:0.0:1763343271.560237:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1038 committed 00000004:00080000:0.0:1763343271.560254:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1046 committed 00000004:00080000:0.0:1763343271.560260:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1045 committed 00000004:00080000:0.0:1763343271.560262:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1037 committed 00000004:00080000:0.0:1763343271.560295:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1036 committed 00000004:00080000:0.0:1763343271.560297:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1044 committed 00010000:00010000:0.0:1763343271.560408:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1013 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a21 expref: 279 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.560429:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e6:0x0].0x0 (ffff9400ccadb800) 00010000:00010000:0.0:1763343271.560432:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343271.560437:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a101a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a28 expref: 279 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.560449:0:6524:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a101a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a28 expref: 279 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.560459:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a101a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a28 expref: 279 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.560511:0:6524:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a101a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a28 expref: 279 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343271.560526:0:6524:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b19500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412923776:192.168.201.40@tcp:105: 00000100:00100000:0.0:1763343271.560625:0:6524:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc52b40 going to sleep for 11 seconds 00000100:00100000:3.0:1763343271.563638:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c791ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412924800:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343271.563704:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343271.563745:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343271.563758:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412924672:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343271.563779:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343271.564436:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412924928:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343271.564471:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763343271.564522:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c4b20000/2, rc 0, transno 17179871793 00000100:00100000:3.0:1763343271.564528:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4b20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412924288:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763343271.564539:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c4b20380/2, rc 0, transno 17179871792 00000100:00100000:3.0:1763343271.564542:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4b20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412924160:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343271.564551:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343271.564556:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c791b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412925056:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343271.564582:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343271.564609:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412924672 00000100:00100000:3.0:1763343271.564613:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412924672 00000100:00100000:0.0:1763343271.565586:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412924928 00000100:00100000:0.0:1763343271.565600:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412924928 00000100:00100000:0.0:1763343271.566604:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6939 00000100:00100000:0.0:1763343271.566616:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+110:3659:x1848998412924928:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343271.566807:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+112:3659:x1848998412924928:12345-0@lo:2:osp-syn-0-1.0 Request processed in 195us (2335us total) trans 21474839065 rc 0/0 00000100:00100000:0.0:1763343271.566814:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6939 00000100:00100000:3.0:1763343271.567159:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6941 00000100:00100000:3.0:1763343271.567168:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+111:3662:x1848998412924672:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343271.568377:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:658 count 1 00010000:00010000:3.0:1763343271.568397:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a1036 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x292:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.568414:0:8413:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9401ed155600/0x9104b1ba770a0e68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x292:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4899c expref: 52 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.568422:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343271.568424:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343271.568428:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a1036 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x292:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.568461:0:8413:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9401ed155600/0x9104b1ba770a0e68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x292:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4899c expref: 52 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.568473:0:8413:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9401ed155600/0x9104b1ba770a0e68 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x292:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4899c expref: 52 pid: 35281 timeout: 1164 lvb_type: 0 00000100:00100000:3.0:1763343271.568486:0:8413:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5953480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412925312:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343271.568557:0:8413:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc440900 going to sleep for 11 seconds 00000100:00100000:0.0:1763343271.569897:0:6524:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b19500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412923776:192.168.201.40@tcp:105: 00010000:00010000:0.0:1763343271.569939:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a100c lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a21 expref: 276 pid: 6524 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763343271.569966:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1013 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a21 expref: 275 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.569995:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121fc00, rc 0) 00000100:00100000:0.0:1763343271.570077:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+275:55884:x1848998399707392:12345-192.168.201.40@tcp:101:bash.0 Request processed in 29955us (30173us total) trans 4294973272 rc 0/0 00000100:00100000:0.0:1763343271.570086:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10271 00000100:00100000:0.0:1763343271.573838:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.573922:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.574017:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.574100:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.574110:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399707904 00000100:00100000:3.0:1763343271.574116:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399707904 00010000:00010000:3.0:1763343271.574141:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a0d9d lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48964 expref: 17 pid: 8413 timeout: 1164 lvb_type: 1 00000100:00100000:3.0:1763343271.574171:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399708160 00000100:00100000:3.0:1763343271.574174:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399708160 00010000:00010000:3.0:1763343271.574189:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a0d96 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x293:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4895d expref: 53 pid: 8413 timeout: 1164 lvb_type: 1 00000100:00100000:3.0:1763343271.574207:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399708032 00000100:00100000:3.0:1763343271.574210:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399708032 00010000:00010000:3.0:1763343271.574223:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a0e61 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x293:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48995 expref: 18 pid: 8412 timeout: 1164 lvb_type: 0 00000100:00100000:3.0:1763343271.574242:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3327 00000100:00100000:3.0:1763343271.574248:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998399707904:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343271.574259:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343271.574264:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a0d9d lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x294:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48964 expref: 18 pid: 8413 timeout: 1164 lvb_type: 1 00000004:00080000:0.0:1763343271.575056:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c791ad80/2, rc 0, transno 21474839066 00000100:00100000:0.0:1763343271.575064:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c791ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412924800:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763343271.575150:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763343271.575157:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a102f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.575166:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121ea00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343271.575171:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a102f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.575179:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a102f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.575190:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a102f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.575198:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a102f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.575213:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343271.575216:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a1028 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.575222:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401ed155c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343271.575224:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a1028 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.575230:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a1028 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.575238:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a1028 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.575245:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a1028 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.575256:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343271.575258:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343271.575259:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343271.575655:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a0d9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x294:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48964 expref: 16 pid: 8413 timeout: 1164 lvb_type: 1 00010000:00010000:3.0:1763343271.575674:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a0d9d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x294:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48964 expref: 16 pid: 8413 timeout: 1164 lvb_type: 1 00010000:00010000:3.0:1763343271.575689:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343271.575692:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343271.575695:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a1021 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.575703:0:6511:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a1021 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.575736:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343271.575773:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998399707904:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1525us (1853us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343271.575787:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3327 00000100:00100000:3.0:1763343271.575931:0:8413:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5953480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412925312:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343271.575951:0:8413:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a1036 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x292:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.576182:0:35266:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a1021 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.576191:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a1021 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.576199:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a1021 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.576206:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a1021 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.576218:0:35266:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343271.576479:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+23:3662:x1848998412924032:12345-0@lo:6:osp-syn-1-1.0 Request processed in 15119us (15422us total) trans 17179871795 rc 0/0 00000100:00100000:0.0:1763343271.576487:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6934 00000100:00100000:0.0:1763343271.578659:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000004:00080000:3.0:1763343271.578777:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c4b22680/2, rc 0, transno 17179871794 00000100:00100000:3.0:1763343271.578786:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4b22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412923904:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1763343271.578799:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c4b23800/2, rc 0, transno 17179871795 00000100:00100000:3.0:1763343271.578805:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4b23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412924032:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763343271.579857:0:8413:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a1036 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.579882:0:8413:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a1036 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.579893:0:8413:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a1036 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.579900:0:8413:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a1036 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.579925:0:8413:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343271.580203:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+111:3662:x1848998412924672:12345-0@lo:6:osp-syn-0-1.0 Request processed in 13034us (16419us total) trans 21474839067 rc 0/0 00000100:00100000:3.0:1763343271.580216:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6941 00000004:00080000:3.0:1763343271.580269:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c7918a80/2, rc 0, transno 21474839067 00000100:00100000:3.0:1763343271.580276:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412924672:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343271.580332:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399708672 00000100:00100000:3.0:1763343271.580339:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399708672 00000100:00100000:3.0:1763343271.580374:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399708544 00000100:00100000:3.0:1763343271.580378:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399708544 00010000:00010000:0.0:1763343271.580513:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343271.580522:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a1036 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.580530:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8693c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343271.580535:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a1036 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.580558:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a1036 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.580583:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a1036 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.580601:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a1036 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.580630:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343271.580634:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343271.580641:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343271.584737:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399708800 00000100:00100000:0.0:1763343271.584746:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399708800 00010000:00010000:0.0:1763343271.584785:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a103d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a2f expref: 54 pid: 8412 timeout: 1164 lvb_type: 1 00000100:00100000:0.0:1763343271.584825:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3331 00000100:00100000:0.0:1763343271.584836:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+54:2407:x1848998399708800:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343271.584852:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343271.584857:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a103d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x294:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a2f expref: 54 pid: 8412 timeout: 1164 lvb_type: 1 00010000:00010000:0.0:1763343271.584871:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a103d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x294:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a2f expref: 54 pid: 8412 timeout: 1164 lvb_type: 1 00010000:00010000:0.0:1763343271.584895:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.584898:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.584905:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9401ed154e00/0x9104b1ba770a1044 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a36 expref: 54 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.584915:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401ed154e00/0x9104b1ba770a1044 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a36 expref: 54 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.584953:0:14071:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9401ed154e00/0x9104b1ba770a1044 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a36 expref: 54 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343271.584968:0:14071:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b2fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:14071:1848998412925568:192.168.201.40@tcp:105: 00010000:00010000:3.0:1763343271.585836:0:35266:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.40@tcp) returned -22 from blocking AST (req@000000003d19116d x1848998412925440) - normal race ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a103d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x294:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a2f expref: 54 pid: 8412 timeout: 1164 lvb_type: 1 00010000:00010000:3.0:1763343271.585865:0:35266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a103d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x294:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a2f expref: 54 pid: 8412 timeout: 1164 lvb_type: 1 00000100:00100000:3.0:1763343271.585877:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc2d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35266:1848998412925440:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343271.585903:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9401ed154e00/0x9104b1ba770a1044 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a36 expref: 53 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.585911:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401ed154e00, rc 0) 00000100:00100000:0.0:1763343271.586720:0:14071:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc52d80 going to sleep for 11 seconds 00000100:00100000:3.0:1763343271.587588:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+53:55884:x1848998399708672:12345-192.168.201.40@tcp:101:bash.0 Request processed in 7165us (7292us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343271.587596:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6942 00000100:00100000:3.0:1763343271.590238:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.590319:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.592054:0:14071:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:14071:1848998412925568:192.168.201.40@tcp:105: 00010000:00010000:0.0:1763343271.592076:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343271.592109:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+52:2407:x1848998399708800:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 7275us (7530us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.592117:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3331 00000100:00100000:0.0:1763343271.596011:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399709696 00000100:00100000:0.0:1763343271.596040:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399709696 00000100:00100000:3.0:1763343271.596047:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399709824 00000100:00100000:3.0:1763343271.596052:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399709824 00002000:00010000:3.0:1763343271.596086:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/660 (0->18446744073709551615) 00002000:00100000:3.0:1763343271.596092:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5dc9180 with x1848998399709824 ext(0->18446744073709551615) 00000100:00100000:0.0:1763343271.596099:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3613 00002000:00010000:3.0:1763343271.596105:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5dc9180. 00000100:00100000:0.0:1763343271.596108:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82c9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:57059:x1848998399709696:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343271.596118:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399709952 00000100:00100000:3.0:1763343271.596120:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399709952 00002000:00010000:3.0:1763343271.596142:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/661 (0->18446744073709551615) 00002000:00100000:3.0:1763343271.596145:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5dc9f80 with x1848998399709952 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343271.596151:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5dc9f80. 00000100:00100000:3.0:1763343271.596167:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1667 00000100:00100000:3.0:1763343271.596173:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+52:2407:x1848998399709824:12345-192.168.201.40@tcp:10:bash.0 00000100:00100000:0.0:1763343271.596340:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82c9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+279:57059:x1848998399709696:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 232us (461us total) trans 4294973275 rc 0/0 00000100:00100000:0.0:1763343271.596348:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3613 00002000:00010000:3.0:1763343271.596511:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x294:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343271.596515:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x294:0x0] updating lvb mtime from disk: 0 -> 1763343270 00002000:00010000:3.0:1763343271.596518:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x294:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343271.596520:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x294:0x0] updating lvb ctime from disk: 0 -> 1763343270 00002000:00010000:3.0:1763343271.596523:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x294:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343271.596547:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+53:2407:x1848998399709824:12345-192.168.201.40@tcp:10:bash.0 Request processed in 374us (609us total) trans 21474839068 rc 0/0 00000100:00100000:3.0:1763343271.596555:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1667 00002000:00010000:3.0:1763343271.596558:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/660 (0->18446744073709551615) 00002000:00100000:3.0:1763343271.596561:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5dc9180 with x1848998399709824 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343271.596565:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5dc9180. 00000100:00100000:0.0:1763343271.599241:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399710080 00000100:00100000:0.0:1763343271.599250:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399710080 00000100:00100000:0.0:1763343271.599828:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3614 00000100:00100000:0.0:1763343271.599840:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+279:57059:x1848998399710080:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:0.0:1763343271.600004:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+279:57059:x1848998399710080:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 166us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.600013:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3614 00000100:00100000:3.0:1763343271.619745:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399710592 00000100:00100000:3.0:1763343271.619757:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399710592 00000100:00100000:3.0:1763343271.619819:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10274 00000100:00100000:3.0:1763343271.619830:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57060:x1848998399710592:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343271.619854:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343271.619880:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1075 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48a4b expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.620000:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a107c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343271.620015:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a107c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343271.620070:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a107c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:3.0:1763343271.620084:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e6:0x0]: returning size 5 00010000:00010000:3.0:1763343271.620212:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1075 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a4b expref: 283 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.620295:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a107c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a4b expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.620304:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e6:0x0].0x0 (ffff9400ccadb800) 00010000:00010000:3.0:1763343271.620307:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1763343271.620311:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8692c00, rc 0) 00000100:00100000:0.0:1763343271.627175:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399710848 00000100:00100000:0.0:1763343271.627187:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399710848 00000100:00100000:0.0:1763343271.628447:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10275 00000100:00100000:0.0:1763343271.628464:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57061:x1848998399710848:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:0.0:1763343271.628519:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1763343271.628771:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1013 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a21 expref: 282 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.628796:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a101a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a28 expref: 281 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.628809:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a1067 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a3d expref: 280 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.628820:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a0fd4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a0c expref: 279 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.628829:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e6:0x0].0x0 (ffff9400ccadb800) 00010000:00010000:0.0:1763343271.628833:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343271.628861:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a108a lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343271.628872:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a108a lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.628880:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a108a lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.628890:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1091 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343271.628896:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1091 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.628906:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1091 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.630165:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a10a6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343271.630179:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a107c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a4b expref: 279 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.630187:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a109f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a52 expref: 279 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.630195:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a10a6 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.630233:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a109f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a52 expref: 279 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.630247:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a109f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a52 expref: 279 pid: 6524 timeout: 1164 lvb_type: 0 00000100:00100000:0.0:1763343271.630260:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412925696:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343271.630344:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a107c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a4b expref: 279 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.630353:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a107c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a4b expref: 279 pid: 7641 timeout: 1164 lvb_type: 0 00000100:00100000:0.0:1763343271.630363:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412925824:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343271.630388:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc52b40 going to sleep for 11 seconds 00000100:00100000:0.0:1763343271.633763:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412925696:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343271.633776:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412925824:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343271.633804:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a10a6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343271.636339:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399711104 00000100:00100000:3.0:1763343271.636358:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399711104 00010000:00010000:3.0:1763343271.636407:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a107c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a4b expref: 280 pid: 7641 timeout: 1164 lvb_type: 0 00000100:00100000:0.0:1763343271.637074:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399711360 00000100:00100000:0.0:1763343271.637082:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399711360 00000100:00100000:0.0:1763343271.637128:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10277 00000100:00100000:0.0:1763343271.637142:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57060:x1848998399711360:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343271.637166:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.637191:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514c00/0x9104b1ba770a10ad lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48a59 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343271.637205:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3333 00000100:00100000:3.0:1763343271.637215:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:2408:x1848998399711104:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343271.637224:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343271.637224:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a109f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a52 expref: 283 pid: 6524 timeout: 1164 lvb_type: 0 00010000:00010000:3.0:1763343271.637229:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a107c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a4b expref: 283 pid: 7641 timeout: 1164 lvb_type: 0 00010000:00010000:3.0:1763343271.637240:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a107c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a4b expref: 282 pid: 7641 timeout: 1164 lvb_type: 0 00010000:00010000:1.0:1763343271.637248:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e6:0x0].0x0 (ffff9400ccadb800) 00010000:00010000:1.0:1763343271.637254:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a10a6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.637262:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a10a6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.637267:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343271.637333:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:2408:x1848998399711232:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 181us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343271.637342:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3332 00010000:00010000:3.0:1763343271.638300:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a107c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a4b expref: 281 pid: 7641 timeout: 1164 lvb_type: 0 00010000:00010000:3.0:1763343271.638317:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e6:0x0].0x0 (ffff9400ccadb800) 00010000:00010000:3.0:1763343271.638332:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a10a6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343271.638341:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a10a6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343271.638348:0:6511:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a10a6 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343271.638388:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343271.638421:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514c00/0x9104b1ba770a10ad lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a59 expref: 280 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.638439:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514c00/0x9104b1ba770a10ad lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a59 expref: 280 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.638474:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e6:0x0].0x0 (ffff9400ccadb800) 00010000:00010000:0.0:1763343271.638478:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343271.638481:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4514c00, rc 0) 00010000:00010000:1.0:1763343271.638758:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a10a6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.638766:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a10a6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343271.638946:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:2408:x1848998399711104:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1731us (5695us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343271.638954:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3333 00000004:00080000:1.0:1763343271.639089:0:7641:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x1e6:0x0] is inserted into orphan list, open count = 1 00000100:00100000:0.0:1763343271.639309:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+279:57060:x1848998399711360:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2168us (2289us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.639317:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10277 00010000:00010000:1.0:1763343271.639857:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a10a6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.639866:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a10a6 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.639873:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a10a6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.639879:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.639883:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a10a6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.639895:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a10a6 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.639910:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e6:0x0].0x0 (ffff9400ccadb800) 00010000:00010000:1.0:1763343271.639913:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343271.639918:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a10a6 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.639924:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a10a6 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.639942:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a108a lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.639948:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a108a lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.639953:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a108a lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.639958:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a108a lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.639962:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.639965:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a108a lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.639970:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a108a lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.639976:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d816a600) 00010000:00010000:1.0:1763343271.639979:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.639981:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a108a lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.639987:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a108a lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00010000:1.0:1763343271.640007:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003d19116d reply state 000000002e22c912 transno 4294973278 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1091 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.640019:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1091 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.641278:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d816a200) 00010000:00010000:1.0:1763343271.641286:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343271.641290:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343271.641651:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57061:x1848998399710848:12345-192.168.201.40@tcp:36:rm.0 Request processed in 13193us (15304us total) trans 4294973278 rc 0/0 00000100:00100000:1.0:1763343271.641660:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10275 00000100:00100000:0.0:1763343271.641858:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399711616 00000100:00100000:0.0:1763343271.641866:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399711616 00000100:00100000:0.0:1763343271.641917:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3616 00000100:00100000:0.0:1763343271.641926:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57060:x1848998399711616:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:0.0:1763343271.642193:0:6527:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1e6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763343271.642260:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1621, 64 off135400 00000040:00080000:0.0:1763343271.642298:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1629, 64 off136096 00000040:00080000:0.0:1763343271.642311:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1630, 64 off136160 00000040:00080000:0.0:1763343271.642333:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1622, 64 off135464 00010000:00010000:0.0:1763343271.642386:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a10b4 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343271.642400:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a10b4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343271.642418:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a10b4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343271.642425:0:6527:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a10b4 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343271.642431:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a10b4 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343271.642436:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a10b4 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343271.642456:0:6527:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343271.642612:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57060:x1848998399711616:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 686us (1001us total) trans 4294973279 rc 0/0 00000100:00100000:0.0:1763343271.642618:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3616 00010000:00010000:3.0:1763343271.643013:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343271.643020:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a10b4 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343271.643172:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4515600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343271.643176:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a10b4 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343271.643183:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a10b4 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343271.643202:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e6:0x0].0x0 (ffff9400ccadb800) 00010000:00010000:3.0:1763343271.643205:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343271.643209:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a10b4 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343271.643215:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a10b4 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343271.643226:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343271.643228:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343271.643230:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343271.646508:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.646595:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399711744 00000100:00100000:1.0:1763343271.646606:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399711744 00000100:00100000:1.0:1763343271.646671:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10278 00000100:00100000:1.0:1763343271.646682:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57060:x1848998399711744:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343271.646807:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343271.646832:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a10bb lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48a60 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.646912:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a10c2 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343271.646926:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a10c2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.646937:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a10c2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.646949:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a10c9 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343271.646956:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a10c9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.646962:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a10c9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.647000:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a10c2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.647007:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a10c2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.647013:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a10c2 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.647019:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a10c2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.647184:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c589be00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.647188:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a10c2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.647196:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a10c2 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.647207:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:1.0:1763343271.647211:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.647215:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a10c2 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.647221:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a10c2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.647232:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a10c9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.647239:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a10c9 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.647245:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a10c9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.647249:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c589ba00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.647251:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a10c9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.647257:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a10c9 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.647263:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d816a200) 00010000:00010000:1.0:1763343271.647265:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.647268:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a10c9 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.647273:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a10c9 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.647300:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a10bb lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a60 expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.647311:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:1.0:1763343271.647313:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.647317:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a10bb lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a60 expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.647347:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c0030200, rc 0) 00000100:00100000:1.0:1763343271.647609:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57060:x1848998399711744:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 928us (1113us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343271.647617:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10278 00000100:00100000:1.0:1763343271.657469:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.657928:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399712000 00000100:00100000:0.0:1763343271.657939:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399712000 00000100:00100000:0.0:1763343271.658003:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10279 00000100:00100000:0.0:1763343271.658013:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57063:x1848998399712000:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343271.658130:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.658159:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a10d0 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48a67 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.658233:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a10d7 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343271.658247:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a10d7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.658257:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a10d7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.658266:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a10de lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343271.658392:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a10de lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.658400:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a10de lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.658442:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a10d7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.658450:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a10d7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.658455:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a10d7 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.658461:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a10d7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.658466:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.658470:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a10d7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.658478:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a10d7 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.658490:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d816a600) 00010000:00010000:0.0:1763343271.658493:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.658498:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a10d7 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.658504:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a10d7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.658517:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a10de lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.658522:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a10de lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.658526:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a10de lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.658531:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.658533:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a10de lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.658538:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a10de lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.658544:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d816a200) 00010000:00010000:0.0:1763343271.658546:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.658549:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a10de lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.658553:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a10de lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.658581:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a10d0 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a67 expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.658591:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d816a600) 00010000:00010000:0.0:1763343271.658594:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343271.658597:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a10d0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a67 expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.658610:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4515600, rc 0) 00000100:00100000:0.0:1763343271.658676:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57063:x1848998399712000:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 664us (1218us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343271.658684:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10279 00000100:00100000:0.0:1763343271.662845:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399712128 00000100:00100000:0.0:1763343271.662855:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399712128 00000100:00100000:0.0:1763343271.662925:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10280 00000100:00100000:0.0:1763343271.662934:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57063:x1848998399712128:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343271.662955:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.662981:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a10e5 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48a6e expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.663082:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a10ec lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343271.663095:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a10ec lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.663107:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a10ec lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.663117:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a10f3 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343271.663124:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a10f3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.663130:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a10f3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.663165:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a10ec lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.663172:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a10ec lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.663177:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a10ec lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.663183:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a10ec lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.663190:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff940202040400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.663194:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a10ec lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.663201:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a10ec lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.663212:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d816ac00) 00010000:00010000:0.0:1763343271.663216:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.663221:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a10ec lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.663227:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a10ec lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.663240:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a10f3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.663246:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a10f3 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.663251:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a10f3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.663256:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff940202041000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.663259:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a10f3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.663264:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a10f3 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.663271:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d816a200) 00010000:00010000:0.0:1763343271.663273:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.663275:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a10f3 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.663279:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a10f3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.663301:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a10e5 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a6e expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.663307:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d816ac00) 00010000:00010000:0.0:1763343271.663309:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.663311:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a10e5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a6e expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.663334:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940202040c00, rc 0) 00000100:00100000:0.0:1763343271.663401:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57063:x1848998399712128:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 467us (664us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343271.663408:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10280 00000100:00100000:3.0:1763343271.667332:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.671255:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399712256 00000100:00100000:0.0:1763343271.671279:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399712256 00000100:00100000:0.0:1763343271.671362:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10281 00000100:00100000:0.0:1763343271.671373:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57062:x1848998399712256:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343271.671394:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.671422:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a10fa lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48a75 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.671496:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1101 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343271.671510:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1101 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.671521:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1101 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.671531:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1108 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343271.671538:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1108 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.671544:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1108 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.671583:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1101 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.671589:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1101 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.671594:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1101 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.671600:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1101 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.671605:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.671609:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1101 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.671615:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1101 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.671626:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d816a600) 00010000:00010000:0.0:1763343271.671629:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.671633:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1101 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.671639:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1101 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.671653:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1108 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.671659:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1108 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.671664:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1108 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.671669:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.671672:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1108 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.671678:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1108 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.671684:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d816a200) 00010000:00010000:0.0:1763343271.671687:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.671690:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1108 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.671695:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1108 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.671721:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a10fa lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a75 expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.671731:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d816a600) 00010000:00010000:0.0:1763343271.671733:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.671736:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a10fa lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a75 expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.671748:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4515600, rc 0) 00000100:00100000:0.0:1763343271.671825:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57062:x1848998399712256:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 454us (4511us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343271.671833:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10281 00000100:00100000:1.0:1763343271.675980:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.676235:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399712512 00000100:00100000:0.0:1763343271.676245:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399712512 00000100:00100000:0.0:1763343271.676308:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10282 00000100:00100000:0.0:1763343271.676328:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57064:x1848998399712512:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343271.676349:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.676378:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a110f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48a7c expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.676461:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a1116 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343271.676474:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a1116 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.676484:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a1116 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.676494:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a111d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343271.676501:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a111d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.676506:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a111d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.676541:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a1116 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.676548:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a1116 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.676554:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a1116 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.676559:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff940202041000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.676564:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a1116 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.676571:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a1116 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.676582:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d816ac00) 00010000:00010000:0.0:1763343271.676585:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.676589:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a1116 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.676595:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a1116 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.676609:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a111d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.676614:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a111d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.676619:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a111d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.676623:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff940202040400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.676625:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a111d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.676630:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a111d lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.676636:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d816a200) 00010000:00010000:0.0:1763343271.676638:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.676641:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a111d lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.676650:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a111d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.676678:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a110f lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a7c expref: 282 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.676689:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d816ac00) 00010000:00010000:0.0:1763343271.676690:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343271.676694:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a110f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a7c expref: 282 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.676707:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940202040c00, rc 0) 00000100:00100000:0.0:1763343271.676775:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57064:x1848998399712512:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 457us (804us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343271.676783:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10282 00000100:00100000:3.0:1763343271.678989:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.679057:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399712640 00000100:00100000:1.0:1763343271.679683:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399712640 00000100:00100000:1.0:1763343271.679757:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10283 00000100:00100000:1.0:1763343271.679768:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57064:x1848998399712640:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343271.679789:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343271.679812:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a1124 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48a83 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.679880:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a112b lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343271.679892:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a112b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.679904:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a112b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.679914:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1132 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343271.679921:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1132 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.679927:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1132 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.679966:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a112b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.679972:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a112b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.679977:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a112b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.679983:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a112b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.679989:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c589ba00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.679993:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a112b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.679999:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a112b lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.680009:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:1.0:1763343271.680013:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.680017:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a112b lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.680062:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a112b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.680076:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1132 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.680082:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1132 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.680087:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1132 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.680092:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c0030200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.680094:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1132 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.680100:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1132 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.680106:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d816a200) 00010000:00010000:1.0:1763343271.680109:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.680112:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1132 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.680117:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1132 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.680142:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a1124 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a83 expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.680152:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:1.0:1763343271.680155:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.680159:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a1124 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a83 expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.680170:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c589be00, rc 0) 00000100:00100000:1.0:1763343271.680234:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57064:x1848998399712640:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 468us (1254us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343271.680241:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10283 00000100:00100000:3.0:1763343271.682693:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.682747:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399712768 00000100:00100000:1.0:1763343271.682757:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399712768 00000100:00100000:1.0:1763343271.682817:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10284 00000100:00100000:1.0:1763343271.682829:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57062:x1848998399712768:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343271.682852:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343271.682892:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a1139 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48a8a expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.682973:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1140 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343271.682987:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1140 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.682999:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1140 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.683009:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a1147 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343271.683017:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a1147 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.683056:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a1147 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.683095:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1140 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.683102:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1140 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.683108:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1140 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.683114:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1140 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.683121:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a2e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.683125:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1140 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.683132:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1140 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.683150:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb700) 00010000:00010000:1.0:1763343271.683153:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.683158:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1140 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.683163:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1140 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.683176:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a1147 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.683181:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a1147 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.683186:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a1147 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.683190:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a3000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.683193:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a1147 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.683199:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a1147 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.683204:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d816a200) 00010000:00010000:1.0:1763343271.683207:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.683210:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a1147 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.683215:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a1147 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.683241:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a1139 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a8a expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.683251:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb700) 00010000:00010000:1.0:1763343271.683254:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.683257:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a1139 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a8a expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.683271:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c1660000, rc 0) 00000100:00100000:1.0:1763343271.683340:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57062:x1848998399712768:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 514us (657us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343271.683350:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10284 00000100:00100000:1.0:1763343271.685447:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399712896 00000100:00100000:1.0:1763343271.685465:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399712896 00000100:00100000:1.0:1763343271.685526:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10285 00000100:00100000:1.0:1763343271.685536:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57062:x1848998399712896:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343271.685555:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343271.685575:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a114e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48a91 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.685637:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a1155 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343271.685654:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a1155 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.685666:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a1155 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343271.685717:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763343271.685725:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763343271.685762:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a114e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a91 expref: 283 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.685782:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a1155 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a91 expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.685791:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadbf00) 00010000:00010000:1.0:1763343271.685794:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343271.685798:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400cbad3c00, rc 0) 00000100:00100000:1.0:1763343271.685861:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57062:x1848998399712896:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 326us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343271.685868:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10285 00000100:00100000:3.0:1763343271.693393:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.695437:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399713024 00000100:00100000:1.0:1763343271.695452:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399713024 00000100:00100000:1.0:1763343271.695593:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10286 00000100:00100000:1.0:1763343271.695604:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57062:x1848998399713024:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343271.695623:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343271.695647:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a115c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48a98 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.695877:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1163 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343271.695893:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1163 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.695906:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1163 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.695918:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a116a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343271.695926:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a116a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.695933:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a116a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.695974:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1163 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.695980:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1163 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.695986:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1163 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.696084:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1163 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.696092:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a2000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.696096:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1163 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.696103:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1163 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.696116:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadbf00) 00010000:00010000:1.0:1763343271.696119:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.696124:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1163 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.696130:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1163 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.696143:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a116a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.696149:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a116a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.696155:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a116a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.696159:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a3000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.696162:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a116a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.696168:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a116a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.696173:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d816a200) 00010000:00010000:1.0:1763343271.696176:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.696178:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a116a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.696183:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a116a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.696212:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a115c lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a98 expref: 283 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.696221:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadbf00) 00010000:00010000:1.0:1763343271.696224:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.696227:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a115c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a98 expref: 283 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.696237:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c1660000, rc 0) 00000100:00100000:1.0:1763343271.696310:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57062:x1848998399713024:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 708us (2927us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343271.696328:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10286 00000100:00100000:3.0:1763343271.702558:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.702657:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399713280 00000100:00100000:1.0:1763343271.702668:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399713280 00000100:00100000:1.0:1763343271.702737:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10287 00000100:00100000:1.0:1763343271.702748:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57062:x1848998399713280:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343271.702769:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343271.702772:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343271.702799:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a1155 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a91 expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.702818:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadbf00) 00010000:00010000:1.0:1763343271.702828:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343271.702844:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a1171 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48a9f expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.702957:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1178 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343271.702971:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1178 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.702980:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1178 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.702995:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a117f lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343271.703002:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a117f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.703008:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a117f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.703454:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a1186 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343271.703463:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a1186 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.703470:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a1186 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343271.703480:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e7:0x0]: returning size 0 00010000:00010000:1.0:1763343271.703509:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1178 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.703515:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1178 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.703520:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1178 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.703527:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1178 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.703533:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a2000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.703537:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1178 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.703548:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1178 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.703556:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb700) 00010000:00010000:1.0:1763343271.703559:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.703562:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1178 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.703568:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1178 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00010000:1.0:1763343271.703578:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000093cfd88e reply state 000000004fbfc043 transno 4294973280 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a117f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.703588:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a117f lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.703593:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d816a200) 00010000:00010000:1.0:1763343271.703596:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343271.703599:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343271.703627:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a1171 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a9f expref: 284 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.703643:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a1186 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a9f expref: 283 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.703650:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e7:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:1.0:1763343271.703652:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343271.703655:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c1660000, rc 0) 00000100:00100000:1.0:1763343271.703732:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57062:x1848998399713280:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 986us (1186us total) trans 4294973280 rc 0/0 00000100:00100000:1.0:1763343271.703743:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10287 00000100:00100000:0.0:1763343271.712928:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399713536 00000100:00100000:0.0:1763343271.712939:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399713536 00000100:00100000:0.0:1763343271.712998:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10288 00000100:00100000:0.0:1763343271.713009:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57062:x1848998399713536:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343271.713062:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.713085:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1194 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48aa6 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.713199:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a119b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343271.713215:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a1186 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a9f expref: 285 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.713231:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a119b lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.713267:0:33856:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a1186 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a9f expref: 285 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.713281:0:33856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a1186 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a9f expref: 285 pid: 7641 timeout: 1164 lvb_type: 0 00000100:00100000:0.0:1763343271.713293:0:33856:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412925952:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343271.713385:0:33856:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc52b40 going to sleep for 11 seconds 00000100:00100000:1.0:1763343271.713941:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399713792 00000100:00100000:1.0:1763343271.713949:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399713792 00000100:00100000:1.0:1763343271.713995:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10289 00000100:00100000:1.0:1763343271.714006:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57066:x1848998399713792:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343271.714017:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343271.714056:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a11a2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48aad expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.714115:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a11a9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343271.714126:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a11a9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.714138:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a11a9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343271.714148:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e7:0x0]: returning size 0 00010000:00010000:1.0:1763343271.714231:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a11a9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.714239:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a11a9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.714246:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a11a9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.714252:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a2000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.714257:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a11a9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.714268:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a11a9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.714280:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e7:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:1.0:1763343271.714283:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1763343271.714288:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a11a9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.714294:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a11a9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.714343:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a11a2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48aad expref: 288 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.714353:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e7:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:1.0:1763343271.714355:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343271.714359:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a11a2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48aad expref: 288 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.714369:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c89a3000, rc 0) 00000100:00100000:1.0:1763343271.714426:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57066:x1848998399713792:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 422us (945us total) trans 4294973281 rc 301/301 00000100:00100000:1.0:1763343271.714433:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10289 00000100:00100000:3.0:1763343271.719621:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399713920 00000100:00100000:3.0:1763343271.719631:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399713920 00010000:00010000:3.0:1763343271.719671:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a1186 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a9f expref: 287 pid: 7641 timeout: 1164 lvb_type: 0 00000100:00100000:0.0:1763343271.719818:0:33856:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412925952:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343271.719840:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a119b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:3.0:1763343271.719933:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3334 00000100:00100000:3.0:1763343271.719946:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7e38450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:2407:x1848998399713920:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343271.719961:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343271.719968:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a1186 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a9f expref: 287 pid: 7641 timeout: 1164 lvb_type: 0 00010000:00010000:3.0:1763343271.719980:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a1186 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a9f expref: 287 pid: 7641 timeout: 1164 lvb_type: 0 00010000:00010000:3.0:1763343271.720001:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a1186 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a9f expref: 287 pid: 7641 timeout: 1164 lvb_type: 0 00010000:00010000:3.0:1763343271.720016:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e7:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:3.0:1763343271.720020:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a119b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.720184:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a119b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.720190:0:6511:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a119b lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343271.720246:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343271.720289:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399714176 00000100:00100000:1.0:1763343271.720295:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399714176 00000100:00100000:1.0:1763343271.720342:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3617 00000100:00100000:1.0:1763343271.720350:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57066:x1848998399714176:12345-192.168.201.40@tcp:35:lfs.0 00010000:00010000:0.0:1763343271.720399:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a119b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.720406:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a119b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:0.0:1763343271.720425:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e7:0x0]: returning size 0 00000100:00100000:3.0:1763343271.720557:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7e38450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:2407:x1848998399713920:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 612us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343271.720566:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3334 00000004:00080000:0.0:1763343271.720815:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x297:0x0], index 1: 0 00000004:00080000:0.0:1763343271.720824:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x296:0x0], index 0: 0 00000004:00080000:0.0:1763343271.720829:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x297:0x0], index 0: 0 00000004:00080000:0.0:1763343271.720833:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x298:0x0], index 1: 0 00000100:00100000:1.0:1763343271.720894:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57066:x1848998399714176:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 544us (1440us total) trans 4294973282 rc 0/0 00000100:00100000:1.0:1763343271.720902:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3617 00010000:00010000:0.0:1763343271.720919:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a119b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.720932:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a119b lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.720938:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a119b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.720943:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff940202040400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.720947:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a119b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.720955:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a119b lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.720964:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e7:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:0.0:1763343271.720967:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343271.720971:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a119b lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.720977:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a119b lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.721015:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1194 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48aa6 expref: 287 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.721916:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e7:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:0.0:1763343271.721922:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343271.721930:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1194 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48aa6 expref: 287 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.721949:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940202040c00, rc 0) 00000100:00100000:0.0:1763343271.722001:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57062:x1848998399713536:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 8994us (9535us total) trans 4294973283 rc 301/301 00000100:00100000:0.0:1763343271.722010:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10288 00000100:00100000:1.0:1763343271.724218:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399714432 00000100:00100000:1.0:1763343271.724229:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399714432 00000100:00100000:3.0:1763343271.724749:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.724888:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3618 00000100:00100000:0.0:1763343271.724902:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57062:x1848998399714432:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343271.725231:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57062:x1848998399714432:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 333us (1111us total) trans 4294973284 rc 0/0 00000100:00100000:0.0:1763343271.725240:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3618 00000100:00100000:0.0:1763343271.725948:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399714688 00000100:00100000:0.0:1763343271.725959:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399714688 00000100:00100000:0.0:1763343271.726018:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10290 00000100:00100000:0.0:1763343271.726047:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f648a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57066:x1848998399714688:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343271.726061:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.726089:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a11be lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48ab4 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.726173:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a11c5 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343271.726188:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a11c5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.726201:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a11c5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.726212:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a11cc lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343271.726220:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a11cc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.726229:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a11cc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.726345:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a11d3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343271.726353:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a11d3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.726360:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a11d3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:0.0:1763343271.726370:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e7:0x0]: returning size 0 00010000:00010000:0.0:1763343271.726435:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a11c5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.726442:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a11c5 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.726448:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a11c5 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.726454:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4515600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.726458:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a11c5 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.726465:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a11c5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.726478:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d816ac00) 00010000:00010000:0.0:1763343271.726481:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.726486:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a11c5 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.726496:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a11c5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.726524:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a11cc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.726530:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a11cc lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.726535:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a11cc lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.726540:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.726543:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a11cc lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.726549:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a11cc lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.726556:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d816a200) 00010000:00010000:0.0:1763343271.726559:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.726561:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a11cc lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.726566:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a11cc lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.726602:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a11be lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ab4 expref: 290 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.726626:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a11d3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ab4 expref: 289 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.726638:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e7:0x0].0x0 (ffff9401d816a600) 00010000:00010000:0.0:1763343271.726641:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343271.726643:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4514a00, rc 0) 00000100:00100000:0.0:1763343271.726708:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f648a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57066:x1848998399714688:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 681us (1960us total) trans 4294973285 rc 0/0 00000100:00100000:0.0:1763343271.726716:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10290 00000100:00100000:3.0:1763343271.727141:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.727179:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399714944 00000100:00100000:0.0:1763343271.727186:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399714944 00000100:00100000:0.0:1763343271.727227:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3619 00000100:00100000:0.0:1763343271.727235:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8446c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57062:x1848998399714944:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343271.727429:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8446c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57062:x1848998399714944:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 193us (288us total) trans 4294973286 rc 0/0 00000100:00100000:0.0:1763343271.727437:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3619 00000100:00100000:1.0:1763343271.732188:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.732398:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399715072 00000100:00100000:3.0:1763343271.732409:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399715072 00000100:00100000:3.0:1763343271.734438:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.736853:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399715456 00000100:00100000:1.0:1763343271.736862:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399715456 00000100:00100000:1.0:1763343271.736912:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10292 00000100:00100000:1.0:1763343271.736920:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57066:x1848998399715456:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343271.736938:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343271.736954:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a11fd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48ac9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.737002:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a11fd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ac9 expref: 292 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.737016:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a11fd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ac9 expref: 292 pid: 6524 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343271.737207:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.737282:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399715584 00000100:00100000:0.0:1763343271.737287:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399715584 00000100:00100000:0.0:1763343271.737336:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10293 00000100:00100000:0.0:1763343271.737343:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:55884:x1848998399715584:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343271.737354:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.737363:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1204 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48ad0 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.737383:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a120b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343271.737391:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a120b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.737404:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a120b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343271.737497:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1204 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ad0 expref: 295 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.737514:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a120b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ad0 expref: 294 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.737522:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e7:0x0].0x0 (ffff9401edc53500) 00010000:00010000:0.0:1763343271.737525:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343271.737529:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4515600, rc 0) 00000100:00100000:0.0:1763343271.737584:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:55884:x1848998399715584:12345-192.168.201.40@tcp:101:bash.0 Request processed in 241us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.737592:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10293 00010000:00010000:1.0:1763343271.737670:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e7:0x0].0x0 (ffff9401edc53500) 00010000:00010000:1.0:1763343271.737673:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343271.737675:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c89a3000, rc 0) 00000100:00100000:1.0:1763343271.737703:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57066:x1848998399715456:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 784us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343271.737709:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10292 00000100:00100000:3.0:1763343271.741184:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.741403:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399715840 00000100:00100000:0.0:1763343271.741415:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399715840 00000100:00100000:0.0:1763343271.741481:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3620 00000100:00100000:0.0:1763343271.741494:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57066:x1848998399715840:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343271.742634:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57066:x1848998399715840:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1136us (1453us total) trans 4294973288 rc 0/0 00000100:00100000:0.0:1763343271.742646:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3620 00000100:00100000:0.0:1763343271.746844:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.746936:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.747440:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399716096 00000100:00100000:1.0:1763343271.747452:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399716096 00000100:00100000:1.0:1763343271.747513:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399716352 00000100:00100000:1.0:1763343271.747517:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399716352 00000100:00100000:1.0:1763343271.747544:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10294 00000100:00100000:1.0:1763343271.747553:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:55884:x1848998399716096:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:1.0:1763343271.747616:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343271.747643:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a11ef lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1e7:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ac2 expref: 295 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.747667:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e7:0x0].0x0 (ffff9401edc53500) 00010000:00010000:1.0:1763343271.747673:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343271.747695:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10295 00000100:00100000:3.0:1763343271.747707:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57066:x1848998399716352:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343271.747724:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343271.747747:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1212 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48ad7 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.747812:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a1219 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343271.747828:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a1219 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.747840:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a1219 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.747851:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1220 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343271.747859:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1220 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.747866:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1220 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.747873:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1227 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343271.747885:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1227 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343271.747893:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1227 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000001:00080000:1.0:1763343271.747951:0:6524:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973289 00000004:00010000:1.0:1763343271.747973:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002b434481 reply state 00000000e39fd5ab transno 4294973290 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1227 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343271.747984:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a122e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343271.747986:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1227 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1e7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343271.748006:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a122e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.748016:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a122e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:3.0:1763343271.748044:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e7:0x0]: returning size 0 00010000:00010000:1.0:1763343271.748232:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e7:0x0].0x0 (ffff9401edc53500) 00010000:00010000:1.0:1763343271.748236:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343271.748240:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343271.748255:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a1219 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.748264:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a1219 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.748274:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a1219 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.748280:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a1219 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.748286:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121e800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343271.748290:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a1219 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.748299:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a1219 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.748308:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b500) 00010000:00010000:3.0:1763343271.748310:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343271.748314:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a1219 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.748331:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a1219 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.748341:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1220 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.748346:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1220 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.748352:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1220 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.748356:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343271.748358:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1220 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.748368:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1220 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.748375:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d816a200) 00010000:00010000:3.0:1763343271.748377:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343271.748381:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1220 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.748386:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1220 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.748417:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1212 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ad7 expref: 300 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.748434:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a122e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ad7 expref: 299 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.748441:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e7:0x0].0x0 (ffff9401edc53500) 00010000:00010000:3.0:1763343271.748443:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343271.748446:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121fc00, rc 0) 00000100:00100000:1.0:1763343271.749376:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:55884:x1848998399716096:12345-192.168.201.40@tcp:36:bash.0 Request processed in 1816us (2535us total) trans 4294973290 rc 0/0 00000100:00100000:1.0:1763343271.749387:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10294 00000020:00080000:1.0:1763343271.749393:0:6524:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343271.750364:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57066:x1848998399716352:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2652us (3419us total) trans 4294973291 rc 0/0 00000100:00100000:3.0:1763343271.751489:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10295 00000100:00100000:0.0:1763343271.754542:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.755985:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.757087:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399716864 00000100:00100000:1.0:1763343271.757096:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399716864 00000100:00100000:1.0:1763343271.757158:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10296 00000100:00100000:1.0:1763343271.757168:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:55884:x1848998399716864:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343271.757192:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343271.757196:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343271.757230:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a11fd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ac9 expref: 299 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.757254:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e7:0x0].0x0 (ffff9401edc53500) 00010000:00010000:1.0:1763343271.757260:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343271.757291:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a123c lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48ade expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.757373:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1243 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343271.757389:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a122e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ad7 expref: 299 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.757398:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1243 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.757429:0:9827:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a122e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ad7 expref: 299 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.757441:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a122e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ad7 expref: 299 pid: 9827 timeout: 1164 lvb_type: 0 00000100:00100000:1.0:1763343271.757460:0:9827:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dc9500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412926080:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343271.757533:0:9827:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd0780 going to sleep for 11 seconds 00000100:00100000:3.0:1763343271.759615:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.761046:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dc9500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412926080:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343271.761076:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1243 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:3.0:1763343271.762173:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.762236:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399717120 00000100:00100000:0.0:1763343271.762243:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399717120 00010000:00010000:0.0:1763343271.762268:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a122e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ad7 expref: 300 pid: 9827 timeout: 1164 lvb_type: 0 00000100:00100000:0.0:1763343271.762310:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3335 00000100:00100000:0.0:1763343271.762328:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:2407:x1848998399717120:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343271.762339:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343271.762345:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a122e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ad7 expref: 300 pid: 9827 timeout: 1164 lvb_type: 0 00010000:00010000:0.0:1763343271.762359:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a122e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ad7 expref: 300 pid: 9827 timeout: 1164 lvb_type: 0 00010000:00010000:0.0:1763343271.762383:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a122e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ad7 expref: 300 pid: 9827 timeout: 1164 lvb_type: 0 00010000:00010000:0.0:1763343271.762401:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e7:0x0].0x0 (ffff9401edc53500) 00010000:00010000:0.0:1763343271.762407:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1243 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.762418:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1243 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.762425:0:6511:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1243 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.762453:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343271.762493:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:2407:x1848998399717120:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 176us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.762501:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3335 00010000:00010000:1.0:1763343271.765151:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1243 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.765171:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1243 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000040:00080000:1.0:1763343271.765451:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1631, 88 off136248 00000004:00080000:1.0:1763343271.765460:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1064889434726ns, next at 1065526239568ns, rc = 0 00000040:00080000:1.0:1763343271.765500:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1623, 88 off135552 00000004:00080000:1.0:1763343271.765505:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1064889480801ns, next at 1065528590468ns, rc = 0 00000040:00080000:1.0:1763343271.765527:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1624, 88 off135640 00000004:00080000:1.0:1763343271.765531:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1064889506801ns, next at 1065528590468ns, rc = 0 00000040:00080000:1.0:1763343271.765542:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1632, 88 off136336 00000004:00080000:1.0:1763343271.765546:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1064889521348ns, next at 1065526239568ns, rc = 0 00000001:00080000:0.0:1763343271.767226:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973293 is committed 00000004:00080000:0.0:1763343271.767237:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1048 committed 00000004:00080000:0.0:1763343271.767247:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1040 committed 00010000:00010000:1.0:1763343271.767255:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1091 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.767267:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1091 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.767283:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1091 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.767294:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.767298:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1091 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.767306:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1091 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.767329:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d816a200) 00010000:00010000:1.0:1763343271.767332:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.767338:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1091 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.767345:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1091 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.767363:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a117f lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.767371:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a117f lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.767377:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a117f lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.767382:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a2e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.767387:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a117f lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.767395:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a117f lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.767405:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d816a200) 00010000:00010000:1.0:1763343271.767409:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.767412:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a117f lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.767419:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a117f lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.767437:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1227 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1e7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343271.767444:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1227 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1e7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343271.767450:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1227 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1e7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343271.767454:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a2000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.767457:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1227 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1e7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343271.767463:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1227 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1e7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343271.767471:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e7:0x0].0x0 (ffff9401edc53500) 00010000:00010000:1.0:1763343271.767473:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.767477:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1227 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1e7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343271.767483:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1227 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1e7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000004:00080000:0.0:1763343271.767642:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1039 committed 00000100:00100000:1.0:1763343271.767730:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412926336 00000004:00080000:0.0:1763343271.767730:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1047 committed 00000100:00100000:1.0:1763343271.767740:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412926336 00000100:00100000:0.0:1763343271.767793:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4788a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412926720:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343271.767794:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412926208 00000100:00100000:1.0:1763343271.767798:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412926208 00000100:00100000:1.0:1763343271.767822:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412926464 00000100:00100000:1.0:1763343271.767825:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412926464 00000100:00100000:0.0:1763343271.767830:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343271.768297:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763343271.768306:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4788e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412926848:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343271.768876:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412926720 00000100:00100000:3.0:1763343271.768881:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412926720 00000100:00100000:1.0:1763343271.768902:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6946 00000100:00100000:1.0:1763343271.768914:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+24:3662:x1848998412926336:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343271.768940:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6947 00002000:00080000:1.0:1763343271.768941:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:662 count 1 00000100:00100000:3.0:1763343271.768950:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+24:3662:x1848998412926208:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763343271.768965:0:28562:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:661 count 1 00010000:00010000:1.0:1763343271.768968:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a124a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x296:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.768979:0:28562:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1251 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.768990:0:35266:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a0f95 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b489f0 expref: 17 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343271.768995:0:28562:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9401ed155000/0x9104b1ba770a104b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a44 expref: 17 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.769006:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343271.769010:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343271.769010:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343271.769015:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343271.769017:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a124a lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.769020:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1251 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.769067:0:28562:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9401ed155000/0x9104b1ba770a104b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a44 expref: 17 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.769070:0:35266:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a0f95 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b489f0 expref: 17 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343271.769096:0:28562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9401ed155000/0x9104b1ba770a104b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a44 expref: 17 pid: 35266 timeout: 1164 lvb_type: 0 00010000:00010000:1.0:1763343271.769096:0:35266:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a0f95 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b489f0 expref: 17 pid: 8414 timeout: 1164 lvb_type: 1 00000100:00100000:1.0:1763343271.769126:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412927360:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343271.769129:0:28562:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4789880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28562:1848998412927232:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343271.769198:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1763343271.769217:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6948 00000100:00100000:1.0:1763343271.769224:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+24:3659:x1848998412926464:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763343271.769373:0:35281:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x297:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343271.769377:0:35281:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x297:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343271.769379:0:35281:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x297:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343271.769381:0:35281:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x297:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763343271.769384:0:35281:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x297:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343271.770182:0:28562:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc440780 going to sleep for 11 seconds 00000100:00100000:1.0:1763343271.770198:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+25:3659:x1848998412926464:12345-0@lo:2:osp-syn-1-1.0 Request processed in 972us (2582us total) trans 17179871797 rc 0/0 00000100:00100000:3.0:1763343271.770205:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412926976 00000100:00100000:1.0:1763343271.770209:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6948 00000100:00100000:3.0:1763343271.770213:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412926976 00000100:00100000:1.0:1763343271.770231:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6949 00000100:00100000:1.0:1763343271.770239:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+112:3661:x1848998412926720:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763343271.770252:0:35281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:660 count 1 00010000:00010000:1.0:1763343271.770267:0:35281:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c589be00/0x9104b1ba770a1258 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x294:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.770401:0:35281:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9401ed154e00/0x9104b1ba770a1044 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a36 expref: 52 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.770408:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343271.770410:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343271.770413:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c589be00/0x9104b1ba770a1258 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.770435:0:35281:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9401ed154e00/0x9104b1ba770a1044 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a36 expref: 52 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.770445:0:35281:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9401ed154e00/0x9104b1ba770a1044 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a36 expref: 52 pid: 35266 timeout: 1164 lvb_type: 0 00000100:00100000:1.0:1763343271.770459:0:35281:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35281:1848998412927488:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343271.770487:0:35281:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd0d80 going to sleep for 11 seconds 00010000:00010000:1.0:1763343271.770551:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1243 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1e7:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ade expref: 276 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.770564:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e7:0x0].0x0 (ffff9401edc53500) 00010000:00010000:1.0:1763343271.770567:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343271.770583:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a123c lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ade expref: 276 pid: 9827 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343271.770600:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1243 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1e7:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ade expref: 275 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.770624:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e7:0x0].0x0 (ffff9401edc53500) 00010000:00010000:1.0:1763343271.770627:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343271.770629:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c0030200, rc 0) 00000100:00100000:1.0:1763343271.770652:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+275:55884:x1848998399716864:12345-192.168.201.40@tcp:101:bash.0 Request processed in 13487us (14669us total) trans 4294973293 rc 0/0 00000100:00100000:1.0:1763343271.770659:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10296 00000100:00100000:3.0:1763343271.771955:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6950 00000100:00100000:3.0:1763343271.771973:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+112:3659:x1848998412926976:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343271.772171:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+113:3659:x1848998412926976:12345-0@lo:2:osp-syn-0-1.0 Request processed in 206us (4149us total) trans 21474839069 rc 0/0 00000100:00100000:3.0:1763343271.772179:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6950 00000100:00100000:0.0:1763343271.773139:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412926592 00000100:00100000:0.0:1763343271.773147:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412926592 00000100:00100000:0.0:1763343271.773189:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6951 00000100:00100000:0.0:1763343271.773198:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+25:3659:x1848998412926592:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343271.773593:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412926848 00000100:00100000:1.0:1763343271.773599:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412926848 00000100:00100000:1.0:1763343271.773632:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6953 00000100:00100000:1.0:1763343271.773642:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+114:3661:x1848998412926848:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763343271.773656:0:28561:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:661 count 1 00010000:00010000:1.0:1763343271.773677:0:28561:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c589ba00/0x9104b1ba770a125f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x295:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.773697:0:28561:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9401c1661000/0x9104b1ba770a0f9c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b489f7 expref: 52 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343271.773710:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343271.773713:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343271.773723:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c589ba00/0x9104b1ba770a125f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343271.773754:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+26:3659:x1848998412926592:12345-0@lo:2:osp-syn-1-1.0 Request processed in 138us (566us total) trans 17179871798 rc 0/0 00010000:00010000:1.0:1763343271.773758:0:28561:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9401c1661000/0x9104b1ba770a0f9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b489f7 expref: 52 pid: 8414 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1763343271.773765:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6951 00010000:00010000:1.0:1763343271.773778:0:28561:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9401c1661000/0x9104b1ba770a0f9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b489f7 expref: 52 pid: 8414 timeout: 1164 lvb_type: 1 00000100:00100000:1.0:1763343271.773791:0:28561:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28561:1848998412927616:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343271.773861:0:28561:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343271.776576:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.776628:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399717376 00000100:00100000:1.0:1763343271.776638:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399717376 00000100:00100000:1.0:1763343271.776691:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10297 00000100:00100000:1.0:1763343271.776700:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+275:57067:x1848998399717376:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343271.776720:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343271.776745:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a1266 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48ae5 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.776821:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a126d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343271.776833:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a126d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.776849:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a126d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.776861:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a1274 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343271.776867:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a1274 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.776873:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a1274 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.776981:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a127b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343271.776998:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a127b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.777005:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a127b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343271.777014:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e7:0x0]: returning size 2 00010000:00010000:1.0:1763343271.777131:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a126d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.777140:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a126d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.777145:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a126d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.777151:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a126d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.777157:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.777162:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a126d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.777169:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a126d lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.777180:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb700) 00010000:00010000:1.0:1763343271.777183:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.777187:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a126d lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.777193:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a126d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.777204:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a1274 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.777210:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a1274 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.777216:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a1274 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.777220:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.777223:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a1274 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.777229:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a1274 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.777248:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadbf00) 00010000:00010000:1.0:1763343271.777251:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.777253:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a1274 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.777263:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a1274 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.777472:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a1266 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ae5 expref: 278 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.777488:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a127b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ae5 expref: 277 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.777496:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e7:0x0].0x0 (ffff9401edc53500) 00010000:00010000:1.0:1763343271.777498:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343271.777500:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917e00, rc 0) 00000100:00100000:1.0:1763343271.777554:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+277:57067:x1848998399717376:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 854us (989us total) trans 4294973294 rc 0/0 00000100:00100000:1.0:1763343271.777561:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10297 00000100:00100000:3.0:1763343271.777825:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.777892:0:28562:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4789880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28562:1848998412927232:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343271.777918:0:28562:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1251 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343271.777953:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.777999:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.778061:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.778088:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.778110:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399717632 00000100:00100000:3.0:1763343271.778115:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399717632 00010000:00010000:3.0:1763343271.778133:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9401ed155000/0x9104b1ba770a104b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a44 expref: 19 pid: 35266 timeout: 1164 lvb_type: 0 00000100:00100000:3.0:1763343271.778160:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399718016 00000100:00100000:3.0:1763343271.778164:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399718016 00010000:00010000:3.0:1763343271.778179:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9401c1661000/0x9104b1ba770a0f9c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b489f7 expref: 54 pid: 8414 timeout: 1164 lvb_type: 1 00000100:00100000:3.0:1763343271.778198:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3337 00000100:00100000:3.0:1763343271.778211:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4789880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2410:x1848998399717632:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343271.778222:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343271.778230:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9401ed155000/0x9104b1ba770a104b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a44 expref: 18 pid: 35266 timeout: 1164 lvb_type: 0 00010000:00010000:3.0:1763343271.778243:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9401ed155000/0x9104b1ba770a104b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a44 expref: 18 pid: 35266 timeout: 1164 lvb_type: 0 00010000:00010000:3.0:1763343271.778257:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401ed155000/0x9104b1ba770a104b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a44 expref: 18 pid: 35266 timeout: 1164 lvb_type: 0 00000100:00100000:0.0:1763343271.778630:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399717760 00000100:00100000:0.0:1763343271.778635:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399717760 00000100:00100000:0.0:1763343271.778670:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6954 00000100:00100000:0.0:1763343271.778678:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:55884:x1848998399717760:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343271.778691:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.778702:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1289 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48aec expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.778721:0:8412:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9401ed155600/0x9104b1ba770a11e1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48abb expref: 19 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343271.778733:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.778734:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.778737:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1289 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48aec expref: 19 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.778766:0:8412:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9401ed155600/0x9104b1ba770a11e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48abb expref: 19 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343271.778780:0:8412:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9401ed155600/0x9104b1ba770a11e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48abb expref: 19 pid: 35266 timeout: 1164 lvb_type: 1 00000100:00100000:0.0:1763343271.778794:0:8412:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8412:1848998412927744:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343271.778845:0:8412:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc52300 going to sleep for 11 seconds 00010000:00010000:1.0:1763343271.779940:0:28561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401c1661000/0x9104b1ba770a0f9c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b489f7 expref: 52 pid: 8414 timeout: 1164 lvb_type: 1 00000100:00100000:1.0:1763343271.779959:0:28561:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28561:1848998412927616:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343271.779980:0:28561:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c589ba00/0x9104b1ba770a125f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.779991:0:28561:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c589ba00/0x9104b1ba770a125f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.779998:0:28561:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c589ba00/0x9104b1ba770a125f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.780009:0:28561:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c589ba00/0x9104b1ba770a125f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.780017:0:28561:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c589ba00/0x9104b1ba770a125f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.780056:0:28561:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343271.780308:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+115:3661:x1848998412926848:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6667us (6752us total) trans 21474839071 rc 0/0 00000100:00100000:1.0:1763343271.780327:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6953 00010000:00010000:1.0:1763343271.780362:0:35281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401ed154e00/0x9104b1ba770a1044 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48a36 expref: 51 pid: 35266 timeout: 1164 lvb_type: 0 00000100:00100000:1.0:1763343271.780372:0:35281:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35281:1848998412927488:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343271.780382:0:35281:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c589be00/0x9104b1ba770a1258 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.780390:0:35281:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c589be00/0x9104b1ba770a1258 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.780396:0:35281:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c589be00/0x9104b1ba770a1258 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.780408:0:35281:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c589be00/0x9104b1ba770a1258 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.780421:0:35281:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c589be00/0x9104b1ba770a1258 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.780438:0:35281:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1763343271.780523:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+115:3661:x1848998412926720:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10285us (12692us total) trans 21474839072 rc 0/0 00000100:00100000:1.0:1763343271.780529:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6949 00010000:00010000:3.0:1763343271.780531:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343271.780534:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343271.780542:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1251 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.780555:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1251 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.780563:0:35266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a0f95 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b489f0 expref: 19 pid: 8414 timeout: 1164 lvb_type: 1 00000100:00100000:1.0:1763343271.780575:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412927360:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343271.780582:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343271.780588:0:35266:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a124a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.780597:0:35266:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a124a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.780603:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a124a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.780611:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a124a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343271.780617:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4789880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2410:x1848998399717632:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 2407us (2663us total) trans 0 rc 0/0 00010000:00010000:1.0:1763343271.780621:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a124a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343271.780630:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3337 00010000:00010000:1.0:1763343271.780645:0:35266:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1763343271.780659:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1763343271.780666:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c589ba00/0x9104b1ba770a125f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.780675:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c589ba00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343271.780679:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c589ba00/0x9104b1ba770a125f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.780689:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c589ba00/0x9104b1ba770a125f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.780702:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c589ba00/0x9104b1ba770a125f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343271.780774:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+26:3662:x1848998412926336:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11860us (13276us total) trans 17179871799 rc 0/0 00000100:00100000:1.0:1763343271.780782:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6946 00010000:00010000:3.0:1763343271.780909:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c589ba00/0x9104b1ba770a125f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.780924:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343271.780926:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343271.780928:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343271.780953:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c59b7100/2, rc 0, transno 17179871799 00000100:00100000:3.0:1763343271.780961:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412926336:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763343271.780984:0:28562:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1251 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.780993:0:28562:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1251 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.781002:0:28562:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1251 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.781010:0:28562:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1251 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.781049:0:28562:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343271.781162:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+26:3662:x1848998412926208:12345-0@lo:6:osp-syn-1-1.0 Request processed in 12214us (13591us total) trans 17179871800 rc 0/0 00000100:00100000:3.0:1763343271.781169:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6947 00010000:00010000:1.0:1763343271.783153:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343271.783168:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1251 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.783180:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8693c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343271.783184:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1251 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.783194:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1251 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.783218:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1251 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.783224:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1251 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.783242:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343271.783243:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343271.783245:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343271.783732:0:8412:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8412:1848998412927744:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343271.783761:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1289 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48aec expref: 17 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.783775:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4514200, rc 0) 00000100:00100000:0.0:1763343271.783832:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:55884:x1848998399717760:12345-192.168.201.40@tcp:101:bash.0 Request processed in 5154us (5835us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.783846:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6954 00000100:00100000:1.0:1763343271.783998:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399718144 00000100:00100000:1.0:1763343271.784006:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399718144 00010000:00010000:1.0:1763343271.784428:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9401ed155600/0x9104b1ba770a11e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48abb expref: 17 pid: 35266 timeout: 1164 lvb_type: 1 00000100:00100000:1.0:1763343271.784473:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3340 00000100:00100000:1.0:1763343271.784485:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998399718144:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343271.784503:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343271.784509:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9401ed155600/0x9104b1ba770a11e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x297:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48abb expref: 17 pid: 35266 timeout: 1164 lvb_type: 1 00010000:00010000:1.0:1763343271.784829:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9401ed155600/0x9104b1ba770a11e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x297:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48abb expref: 17 pid: 35266 timeout: 1164 lvb_type: 1 00010000:00010000:1.0:1763343271.784856:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401ed155600/0x9104b1ba770a11e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x297:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48abb expref: 17 pid: 35266 timeout: 1164 lvb_type: 1 00010000:00010000:1.0:1763343271.784869:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343271.784872:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343271.784879:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1289 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48aec expref: 16 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.784891:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1289 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48aec expref: 16 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.784932:0:7904:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1289 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48aec expref: 16 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343271.784948:0:7904:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5df480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7904:1848998412927872:192.168.201.40@tcp:105: 00000100:00100000:1.0:1763343271.785068:0:7904:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1763343271.788264:0:7904:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5df480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7904:1848998412927872:192.168.201.40@tcp:105: 00010000:00010000:1.0:1763343271.788298:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343271.788372:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399718144:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 3888us (4535us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343271.788384:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3340 00000100:00100000:3.0:1763343271.788552:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.788676:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.789201:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6956 00000100:00100000:3.0:1763343271.789211:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399718272:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343271.789219:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343271.789231:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401c1660000/0x9104b1ba770a1297 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x297:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48af3 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343271.789276:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6282d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412928000:192.168.201.40@tcp:106: 00000100:00100000:3.0:1763343271.789341:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc440e40 going to sleep for 11 seconds 00002000:00010000:1.0:1763343271.792042:0:35266:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000400:0x297:0x0] updating lvb mtime: 0 -> 1763343271 00002000:00010000:1.0:1763343271.792051:0:35266:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000400:0x297:0x0] updating lvb atime: 0 -> 1763343271 00002000:00010000:1.0:1763343271.792055:0:35266:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000400:0x297:0x0] updating lvb ctime: 0 -> 1763343271 00000100:00100000:1.0:1763343271.792078:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6282d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412928000:192.168.201.40@tcp:106: 00010000:00010000:1.0:1763343271.792118:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9401c1660000/0x9104b1ba770a1297 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x297:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48af3 expref: 17 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343271.792140:0:35266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401c1660000/0x9104b1ba770a1297 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x297:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48af3 expref: 17 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343271.792153:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c1660000, rc 0) 00000100:00100000:1.0:1763343271.792205:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399718272:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2995us (3528us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343271.792214:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6956 00000100:00100000:3.0:1763343271.792264:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.793226:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.795458:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.795499:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399718912 00000100:00100000:1.0:1763343271.795504:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399718912 00000100:00100000:1.0:1763343271.795545:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3623 00000100:00100000:1.0:1763343271.795555:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+277:57067:x1848998399718912:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343271.795715:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:57067:x1848998399718912:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 160us (257us total) trans 4294973295 rc 0/0 00000100:00100000:1.0:1763343271.795723:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3623 00000100:00100000:0.0:1763343271.808786:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.808906:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399719168 00000100:00100000:1.0:1763343271.808919:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399719168 00000100:00100000:1.0:1763343271.808985:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10298 00000100:00100000:1.0:1763343271.808995:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:57067:x1848998399719168:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343271.809016:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343271.809074:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a129e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48b01 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.809185:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a12a5 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343271.809203:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a12a5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.809214:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a12a5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343271.809228:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e7:0x0]: returning size 2 00010000:00010000:1.0:1763343271.809353:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a129e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b01 expref: 281 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.809373:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a12a5 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1e7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b01 expref: 280 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.809384:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e7:0x0].0x0 (ffff9401edc53500) 00010000:00010000:1.0:1763343271.809387:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763343271.809392:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917a00, rc 0) 00000100:00100000:1.0:1763343271.809463:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57067:x1848998399719168:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 470us (688us total) trans 4294973296 rc 0/0 00000100:00100000:1.0:1763343271.809471:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10298 00000100:00100000:0.0:1763343271.811691:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.811826:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399719296 00000100:00100000:1.0:1763343271.811839:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399719296 00000100:00100000:1.0:1763343271.811946:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6957 00000100:00100000:1.0:1763343271.811955:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998399719296:12345-192.168.201.40@tcp:1:lfs.0 00010000:00010000:1.0:1763343271.811996:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a12b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.812014:0:35266:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1289 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48aec expref: 17 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.812022:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343271.812284:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343271.812289:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a12b3 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.812339:0:35266:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1289 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48aec expref: 17 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.812354:0:35266:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1289 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48aec expref: 17 pid: 8412 timeout: 1164 lvb_type: 0 00000100:00100000:1.0:1763343271.812482:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412928128:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343271.812673:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1763343271.822294:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.822389:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.822753:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399719552 00000100:00100000:1.0:1763343271.822758:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399719552 00000100:00100000:1.0:1763343271.822798:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10299 00000100:00100000:1.0:1763343271.822807:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57068:x1848998399719552:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:1.0:1763343271.822859:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1763343271.822894:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a12a5 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1e7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b01 expref: 280 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.822916:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1243 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e7:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ade expref: 279 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.822932:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a127b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ae5 expref: 278 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.822946:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a120b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ad0 expref: 277 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.822958:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e7:0x0].0x0 (ffff9401edc53500) 00010000:00010000:1.0:1763343271.822972:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343271.823002:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a12ba lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343271.823015:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a12ba lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.823060:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a12ba lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.823092:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a12c1 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343271.823101:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a12c1 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.823108:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a12c1 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.823188:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a12c8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343271.823197:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a12c8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.823204:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a12c8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00080000:1.0:1763343271.823432:0:9827:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x1e7:0x0] is inserted into orphan list, open count = 2 00010000:00010000:1.0:1763343271.823522:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a12c8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.823533:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a12c8 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.823552:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a12c8 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.823564:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c1661c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.823571:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a12c8 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.823582:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a12c8 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.823592:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e7:0x0].0x0 (ffff9400ccadb100) 00010000:00010000:1.0:1763343271.823600:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343271.823605:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a12c8 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.823612:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a12c8 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000100:00100000:3.0:1763343271.823628:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412928128:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343271.823631:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a12ba lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.823640:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a12ba lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.823645:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a12ba lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.823651:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a12ba lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.823656:0:35266:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a12b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.823656:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3916200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.823659:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a12ba lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.823665:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a12ba lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.823671:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb700) 00010000:00010000:1.0:1763343271.823673:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.823676:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a12ba lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.823681:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a12ba lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000004:00010000:1.0:1763343271.823692:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009e820407 reply state 00000000c44278b8 transno 4294973297 ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a12c1 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.823702:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a12c1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.823708:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadbf00) 00010000:00010000:1.0:1763343271.823711:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343271.823714:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343271.823756:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:57068:x1848998399719552:12345-192.168.201.40@tcp:36:rm.0 Request processed in 951us (1474us total) trans 4294973297 rc 0/0 00000100:00100000:1.0:1763343271.823763:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10299 00000100:00100000:0.0:1763343271.826192:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.826273:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399719808 00000100:00100000:1.0:1763343271.826284:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399719808 00010000:00010000:1.0:1763343271.826340:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1289 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48aec expref: 20 pid: 8412 timeout: 1164 lvb_type: 0 00000100:00100000:1.0:1763343271.826384:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3341 00000100:00100000:1.0:1763343271.826394:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2409:x1848998399719808:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343271.826412:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1763343271.826431:0:7904:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x297:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:1.0:1763343271.826434:0:7904:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x297:0x0] updating lvb atime from disk: 0 -> 1763343271 00002000:00010000:1.0:1763343271.826436:0:7904:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x297:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1763343271.826442:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1289 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48aec expref: 20 pid: 8412 timeout: 1164 lvb_type: 0 00010000:00010000:1.0:1763343271.826456:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1289 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48aec expref: 20 pid: 8412 timeout: 1164 lvb_type: 0 00010000:00010000:1.0:1763343271.826480:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1289 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48aec expref: 20 pid: 8412 timeout: 1164 lvb_type: 0 00010000:00010000:1.0:1763343271.826497:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343271.826499:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343271.826504:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a12b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.826518:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a12b3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.826554:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343271.826608:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2409:x1848998399719808:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 215us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343271.826615:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3341 00000100:00100000:0.0:1763343271.832821:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.833684:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399720064 00000100:00100000:1.0:1763343271.833696:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399720064 00000100:00100000:1.0:1763343271.833764:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10300 00000100:00100000:1.0:1763343271.833776:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:57067:x1848998399720064:12345-192.168.201.40@tcp:36:lfs.0 00000100:00100000:1.0:1763343271.834369:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:57067:x1848998399720064:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 591us (1555us total) trans 0 rc -116/-116 00000100:00100000:1.0:1763343271.834379:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10300 00000100:00100000:0.0:1763343271.835378:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.835806:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399720192 00000100:00100000:1.0:1763343271.835816:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399720192 00000100:00100000:1.0:1763343271.835875:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10301 00000100:00100000:1.0:1763343271.835884:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:57069:x1848998399720192:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343271.835903:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343271.835928:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a12cf lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48b08 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.836004:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a12d6 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343271.836019:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a12d6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.836058:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a12d6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.836070:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a12dd lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343271.836077:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a12dd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.836082:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a12dd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.836129:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a12d6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.836135:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a12d6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.836141:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a12d6 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.836148:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a12d6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.836154:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c1661000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.836158:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a12d6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.836165:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a12d6 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.836178:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb700) 00010000:00010000:1.0:1763343271.836181:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.836185:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a12d6 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.836191:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a12d6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.836204:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a12dd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.836209:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a12dd lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.836214:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a12dd lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.836217:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c0030200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.836220:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a12dd lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.836224:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a12dd lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.836230:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadbf00) 00010000:00010000:1.0:1763343271.836233:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.836235:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a12dd lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.836240:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a12dd lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.836265:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a12cf lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b08 expref: 279 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.836274:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb700) 00010000:00010000:1.0:1763343271.836277:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.836281:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a12cf lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b08 expref: 279 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.836293:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c1661c00, rc 0) 00000100:00100000:1.0:1763343271.836359:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:57069:x1848998399720192:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 475us (989us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343271.836366:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10301 00000100:00100000:3.0:1763343271.838700:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.838872:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399720448 00000100:00100000:1.0:1763343271.838885:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399720448 00000100:00100000:1.0:1763343271.838951:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3624 00000100:00100000:1.0:1763343271.838963:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:57067:x1848998399720448:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343271.839805:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+279:57067:x1848998399720448:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 842us (1119us total) trans 4294973298 rc 0/0 00000100:00100000:1.0:1763343271.839815:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3624 00000100:00100000:0.0:1763343271.840685:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.841463:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.841794:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399720832 00000100:00100000:1.0:1763343271.841804:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399720832 00000100:00100000:1.0:1763343271.842768:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3625 00000100:00100000:1.0:1763343271.842777:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8444850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+279:57067:x1848998399720832:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:1.0:1763343271.843009:0:19639:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1e7:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1763343271.843120:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1633, 64 off136400 00000040:00080000:1.0:1763343271.843145:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1625, 64 off135704 00000040:00080000:1.0:1763343271.843154:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1626, 64 off135768 00000040:00080000:1.0:1763343271.843163:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1634, 64 off136464 00010000:00010000:1.0:1763343271.843222:0:19639:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a12f9 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19639 initiator: MDT0 00010000:00010000:1.0:1763343271.843232:0:19639:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a12f9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 19639 initiator: MDT1 00010000:00010000:1.0:1763343271.843242:0:19639:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a12f9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19639 initiator: MDT1 00010000:00010000:1.0:1763343271.843249:0:19639:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a12f9 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1e7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19639 initiator: MDT1 00010000:00010000:1.0:1763343271.843255:0:19639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a12f9 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1e7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19639 initiator: MDT1 00010000:00010000:1.0:1763343271.843261:0:19639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a12f9 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1e7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19639 initiator: MDT1 00010000:00010000:1.0:1763343271.843278:0:19639:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343271.843466:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8444850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57067:x1848998399720832:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 688us (2003us total) trans 4294973299 rc 0/0 00000100:00100000:1.0:1763343271.843474:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3625 00000100:00100000:3.0:1763343271.850664:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.850746:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399720960 00000100:00100000:1.0:1763343271.850757:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399720960 00000100:00100000:1.0:1763343271.850822:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10303 00000100:00100000:1.0:1763343271.850833:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57069:x1848998399720960:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343271.850854:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343271.850878:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a1300 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48b16 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.850941:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a1307 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343271.850954:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a1307 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.850966:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a1307 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343271.851014:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763343271.851019:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763343271.851099:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a1300 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b16 expref: 282 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.851117:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a1307 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b16 expref: 281 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.851126:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb700) 00010000:00010000:1.0:1763343271.851129:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343271.851132:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917e00, rc 0) 00000100:00100000:1.0:1763343271.851179:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57069:x1848998399720960:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 349us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343271.851186:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10303 00000100:00100000:0.0:1763343271.858228:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.858691:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399721216 00000100:00100000:1.0:1763343271.858703:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399721216 00000100:00100000:1.0:1763343271.858771:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10304 00000100:00100000:1.0:1763343271.858783:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57070:x1848998399721216:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343271.858808:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343271.858829:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a130e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48b1d expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.858919:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a1315 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343271.858935:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a1315 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.858946:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a1315 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.858958:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a131c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343271.858964:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a131c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.858970:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a131c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.859014:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a1315 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.859021:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a1315 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.859116:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a1315 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.859122:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a1315 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.859128:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.859132:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a1315 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.859140:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a1315 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.859153:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb700) 00010000:00010000:1.0:1763343271.859155:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.859160:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a1315 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.859165:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a1315 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.859179:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a131c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.859184:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a131c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.859419:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a131c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.859424:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3916200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.859426:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a131c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.859432:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a131c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.859440:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadbf00) 00010000:00010000:1.0:1763343271.859443:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.859446:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a131c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.859451:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a131c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.859485:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a130e lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b1d expref: 282 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.859496:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb700) 00010000:00010000:1.0:1763343271.859498:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343271.859502:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a130e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b1d expref: 282 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.859516:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917000, rc 0) 00000100:00100000:0.0:1763343271.861581:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57070:x1848998399721216:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2787us (3349us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343271.861596:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10304 00000100:00100000:0.0:1763343271.868708:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.869106:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399721344 00000100:00100000:3.0:1763343271.869116:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399721344 00000100:00100000:3.0:1763343271.869172:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10305 00000100:00100000:3.0:1763343271.869182:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57069:x1848998399721344:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343271.869200:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343271.869221:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1323 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48b24 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.869287:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a132a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343271.869305:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a132a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.869328:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a132a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.869340:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1331 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343271.869348:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1331 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.869354:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1331 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.869393:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a132a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.869400:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a132a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.869406:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a132a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.869413:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a132a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.869419:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8692c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343271.869423:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a132a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.869430:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a132a lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.869444:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb700) 00010000:00010000:3.0:1763343271.869447:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343271.869452:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a132a lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.869458:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a132a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.869470:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1331 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.869475:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1331 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.869480:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1331 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.869486:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8693c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343271.869489:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1331 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.869495:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1331 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.869502:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadbf00) 00010000:00010000:3.0:1763343271.869504:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343271.869507:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1331 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.869512:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1331 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.869538:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1323 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b24 expref: 282 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.869548:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb700) 00010000:00010000:3.0:1763343271.869551:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343271.869555:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1323 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b24 expref: 282 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.869563:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8693e00, rc 0) 00000100:00100000:3.0:1763343271.869632:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57069:x1848998399721344:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 450us (938us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343271.869639:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10305 00000100:00100000:0.0:1763343271.873205:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399721600 00000100:00100000:0.0:1763343271.873220:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399721600 00000100:00100000:0.0:1763343271.873287:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10306 00000100:00100000:0.0:1763343271.873298:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57069:x1848998399721600:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343271.873332:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.873336:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343271.873366:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a1307 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b16 expref: 281 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.873388:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb700) 00010000:00010000:0.0:1763343271.873398:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343271.873415:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1338 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48b2b expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.873525:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a133f lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343271.873538:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a133f lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.873549:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a133f lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.873562:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1346 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343271.873569:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1346 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.873575:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1346 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.873958:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a134d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343271.873967:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a134d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.873975:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a134d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343271.873984:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e8:0x0]: returning size 0 00010000:00010000:0.0:1763343271.874008:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a133f lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.874014:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a133f lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.874020:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a133f lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.874054:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a133f lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.874059:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.874064:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a133f lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.874070:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a133f lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.874078:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d0aa0800) 00010000:00010000:0.0:1763343271.874081:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.874085:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a133f lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.874090:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a133f lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00010000:0.0:1763343271.874103:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003d37fc5f reply state 00000000fd950b3d transno 4294973300 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1346 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.874112:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1346 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.874117:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadbf00) 00010000:00010000:0.0:1763343271.874119:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343271.874122:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343271.874147:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1338 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b2b expref: 283 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.874164:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a134d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b2b expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.874171:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e8:0x0].0x0 (ffff9401d0aa0e00) 00010000:00010000:0.0:1763343271.874173:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343271.874175:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4514a00, rc 0) 00000100:00100000:0.0:1763343271.874263:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57069:x1848998399721600:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 966us (1860us total) trans 4294973300 rc 0/0 00000100:00100000:0.0:1763343271.874271:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10306 00000100:00100000:0.0:1763343271.879290:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.879507:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399721984 00000100:00100000:3.0:1763343271.879517:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399721984 00000100:00100000:3.0:1763343271.879585:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10307 00000100:00100000:3.0:1763343271.879596:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57071:x1848998399721984:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343271.879621:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343271.879641:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a135b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1e8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48b32 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.879748:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1362 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343271.879764:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1362 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343271.879776:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1362 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:3.0:1763343271.879787:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e8:0x0]: returning size 0 00010000:00010000:3.0:1763343271.879893:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a135b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b32 expref: 286 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.879914:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1362 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b32 expref: 285 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.879924:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e8:0x0].0x0 (ffff9401d0aa0e00) 00010000:00010000:3.0:1763343271.879928:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343271.879932:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8693c00, rc 0) 00000100:00100000:3.0:1763343271.880007:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57071:x1848998399721984:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 413us (728us total) trans 4294973301 rc 0/0 00000100:00100000:3.0:1763343271.880014:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10307 00000100:00100000:0.0:1763343271.880102:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.885060:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.885098:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.885126:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.885220:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399722240 00000100:00100000:3.0:1763343271.885230:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399722240 00010000:00010000:3.0:1763343271.885280:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1362 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b32 expref: 287 pid: 9827 timeout: 1165 lvb_type: 0 00000100:00100000:3.0:1763343271.885308:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399722368 00000100:00100000:3.0:1763343271.885311:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399722368 00010000:00010000:3.0:1763343271.885334:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a134d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b2b expref: 288 pid: 7641 timeout: 1165 lvb_type: 0 00000100:00100000:0.0:1763343271.885417:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3342 00000100:00100000:0.0:1763343271.885430:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:2407:x1848998399722240:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343271.885446:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343271.885454:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1362 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b32 expref: 288 pid: 9827 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343271.885467:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1362 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b32 expref: 288 pid: 9827 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343271.885490:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1362 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b32 expref: 288 pid: 9827 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343271.885508:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e8:0x0].0x0 (ffff9401d0aa0e00) 00010000:00010000:0.0:1763343271.885514:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a1377 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.885522:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343271.885578:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:2407:x1848998399722240:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 150us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.885587:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3342 00000100:00100000:1.0:1763343271.886762:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3343 00000100:00100000:1.0:1763343271.886774:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:2407:x1848998399722368:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343271.886784:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343271.886791:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a134d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b2b expref: 287 pid: 7641 timeout: 1165 lvb_type: 0 00010000:00010000:1.0:1763343271.886803:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a134d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b2b expref: 287 pid: 7641 timeout: 1165 lvb_type: 0 00010000:00010000:1.0:1763343271.886823:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a134d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b2b expref: 287 pid: 7641 timeout: 1165 lvb_type: 0 00010000:00010000:1.0:1763343271.886838:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e8:0x0].0x0 (ffff9401d0aa0e00) 00010000:00010000:1.0:1763343271.886843:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a1377 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.886851:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a1377 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.886857:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a1377 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.886892:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343271.886926:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:2407:x1848998399722368:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 156us (1799us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343271.886934:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3343 00010000:00010000:0.0:1763343271.887356:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a1377 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.887365:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a1377 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343271.887397:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e8:0x0]: returning size 0 00000004:00080000:0.0:1763343271.887596:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x298:0x0], index 0: 0 00000004:00080000:0.0:1763343271.887603:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x299:0x0], index 1: 0 00000004:00080000:0.0:1763343271.887608:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x29a:0x0], index 1: 0 00000004:00080000:0.0:1763343271.887612:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x299:0x0], index 0: 0 00010000:00010000:0.0:1763343271.887720:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a1377 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.887728:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a1377 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.887736:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a1377 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.887741:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401ed154e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.887746:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a1377 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.887753:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a1377 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.887763:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e8:0x0].0x0 (ffff9401d0aa0e00) 00010000:00010000:0.0:1763343271.887766:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343271.887770:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a1377 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.887775:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a1377 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.887825:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a1370 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b39 expref: 286 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.887839:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e8:0x0].0x0 (ffff9401d0aa0e00) 00010000:00010000:0.0:1763343271.887841:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343271.887844:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a1370 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b39 expref: 286 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.887858:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401ed155000, rc 0) 00000100:00100000:0.0:1763343271.888570:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57069:x1848998399722112:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 8204us (9124us total) trans 4294973303 rc 301/301 00000100:00100000:0.0:1763343271.888580:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10308 00000100:00100000:0.0:1763343271.891950:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.892523:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.892591:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399723136 00000100:00100000:3.0:1763343271.892595:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399723136 00000100:00100000:3.0:1763343271.892634:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10309 00000100:00100000:3.0:1763343271.892641:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57071:x1848998399723136:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343271.892651:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343271.892675:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a1385 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48b40 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.892985:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a138c lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343271.893000:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a138c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343271.893012:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a138c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343271.893088:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1393 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343271.893098:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1393 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343271.893104:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1393 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343271.893185:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a139a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343271.893193:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a139a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343271.893199:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a139a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:3.0:1763343271.893208:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e8:0x0]: returning size 0 00010000:00010000:3.0:1763343271.893638:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a138c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343271.893648:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a138c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343271.893658:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a138c lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343271.893665:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a138c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343271.893671:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8693e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343271.893675:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a138c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343271.893682:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a138c lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343271.893751:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b500) 00010000:00010000:3.0:1763343271.893755:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343271.893760:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a138c lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343271.893766:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a138c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343271.893780:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1393 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343271.893786:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1393 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343271.893791:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1393 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343271.893796:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121fc00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343271.893799:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1393 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343271.893810:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1393 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343271.893817:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadbf00) 00010000:00010000:3.0:1763343271.893819:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343271.893822:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1393 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343271.893828:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1393 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343271.893864:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a1385 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b40 expref: 289 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.893882:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a139a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b40 expref: 288 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343271.893890:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e8:0x0].0x0 (ffff9400c488ba00) 00010000:00010000:3.0:1763343271.893892:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343271.893895:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121e200, rc 0) 00000100:00100000:3.0:1763343271.893947:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57071:x1848998399723136:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1306us (1425us total) trans 4294973305 rc 0/0 00000100:00100000:3.0:1763343271.893955:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10309 00000100:00100000:0.0:1763343271.896738:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.904716:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.904764:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.906890:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399723520 00000100:00100000:1.0:1763343271.906909:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399723520 00000100:00100000:1.0:1763343271.906978:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399723648 00000100:00100000:1.0:1763343271.906981:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399723648 00000100:00100000:1.0:1763343271.907011:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6958 00000100:00100000:1.0:1763343271.907020:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2407:x1848998399723520:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343271.907061:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343271.907088:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba770a13a8 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48b47 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343271.907113:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x29a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343271.907134:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343271.907137:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343271.907146:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba770a13a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b47 expref: 19 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343271.907165:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba770a13a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b47 expref: 19 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343271.907179:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3916200, rc 0) 00000100:00100000:1.0:1763343271.907243:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2407:x1848998399723520:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 223us (2539us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343271.907251:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6958 00000100:00100000:1.0:1763343271.907281:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6959 00000100:00100000:1.0:1763343271.907289:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+53:2408:x1848998399723648:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343271.907300:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343271.907311:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a13af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48b4e expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343271.907335:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x299:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343271.907346:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343271.907348:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343271.907352:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a13af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b4e expref: 54 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343271.907365:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a13af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b4e expref: 54 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343271.907373:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917a00, rc 0) 00000100:00100000:1.0:1763343271.907393:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+54:2408:x1848998399723648:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 106us (2629us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343271.907399:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6959 00000100:00100000:3.0:1763343271.907713:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.908683:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399723904 00000100:00100000:1.0:1763343271.908693:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399723904 00000100:00100000:1.0:1763343271.909245:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10310 00000100:00100000:1.0:1763343271.909257:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:55884:x1848998399723904:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343271.909390:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343271.909394:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343271.909422:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a139a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b40 expref: 289 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.909440:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e8:0x0].0x0 (ffff9400c488ba00) 00010000:00010000:1.0:1763343271.909450:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343271.909465:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a13b6 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x1e8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48b55 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.909680:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a13bd lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1e8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343271.909692:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a13bd lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1e8:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.909702:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a13bd lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1e8:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343271.909717:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e8:0x0]: returning size 0 00010000:00010000:1.0:1763343271.909825:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a13b6 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1e8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b55 expref: 291 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.909853:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a13bd lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1e8:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b55 expref: 290 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.909860:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e8:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:1.0:1763343271.909863:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:1.0:1763343271.909865:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c0030200, rc 0) 00000100:00100000:1.0:1763343271.909948:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:55884:x1848998399723904:12345-192.168.201.40@tcp:101:bash.0 Request processed in 694us (2236us total) trans 4294973307 rc 0/0 00000100:00100000:1.0:1763343271.909957:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10310 00000100:00100000:3.0:1763343271.912115:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.912234:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399724032 00000100:00100000:1.0:1763343271.912244:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399724032 00000100:00100000:1.0:1763343271.912305:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10311 00000100:00100000:1.0:1763343271.912325:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57071:x1848998399724032:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343271.912353:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343271.912377:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a13cb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1e8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48b5c expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.912433:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a13cb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1e8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b5c expref: 291 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.912447:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a13cb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1e8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b5c expref: 291 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.912465:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e8:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:1.0:1763343271.912468:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343271.912471:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c1661c00, rc 0) 00000100:00100000:1.0:1763343271.913331:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57071:x1848998399724032:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1004us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343271.913341:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10311 00000100:00100000:3.0:1763343271.913688:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.913908:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399724160 00000100:00100000:1.0:1763343271.913917:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399724160 00000100:00100000:1.0:1763343271.914106:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10312 00000100:00100000:1.0:1763343271.914117:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:55884:x1848998399724160:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343271.914135:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343271.914153:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a13d2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48b63 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.914184:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a13d9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343271.914197:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a13d9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.914208:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a13d9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.914339:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a13d2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b63 expref: 293 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.914355:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a13d9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b63 expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.914364:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e8:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:1.0:1763343271.914366:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343271.914368:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400cbad3c00, rc 0) 00000100:00100000:1.0:1763343271.914410:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:55884:x1848998399724160:12345-192.168.201.40@tcp:101:bash.0 Request processed in 296us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343271.914416:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10312 00000100:00100000:3.0:1763343271.917510:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.917607:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399724416 00000100:00100000:1.0:1763343271.917617:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399724416 00000100:00100000:1.0:1763343271.917677:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3629 00000100:00100000:1.0:1763343271.917687:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57071:x1848998399724416:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343271.917901:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57071:x1848998399724416:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 215us (401us total) trans 4294973308 rc 0/0 00000100:00100000:1.0:1763343271.917909:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3629 00000100:00100000:3.0:1763343271.918680:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.918725:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399724672 00000100:00100000:1.0:1763343271.918731:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399724672 00000100:00100000:1.0:1763343271.918776:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10313 00000100:00100000:1.0:1763343271.918784:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:55884:x1848998399724672:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:1.0:1763343271.918824:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343271.918851:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a13bd lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1e8:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b55 expref: 293 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.918871:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e8:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:1.0:1763343271.918877:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343271.919249:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a13e0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1e8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343271.919265:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a13e0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.919275:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a13e0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000001:00080000:1.0:1763343271.919331:0:7641:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973309 00000004:00010000:1.0:1763343271.919355:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000044957094 reply state 00000000315300c3 transno 4294973310 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a13e0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.919367:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a13e0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1e8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.919373:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e8:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:1.0:1763343271.919375:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343271.919378:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343271.919463:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:55884:x1848998399724672:12345-192.168.201.40@tcp:36:bash.0 Request processed in 675us (782us total) trans 4294973310 rc 0/0 00000100:00100000:1.0:1763343271.919470:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10313 00000020:00080000:1.0:1763343271.919474:0:7641:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343271.921729:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399724928 00000100:00100000:1.0:1763343271.921740:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399724928 00000100:00100000:1.0:1763343271.921797:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10314 00000100:00100000:1.0:1763343271.921807:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57071:x1848998399724928:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343271.921829:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343271.921851:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a13e7 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48b6a expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.921931:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a13ee lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343271.921944:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a13ee lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.921955:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a13ee lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.921967:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a13f5 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343271.921975:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a13f5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.921981:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a13f5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.922111:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a13fc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343271.922120:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a13fc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.922127:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a13fc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343271.922138:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e8:0x0]: returning size 0 00010000:00010000:1.0:1763343271.922215:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a13ee lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.922223:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a13ee lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.922229:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a13ee lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.922235:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a13ee lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.922240:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a2e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.922244:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a13ee lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.922252:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a13ee lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.922264:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:1.0:1763343271.922275:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.922280:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a13ee lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.922286:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a13ee lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.922299:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a13f5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.922304:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a13f5 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.922309:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a13f5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.922326:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.922329:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a13f5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.922334:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a13f5 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.922342:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadbf00) 00010000:00010000:1.0:1763343271.922344:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.922347:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a13f5 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.922352:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a13f5 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.922388:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a13e7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b6a expref: 298 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.922407:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a13fc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b6a expref: 297 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.922414:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e8:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:1.0:1763343271.922416:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343271.922419:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5088800, rc 0) 00000100:00100000:1.0:1763343271.922498:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57071:x1848998399724928:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 692us (1550us total) trans 4294973311 rc 0/0 00000100:00100000:1.0:1763343271.922505:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10314 00000100:00100000:1.0:1763343271.924382:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.924898:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399725184 00000100:00100000:0.0:1763343271.924910:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399725184 00000100:00100000:1.0:1763343271.925518:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10315 00000100:00100000:1.0:1763343271.925533:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:55884:x1848998399725184:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343271.925562:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343271.925566:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343271.925595:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a13cb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e8:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b5c expref: 297 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.925614:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e8:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:1.0:1763343271.925620:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343271.925633:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a140a lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48b71 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.925678:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a1411 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343271.925691:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a13fc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b6a expref: 297 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.925699:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a1411 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.925731:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a13fc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b6a expref: 297 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.925744:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a13fc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b6a expref: 297 pid: 7641 timeout: 1165 lvb_type: 0 00000100:00100000:1.0:1763343271.925757:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6403100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412928512:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343271.925858:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1763343271.926456:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.927245:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399725440 00000100:00100000:1.0:1763343271.927255:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399725440 00000100:00100000:1.0:1763343271.927301:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3630 00000100:00100000:1.0:1763343271.927309:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57071:x1848998399725440:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343271.927552:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57071:x1848998399725440:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 242us (1097us total) trans 4294973312 rc 0/0 00000100:00100000:1.0:1763343271.927561:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3630 00000100:00100000:1.0:1763343271.928737:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6403100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412928512:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343271.928763:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a1411 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343271.930727:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.930819:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.931178:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399725696 00000100:00100000:0.0:1763343271.931186:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399725696 00010000:00010000:0.0:1763343271.931213:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a13fc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b6a expref: 300 pid: 7641 timeout: 1165 lvb_type: 0 00000100:00100000:0.0:1763343271.931246:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3344 00000100:00100000:0.0:1763343271.931255:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:2409:x1848998399725696:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343271.931268:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343271.931274:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a13fc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b6a expref: 300 pid: 7641 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343271.931294:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a13fc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b6a expref: 300 pid: 7641 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343271.931332:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a13fc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b6a expref: 300 pid: 7641 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343271.931349:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e8:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:0.0:1763343271.931355:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a1411 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.931369:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a1411 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.932497:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a1411 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.932538:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343271.932565:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a1411 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.932575:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a1411 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:0.0:1763343271.932589:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:2409:x1848998399725696:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1333us (1767us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.932599:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3344 00000040:00080000:1.0:1763343271.932809:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1627, 88 off135856 00000004:00080000:1.0:1763343271.932818:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1065056793070ns, next at 1065528590468ns, rc = 0 00000040:00080000:1.0:1763343271.932854:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1635, 88 off136552 00000004:00080000:1.0:1763343271.932859:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1065056834676ns, next at 1065526239568ns, rc = 0 00000040:00080000:1.0:1763343271.932897:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1636, 88 off136640 00000004:00080000:1.0:1763343271.932902:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1065056877536ns, next at 1065526239568ns, rc = 0 00000040:00080000:1.0:1763343271.932919:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1628, 88 off135944 00000004:00080000:1.0:1763343271.932923:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1065056898450ns, next at 1065528590468ns, rc = 0 00010000:00010000:1.0:1763343271.940725:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a12c1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00000100:00100000:3.0:1763343271.940727:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c39b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412929024:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1763343271.940744:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a12c1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.940758:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a12c1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.940765:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c1660000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.940771:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a12c1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.940779:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a12c1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.940801:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadbf00) 00010000:00010000:1.0:1763343271.940805:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.940810:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a12c1 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000100:00100000:3.0:1763343271.940817:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343271.940822:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a12c1 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.940850:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1346 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.940856:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1346 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343271.940861:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1763343271.940862:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1346 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343271.940869:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c39b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412928896:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1763343271.940870:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4515600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.940876:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1346 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.940882:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1346 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.940891:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadbf00) 00010000:00010000:1.0:1763343271.940894:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.940897:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1346 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343271.940900:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343271.940908:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1346 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.940929:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a13e0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1e8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.940935:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a13e0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1e8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343271.940938:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412929024 00010000:00010000:1.0:1763343271.940941:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a13e0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1e8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343271.940947:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412929024 00010000:00010000:1.0:1763343271.940948:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a3000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.940953:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a13e0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1e8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.940959:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a13e0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1e8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.940967:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e8:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:1.0:1763343271.940969:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.940973:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a13e0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1e8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343271.940978:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a13e0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1e8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343271.940991:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412928896 00000100:00100000:3.0:1763343271.940996:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412928896 00000100:00100000:3.0:1763343271.941044:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6960 00000100:00100000:3.0:1763343271.941055:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+116:3660:x1848998412929024:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1763343271.941063:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a1411 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1e8:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b71 expref: 276 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.941073:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e8:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:1.0:1763343271.941076:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343271.941093:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a140a lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b71 expref: 276 pid: 7641 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343271.941107:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a1411 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1e8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b71 expref: 275 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.941133:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e8:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:1.0:1763343271.941136:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343271.941138:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5088200, rc 0) 00000100:00100000:1.0:1763343271.941193:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+275:55884:x1848998399725184:12345-192.168.201.40@tcp:101:bash.0 Request processed in 15665us (17173us total) trans 4294973313 rc 0/0 00000100:00100000:1.0:1763343271.941202:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10315 00002000:00010000:3.0:1763343271.941208:0:28562:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x299:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343271.941213:0:28562:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x299:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343271.941215:0:28562:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x299:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343271.941218:0:28562:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x299:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343271.941221:0:28562:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x299:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343271.941258:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+117:3660:x1848998412929024:12345-0@lo:2:osp-syn-0-1.0 Request processed in 206us (445us total) trans 21474839074 rc 0/0 00000100:00100000:3.0:1763343271.941264:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6960 00000004:00080000:1.0:1763343271.941303:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c39b6680/2, rc 0, transno 21474839074 00000100:00100000:1.0:1763343271.941310:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c39b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412929024:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343271.941511:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c7ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412929536:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343271.941701:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6961 00000100:00100000:3.0:1763343271.941708:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+116:3660:x1848998412928896:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343271.943647:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343271.944384:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412929536 00000100:00100000:0.0:1763343271.944393:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412929536 00000100:00100000:0.0:1763343271.944448:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6962 00000100:00100000:0.0:1763343271.944463:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+26:3660:x1848998412929536:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1763343271.944615:0:28561:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x29a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343271.944619:0:28561:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x29a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343271.944622:0:28561:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x29a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343271.944624:0:28561:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x29a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343271.944627:0:28561:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x29a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343271.944675:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+27:3660:x1848998412929536:12345-0@lo:2:osp-syn-1-1.0 Request processed in 219us (1035us total) trans 17179871803 rc 0/0 00000100:00100000:0.0:1763343271.944683:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6962 00000004:00080000:1.0:1763343271.945248:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c7ef7480/2, rc 0, transno 17179871803 00000100:00100000:1.0:1763343271.945258:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c7ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412929536:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343271.945325:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+117:3660:x1848998412928896:12345-0@lo:2:osp-syn-0-1.0 Request processed in 3605us (4415us total) trans 21474839075 rc 0/0 00000100:00100000:3.0:1763343271.945333:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6961 00000100:00100000:0.0:1763343271.945354:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343271.945381:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412929408 00000100:00100000:3.0:1763343271.945391:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412929408 00000100:00100000:0.0:1763343271.945399:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343271.945423:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c7ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412929280:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343271.945432:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412928768 00000100:00100000:3.0:1763343271.945437:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412928768 00000100:00100000:3.0:1763343271.945461:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6963 00000100:00100000:0.0:1763343271.945467:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343271.945471:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+27:3659:x1848998412929408:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343271.945502:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343271.945524:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c7ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412929152:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343271.945547:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343271.945607:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+29:3659:x1848998412929408:12345-0@lo:2:osp-syn-1-1.0 Request processed in 136us (253us total) trans 17179871804 rc 0/0 00000100:00100000:1.0:1763343271.945615:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412929152 00000100:00100000:3.0:1763343271.945618:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6963 00000100:00100000:1.0:1763343271.945622:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412929152 00000100:00100000:3.0:1763343271.945640:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6965 00000100:00100000:1.0:1763343271.946099:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6966 00000100:00100000:1.0:1763343271.946108:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+119:3661:x1848998412928640:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763343271.946133:0:8414:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:662 count 1 00010000:00010000:1.0:1763343271.946146:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a141f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x296:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.946162:0:8414:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9401ed154800/0x9104b1ba770a1290 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48afa expref: 53 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.946171:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343271.946173:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343271.946175:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a141f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.946204:0:8414:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9401ed154800/0x9104b1ba770a1290 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48afa expref: 53 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.946219:0:8414:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9401ed154800/0x9104b1ba770a1290 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48afa expref: 53 pid: 28562 timeout: 1165 lvb_type: 0 00000100:00100000:1.0:1763343271.946233:0:8414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c8bc0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1848998412929664:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343271.946295:0:8414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343271.946330:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6967 00000100:00100000:1.0:1763343271.946338:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+29:3661:x1848998412929152:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343271.946352:0:27798:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:663 count 1 00002000:00010000:1.0:1763343271.946371:0:27798:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x297:0x0] initial LVB size: 5, mtime: 0x691a7ba7, atime: 0x691a7ba7, ctime: 0x691a7ba7, blocks: 0x8 00010000:00010000:1.0:1763343271.946376:0:27798:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1426 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.946384:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343271.946386:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343271.946390:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1426 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.946403:0:27798:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1426 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.946410:0:27798:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1426 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.946418:0:27798:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1426 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.946438:0:27798:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343271.946684:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+30:3661:x1848998412929152:12345-0@lo:6:osp-syn-1-1.0 Request processed in 346us (1136us total) trans 17179871805 rc 0/0 00000100:00100000:1.0:1763343271.946692:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6967 00010000:00010000:1.0:1763343271.946719:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343271.946741:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c7ef6300/2, rc 0, transno 17179871805 00000100:00100000:1.0:1763343271.946746:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c7ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412929152:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1763343271.946768:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c39b6300/2, rc 0, transno 21474839075 00000100:00100000:1.0:1763343271.946774:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c39b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412928896:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763343271.947227:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c7ef5880/2, rc 0, transno 17179871804 00000100:00100000:0.0:1763343271.947234:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c7ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412929408:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343271.947492:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+29:3662:x1848998412929280:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1763343271.947682:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343271.947689:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a142d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.947698:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd9000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343271.947702:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a142d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.947711:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a142d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.947725:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a142d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.947738:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a142d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.947759:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343271.947761:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343271.947763:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343271.947872:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c7ef7b80/2, rc 0, transno 17179871806 00000100:00100000:0.0:1763343271.947878:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c7ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412929280:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343271.950692:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.950830:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.951383:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399726080 00000100:00100000:0.0:1763343271.951390:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399726080 00010000:00010000:0.0:1763343271.951419:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9401ed154800/0x9104b1ba770a1290 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48afa expref: 56 pid: 28562 timeout: 1165 lvb_type: 0 00000100:00100000:0.0:1763343271.951451:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3345 00000100:00100000:0.0:1763343271.951463:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+56:2407:x1848998399726080:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343271.951475:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343271.951482:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9401ed154800/0x9104b1ba770a1290 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48afa expref: 56 pid: 28562 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343271.951495:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9401ed154800/0x9104b1ba770a1290 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48afa expref: 56 pid: 28562 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343271.951512:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.951514:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343271.951518:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a141f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.951533:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a141f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.951562:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343271.951587:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+55:2407:x1848998399726080:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 127us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343271.951595:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3345 00010000:00010000:1.0:1763343271.951720:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401ed154800/0x9104b1ba770a1290 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48afa expref: 54 pid: 28562 timeout: 1165 lvb_type: 0 00000100:00100000:1.0:1763343271.951736:0:8414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c8bc0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1848998412929664:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343271.951755:0:8414:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a141f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.951767:0:8414:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a141f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.951773:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a141f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.951782:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a141f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.951788:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a141f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.951811:0:8414:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343271.952071:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+119:3661:x1848998412928640:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5963us (6567us total) trans 21474839077 rc 0/0 00000100:00100000:1.0:1763343271.952077:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6966 00000004:00080000:0.0:1763343271.952250:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c39b7b80/2, rc 0, transno 21474839077 00000100:00100000:0.0:1763343271.952257:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c39b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412928640:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343271.953427:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.953478:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399726208 00000100:00100000:0.0:1763343271.953487:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399726208 00000100:00100000:0.0:1763343271.953542:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10316 00000100:00100000:0.0:1763343271.953553:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+275:57072:x1848998399726208:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343271.953579:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343271.953603:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a143b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48b78 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.953686:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1442 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343271.953700:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1442 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.953710:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1442 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.953721:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1449 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343271.953727:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1449 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.953732:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1449 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.953832:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a1450 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343271.953842:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a1450 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.953848:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a1450 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343271.953859:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e8:0x0]: returning size 2 00010000:00010000:0.0:1763343271.953953:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1442 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.953960:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1442 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.953965:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1442 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.953970:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1442 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.953975:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff940202040c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.953978:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1442 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.953983:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1442 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.953994:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d816a300) 00010000:00010000:0.0:1763343271.953997:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.954000:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1442 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.954005:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1442 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.954016:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1449 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.954021:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1449 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.954046:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1449 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.954051:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff940202040400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343271.954054:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1449 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.954059:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1449 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.954065:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d816a100) 00010000:00010000:0.0:1763343271.954067:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343271.954069:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1449 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.954074:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1449 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343271.954118:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a143b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b78 expref: 278 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.954215:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a1450 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b78 expref: 277 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.954222:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e8:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:0.0:1763343271.954224:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343271.954227:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8692c00, rc 0) 00000100:00100000:0.0:1763343271.954290:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+277:57072:x1848998399726208:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 738us (868us total) trans 4294973314 rc 0/0 00000100:00100000:0.0:1763343271.954297:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10316 00000100:00100000:1.0:1763343271.961595:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399726336 00000100:00100000:1.0:1763343271.961605:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399726336 00000100:00100000:1.0:1763343271.961666:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6969 00000100:00100000:1.0:1763343271.961678:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:55884:x1848998399726336:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343271.961700:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343271.961726:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a145e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48b86 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343271.961755:0:8414:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x299:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343271.961779:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343271.961781:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343271.961792:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a145e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b86 expref: 20 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.961810:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a145e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b86 expref: 20 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343271.961823:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089200, rc 0) 00000100:00100000:1.0:1763343271.961899:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:55884:x1848998399726336:12345-192.168.201.40@tcp:101:bash.0 Request processed in 222us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343271.961906:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6969 00000100:00100000:0.0:1763343271.965660:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399726592 00000100:00100000:0.0:1763343271.965673:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399726592 00000100:00100000:0.0:1763343271.965739:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3632 00000100:00100000:0.0:1763343271.965750:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+277:57072:x1848998399726592:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343271.965979:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:57072:x1848998399726592:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 230us (392us total) trans 4294973315 rc 0/0 00000100:00100000:0.0:1763343271.965987:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3632 00000100:00100000:0.0:1763343271.969354:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399726848 00000100:00100000:0.0:1763343271.969366:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399726848 00002000:00010000:0.0:1763343271.969411:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/665 (0->18446744073709551615) 00002000:00100000:0.0:1763343271.969416:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b2aa00 with x1848998399726848 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343271.969429:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5b2aa00. 00000100:00100000:1.0:1763343271.970846:0:28389:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399726720 00000100:00100000:1.0:1763343271.970859:0:28389:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399726720 00002000:00010000:1.0:1763343271.970896:0:28389:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/664 (0->18446744073709551615) 00002000:00100000:1.0:1763343271.970902:0:28389:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b9dc00 with x1848998399726720 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343271.970912:0:28389:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5b9dc00. 00000100:00100000:1.0:1763343271.970943:0:28389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1671 00000100:00100000:1.0:1763343271.970953:0:28389:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2409:x1848998399726848:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:1.0:1763343271.971194:0:28389:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x299:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343271.971198:0:28389:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x299:0x0] updating lvb mtime from disk: 0 -> 1763343271 00002000:00010000:1.0:1763343271.971200:0:28389:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x299:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343271.971202:0:28389:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x299:0x0] updating lvb ctime from disk: 0 -> 1763343271 00002000:00010000:1.0:1763343271.971204:0:28389:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x299:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343271.971273:0:28389:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2409:x1848998399726848:12345-192.168.201.40@tcp:10:bash.0 Request processed in 321us (3067us total) trans 17179871807 rc 0/0 00000100:00100000:1.0:1763343271.971282:0:28389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1671 00002000:00010000:1.0:1763343271.971286:0:28389:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/665 (0->18446744073709551615) 00002000:00100000:1.0:1763343271.971289:0:28389:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b2aa00 with x1848998399726848 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343271.971294:0:28389:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5b2aa00. 00000100:00100000:1.0:1763343271.971325:0:28389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1672 00000100:00100000:1.0:1763343271.971333:0:28389:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+54:2409:x1848998399726720:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:1.0:1763343271.971414:0:28389:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x298:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343271.971417:0:28389:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x298:0x0] updating lvb mtime from disk: 0 -> 1763343271 00002000:00010000:1.0:1763343271.971419:0:28389:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x298:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343271.971421:0:28389:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x298:0x0] updating lvb ctime from disk: 0 -> 1763343271 00002000:00010000:1.0:1763343271.971423:0:28389:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x298:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343271.971445:0:28389:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+55:2409:x1848998399726720:12345-192.168.201.40@tcp:10:bash.0 Request processed in 113us (2131us total) trans 21474839078 rc 0/0 00000100:00100000:1.0:1763343271.971452:0:28389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1672 00002000:00010000:1.0:1763343271.971455:0:28389:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/664 (0->18446744073709551615) 00002000:00100000:1.0:1763343271.971459:0:28389:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b9dc00 with x1848998399726720 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343271.971462:0:28389:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5b9dc00. 00000100:00100000:3.0:1763343271.978557:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.978618:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.978750:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399727104 00000100:00100000:0.0:1763343271.978760:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399727104 00000100:00100000:0.0:1763343271.978818:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10317 00000100:00100000:0.0:1763343271.978827:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:57073:x1848998399727104:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343271.978852:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1763343271.979157:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399727360 00000100:00100000:1.0:1763343271.979163:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399727360 00000100:00100000:1.0:1763343271.979199:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3633 00000100:00100000:1.0:1763343271.979206:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+279:55884:x1848998399727360:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:1.0:1763343271.979540:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:55884:x1848998399727360:12345-192.168.201.40@tcp:35:bash.0 Request processed in 333us (920us total) trans 4294973316 rc 0/0 00000100:00100000:1.0:1763343271.979548:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3633 00010000:00010000:0.0:1763343271.980177:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1465 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1e8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48b8d expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.980273:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a146c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x1e8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343271.980288:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a146c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1e8:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.980299:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a146c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1e8:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:0.0:1763343271.980311:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e8:0x0]: returning size 5 00010000:00010000:0.0:1763343271.980402:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1465 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b8d expref: 282 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.980420:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a146c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1e8:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b8d expref: 281 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.980428:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e8:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:0.0:1763343271.980431:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1763343271.980434:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8693c00, rc 0) 00000100:00100000:0.0:1763343271.980484:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57073:x1848998399727104:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1657us (1939us total) trans 4294973317 rc 0/0 00000100:00100000:0.0:1763343271.980491:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10317 00000100:00100000:3.0:1763343271.986258:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399727616 00000100:00100000:3.0:1763343271.986270:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399727616 00000100:00100000:3.0:1763343271.986339:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3634 00000100:00100000:3.0:1763343271.986349:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57074:x1848998399727616:12345-192.168.201.40@tcp:35:rm.0 00000100:00100000:3.0:1763343271.986642:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57074:x1848998399727616:12345-192.168.201.40@tcp:35:rm.0 Request processed in 293us (729us total) trans 4294973318 rc 0/0 00000100:00100000:3.0:1763343271.986649:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3634 00000100:00100000:1.0:1763343271.986812:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343271.987020:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399727744 00000100:00100000:3.0:1763343271.987088:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399727744 00000100:00100000:1.0:1763343271.991636:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343271.991692:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399728000 00000100:00100000:0.0:1763343271.991702:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399728000 00000100:00100000:0.0:1763343271.991758:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10319 00000100:00100000:0.0:1763343271.991768:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57074:x1848998399728000:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:0.0:1763343271.991826:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1763343271.991852:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a146c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e8:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b8d expref: 283 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.991874:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a1411 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e8:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b71 expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.991886:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a1450 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b78 expref: 281 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.991896:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a13d9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b63 expref: 280 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.991905:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e8:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:0.0:1763343271.991909:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343271.991936:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1488 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343271.991948:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1488 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.991956:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1488 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.991966:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a148f lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343271.991971:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a148f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.991976:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a148f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.992118:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1496 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343271.992128:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1481 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b94 expref: 279 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.992135:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1496 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.992166:0:9827:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1481 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b94 expref: 279 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343271.992180:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1481 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b94 expref: 279 pid: 7641 timeout: 1165 lvb_type: 0 00000100:00100000:0.0:1763343271.992192:0:9827:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6e8d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412929792:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343271.992273:0:9827:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc52300 going to sleep for 11 seconds 00000100:00100000:0.0:1763343271.994348:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6e8d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412929792:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343271.994379:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1496 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:1.0:1763343271.996152:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343271.996243:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:1.0:1763343271.996722:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1496 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.996732:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1496 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000040:00080000:1.0:1763343271.997057:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1629, 64 off136008 00000040:00080000:1.0:1763343271.997088:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1637, 64 off136704 00000040:00080000:1.0:1763343271.997100:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1638, 64 off136768 00000040:00080000:1.0:1763343271.997110:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1630, 64 off136072 00010000:00010000:1.0:1763343271.997170:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a149d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1e8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343271.997182:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a149d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.997192:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a149d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.997199:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a149d lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1e8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.997205:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a149d lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1e8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.997210:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a149d lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1e8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.997234:0:9827:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343271.997254:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1496 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.997257:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343271.997261:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1496 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.997265:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a149d lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1e8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.997280:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1496 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.997465:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343271.997470:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a149d lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1e8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.997480:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a149d lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1e8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.997491:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e8:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:0.0:1763343271.997495:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343271.997499:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a149d lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1e8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.997504:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a149d lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1e8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343271.997516:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343271.997518:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343271.997520:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343271.997984:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399728256 00000100:00100000:3.0:1763343271.997993:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399728256 00010000:00010000:1.0:1763343271.998481:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff940202040400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.998485:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1496 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.998492:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1496 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.998504:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e8:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:1.0:1763343271.998507:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343271.998510:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1496 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.998515:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1496 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.998678:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1488 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.998686:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1488 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.998691:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1488 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.998696:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1488 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.998701:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8693e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343271.998704:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1488 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.998822:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1488 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.998836:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d816a300) 00010000:00010000:1.0:1763343271.998839:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343271.998844:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1488 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.998850:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1488 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000004:00010000:1.0:1763343271.998866:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006e6112e0 reply state 000000002e7ce808 transno 4294973319 ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a148f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.998877:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a148f lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343271.998883:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d816a100) 00010000:00010000:1.0:1763343271.998886:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343271.998889:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343271.999016:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57074:x1848998399728000:12345-192.168.201.40@tcp:36:rm.0 Request processed in 7249us (7387us total) trans 4294973319 rc 0/0 00000100:00100000:1.0:1763343271.999117:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10319 00000100:00100000:0.0:1763343272.005585:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399728384 00000100:00100000:0.0:1763343272.005596:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399728384 00000100:00100000:0.0:1763343272.005755:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3635 00000100:00100000:0.0:1763343272.005767:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57073:x1848998399728384:12345-192.168.201.40@tcp:49:lfs.0 00000100:00100000:0.0:1763343272.007665:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57073:x1848998399728384:12345-192.168.201.40@tcp:49:lfs.0 Request processed in 1887us (2178us total) trans 0 rc -2/-2 00000100:00100000:0.0:1763343272.007679:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3635 00000100:00100000:0.0:1763343272.011723:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399728512 00000100:00100000:0.0:1763343272.011734:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399728512 00000100:00100000:0.0:1763343272.011790:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3636 00000100:00100000:0.0:1763343272.011800:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8445050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57073:x1848998399728512:12345-192.168.201.40@tcp:49:lfs.0 00000100:00100000:0.0:1763343272.011962:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8445050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57073:x1848998399728512:12345-192.168.201.40@tcp:49:lfs.0 Request processed in 163us (334us total) trans 0 rc -2/-2 00000100:00100000:0.0:1763343272.011971:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3636 00000100:00100000:1.0:1763343272.016846:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.017154:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399728640 00000100:00100000:3.0:1763343272.017164:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399728640 00000100:00100000:3.0:1763343272.017837:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3637 00000100:00100000:3.0:1763343272.017851:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57073:x1848998399728640:12345-192.168.201.40@tcp:49:lfs.0 00000100:00100000:3.0:1763343272.019330:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57073:x1848998399728640:12345-192.168.201.40@tcp:49:lfs.0 Request processed in 1463us (2475us total) trans 0 rc -2/-2 00000100:00100000:1.0:1763343272.019491:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.019709:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3637 00000100:00100000:0.0:1763343272.024607:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399729024 00000100:00100000:0.0:1763343272.024618:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399729024 00000100:00100000:0.0:1763343272.024676:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10322 00000100:00100000:0.0:1763343272.024683:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57073:x1848998399729024:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343272.024701:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.024723:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a14c0 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48ba9 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.024797:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a14c7 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343272.024808:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a14c7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.024816:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a14c7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.024823:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a14ce lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343272.024828:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a14ce lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.024831:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a14ce lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.024862:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a14c7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.024866:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a14c7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.024870:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a14c7 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.024874:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a14c7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.024879:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff940202040400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343272.024882:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a14c7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.024891:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a14c7 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.024899:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d816a700) 00010000:00010000:0.0:1763343272.024901:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343272.024904:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a14c7 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.024908:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a14c7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.024918:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a14ce lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.024921:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a14ce lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.024923:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a14ce lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.024927:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400cbad3c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343272.024928:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a14ce lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.024931:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a14ce lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.024935:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d816a100) 00010000:00010000:0.0:1763343272.024936:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343272.024938:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a14ce lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.024941:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a14ce lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.024960:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a14c0 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ba9 expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.024967:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d816a700) 00010000:00010000:0.0:1763343272.024968:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343272.024970:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a14c0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ba9 expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.024988:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940202040c00, rc 0) 00000100:00100000:0.0:1763343272.025060:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57073:x1848998399729024:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 377us (638us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343272.025065:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10322 00000100:00100000:3.0:1763343272.029133:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.029195:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399729152 00000100:00100000:1.0:1763343272.029206:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399729152 00000100:00100000:1.0:1763343272.029279:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10323 00000100:00100000:1.0:1763343272.029290:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57075:x1848998399729152:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.029329:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.029371:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a14d5 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48bb0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.029444:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a14dc lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343272.029457:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a14dc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.029468:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a14dc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.029479:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a14e3 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343272.029486:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a14e3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.029492:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a14e3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.029538:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a14dc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.029553:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a14dc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.029559:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a14dc lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.029565:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a14dc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.029572:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5088a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.029576:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a14dc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.029583:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a14dc lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.029597:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:1.0:1763343272.029600:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.029606:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a14dc lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.029613:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a14dc lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.029627:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a14e3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.029632:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a14e3 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.029637:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a14e3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.029641:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.029644:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a14e3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.029649:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a14e3 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.029656:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d816a100) 00010000:00010000:1.0:1763343272.029658:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.029660:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a14e3 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.029665:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a14e3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.029691:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a14d5 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48bb0 expref: 282 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.029700:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:1.0:1763343272.029702:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.029706:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a14d5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48bb0 expref: 282 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.029718:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5088800, rc 0) 00000100:00100000:1.0:1763343272.029785:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57075:x1848998399729152:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 497us (662us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343272.029792:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10323 00000100:00100000:1.0:1763343272.036560:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399729280 00000100:00100000:1.0:1763343272.036574:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399729280 00000100:00100000:1.0:1763343272.036646:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10324 00000100:00100000:1.0:1763343272.036658:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57075:x1848998399729280:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.036683:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.036712:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a14ea lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48bb7 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.036779:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a14f1 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343272.036792:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a14f1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.036804:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a14f1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343272.036864:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763343272.036868:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763343272.036900:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a14ea lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48bb7 expref: 283 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.036916:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a14f1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48bb7 expref: 282 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.036925:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadbf00) 00010000:00010000:1.0:1763343272.036927:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343272.036931:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089c00, rc 0) 00000100:00100000:1.0:1763343272.037012:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57075:x1848998399729280:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 357us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343272.037019:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10324 00000100:00100000:1.0:1763343272.044243:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399729536 00000100:00100000:1.0:1763343272.044254:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399729536 00000100:00100000:1.0:1763343272.045341:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10325 00000100:00100000:1.0:1763343272.045359:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57076:x1848998399729536:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.045382:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.045413:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a14f8 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48bbe expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.045493:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a14ff lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343272.045508:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a14ff lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.045520:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a14ff lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.045530:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1506 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343272.045537:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1506 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.045543:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1506 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.045581:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a14ff lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.045589:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a14ff lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.045596:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a14ff lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.045603:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a14ff lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.045609:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5088800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.045614:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a14ff lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.045621:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a14ff lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.045634:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadbf00) 00010000:00010000:1.0:1763343272.045637:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.045642:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a14ff lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.045648:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a14ff lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.045661:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1506 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.045667:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1506 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.045673:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1506 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.045677:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.045680:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1506 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.045686:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1506 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.045693:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d816a100) 00010000:00010000:1.0:1763343272.045696:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.045699:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1506 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.045705:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1506 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.045732:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a14f8 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48bbe expref: 283 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.045742:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadbf00) 00010000:00010000:1.0:1763343272.045744:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343272.045747:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a14f8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48bbe expref: 283 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.045759:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089600, rc 0) 00000100:00100000:1.0:1763343272.045849:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57076:x1848998399729536:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 498us (2181us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343272.045857:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10325 00000100:00100000:3.0:1763343272.052638:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.053193:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399729792 00000100:00100000:1.0:1763343272.053203:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399729792 00000100:00100000:1.0:1763343272.053259:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10326 00000100:00100000:1.0:1763343272.053269:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57075:x1848998399729792:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.053289:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.053292:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343272.053330:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a14f1 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48bb7 expref: 282 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.053349:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadbf00) 00010000:00010000:1.0:1763343272.053359:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343272.053375:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a150d lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48bc5 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.053487:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a1514 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343272.053500:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a1514 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.053508:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a1514 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.053521:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a151b lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343272.053529:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a151b lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.053535:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a151b lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.053874:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1522 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343272.053882:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1522 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.053888:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1522 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343272.053897:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e9:0x0]: returning size 0 00010000:00010000:1.0:1763343272.053917:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a1514 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.053923:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a1514 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.053929:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a1514 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.053934:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a1514 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.053939:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5088200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.053943:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a1514 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.053949:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a1514 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.053960:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:1.0:1763343272.053962:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.053965:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a1514 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.053970:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a1514 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000004:00010000:1.0:1763343272.053979:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001599f572 reply state 00000000fc98d860 transno 4294973320 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a151b lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.053988:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a151b lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.053993:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d816a100) 00010000:00010000:1.0:1763343272.053995:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343272.053997:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343272.054018:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a150d lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48bc5 expref: 284 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.054064:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1522 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48bc5 expref: 283 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.054071:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e9:0x0].0x0 (ffff9400ccadb200) 00010000:00010000:1.0:1763343272.054073:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343272.054076:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c89a2000, rc 0) 00000100:00100000:1.0:1763343272.054145:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57075:x1848998399729792:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 876us (1516us total) trans 4294973320 rc 0/0 00000100:00100000:1.0:1763343272.054152:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10326 00000100:00100000:1.0:1763343272.058348:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399730048 00000100:00100000:1.0:1763343272.058361:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399730048 00000100:00100000:1.0:1763343272.058432:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10327 00000100:00100000:1.0:1763343272.058444:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57075:x1848998399730048:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.058470:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.058491:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1530 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48bcc expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.058627:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1537 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343272.058645:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1522 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48bc5 expref: 285 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.058654:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1537 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.058696:0:9827:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1522 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48bc5 expref: 285 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.058711:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1522 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48bc5 expref: 285 pid: 9827 timeout: 1165 lvb_type: 0 00000100:00100000:1.0:1763343272.058725:0:9827:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc70a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412929920:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343272.059675:0:9827:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd0480 going to sleep for 11 seconds 00000100:00100000:3.0:1763343272.068199:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.068229:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399730176 00000100:00100000:3.0:1763343272.068238:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399730176 00010000:00010000:3.0:1763343272.068279:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1522 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48bc5 expref: 286 pid: 9827 timeout: 1165 lvb_type: 0 00000100:00100000:0.0:1763343272.069827:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399730432 00000100:00100000:0.0:1763343272.069834:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399730432 00000100:00100000:0.0:1763343272.069877:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10328 00000100:00100000:0.0:1763343272.069885:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57077:x1848998399730432:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343272.069901:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.069919:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a153e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48bd3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.069987:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1545 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343272.069997:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1545 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.070007:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1545 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.070017:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a154c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343272.070039:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a154c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.070046:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a154c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.070284:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1522 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48bc5 expref: 287 pid: 9827 timeout: 1165 lvb_type: 0 00000100:00100000:1.0:1763343272.070300:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc70a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412929920:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343272.070330:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1537 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.070338:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1537 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.070343:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1537 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343272.070358:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e9:0x0]: returning size 0 00000004:00080000:1.0:1763343272.070514:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x29b:0x0], index 1: 0 00000004:00080000:1.0:1763343272.070519:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x29a:0x0], index 0: 0 00000004:00080000:1.0:1763343272.070523:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x29b:0x0], index 0: 0 00000004:00080000:1.0:1763343272.070526:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x29c:0x0], index 1: 0 00010000:00010000:0.0:1763343272.071212:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1553 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343272.071224:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1553 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.071232:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1553 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.071278:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1553 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.071284:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1553 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.071290:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1553 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.071295:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8693e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343272.071299:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1553 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.071309:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1553 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.071330:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e9:0x0].0x0 (ffff9400ccadb200) 00010000:00010000:0.0:1763343272.071332:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763343272.071336:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1553 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.071342:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1553 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.071356:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1545 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.071360:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1545 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.071365:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1545 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.071371:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1545 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.071375:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff940202040c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343272.071377:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1545 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.071382:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1545 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.071387:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d816a700) 00010000:00010000:0.0:1763343272.071389:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343272.071391:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1545 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.071396:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1545 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.071404:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a154c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.071408:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a154c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.071413:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a154c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.071418:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff940202040400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343272.071420:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a154c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.071425:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a154c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.071430:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d816a100) 00010000:00010000:0.0:1763343272.071432:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343272.071434:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a154c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.071438:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a154c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.071469:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a153e lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48bd3 expref: 288 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.071477:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d816a700) 00010000:00010000:0.0:1763343272.071479:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343272.071483:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a153e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48bd3 expref: 288 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.071494:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400cbad3c00, rc 0) 00000100:00100000:0.0:1763343272.071538:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57077:x1848998399730432:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1654us (3826us total) trans 4294973322 rc 301/301 00000100:00100000:0.0:1763343272.071547:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10328 00010000:00010000:1.0:1763343272.072433:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1537 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.072447:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1537 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.072452:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1537 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.072457:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.072461:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1537 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.072467:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1537 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.072480:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e9:0x0].0x0 (ffff9400ccadb200) 00010000:00010000:1.0:1763343272.072482:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343272.072486:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1537 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.072495:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1537 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.072534:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1530 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48bcc expref: 286 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.072543:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e9:0x0].0x0 (ffff9400ccadb200) 00010000:00010000:1.0:1763343272.072545:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343272.072549:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1530 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48bcc expref: 286 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.072560:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c89a2e00, rc 0) 00000100:00100000:1.0:1763343272.072593:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57075:x1848998399730048:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 14152us (15324us total) trans 4294973321 rc 301/301 00000100:00100000:1.0:1763343272.072600:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10327 00000100:00100000:1.0:1763343272.076193:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399730560 00000100:00100000:1.0:1763343272.076208:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399730560 00000100:00100000:1.0:1763343272.076298:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10329 00000100:00100000:1.0:1763343272.076308:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57077:x1848998399730560:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.076338:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.076363:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1568 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48bda expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.076460:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a156f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343272.076474:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a156f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.076490:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a156f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343272.076520:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343272.076541:0:9827:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a156f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.076566:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1568 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48bda expref: 287 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.076584:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a156f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48bda expref: 286 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.076593:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e9:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:1.0:1763343272.076596:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343272.076599:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5088200, rc 0) 00000100:00100000:1.0:1763343272.076673:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57077:x1848998399730560:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 366us (2032us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343272.076680:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10329 00000100:00100000:3.0:1763343272.081668:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399730816 00000100:00100000:3.0:1763343272.081679:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399730816 00000100:00100000:0.0:1763343272.084400:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399730944 00000100:00100000:0.0:1763343272.084411:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399730944 00000100:00100000:1.0:1763343272.084479:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399731072 00000100:00100000:1.0:1763343272.084486:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399731072 00000100:00100000:1.0:1763343272.084551:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6970 00000100:00100000:0.0:1763343272.084562:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6971 00000100:00100000:0.0:1763343272.084574:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+55:2407:x1848998399730944:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:1.0:1763343272.084576:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399731072:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.084597:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.084597:0:8413:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.084625:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a157d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48be8 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.084625:0:8413:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a1576 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48be1 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343272.084663:0:8413:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x29b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1763343272.084664:0:8414:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x29c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343272.084688:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.084688:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343272.084693:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.084693:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.084705:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a1576 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48be1 expref: 56 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343272.084706:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a157d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48be8 expref: 22 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343272.084741:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a157d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48be8 expref: 22 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343272.084741:0:8413:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a1576 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48be1 expref: 56 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343272.084769:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089600, rc 0) 00010000:00010000:0.0:1763343272.084770:0:8413:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8693e00, rc 0) 00000100:00100000:1.0:1763343272.084827:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2408:x1848998399731072:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 266us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343272.084834:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6970 00000100:00100000:3.0:1763343272.084951:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399731328 00000100:00100000:3.0:1763343272.084956:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399731328 00000100:00100000:3.0:1763343272.084998:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3639 00000100:00100000:3.0:1763343272.085006:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57075:x1848998399731328:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343272.085419:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+56:2407:x1848998399730944:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 845us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.085427:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6971 00000100:00100000:3.0:1763343272.091672:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.091761:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.091904:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399731840 00000100:00100000:1.0:1763343272.091917:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399731840 00000100:00100000:1.0:1763343272.091987:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10330 00000100:00100000:0.0:1763343272.091993:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399731584 00000100:00100000:1.0:1763343272.091999:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:55884:x1848998399731840:12345-192.168.201.40@tcp:101:bash.0 00000100:00100000:0.0:1763343272.092000:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399731584 00010000:00010000:1.0:1763343272.092060:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1763343272.092065:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3640 00000100:00100000:0.0:1763343272.092073:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57077:x1848998399731584:12345-192.168.201.40@tcp:35:lfs.0 00010000:00010000:1.0:1763343272.092086:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1584 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48bef expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.092205:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a158b lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.092219:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a158b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.092232:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a158b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.092243:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1592 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.092251:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1592 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.092257:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1592 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:0.0:1763343272.092265:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57077:x1848998399731584:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 192us (604us total) trans 4294973325 rc 0/0 00000100:00100000:0.0:1763343272.092284:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3640 00010000:00010000:1.0:1763343272.092299:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1599 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.092308:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1599 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.092326:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1599 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343272.092337:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e9:0x0]: returning size 0 00010000:00010000:1.0:1763343272.092389:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a158b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.092396:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a158b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.092401:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a158b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.092408:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a158b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.092413:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.092418:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a158b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.092424:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a158b lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.092441:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb700) 00010000:00010000:1.0:1763343272.092445:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.092450:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a158b lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.092456:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a158b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.092469:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1592 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.092474:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1592 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.092480:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1592 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.092486:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.092488:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1592 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.092493:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1592 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.092510:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d816a100) 00010000:00010000:1.0:1763343272.092513:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.092515:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1592 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.092520:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1592 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.092549:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1584 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48bef expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.092567:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1599 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48bef expref: 291 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.092573:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e9:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:1.0:1763343272.092575:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343272.092578:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5088800, rc 0) 00000100:00100000:1.0:1763343272.092616:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:55884:x1848998399731840:12345-192.168.201.40@tcp:101:bash.0 Request processed in 619us (854us total) trans 4294973326 rc 0/0 00000100:00100000:1.0:1763343272.092622:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10330 00000100:00100000:3.0:1763343272.098625:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.098663:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.098693:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.098721:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399732096 00000100:00100000:3.0:1763343272.098731:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399732096 00000100:00100000:3.0:1763343272.098791:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 448 00000100:00100000:3.0:1763343272.098801:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:2410:x1848998399732096:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343272.098823:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343272.098849:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1599 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48bef expref: 291 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.098867:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e9:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:3.0:1763343272.098873:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343272.098921:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:2410:x1848998399732096:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 122us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343272.098929:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 448 00000100:00100000:3.0:1763343272.103446:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.103495:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.103534:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399732480 00000100:00100000:1.0:1763343272.103545:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399732480 00000100:00100000:0.0:1763343272.103562:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399732736 00000100:00100000:0.0:1763343272.103569:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399732736 00000100:00100000:1.0:1763343272.103607:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3641 00000100:00100000:1.0:1763343272.103620:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8445450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57077:x1848998399732480:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:0.0:1763343272.103623:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10333 00000100:00100000:0.0:1763343272.103637:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:55884:x1848998399732736:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:0.0:1763343272.103689:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343272.103721:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a156f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48bda expref: 294 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.103739:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e9:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:0.0:1763343272.103745:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343272.103790:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8445450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57077:x1848998399732480:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 173us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343272.103799:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3641 00010000:00010000:0.0:1763343272.103933:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a15ca lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343272.103949:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a15ca lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.103959:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a15ca lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000001:00080000:0.0:1763343272.104007:0:7641:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973328 00000004:00010000:0.0:1763343272.104076:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000045fd45bf reply state 00000000d194243c transno 4294973329 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a15ca lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.104095:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a15ca lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.104102:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e9:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:0.0:1763343272.104105:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343272.104107:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343272.104175:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:55884:x1848998399732736:12345-192.168.201.40@tcp:36:bash.0 Request processed in 540us (678us total) trans 4294973329 rc 0/0 00000100:00100000:0.0:1763343272.104181:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10333 00000020:00080000:0.0:1763343272.104185:0:7641:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343272.114072:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.114159:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399732992 00000100:00100000:1.0:1763343272.114173:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399732992 00000100:00100000:0.0:1763343272.114194:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399733248 00000100:00100000:0.0:1763343272.114201:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399733248 00000100:00100000:1.0:1763343272.114252:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3642 00000100:00100000:0.0:1763343272.114253:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10334 00000100:00100000:0.0:1763343272.114276:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57078:x1848998399733248:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:1.0:1763343272.114277:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:55884:x1848998399732992:12345-192.168.201.40@tcp:35:bash.0 00010000:00010000:0.0:1763343272.114413:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.114447:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a15d1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48c04 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.114534:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a15d8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343272.114550:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a15d8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.114564:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a15d8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.114575:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a15df lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343272.114582:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a15df lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.114594:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a15df lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:1.0:1763343272.114630:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:55884:x1848998399732992:12345-192.168.201.40@tcp:35:bash.0 Request processed in 362us (566us total) trans 4294973330 rc 0/0 00000100:00100000:1.0:1763343272.114639:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3642 00010000:00010000:0.0:1763343272.114679:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a15e6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343272.114688:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a15e6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.114696:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a15e6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:0.0:1763343272.114706:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e9:0x0]: returning size 0 00010000:00010000:0.0:1763343272.114755:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a15d8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.114762:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a15d8 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.114769:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a15d8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.114774:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400cbad3c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343272.114779:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a15d8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.114786:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a15d8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.114795:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d816a600) 00010000:00010000:0.0:1763343272.114798:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343272.114802:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a15d8 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.114812:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a15d8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.114822:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a15df lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.114827:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a15df lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.114832:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a15df lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.114837:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff940202040400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343272.114839:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a15df lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.114843:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a15df lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.114848:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d816a100) 00010000:00010000:0.0:1763343272.114850:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343272.114853:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a15df lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.114857:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a15df lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.114883:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a15d1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c04 expref: 299 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.114898:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a15e6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c04 expref: 298 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.114909:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e9:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:0.0:1763343272.114911:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343272.114913:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940202040c00, rc 0) 00000100:00100000:0.0:1763343272.114957:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57078:x1848998399733248:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 692us (860us total) trans 4294973331 rc 0/0 00000100:00100000:0.0:1763343272.114963:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10334 00000100:00100000:0.0:1763343272.116659:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399733504 00000100:00100000:0.0:1763343272.116670:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399733504 00000100:00100000:0.0:1763343272.116735:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10335 00000100:00100000:0.0:1763343272.116745:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:55884:x1848998399733504:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343272.116771:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.116774:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343272.116799:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a15ae lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48bfd expref: 298 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.116815:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e9:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:0.0:1763343272.116820:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343272.116839:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a15f4 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48c0b expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.116880:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a15fb lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343272.116892:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a15e6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c04 expref: 298 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.116901:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a15fb lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.116931:0:33856:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a15e6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c04 expref: 298 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.116944:0:33856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a15e6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c04 expref: 298 pid: 33856 timeout: 1165 lvb_type: 0 00000100:00100000:0.0:1763343272.116958:0:33856:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6e8d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412930048:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343272.117069:0:33856:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc52d80 going to sleep for 11 seconds 00000100:00100000:3.0:1763343272.117592:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.117664:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399733760 00000100:00100000:1.0:1763343272.117672:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399733760 00000100:00100000:1.0:1763343272.117727:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3643 00000100:00100000:1.0:1763343272.117740:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57078:x1848998399733760:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343272.117942:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57078:x1848998399733760:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 206us (352us total) trans 4294973332 rc 0/0 00000100:00100000:1.0:1763343272.117951:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3643 00000100:00100000:0.0:1763343272.118878:0:33856:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6e8d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412930048:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343272.118902:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a15fb lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:3.0:1763343272.123455:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.123523:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399734016 00000100:00100000:1.0:1763343272.123534:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399734016 00000100:00100000:0.0:1763343272.123546:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399734144 00000100:00100000:0.0:1763343272.123553:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399734144 00010000:00010000:0.0:1763343272.123584:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a15e6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c04 expref: 301 pid: 33856 timeout: 1165 lvb_type: 0 00000100:00100000:1.0:1763343272.123602:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10336 00000100:00100000:1.0:1763343272.123615:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57078:x1848998399734016:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:0.0:1763343272.123623:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3348 00000100:00100000:0.0:1763343272.123633:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:2408:x1848998399734144:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343272.123641:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.123652:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343272.123659:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a15e6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c04 expref: 301 pid: 33856 timeout: 1165 lvb_type: 0 00010000:00010000:1.0:1763343272.123669:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1602 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48c12 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.123675:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a15e6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c04 expref: 301 pid: 33856 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343272.123707:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a15e6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c04 expref: 302 pid: 33856 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343272.123728:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e9:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:0.0:1763343272.123733:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a15fb lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.123743:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a15fb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.123751:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a15fb lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.123788:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343272.123789:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1609 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.123801:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1609 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1e9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.123811:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1609 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1e9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343272.123823:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e9:0x0]: returning size 0 00000100:00100000:0.0:1763343272.123845:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:2408:x1848998399734144:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 212us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.123853:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3348 00010000:00010000:1.0:1763343272.123977:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1602 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c12 expref: 302 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.123995:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1609 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1e9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c12 expref: 301 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.124014:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e9:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:1.0:1763343272.124019:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1763343272.124045:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089000, rc 0) 00000100:00100000:1.0:1763343272.124083:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57078:x1848998399734016:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 471us (645us total) trans 4294973333 rc 0/0 00000100:00100000:1.0:1763343272.124091:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10336 00000001:00080000:0.0:1763343272.127079:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973334 is committed 00000004:00080000:0.0:1763343272.127094:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1052 committed 00000004:00080000:0.0:1763343272.127105:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1044 committed 00000004:00080000:0.0:1763343272.127114:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1043 committed 00000004:00080000:0.0:1763343272.127118:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1051 committed 00000100:00100000:3.0:1763343272.127321:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412930304:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343272.127382:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343272.127422:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343272.127428:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412930176:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343272.127449:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343272.127480:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412930432:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1763343272.127488:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a148f lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.127501:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a148f lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00000100:00100000:3.0:1763343272.127507:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343272.127516:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a148f lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.127522:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff940202041000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.127527:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a148f lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.127536:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a148f lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00000100:00100000:3.0:1763343272.127542:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343272.127550:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412930560:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1763343272.127553:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d816a100) 00010000:00010000:1.0:1763343272.127557:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.127563:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a148f lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.127569:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a148f lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000100:00100000:3.0:1763343272.127578:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343272.127602:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a151b lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00000100:00100000:3.0:1763343272.127613:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412930304 00010000:00010000:1.0:1763343272.127614:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a151b lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00000100:00100000:3.0:1763343272.127623:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412930304 00010000:00010000:1.0:1763343272.127623:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a151b lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.127631:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a3000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.127634:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a151b lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.127640:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a151b lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.127650:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d816a100) 00010000:00010000:1.0:1763343272.127653:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.127656:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a151b lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343272.127662:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a151b lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000100:00100000:3.0:1763343272.127665:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412930176 00000100:00100000:3.0:1763343272.127670:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412930176 00010000:00010000:1.0:1763343272.127685:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a15ca lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1e9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343272.127691:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412930432 00010000:00010000:1.0:1763343272.127693:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a15ca lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1e9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343272.127695:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412930432 00010000:00010000:1.0:1763343272.127703:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a15ca lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1e9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.127713:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8692c00 already unused, calling callback (ffffffffc18dd550) 00000100:00100000:3.0:1763343272.127715:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412930560 00010000:00010000:1.0:1763343272.127717:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a15ca lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1e9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343272.127719:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412930560 00010000:00010000:1.0:1763343272.127727:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a15ca lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1e9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.127735:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e9:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:1.0:1763343272.127738:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.127741:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a15ca lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1e9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343272.127746:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6972 00010000:00010000:1.0:1763343272.127751:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a15ca lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1e9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343272.127759:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+33:3662:x1848998412930304:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763343272.127789:0:28561:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:666 count 1 00010000:00010000:3.0:1763343272.127814:0:28561:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1617 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x29a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.127834:0:28561:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba770a13a8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b47 expref: 21 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343272.127844:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1763343272.127846:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412930688:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1763343272.127848:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.127853:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1617 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.127883:0:28561:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba770a13a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b47 expref: 21 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343272.127897:0:28561:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba770a13a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b47 expref: 21 pid: 8412 timeout: 1165 lvb_type: 1 00000100:00100000:3.0:1763343272.127908:0:28561:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5956680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998412931200:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343272.127962:0:28561:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc440180 going to sleep for 11 seconds 00000100:00100000:3.0:1763343272.127979:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6973 00000100:00100000:3.0:1763343272.127986:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+33:3662:x1848998412930176:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763343272.128000:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:665 count 1 00010000:00010000:3.0:1763343272.128011:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401d121e800/0x9104b1ba770a161e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.128053:0:8413:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a145e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b86 expref: 21 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.128061:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343272.128063:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343272.128066:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121e800/0x9104b1ba770a161e lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343272.128067:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343272.128089:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1763343272.128093:0:8413:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a145e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b86 expref: 21 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343272.128096:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412930816:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1763343272.128110:0:8413:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a145e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b86 expref: 21 pid: 8414 timeout: 1165 lvb_type: 0 00000100:00100000:1.0:1763343272.128119:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343272.128125:0:8413:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8413:1848998412931328:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343272.128138:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412930688 00000100:00100000:1.0:1763343272.128142:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412930688 00000100:00100000:3.0:1763343272.128157:0:8413:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc440a80 going to sleep for 11 seconds 00000100:00100000:1.0:1763343272.128158:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412930816 00000100:00100000:1.0:1763343272.128162:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412930816 00000100:00100000:1.0:1763343272.128171:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6974 00000100:00100000:1.0:1763343272.128176:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401ede6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+33:3659:x1848998412930432:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343272.128183:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6975 00000100:00100000:3.0:1763343272.128193:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+33:3659:x1848998412930560:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343272.128295:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401ede6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+35:3659:x1848998412930432:12345-0@lo:2:osp-syn-1-1.0 Request processed in 119us (792us total) trans 17179871808 rc 0/0 00000100:00100000:1.0:1763343272.128302:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6974 00000100:00100000:1.0:1763343272.128332:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6976 00000100:00100000:1.0:1763343272.128339:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+120:3661:x1848998412930688:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763343272.128351:0:11289:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:664 count 1 00010000:00010000:1.0:1763343272.128368:0:11289:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a1625 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x298:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.128395:0:11289:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a1434 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x298:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b7f expref: 55 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.128406:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343272.128408:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343272.128411:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a1625 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x298:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.128438:0:11289:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a1434 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x298:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b7f expref: 55 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.128453:0:11289:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a1434 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x298:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b7f expref: 55 pid: 35281 timeout: 1165 lvb_type: 0 00000100:00100000:1.0:1763343272.128464:0:11289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c517b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11289:1848998412931456:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343272.128491:0:11289:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd0540 going to sleep for 11 seconds 00000100:00100000:1.0:1763343272.128588:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6977 00000100:00100000:1.0:1763343272.128598:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+120:3661:x1848998412930816:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763343272.128613:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:665 count 1 00010000:00010000:1.0:1763343272.128626:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5088200/0x9104b1ba770a1633 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x299:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.128643:0:35266:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a13af lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b4e expref: 55 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343272.128650:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343272.128652:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343272.128654:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5088200/0x9104b1ba770a1633 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.128677:0:35266:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a13af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b4e expref: 55 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343272.128691:0:35266:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a13af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b4e expref: 55 pid: 8412 timeout: 1165 lvb_type: 1 00000100:00100000:1.0:1763343272.128713:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c517a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35266:1848998412931584:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343272.128749:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343272.128766:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412931072:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343272.128796:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343272.128822:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412931072 00000100:00100000:0.0:1763343272.128828:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412931072 00000100:00100000:1.0:1763343272.128839:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763343272.128848:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412930944:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343272.128854:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6978 00000100:00100000:0.0:1763343272.128864:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+121:3660:x1848998412931072:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343272.128883:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1763343272.128928:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5954a80/2, rc 0, transno 17179871808 00000100:00100000:1.0:1763343272.128935:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412930432:0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1763343272.129249:0:8414:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x29b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343272.129255:0:8414:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x29b:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343272.129260:0:8414:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x29b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343272.129265:0:8414:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x29b:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343272.129279:0:8414:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x29b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343272.129341:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+124:3660:x1848998412931072:12345-0@lo:2:osp-syn-0-1.0 Request processed in 479us (545us total) trans 21474839079 rc 0/0 00000100:00100000:0.0:1763343272.129349:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6978 00000004:00080000:0.0:1763343272.129381:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401efc71180/2, rc 0, transno 21474839080 00000100:00100000:0.0:1763343272.129390:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412930944:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763343272.129402:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5dc8a80/2, rc 0, transno 21474839079 00000100:00100000:0.0:1763343272.129407:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412931072:0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763343272.129557:0:35281:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x29c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343272.129561:0:35281:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x29c:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343272.129563:0:35281:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x29c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343272.129565:0:35281:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x29c:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343272.129568:0:35281:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x29c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343272.129608:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+34:3659:x1848998412930560:12345-0@lo:2:osp-syn-1-1.0 Request processed in 1416us (2032us total) trans 17179871809 rc 0/0 00000100:00100000:3.0:1763343272.129615:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6975 00000004:00080000:1.0:1763343272.129682:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5956a00/2, rc 0, transno 17179871809 00000100:00100000:1.0:1763343272.129687:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412930560:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343272.135164:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399734656 00000100:00100000:3.0:1763343272.135169:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399734656 00000100:00100000:3.0:1763343272.135199:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399734528 00000100:00100000:3.0:1763343272.135203:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399734528 00000100:00100000:3.0:1763343272.135224:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6980 00000100:00100000:3.0:1763343272.135231:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:55884:x1848998399734656:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343272.135246:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343272.135263:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1641 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48c27 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343272.135284:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x29b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343272.135297:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.135299:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.135305:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1641 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c27 expref: 24 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.135330:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1641 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c27 expref: 24 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.135340:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121fc00, rc 0) 00000100:00100000:3.0:1763343272.135368:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:55884:x1848998399734656:12345-192.168.201.40@tcp:101:bash.0 Request processed in 139us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343272.135374:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6980 00000100:00100000:3.0:1763343272.135387:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6981 00000100:00100000:3.0:1763343272.135394:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2407:x1848998399734528:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343272.135401:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343272.135408:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1648 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x29b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48c20 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343272.135449:0:8412:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8412:1848998412931712:192.168.201.40@tcp:106: 00010000:00010000:1.0:1763343272.135485:0:35266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a13af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b4e expref: 55 pid: 8412 timeout: 1165 lvb_type: 1 00000100:00100000:1.0:1763343272.135502:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c517a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35266:1848998412931584:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343272.135507:0:8412:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc4406c0 going to sleep for 11 seconds 00010000:00010000:1.0:1763343272.135523:0:35266:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5088200/0x9104b1ba770a1633 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.135535:0:35266:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5088200/0x9104b1ba770a1633 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.135542:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5088200/0x9104b1ba770a1633 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.135552:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5088200/0x9104b1ba770a1633 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.135554:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a145e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b86 expref: 24 pid: 8414 timeout: 1165 lvb_type: 0 00010000:00010000:1.0:1763343272.135570:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5088200/0x9104b1ba770a1633 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343272.135575:0:8413:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8413:1848998412931328:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343272.135594:0:35266:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343272.135595:0:8413:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9401d121e800/0x9104b1ba770a161e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.135605:0:8413:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9401d121e800/0x9104b1ba770a161e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.135611:0:8413:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401d121e800/0x9104b1ba770a161e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.135618:0:8413:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401d121e800/0x9104b1ba770a161e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.135625:0:8413:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121e800/0x9104b1ba770a161e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.135643:0:8413:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763343272.135851:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+34:3662:x1848998412930176:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7864us (8400us total) trans 17179871810 rc 0/0 00000100:00100000:1.0:1763343272.135855:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+123:3661:x1848998412930816:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7256us (7734us total) trans 21474839081 rc 0/0 00000100:00100000:3.0:1763343272.135860:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6973 00000100:00100000:1.0:1763343272.135876:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6977 00010000:00010000:3.0:1763343272.135881:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763343272.135889:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5088200/0x9104b1ba770a1633 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.135898:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5088200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343272.135902:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5088200/0x9104b1ba770a1633 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.135911:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5088200/0x9104b1ba770a1633 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763343272.135921:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5956d80/2, rc 0, transno 17179871810 00010000:00010000:3.0:1763343272.135927:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5088200/0x9104b1ba770a1633 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343272.135929:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412930176:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763343272.135941:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5088200/0x9104b1ba770a1633 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.135958:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:1.0:1763343272.135960:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401efc72d80/2, rc 0, transno 21474839081 00010000:00010000:3.0:1763343272.135962:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9401d121e800/0x9104b1ba770a161e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343272.135969:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412930816:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1763343272.135972:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121e800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343272.135977:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9401d121e800/0x9104b1ba770a161e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.135988:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9401d121e800/0x9104b1ba770a161e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.135999:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9401d121e800/0x9104b1ba770a161e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.136003:0:11289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a1434 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x298:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b7f expref: 54 pid: 35281 timeout: 1165 lvb_type: 0 00010000:00010000:3.0:1763343272.136010:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401d121e800/0x9104b1ba770a161e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343272.136019:0:11289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c517b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11289:1848998412931456:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343272.136058:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343272.136062:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343272.136064:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343272.136066:0:11289:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a1625 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.136075:0:11289:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a1625 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.136083:0:11289:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a1625 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.136088:0:28561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba770a13a8 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48b47 expref: 23 pid: 8412 timeout: 1165 lvb_type: 1 00010000:00010000:1.0:1763343272.136093:0:11289:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a1625 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343272.136104:0:28561:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5956680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998412931200:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343272.136107:0:11289:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a1625 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.136120:0:28561:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1617 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.136123:0:11289:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343272.136133:0:28561:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1617 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.136139:0:28561:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1617 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.136146:0:28561:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1617 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.136154:0:28561:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1617 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.136167:0:28561:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1763343272.136250:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+123:3661:x1848998412930688:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7910us (8181us total) trans 21474839082 rc 0/0 00000100:00100000:1.0:1763343272.136257:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6976 00000004:00080000:1.0:1763343272.136291:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401efc70a80/2, rc 0, transno 21474839082 00000100:00100000:1.0:1763343272.136296:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412930688:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343272.136309:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+34:3662:x1848998412930304:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8552us (8925us total) trans 17179871811 rc 0/0 00000100:00100000:3.0:1763343272.136329:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6972 00000004:00080000:1.0:1763343272.136332:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5954e00/2, rc 0, transno 17179871811 00000100:00100000:1.0:1763343272.136338:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412930304:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763343272.136449:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763343272.136454:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a1625 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.136461:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343272.136464:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a1625 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.136470:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a1625 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.136480:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a1625 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.136486:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a1625 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.136499:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343272.136503:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1617 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.136508:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121ea00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343272.136511:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1617 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.136517:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1617 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.136526:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1617 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.136532:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1617 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.136543:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343272.136544:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343272.136546:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343272.136622:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343272.136629:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343272.140984:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399735168 00000100:00100000:3.0:1763343272.140994:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399735168 00000100:00100000:3.0:1763343272.141068:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6982 00000100:00100000:3.0:1763343272.141078:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+54:55884:x1848998399735168:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343272.141098:0:28561:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343272.141120:0:28561:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a164f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48c2e expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343272.141144:0:28561:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x29a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343272.141166:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.141169:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.141179:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a164f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c2e expref: 55 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.141194:0:28561:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a164f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c2e expref: 55 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.141205:0:28561:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3b4ba00, rc 0) 00000100:00100000:3.0:1763343272.141265:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+55:55884:x1848998399735168:12345-192.168.201.40@tcp:101:bash.0 Request processed in 188us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343272.141272:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6982 00002000:00010000:0.0:1763343272.142236:0:8412:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000400:0x29b:0x0] updating lvb mtime: 0 -> 1763343271 00002000:00010000:0.0:1763343272.142242:0:8412:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000400:0x29b:0x0] updating lvb atime: 0 -> 1763343271 00002000:00010000:0.0:1763343272.142244:0:8412:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000400:0x29b:0x0] updating lvb ctime: 0 -> 1763343271 00000100:00100000:0.0:1763343272.142259:0:8412:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8412:1848998412931712:192.168.201.40@tcp:106: 00010000:00010000:0.0:1763343272.142289:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1648 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x29b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c20 expref: 22 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343272.142305:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1648 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x29b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c20 expref: 22 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343272.142327:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121e200, rc 0) 00000100:00100000:0.0:1763343272.142412:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399734528:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 7017us (8146us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343272.142419:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6981 00000100:00100000:3.0:1763343272.145893:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399735296 00000100:00100000:3.0:1763343272.145904:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399735296 00002000:00010000:3.0:1763343272.145948:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/667 (0->18446744073709551615) 00002000:00100000:3.0:1763343272.145953:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5bffb80 with x1848998399735296 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343272.145965:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5bffb80. 00000100:00100000:3.0:1763343272.145993:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399735424 00000100:00100000:3.0:1763343272.145995:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399735424 00002000:00010000:3.0:1763343272.146004:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/666 (0->18446744073709551615) 00002000:00100000:3.0:1763343272.146007:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5bfe300 with x1848998399735424 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343272.146012:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5bfe300. 00000100:00100000:3.0:1763343272.146065:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1673 00000100:00100000:0.0:1763343272.146075:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1674 00000100:00100000:3.0:1763343272.146076:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399735296:12345-192.168.201.40@tcp:10:bash.0 00000100:00100000:0.0:1763343272.146092:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+55:2408:x1848998399735424:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:0.0:1763343272.146269:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x29a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343272.146273:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x29a:0x0] updating lvb mtime from disk: 0 -> 1763343271 00002000:00010000:0.0:1763343272.146276:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x29a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343272.146278:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x29b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343272.146279:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x29a:0x0] updating lvb ctime from disk: 0 -> 1763343271 00002000:00010000:3.0:1763343272.146284:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x29b:0x0] updating lvb mtime from disk: 1763343271 -> 1763343271 00002000:00010000:0.0:1763343272.146286:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x29a:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1763343272.146289:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x29b:0x0] updating lvb atime from disk: 1763343271 -> 0 00002000:00010000:3.0:1763343272.146292:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x29b:0x0] updating lvb ctime from disk: 1763343271 -> 1763343271 00002000:00010000:3.0:1763343272.146295:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x29b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343272.146370:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+56:2408:x1848998399735424:12345-192.168.201.40@tcp:10:bash.0 Request processed in 282us (615us total) trans 21474839083 rc 0/0 00000100:00100000:0.0:1763343272.146378:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1674 00002000:00010000:0.0:1763343272.146382:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/666 (0->18446744073709551615) 00002000:00100000:0.0:1763343272.146386:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5bfe300 with x1848998399735424 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343272.146391:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5bfe300. 00000100:00100000:3.0:1763343272.146463:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399735296:12345-192.168.201.40@tcp:10:bash.0 Request processed in 389us (802us total) trans 17179871812 rc 0/0 00000100:00100000:3.0:1763343272.146471:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1673 00002000:00010000:3.0:1763343272.146475:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/667 (0->18446744073709551615) 00002000:00100000:3.0:1763343272.146478:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5bffb80 with x1848998399735296 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343272.146483:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5bffb80. 00000100:00100000:3.0:1763343272.146508:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399735680 00000100:00100000:3.0:1763343272.146512:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399735680 00000100:00100000:3.0:1763343272.146921:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10338 00000100:00100000:3.0:1763343272.146930:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:57078:x1848998399735680:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343272.146948:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343272.147079:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1656 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48c35 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.147445:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a165d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343272.147460:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a165d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343272.147471:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a165d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:1.0:1763343272.152146:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.152282:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399735936 00000100:00100000:3.0:1763343272.152292:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399735936 00000100:00100000:3.0:1763343272.152370:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3644 00000100:00100000:3.0:1763343272.152381:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:55884:x1848998399735936:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:3.0:1763343272.152672:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:55884:x1848998399735936:12345-192.168.201.40@tcp:35:bash.0 Request processed in 291us (534us total) trans 4294973336 rc 0/0 00000100:00100000:3.0:1763343272.152681:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3644 00000100:00100000:0.0:1763343272.155703:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.155747:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.155904:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399736192 00000100:00100000:3.0:1763343272.155914:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399736192 00000100:00100000:3.0:1763343272.155976:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3645 00000100:00100000:3.0:1763343272.155988:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57078:x1848998399736192:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:1.0:1763343272.156396:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399736064 00000100:00100000:1.0:1763343272.156401:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399736064 00000100:00100000:1.0:1763343272.156438:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 449 00000100:00100000:1.0:1763343272.156445:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:2408:x1848998399736064:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343272.156456:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343272.156479:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a166b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c35 expref: 281 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.156498:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e9:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:1.0:1763343272.156503:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343272.156541:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:2408:x1848998399736064:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 95us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343272.156547:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 449 00000100:00100000:0.0:1763343272.158672:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.161482:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.161558:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399736704 00000100:00100000:1.0:1763343272.161569:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399736704 00000100:00100000:1.0:1763343272.161623:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10339 00000100:00100000:1.0:1763343272.161632:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57079:x1848998399736704:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:1.0:1763343272.161690:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763343272.161717:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a15fb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c0b expref: 280 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.161741:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a163a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c19 expref: 279 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.161759:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a15c3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1e9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48bf6 expref: 278 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.161769:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e9:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:1.0:1763343272.161773:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343272.161804:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1679 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.161817:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1679 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.161826:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1679 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.161836:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1680 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.161841:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1680 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.161846:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1680 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.161916:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1687 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.161924:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1609 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1e9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c12 expref: 277 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.161932:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1687 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.161969:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1609 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1e9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c12 expref: 277 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.161983:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1609 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1e9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c12 expref: 277 pid: 7641 timeout: 1165 lvb_type: 0 00000100:00100000:1.0:1763343272.161997:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c517a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412931840:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343272.163237:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd0780 going to sleep for 11 seconds 00000100:00100000:3.0:1763343272.166371:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399736960 00000100:00100000:3.0:1763343272.166382:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399736960 00000100:00100000:3.0:1763343272.166443:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10340 00000100:00100000:3.0:1763343272.166522:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+279:57078:x1848998399736960:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343272.166547:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343272.166550:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343272.166563:0:6524:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1609 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1e9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c12 expref: 279 pid: 7641 timeout: 1165 lvb_type: 0 00010000:00010000:3.0:1763343272.166591:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e9:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:3.0:1763343272.166596:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1687 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343272.166606:0:6524:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1687 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343272.166612:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1687 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343272.166629:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343272.166642:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a168e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48c3c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.166739:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1695 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343272.166749:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1695 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343272.166756:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1695 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1e9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:3.0:1763343272.166766:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1e9:0x0]: returning size 5 00010000:00010000:3.0:1763343272.166853:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a168e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c3c expref: 282 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.166868:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1695 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1e9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c3c expref: 281 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.166874:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e9:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:3.0:1763343272.166877:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763343272.166879:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121ea00, rc 0) 00000100:00100000:3.0:1763343272.166932:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57078:x1848998399736960:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 482us (868us total) trans 4294973338 rc 0/0 00000100:00100000:3.0:1763343272.166939:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10340 00010000:00010000:1.0:1763343272.167074:0:7641:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.40@tcp) returned -22 from blocking AST (req@00000000e15f40a4 x1848998412931840) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1609 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1e9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c12 expref: 280 pid: 7641 timeout: 1165 lvb_type: 0 00010000:00010000:1.0:1763343272.167090:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1609 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1e9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c12 expref: 280 pid: 7641 timeout: 1165 lvb_type: 0 00000100:00100000:1.0:1763343272.167103:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c517a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412931840:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343272.167121:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e9:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:1.0:1763343272.167127:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1687 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.167136:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1687 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.167141:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1687 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00080000:1.0:1763343272.167370:0:7641:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x1e9:0x0] is inserted into orphan list, open count = 2 00010000:00010000:1.0:1763343272.167438:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1687 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.167447:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1687 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.167454:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1687 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.167460:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.167464:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1687 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.167471:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1687 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.167480:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e9:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:1.0:1763343272.167482:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343272.167486:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1687 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.167492:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1687 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.167505:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1679 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.167511:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1679 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.167516:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1679 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.167521:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1679 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.167533:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5088800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.167536:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1679 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.167542:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1679 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.167549:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb700) 00010000:00010000:1.0:1763343272.167552:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.167554:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1679 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.167560:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1679 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00010000:1.0:1763343272.167573:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a5d33e2b reply state 000000005193a2d4 transno 4294973339 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1680 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.167583:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1680 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.167589:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadb100) 00010000:00010000:1.0:1763343272.167591:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343272.167594:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343272.167646:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57079:x1848998399736704:12345-192.168.201.40@tcp:36:rm.0 Request processed in 6013us (6174us total) trans 4294973339 rc 0/0 00000100:00100000:1.0:1763343272.167652:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10339 00000100:00100000:0.0:1763343272.169976:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.175785:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399737344 00000100:00100000:1.0:1763343272.175800:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399737344 00000100:00100000:1.0:1763343272.175877:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10341 00000100:00100000:1.0:1763343272.175888:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57078:x1848998399737344:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.175924:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.175958:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a16aa lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48c43 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.176084:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a16aa lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c43 expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.176101:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088200/0x9104b1ba770a16aa lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c43 expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.176125:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e9:0x0].0x0 (ffff9400ccadb900) 00010000:00010000:1.0:1763343272.176129:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343272.176132:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5088200, rc 0) 00000100:00100000:1.0:1763343272.176208:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57078:x1848998399737344:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 321us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343272.176216:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10341 00000100:00100000:0.0:1763343272.184578:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.184625:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.184731:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399737728 00000100:00100000:1.0:1763343272.184741:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399737728 00000100:00100000:1.0:1763343272.184805:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10342 00000100:00100000:1.0:1763343272.184817:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57080:x1848998399737728:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.184839:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.184865:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a16b1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48c4a expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.184964:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a16b8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.184980:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a16b8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.184996:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a16b8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.185013:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a16bf lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.185051:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a16bf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.185064:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a16bf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.185112:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a16b8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.185118:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a16b8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.185122:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a16b8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.185127:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a16b8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.185132:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.185136:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a16b8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.185142:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a16b8 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.185156:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb700) 00010000:00010000:1.0:1763343272.185160:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.185165:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a16b8 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.185171:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a16b8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.185182:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a16bf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.185188:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a16bf lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.185194:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a16bf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.185198:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.185200:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a16bf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.185205:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a16bf lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.185211:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadb100) 00010000:00010000:1.0:1763343272.185214:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.185216:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a16bf lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.185221:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a16bf lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.185246:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a16b1 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c4a expref: 284 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.185256:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb700) 00010000:00010000:1.0:1763343272.185259:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.185262:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a16b1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c4a expref: 284 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.185279:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5088800, rc 0) 00000100:00100000:1.0:1763343272.185353:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57080:x1848998399737728:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 538us (727us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343272.185361:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10342 00010000:00010000:3.0:1763343272.185586:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343272.185593:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a16c6 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343272.185600:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5b3d000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343272.185604:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a16c6 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343272.185610:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a16c6 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343272.185623:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1e9:0x0].0x0 (ffff9400ccadb900) 00010000:00010000:3.0:1763343272.185626:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343272.185630:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a16c6 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343272.185635:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a16c6 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343272.185653:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343272.185655:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343272.185658:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343272.188887:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.189761:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399737856 00000100:00100000:3.0:1763343272.189773:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399737856 00000100:00100000:3.0:1763343272.189843:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10343 00000100:00100000:3.0:1763343272.189860:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57080:x1848998399737856:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343272.189882:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343272.189909:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a16cd lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48c51 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.189983:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a16d4 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343272.189997:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a16d4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343272.190008:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a16d4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343272.190019:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a16db lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343272.190040:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a16db lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343272.190047:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a16db lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343272.190090:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a16d4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343272.190098:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a16d4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343272.190105:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a16d4 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343272.190111:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a16d4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343272.190117:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121e200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343272.190122:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a16d4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343272.190129:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a16d4 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343272.190139:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488bc00) 00010000:00010000:3.0:1763343272.190142:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343272.190147:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a16d4 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343272.190152:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a16d4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343272.190164:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a16db lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343272.190170:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a16db lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343272.190176:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a16db lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343272.190181:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343272.190183:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a16db lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343272.190189:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a16db lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343272.190196:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadb100) 00010000:00010000:3.0:1763343272.190198:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343272.190200:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a16db lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343272.190206:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a16db lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343272.190233:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a16cd lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c51 expref: 284 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.190243:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488bc00) 00010000:00010000:3.0:1763343272.190245:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343272.190248:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a16cd lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c51 expref: 284 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.190261:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121e800, rc 0) 00000100:00100000:3.0:1763343272.190644:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57080:x1848998399737856:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 790us (1767us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343272.190651:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10343 00000100:00100000:3.0:1763343272.193114:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.200258:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.206533:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.206642:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399738368 00000100:00100000:3.0:1763343272.206652:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399738368 00000100:00100000:1.0:1763343272.207075:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10346 00000100:00100000:1.0:1763343272.207089:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57080:x1848998399738368:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.207113:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.207116:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343272.207144:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a16e9 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c58 expref: 284 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.207162:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8700) 00010000:00010000:1.0:1763343272.207173:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343272.207189:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1705 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48c66 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.207293:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a170c lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.207307:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a170c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.207327:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a170c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.207337:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1713 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.207349:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1713 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.207361:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1713 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.207764:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a171a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.208110:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a171a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.208122:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a171a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343272.208133:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1eb:0x0]: returning size 0 00010000:00010000:0.0:1763343272.208201:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a170c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.208210:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a170c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.208216:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a170c lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.208222:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a170c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.208229:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343272.208233:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a170c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.208241:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a170c lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.208251:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb700) 00010000:00010000:0.0:1763343272.208254:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343272.208258:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a170c lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.208264:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a170c lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00010000:0.0:1763343272.208275:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005a03882c reply state 0000000073fb0672 transno 4294973342 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1713 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.208288:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1713 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.208294:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadb100) 00010000:00010000:0.0:1763343272.208296:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343272.208299:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343272.208343:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1705 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c66 expref: 286 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.208360:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a171a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c66 expref: 285 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.208367:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400ccadb400) 00010000:00010000:0.0:1763343272.208370:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343272.208372:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089c00, rc 0) 00000100:00100000:0.0:1763343272.208449:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57080:x1848998399738368:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1363us (1925us total) trans 4294973342 rc 0/0 00000100:00100000:0.0:1763343272.208456:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10346 00000100:00100000:3.0:1763343272.216599:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.216646:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399738752 00000100:00100000:0.0:1763343272.216656:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399738752 00000100:00100000:3.0:1763343272.218718:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.218901:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399738880 00000100:00100000:1.0:1763343272.218941:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399738880 00000100:00100000:1.0:1763343272.218995:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10348 00000100:00100000:1.0:1763343272.219001:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57081:x1848998399738880:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.219008:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.219016:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a172f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48c74 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.219119:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1736 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343272.219133:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1736 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.219251:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1736 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:1.0:1763343272.219268:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1eb:0x0]: returning size 0 00010000:00010000:1.0:1763343272.219414:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a172f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c74 expref: 291 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.219433:0:33856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1736 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c74 expref: 290 pid: 33856 timeout: 1165 lvb_type: 0 00010000:00010000:1.0:1763343272.219442:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1736 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c74 expref: 290 pid: 33856 timeout: 1165 lvb_type: 0 00010000:00010000:1.0:1763343272.219460:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400ccadb400) 00010000:00010000:1.0:1763343272.219462:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343272.219466:0:33856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a173d lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.219472:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c89a2000, rc 0) 00000100:00100000:1.0:1763343272.219536:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57081:x1848998399738880:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 534us (827us total) trans 4294973343 rc 0/0 00000100:00100000:1.0:1763343272.219543:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10348 00000100:00100000:3.0:1763343272.224893:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.224935:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.224970:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.225006:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399739008 00000100:00100000:0.0:1763343272.225017:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399739008 00010000:00010000:0.0:1763343272.225080:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a171a lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c66 expref: 290 pid: 7641 timeout: 1165 lvb_type: 0 00000100:00100000:0.0:1763343272.225113:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399739136 00000100:00100000:0.0:1763343272.225116:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399739136 00010000:00010000:0.0:1763343272.225128:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1736 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c74 expref: 291 pid: 33856 timeout: 1165 lvb_type: 0 00000100:00100000:0.0:1763343272.225147:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3353 00000100:00100000:0.0:1763343272.225156:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7e38850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:2408:x1848998399739008:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343272.225172:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343272.225179:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a171a lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c66 expref: 291 pid: 7641 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343272.225192:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a171a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c66 expref: 291 pid: 7641 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343272.225217:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400ccadb400) 00010000:00010000:0.0:1763343272.225222:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a173d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.225235:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343272.225282:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7e38850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:2408:x1848998399739008:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 127us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.225290:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3353 00000100:00100000:0.0:1763343272.225351:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3354 00000100:00100000:0.0:1763343272.225358:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:2407:x1848998399739136:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343272.225365:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343272.225370:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1736 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c74 expref: 290 pid: 33856 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343272.225381:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1736 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c74 expref: 290 pid: 33856 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343272.225394:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400ccadb400) 00010000:00010000:0.0:1763343272.225398:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a173d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.225407:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a173d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.225414:0:7904:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a173d lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.225435:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343272.225453:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:2407:x1848998399739136:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 96us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.225461:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3354 00000100:00100000:3.0:1763343272.226245:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399739392 00000100:00100000:3.0:1763343272.226251:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399739392 00000100:00100000:3.0:1763343272.226318:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3649 00000100:00100000:3.0:1763343272.226333:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57081:x1848998399739392:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343272.226577:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57081:x1848998399739392:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 247us (1605us total) trans 4294973345 rc 0/0 00000100:00100000:3.0:1763343272.226586:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3649 00000100:00100000:0.0:1763343272.229685:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.229780:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.230487:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399739904 00000100:00100000:1.0:1763343272.230493:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399739904 00000100:00100000:1.0:1763343272.230530:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3650 00000100:00100000:1.0:1763343272.230539:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57080:x1848998399739904:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343272.231684:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57080:x1848998399739904:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1145us (1903us total) trans 4294973346 rc 0/0 00000100:00100000:1.0:1763343272.231693:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3650 00000100:00100000:3.0:1763343272.237245:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.238085:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.238123:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399740160 00000100:00100000:1.0:1763343272.238134:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399740160 00000100:00100000:1.0:1763343272.238195:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3651 00000100:00100000:1.0:1763343272.238206:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57080:x1848998399740160:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343272.238363:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399740288 00000100:00100000:0.0:1763343272.238368:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399740288 00000100:00100000:0.0:1763343272.238416:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6983 00000100:00100000:0.0:1763343272.238425:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+56:2407:x1848998399740288:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343272.238437:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.238471:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c4514a00/0x9104b1ba770a1775 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48c82 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343272.238493:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x29c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343272.238520:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.238523:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.238534:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c4514a00/0x9104b1ba770a1775 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c82 expref: 57 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343272.238551:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c4514a00/0x9104b1ba770a1775 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c82 expref: 57 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343272.238563:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4514a00, rc 0) 00000100:00100000:1.0:1763343272.238593:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57080:x1848998399740160:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 388us (1357us total) trans 4294973348 rc 0/0 00000100:00100000:0.0:1763343272.238600:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+57:2407:x1848998399740288:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 174us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343272.238608:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3651 00000100:00100000:0.0:1763343272.238613:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6983 00000100:00100000:0.0:1763343272.241508:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.241624:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399740544 00000100:00100000:1.0:1763343272.241635:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399740544 00000100:00100000:1.0:1763343272.241699:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3652 00000100:00100000:1.0:1763343272.241709:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57081:x1848998399740544:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343272.241939:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57081:x1848998399740544:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 231us (441us total) trans 4294973349 rc 0/0 00000100:00100000:1.0:1763343272.241947:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3652 00000100:00100000:3.0:1763343272.243076:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.246018:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.247654:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399741056 00000100:00100000:1.0:1763343272.247667:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399741056 00000100:00100000:1.0:1763343272.247733:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399741184 00000100:00100000:1.0:1763343272.247737:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399741184 00000100:00100000:1.0:1763343272.247772:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10351 00000100:00100000:1.0:1763343272.247783:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57081:x1848998399741056:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.247810:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.247837:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1791 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48c90 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.247912:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1798 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343272.247924:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1798 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.247935:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1798 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.247944:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a179f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343272.247952:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a179f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.247957:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a179f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.248114:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a17a6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343272.248127:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a17a6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.248134:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a17a6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.248141:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a17a6 lrc: 3/0,0 mode: --/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.248147:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c0030200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.248151:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a17a6 lrc: 3/0,0 mode: --/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.248158:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a17a6 lrc: 4/0,0 mode: --/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.248170:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:1.0:1763343272.248178:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a17a6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.248187:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a17a6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00200000:1.0:1763343272.248803:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1eb:0x0]: returning size 0 00010000:00010000:1.0:1763343272.248898:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1798 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.248906:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1798 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.248912:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1798 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.248916:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a2000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.248920:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1798 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.248926:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1798 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.248936:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadbd00) 00010000:00010000:1.0:1763343272.248938:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.248941:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1798 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.248947:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1798 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.248956:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a179f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.248968:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a179f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.248977:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a179f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.248982:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a3000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.248984:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a179f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.248989:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a179f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.248996:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadb100) 00010000:00010000:1.0:1763343272.248999:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.249001:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a179f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.249006:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a179f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.249150:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1791 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c90 expref: 297 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.249162:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadbd00) 00010000:00010000:1.0:1763343272.249164:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343272.249168:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1791 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c90 expref: 297 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.249182:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c89a2e00, rc 0) 00000100:00100000:1.0:1763343272.249215:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57081:x1848998399741056:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1435us (3759us total) trans 4294973351 rc 301/301 00000100:00100000:1.0:1763343272.249222:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10351 00000100:00100000:3.0:1763343272.256347:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399741440 00000100:00100000:3.0:1763343272.256369:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399741440 00000100:00100000:3.0:1763343272.256438:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3653 00000100:00100000:3.0:1763343272.256449:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8444c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57081:x1848998399741440:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343272.259519:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8444c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57081:x1848998399741440:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 3059us (3844us total) trans 4294973352 rc 0/0 00000100:00100000:3.0:1763343272.259535:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3653 00000100:00100000:3.0:1763343272.263968:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.264118:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399741696 00000100:00100000:0.0:1763343272.264131:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399741696 00000100:00100000:0.0:1763343272.270373:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3654 00000100:00100000:0.0:1763343272.270405:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57081:x1848998399741696:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:0.0:1763343272.270583:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57081:x1848998399741696:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 195us (8233us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.270591:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3654 00000100:00100000:3.0:1763343272.271141:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399741824 00000100:00100000:3.0:1763343272.271152:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399741824 00000100:00100000:3.0:1763343272.271201:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10353 00000100:00100000:3.0:1763343272.271209:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:55884:x1848998399741824:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:3.0:1763343272.271244:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343272.271283:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a1783 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1eb:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c89 expref: 297 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.271303:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:3.0:1763343272.271317:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343272.271485:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a17c2 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343272.271500:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a17c2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343272.271509:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a17c2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000001:00080000:3.0:1763343272.271553:0:6524:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973353 00000004:00010000:3.0:1763343272.271574:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001824f489 reply state 0000000064f11c2f transno 4294973354 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a17c2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343272.271587:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a17c2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343272.271592:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:3.0:1763343272.271595:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343272.271597:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343272.271663:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:55884:x1848998399741824:12345-192.168.201.40@tcp:36:bash.0 Request processed in 454us (719us total) trans 4294973354 rc 0/0 00000100:00100000:3.0:1763343272.271673:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10353 00000020:00080000:3.0:1763343272.271676:0:6524:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343272.278277:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399741952 00000100:00100000:1.0:1763343272.278291:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399741952 00000100:00100000:1.0:1763343272.278373:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10354 00000100:00100000:1.0:1763343272.278383:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:55884:x1848998399741952:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343272.278407:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.278430:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a17c9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48c9e expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.278487:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a17c9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c9e expref: 300 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.278503:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a17c9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c9e expref: 300 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.278521:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:1.0:1763343272.278524:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343272.278528:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c0030200, rc 0) 00000100:00100000:1.0:1763343272.278603:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:55884:x1848998399741952:12345-192.168.201.40@tcp:101:bash.0 Request processed in 221us (1815us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343272.278610:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10354 00000100:00100000:0.0:1763343272.288565:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399742208 00000100:00100000:0.0:1763343272.288576:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399742208 00000100:00100000:0.0:1763343272.288636:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10355 00000100:00100000:0.0:1763343272.288646:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:55884:x1848998399742208:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343272.288666:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.288669:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343272.288702:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a17c9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c9e expref: 300 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.288722:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:0.0:1763343272.288728:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343272.288741:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a17d0 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48ca5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.288788:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a17d7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343272.288800:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a17d7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.288808:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a17d7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000040:00080000:0.0:1763343272.289082:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1635, 88 off136464 00000004:00080000:0.0:1763343272.289090:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1065413065147ns, next at 1065528590468ns, rc = 0 00000040:00080000:0.0:1763343272.289120:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1643, 88 off137160 00000004:00080000:0.0:1763343272.289125:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1065413100040ns, next at 1065526239568ns, rc = 0 00000040:00080000:0.0:1763343272.289143:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1644, 88 off137248 00000004:00080000:0.0:1763343272.289147:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1065413122687ns, next at 1065526239568ns, rc = 0 00000040:00080000:0.0:1763343272.289156:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1636, 88 off136552 00000004:00080000:0.0:1763343272.289160:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1065413135359ns, next at 1065528590468ns, rc = 0 00000001:00080000:0.0:1763343272.291680:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973355 is committed 00000004:00080000:0.0:1763343272.291695:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1046 committed 00010000:00010000:1.0:1763343272.291711:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1680 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00000004:00080000:0.0:1763343272.291715:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1054 committed 00010000:00010000:1.0:1763343272.291724:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1680 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00000004:00080000:0.0:1763343272.291726:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1053 committed 00000004:00080000:0.0:1763343272.291732:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1045 committed 00010000:00010000:1.0:1763343272.291736:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1680 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.291744:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5088a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.291750:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1680 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.291758:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1680 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.291776:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadb100) 00010000:00010000:1.0:1763343272.291779:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.291784:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1680 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.291789:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1680 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.291808:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1713 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.291815:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1713 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.291821:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1713 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.291826:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.291829:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1713 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.291836:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a17d7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ca5 expref: 280 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.291838:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1713 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.291854:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadb100) 00010000:00010000:0.0:1763343272.291858:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:1.0:1763343272.291859:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.291865:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1713 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.291865:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:3.0:1763343272.291867:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412932224:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1763343272.291877:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1713 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.291883:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a17d0 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ca5 expref: 280 pid: 6524 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343272.291895:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a17c2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.291902:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a17c2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.291906:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a17c2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00000100:00100000:3.0:1763343272.291934:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343272.291971:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343272.292111:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412932736:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343272.292140:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343272.292160:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412932352:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343272.292180:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343272.292209:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412932480:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343272.292232:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343272.292248:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412932992:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343272.292266:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343272.292290:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1763343272.292294:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412932608:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343272.292323:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343272.292443:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412933120:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343272.292475:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343272.292502:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412933120 00000100:00100000:3.0:1763343272.292508:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412933120 00000100:00100000:3.0:1763343272.292537:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6985 00000100:00100000:3.0:1763343272.292549:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+126:3662:x1848998412932864:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343272.292572:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:667 count 1 00010000:00010000:3.0:1763343272.292591:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a17de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.292612:0:35266:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a1576 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48be1 expref: 56 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343272.292620:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.292622:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.292625:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a17de lrc: 4/0,1 mode: --/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.292646:0:35266:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a1576 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48be1 expref: 56 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343272.292657:0:35266:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a1576 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48be1 expref: 56 pid: 8413 timeout: 1165 lvb_type: 1 00000100:00100000:3.0:1763343272.292667:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35266:1848998412933248:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343272.292716:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc440e40 going to sleep for 11 seconds 00000100:00100000:3.0:1763343272.292730:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6986 00000100:00100000:3.0:1763343272.292737:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+126:3661:x1848998412932736:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343272.292748:0:8626:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:666 count 1 00010000:00010000:3.0:1763343272.292759:0:8626:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a17e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.292770:0:8626:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a164f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c2e expref: 56 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.292776:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343272.292778:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343272.292780:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a17e5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.292798:0:8626:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a164f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c2e expref: 56 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.292807:0:8626:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a164f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c2e expref: 56 pid: 28561 timeout: 1165 lvb_type: 0 00000100:00100000:3.0:1763343272.292816:0:8626:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8626:1848998412933376:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343272.292838:0:8626:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc440840 going to sleep for 11 seconds 00000100:00100000:3.0:1763343272.292854:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6987 00000100:00100000:3.0:1763343272.292861:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+37:3661:x1848998412932352:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763343272.292875:0:28562:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:668 count 1 00010000:00010000:3.0:1763343272.292890:0:28562:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a17ec lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.292901:0:28562:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a157d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48be8 expref: 21 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343272.292906:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.292907:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.292910:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a17ec lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.292927:0:28562:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a157d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48be8 expref: 21 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343272.292940:0:28562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a157d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48be8 expref: 21 pid: 8414 timeout: 1165 lvb_type: 1 00000100:00100000:3.0:1763343272.292949:0:28562:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28562:1848998412933504:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343272.292972:0:28562:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc440a80 going to sleep for 11 seconds 00000100:00100000:3.0:1763343272.293137:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6988 00000100:00100000:3.0:1763343272.293145:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+37:3659:x1848998412932480:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343272.293483:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+38:3659:x1848998412932480:12345-0@lo:2:osp-syn-1-1.0 Request processed in 154us (1066us total) trans 17179871813 rc 0/0 00000100:00100000:3.0:1763343272.293497:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6988 00010000:00010000:0.0:1763343272.293652:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a17d7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ca5 expref: 278 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.293693:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121e800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.293700:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a17c2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.293709:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a17c2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.293722:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:1.0:1763343272.293725:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.293729:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a17c2 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.293736:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a17c2 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000100:00100000:0.0:1763343272.294628:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6990 00000100:00100000:1.0:1763343272.294660:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6991 00000100:00100000:0.0:1763343272.294705:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+37:3659:x1848998412932608:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343272.295165:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+126:3659:x1848998412933120:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343272.295262:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+127:3659:x1848998412933120:12345-0@lo:2:osp-syn-0-1.0 Request processed in 102us (2789us total) trans 21474839085 rc 0/0 00000100:00100000:1.0:1763343272.295273:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6991 00000100:00100000:0.0:1763343272.295523:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+38:3659:x1848998412932608:12345-0@lo:2:osp-syn-1-1.0 Request processed in 821us (3198us total) trans 17179871814 rc 0/0 00000100:00100000:0.0:1763343272.295529:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6990 00010000:00010000:0.0:1763343272.295579:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:0.0:1763343272.295582:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343272.295586:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4514400, rc 0) 00000100:00100000:1.0:1763343272.295677:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399742464 00000100:00100000:1.0:1763343272.295684:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399742464 00000100:00100000:0.0:1763343272.295776:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:55884:x1848998399742208:12345-192.168.201.40@tcp:101:bash.0 Request processed in 7130us (7288us total) trans 4294973355 rc 0/0 00000100:00100000:0.0:1763343272.295783:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10355 00000100:00100000:0.0:1763343272.295802:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10356 00000100:00100000:0.0:1763343272.295808:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+277:57082:x1848998399742464:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343272.295820:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.295840:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a17fa lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48cac expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.297058:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1801 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343272.297072:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1801 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.297084:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1801 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.297099:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1808 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343272.297106:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1808 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.297113:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1808 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.297206:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a180f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343272.297216:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a180f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.297222:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a180f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:0.0:1763343272.297233:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1eb:0x0]: returning size 2 00000100:00100000:3.0:1763343272.298271:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8626:1848998412933376:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343272.298282:0:28562:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28562:1848998412933504:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343272.298295:0:8626:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a17e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.298442:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1801 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.298452:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1801 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.298457:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1801 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.298463:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1801 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.298467:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343272.298472:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1801 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.298478:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1801 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.298491:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d816a900) 00010000:00010000:0.0:1763343272.298493:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.298588:0:28562:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a17ec lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.298627:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1801 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000100:00100000:3.0:1763343272.298675:0:28561:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b25880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998412933632:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343272.298694:0:28561:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a17f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.299111:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1801 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.299127:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1808 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.299132:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1808 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.299142:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1808 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.299146:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5088800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343272.299149:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1808 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.299155:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1808 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.299170:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d816ac00) 00010000:00010000:0.0:1763343272.299172:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343272.299178:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1808 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.299184:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1808 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.299242:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a17fa lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cac expref: 280 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.299259:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a180f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cac expref: 279 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.299265:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:0.0:1763343272.299268:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343272.299270:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089000, rc 0) 00000100:00100000:0.0:1763343272.299330:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+279:57082:x1848998399742464:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3521us (4473us total) trans 4294973356 rc 0/0 00000100:00100000:0.0:1763343272.299339:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10356 00000100:00100000:0.0:1763343272.301973:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399742592 00000100:00100000:0.0:1763343272.301983:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399742592 00000100:00100000:1.0:1763343272.302252:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35266:1848998412933248:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343272.302276:0:35266:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a17de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.302326:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a164f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c2e expref: 57 pid: 28561 timeout: 1165 lvb_type: 0 00000100:00100000:0.0:1763343272.302354:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399742720 00000100:00100000:0.0:1763343272.302402:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399742720 00010000:00010000:0.0:1763343272.302424:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a157d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48be8 expref: 22 pid: 8414 timeout: 1165 lvb_type: 1 00000100:00100000:3.0:1763343272.302614:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399742848 00000100:00100000:3.0:1763343272.302619:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399742848 00010000:00010000:3.0:1763343272.302639:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1641 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c27 expref: 23 pid: 8412 timeout: 1165 lvb_type: 0 00000100:00100000:3.0:1763343272.302665:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3355 00000100:00100000:3.0:1763343272.302675:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+57:2410:x1848998399742592:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343272.302690:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343272.302696:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a164f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c2e expref: 57 pid: 28561 timeout: 1165 lvb_type: 0 00010000:00010000:3.0:1763343272.302706:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a164f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c2e expref: 57 pid: 28561 timeout: 1165 lvb_type: 0 00010000:00010000:3.0:1763343272.302731:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a164f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c2e expref: 57 pid: 28561 timeout: 1165 lvb_type: 0 00010000:00010000:3.0:1763343272.302747:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.302749:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.302755:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a17e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.302765:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a17e5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.302791:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343272.302841:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+56:2410:x1848998399742592:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 166us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343272.302867:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3355 00000100:00100000:3.0:1763343272.302885:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3356 00000100:00100000:3.0:1763343272.302893:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2410:x1848998399742720:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343272.302902:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343272.302907:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a157d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x29c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48be8 expref: 23 pid: 8414 timeout: 1165 lvb_type: 1 00010000:00010000:3.0:1763343272.302917:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a157d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x29c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48be8 expref: 23 pid: 8414 timeout: 1165 lvb_type: 1 00000100:00100000:0.0:1763343272.302927:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3357 00010000:00010000:3.0:1763343272.302937:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a157d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x29c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48be8 expref: 23 pid: 8414 timeout: 1165 lvb_type: 1 00000100:00100000:0.0:1763343272.302939:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2410:x1848998399742848:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343272.302954:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343272.302956:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.302960:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.302961:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1641 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x29b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c27 expref: 22 pid: 8412 timeout: 1165 lvb_type: 0 00010000:00010000:3.0:1763343272.302965:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a17ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.302979:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a17ec lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.302983:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1641 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x29b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c27 expref: 22 pid: 8412 timeout: 1165 lvb_type: 0 00010000:00010000:3.0:1763343272.303005:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343272.303057:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2410:x1848998399742720:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 164us (1134us total) trans 0 rc 0/0 00010000:00010000:1.0:1763343272.303060:0:28562:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a17ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343272.303065:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3356 00010000:00010000:1.0:1763343272.303077:0:28562:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a17ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.303087:0:28562:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a17ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.303091:0:8626:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a17e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.303096:0:28562:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a17ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.303106:0:8626:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a17e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.303117:0:8626:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a17e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.303121:0:28562:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343272.303134:0:8626:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a17e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.303153:0:8626:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1763343272.303385:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1641 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x29b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c27 expref: 22 pid: 8412 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343272.303400:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.303403:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.303407:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a17f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343272.303414:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+127:3661:x1848998412932736:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10674us (11270us total) trans 21474839086 rc 0/0 00010000:00010000:0.0:1763343272.303418:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a17f3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343272.303428:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6986 00010000:00010000:0.0:1763343272.303447:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:3.0:1763343272.303473:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b25500/2, rc 0, transno 21474839086 00000100:00100000:3.0:1763343272.303480:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412932736:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343272.303551:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2410:x1848998399742848:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 615us (1567us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.303560:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3357 00010000:00010000:0.0:1763343272.303704:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763343272.303711:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a17ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.303720:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ec00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343272.303724:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a17ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.303741:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a17ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.303756:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a17ec lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.303763:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a17ec lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.303780:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343272.303784:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a17e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.303790:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121e200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343272.303794:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a17e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343272.303956:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+38:3661:x1848998412932352:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11094us (11774us total) trans 17179871815 rc 0/0 00000100:00100000:1.0:1763343272.303966:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6987 00000100:00100000:1.0:1763343272.303980:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399743104 00000100:00100000:1.0:1763343272.303984:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399743104 00000100:00100000:1.0:1763343272.304056:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6992 00000100:00100000:1.0:1763343272.304160:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+56:55884:x1848998399743104:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343272.304172:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.304185:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401c0030200/0x9104b1ba770a181d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48cb3 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.304204:0:28562:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c4514a00/0x9104b1ba770a1775 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c82 expref: 57 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343272.304210:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343272.304212:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343272.304215:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401c0030200/0x9104b1ba770a181d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cb3 expref: 57 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.304238:0:28562:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c4514a00/0x9104b1ba770a1775 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c82 expref: 57 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343272.304249:0:28562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c4514a00/0x9104b1ba770a1775 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c82 expref: 57 pid: 8412 timeout: 1165 lvb_type: 1 00000100:00100000:1.0:1763343272.304261:0:28562:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c517b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28562:1848998412933760:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343272.304322:0:28562:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd0d80 going to sleep for 11 seconds 00010000:00010000:0.0:1763343272.304858:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a17e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.304872:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a17e5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.304878:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a17e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.304895:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343272.304897:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343272.304900:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343272.304907:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343272.304917:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399742976 00010000:00010000:0.0:1763343272.304921:0:28561:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a17f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343272.304925:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399742976 00010000:00010000:0.0:1763343272.304933:0:28561:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a17f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.304941:0:28561:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a17f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.304949:0:28561:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a17f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.304950:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a1576 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48be1 expref: 58 pid: 8413 timeout: 1165 lvb_type: 1 00010000:00010000:0.0:1763343272.304972:0:28561:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343272.305170:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+38:3661:x1848998412932224:12345-0@lo:6:osp-syn-1-1.0 Request processed in 12640us (13235us total) trans 17179871816 rc 0/0 00000100:00100000:0.0:1763343272.305177:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6984 00000004:00080000:0.0:1763343272.305212:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5953b80/2, rc 0, transno 17179871816 00000100:00100000:0.0:1763343272.305216:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412932224:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343272.305281:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3358 00000100:00100000:3.0:1763343272.305293:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+58:2410:x1848998399742976:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343272.305319:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343272.305328:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a1576 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x29b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48be1 expref: 58 pid: 8413 timeout: 1165 lvb_type: 1 00010000:00010000:3.0:1763343272.305346:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a1576 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x29b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48be1 expref: 58 pid: 8413 timeout: 1165 lvb_type: 1 00010000:00010000:3.0:1763343272.305367:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a1576 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x29b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48be1 expref: 58 pid: 8413 timeout: 1165 lvb_type: 1 00010000:00010000:3.0:1763343272.305389:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.305392:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.305395:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a17de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.305404:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a17de lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.305432:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343272.305462:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+57:2410:x1848998399742976:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 173us (1807us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343272.305469:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3358 00000100:00100000:1.0:1763343272.305498:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.305526:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399743360 00000100:00100000:3.0:1763343272.305531:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399743360 00000100:00100000:3.0:1763343272.305558:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3655 00000100:00100000:3.0:1763343272.305567:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+279:57082:x1848998399743360:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343272.305718:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57082:x1848998399743360:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 153us (223us total) trans 4294973357 rc 0/0 00000100:00100000:3.0:1763343272.305725:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3655 00000004:00080000:3.0:1763343272.306561:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b26680/2, rc 0, transno 21474839087 00000100:00100000:3.0:1763343272.306568:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412932864:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1763343272.306835:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343272.306843:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a17de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.306853:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121ea00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343272.306857:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a17de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.306865:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a17de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.306880:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a17de lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.306887:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a17de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.306907:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343272.306909:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343272.306911:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343272.311274:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.311340:0:28562:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c517b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28562:1848998412933760:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343272.311376:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9401c0030200/0x9104b1ba770a181d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cb3 expref: 56 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343272.311395:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:3.0:1763343272.311407:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c0030200, rc 0) 00000100:00100000:0.0:1763343272.311463:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399743488 00000100:00100000:0.0:1763343272.311476:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399743488 00010000:00010000:0.0:1763343272.311515:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c4514a00/0x9104b1ba770a1775 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c82 expref: 57 pid: 8412 timeout: 1165 lvb_type: 1 00000100:00100000:0.0:1763343272.311550:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3359 00000100:00100000:0.0:1763343272.311559:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8599180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+57:2407:x1848998399743488:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343272.311574:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343272.311579:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c4514a00/0x9104b1ba770a1775 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c82 expref: 57 pid: 8412 timeout: 1165 lvb_type: 1 00010000:00010000:0.0:1763343272.311591:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c4514a00/0x9104b1ba770a1775 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c82 expref: 57 pid: 8412 timeout: 1165 lvb_type: 1 00010000:00010000:0.0:1763343272.311612:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c4514a00/0x9104b1ba770a1775 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c82 expref: 57 pid: 8412 timeout: 1165 lvb_type: 1 00010000:00010000:0.0:1763343272.311623:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.311626:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.311633:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9401c0030200/0x9104b1ba770a181d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cb3 expref: 56 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.311644:0:6511:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401c0030200/0x9104b1ba770a181d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cb3 expref: 56 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.311684:0:6511:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9401c0030200/0x9104b1ba770a181d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cb3 expref: 56 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343272.311696:0:6511:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6e8ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6511:1848998412933888:192.168.201.40@tcp:105: 00000100:00100000:3.0:1763343272.312847:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+58:55884:x1848998399743104:12345-192.168.201.40@tcp:101:bash.0 Request processed in 8776us (9111us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343272.312857:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6992 00000100:00100000:0.0:1763343272.312876:0:6511:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc52480 going to sleep for 11 seconds 00000100:00100000:0.0:1763343272.316109:0:6511:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6e8ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6511:1848998412933888:192.168.201.40@tcp:105: 00010000:00010000:0.0:1763343272.316139:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343272.316192:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8599180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+57:2407:x1848998399743488:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 4632us (4927us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.316202:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3359 00002000:00010000:3.0:1763343272.316719:0:35266:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x29c:0x0] updating lvb mtime: 0 -> 1763343271 00002000:00010000:3.0:1763343272.316723:0:35266:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x29c:0x0] updating lvb atime: 0 -> 1763343271 00002000:00010000:3.0:1763343272.316725:0:35266:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x29c:0x0] updating lvb ctime: 0 -> 1763343271 00000100:00100000:3.0:1763343272.316737:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b25880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35266:1848998412934016:192.168.201.40@tcp:106: 00010000:00010000:3.0:1763343272.316763:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3de00/0x9104b1ba770a1824 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cba expref: 56 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343272.316777:0:35266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3de00/0x9104b1ba770a1824 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cba expref: 56 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343272.316788:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5b3de00, rc 0) 00000100:00100000:3.0:1763343272.316826:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+55:2408:x1848998399743616:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 4990us (5436us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343272.316833:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 6993 00000100:00100000:0.0:1763343272.320731:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399744000 00000100:00100000:0.0:1763343272.320743:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399744000 00002000:00010000:0.0:1763343272.320786:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/669 (0->18446744073709551615) 00002000:00100000:0.0:1763343272.320791:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5a3ca80 with x1848998399744000 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343272.320803:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5a3ca80. 00000100:00100000:0.0:1763343272.321198:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399743872 00000100:00100000:0.0:1763343272.321203:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399743872 00002000:00010000:0.0:1763343272.321219:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/668 (0->18446744073709551615) 00002000:00100000:0.0:1763343272.321223:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5a3ea00 with x1848998399743872 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343272.321230:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5a3ea00. 00000100:00100000:0.0:1763343272.323938:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1676 00000100:00100000:0.0:1763343272.323964:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+55:2408:x1848998399743872:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:0.0:1763343272.324187:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x29c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343272.324192:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x29c:0x0] updating lvb mtime from disk: 1763343271 -> 1763343271 00002000:00010000:0.0:1763343272.324195:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x29c:0x0] updating lvb atime from disk: 1763343271 -> 0 00002000:00010000:0.0:1763343272.324197:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x29c:0x0] updating lvb ctime from disk: 1763343271 -> 1763343271 00002000:00010000:0.0:1763343272.324199:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x29c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343272.324274:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+56:2408:x1848998399743872:12345-192.168.201.40@tcp:10:bash.0 Request processed in 321us (3599us total) trans 21474839088 rc 0/0 00000100:00100000:0.0:1763343272.324283:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1676 00002000:00010000:0.0:1763343272.324289:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/668 (0->18446744073709551615) 00002000:00100000:0.0:1763343272.324293:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5a3ea00 with x1848998399743872 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343272.324300:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5a3ea00. 00000100:00100000:1.0:1763343272.340931:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.341146:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399744256 00000100:00100000:1.0:1763343272.341155:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399744256 00000100:00100000:1.0:1763343272.341210:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3656 00000100:00100000:1.0:1763343272.341220:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:55884:x1848998399744256:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:3.0:1763343272.341453:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399744512 00000100:00100000:3.0:1763343272.341459:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399744512 00000100:00100000:3.0:1763343272.341499:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10357 00000100:00100000:3.0:1763343272.341510:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7f56c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57083:x1848998399744512:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343272.341521:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1763343272.342988:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:55884:x1848998399744256:12345-192.168.201.40@tcp:35:bash.0 Request processed in 1764us (1919us total) trans 4294973359 rc 0/0 00000100:00100000:1.0:1763343272.343001:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3656 00000100:00100000:0.0:1763343272.350902:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399744768 00000100:00100000:0.0:1763343272.350916:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399744768 00000100:00100000:0.0:1763343272.351290:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10358 00000100:00100000:0.0:1763343272.351302:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57083:x1848998399744768:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.351386:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.351409:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a1847 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48ccf expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.351533:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a184e lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343272.351547:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a180f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cac expref: 284 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.351558:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a184e lrc: 4/0,1 mode: --/CW res: [0x240000404:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.351593:0:33856:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a180f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cac expref: 284 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.351606:0:33856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a180f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cac expref: 284 pid: 6524 timeout: 1165 lvb_type: 0 00000100:00100000:1.0:1763343272.351619:0:33856:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4b23b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412934144:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343272.351848:0:33856:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343272.355584:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399744896 00000100:00100000:0.0:1763343272.355595:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399744896 00010000:00010000:0.0:1763343272.355637:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a180f lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cac expref: 285 pid: 6524 timeout: 1165 lvb_type: 0 00000100:00100000:0.0:1763343272.355684:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3360 00000100:00100000:0.0:1763343272.355694:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:2407:x1848998399744896:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343272.355712:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343272.355720:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a180f lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cac expref: 285 pid: 6524 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343272.355734:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a180f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cac expref: 285 pid: 6524 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343272.355764:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:0.0:1763343272.355771:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a184e lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.355781:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a184e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.355789:0:6511:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a184e lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.355809:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343272.355868:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:2407:x1848998399744896:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 174us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.355876:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3360 00010000:00010000:1.0:1763343272.356058:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a180f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cac expref: 284 pid: 6524 timeout: 1165 lvb_type: 0 00000100:00100000:1.0:1763343272.356077:0:33856:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4b23b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412934144:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343272.356097:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a184e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.356111:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a184e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.356116:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a184e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:1.0:1763343272.356141:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1eb:0x0]: returning size 5 00010000:00010000:1.0:1763343272.356262:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a1847 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ccf expref: 285 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.356277:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a184e lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ccf expref: 284 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.356284:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:1.0:1763343272.356287:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1763343272.356289:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121fc00, rc 0) 00000100:00100000:1.0:1763343272.356334:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57083:x1848998399744768:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 5035us (5568us total) trans 4294973360 rc 0/0 00000100:00100000:1.0:1763343272.356341:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10358 00000100:00100000:1.0:1763343272.361816:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399745024 00000100:00100000:1.0:1763343272.361826:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399745024 00000100:00100000:1.0:1763343272.361881:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399745152 00000100:00100000:1.0:1763343272.361884:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399745152 00000100:00100000:1.0:1763343272.361916:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10359 00000100:00100000:1.0:1763343272.361926:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57083:x1848998399745024:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.361948:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.361969:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a185c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48cd6 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343272.362014:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10360 00000100:00100000:0.0:1763343272.362072:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57084:x1848998399745152:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:1.0:1763343272.362093:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1863 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343272.362101:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.362110:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a184e lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ccf expref: 286 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.362118:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a186a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48cdd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.362120:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1863 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.362165:0:33856:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a184e lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ccf expref: 287 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.362179:0:33856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a184e lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ccf expref: 287 pid: 33856 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343272.362179:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1871 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343272.362202:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1871 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00000100:00100000:1.0:1763343272.362205:0:33856:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4b23b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412934272:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343272.362221:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1871 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.362239:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1878 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343272.362247:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1878 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.362254:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1878 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000100:00100000:1.0:1763343272.362283:0:33856:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd00c0 going to sleep for 11 seconds 00010000:00010000:0.0:1763343272.362346:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a187f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343272.362356:0:6524:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a187f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.362364:0:6524:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a187f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000100:00100000:1.0:1763343272.364962:0:33856:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4b23b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412934272:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343272.364992:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1863 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:3.0:1763343272.366114:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399745280 00000100:00100000:3.0:1763343272.366123:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399745280 00010000:00010000:1.0:1763343272.366734:0:6524:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a187f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.366742:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a187f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:1.0:1763343272.366791:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1eb:0x0]: returning size 5 00000004:00200000:1.0:1763343272.366795:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343272.366816:0:6524:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a187f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.366828:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a187f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.366839:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1871 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.366845:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1871 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.366851:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1871 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.366857:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1871 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.366862:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.366866:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1871 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.366873:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1871 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.366882:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401d816a900) 00010000:00010000:1.0:1763343272.366885:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.366888:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1871 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.366894:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1871 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.366905:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1878 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.366915:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1878 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.366920:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1878 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.366925:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.366928:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1878 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.366933:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1878 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.366940:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401d816ac00) 00010000:00010000:1.0:1763343272.366942:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.366945:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1878 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.366950:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1878 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.366984:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a186a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cdd expref: 287 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.366999:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a187f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cdd expref: 286 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.367006:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:1.0:1763343272.367009:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343272.367011:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089200, rc 0) 00000100:00100000:1.0:1763343272.367081:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57084:x1848998399745152:12345-192.168.201.40@tcp:101:rm.0 Request processed in 5058us (5354us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343272.367089:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10360 00010000:00010000:3.0:1763343272.367157:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1863 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.367164:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1863 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:3.0:1763343272.367184:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1eb:0x0]: returning size 5 00000004:00200000:3.0:1763343272.367187:0:33856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343272.367197:0:33856:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1863 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.367217:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a185c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cd6 expref: 286 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.367229:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1863 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cd6 expref: 285 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.367236:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:3.0:1763343272.367239:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343272.367241:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121ea00, rc 0) 00000100:00100000:3.0:1763343272.367264:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57083:x1848998399745024:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 5340us (5592us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343272.367270:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10359 00000100:00100000:1.0:1763343272.371961:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399745536 00000100:00100000:1.0:1763343272.371971:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399745536 00000100:00100000:1.0:1763343272.372050:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3657 00000100:00100000:1.0:1763343272.372060:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57083:x1848998399745536:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343272.372296:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399745664 00000100:00100000:0.0:1763343272.372301:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399745664 00000100:00100000:1.0:1763343272.372344:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57083:x1848998399745536:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 284us (749us total) trans 4294973361 rc 0/0 00000100:00100000:0.0:1763343272.372348:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 450 00000100:00100000:1.0:1763343272.372360:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3657 00000100:00100000:0.0:1763343272.372362:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:2409:x1848998399745664:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343272.372376:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343272.372400:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1863 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cd6 expref: 286 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.372416:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:0.0:1763343272.372421:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343272.372442:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:2409:x1848998399745664:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 86us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.372448:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 450 00000100:00100000:3.0:1763343272.376655:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399745920 00000100:00100000:3.0:1763343272.376666:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399745920 00000100:00100000:3.0:1763343272.376729:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10361 00000100:00100000:3.0:1763343272.376739:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57084:x1848998399745920:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:3.0:1763343272.376795:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763343272.376823:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a17d7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1eb:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ca5 expref: 285 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.376843:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a187f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cdd expref: 284 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.376854:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a17b4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48c97 expref: 283 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.376864:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:3.0:1763343272.376869:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343272.376894:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1886 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343272.376905:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1886 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.376913:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1886 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.376924:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a188d lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343272.376930:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a188d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.376935:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a188d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.377012:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a1894 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343272.377042:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a1839 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1eb:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cc8 expref: 282 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.377056:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a1894 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.377087:0:33856:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a1839 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1eb:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cc8 expref: 282 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.377100:0:33856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a1839 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1eb:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cc8 expref: 282 pid: 6524 timeout: 1165 lvb_type: 0 00000100:00100000:3.0:1763343272.377114:0:33856:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412934400:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343272.377201:0:33856:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc440180 going to sleep for 11 seconds 00000100:00100000:1.0:1763343272.377478:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.377526:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399746176 00000100:00100000:0.0:1763343272.377533:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399746176 00000100:00100000:0.0:1763343272.377574:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10362 00000100:00100000:0.0:1763343272.377582:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57083:x1848998399746176:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343272.377593:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.377596:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343272.377603:0:6524:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a1839 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1eb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cc8 expref: 283 pid: 6524 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343272.377618:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:0.0:1763343272.377622:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a1894 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.377629:0:6524:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a1894 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.377635:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a1894 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.377647:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343272.377656:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a189b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48ce4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.377728:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a18a2 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343272.377736:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a18a2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.377743:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a18a2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:0.0:1763343272.377753:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1eb:0x0]: returning size 5 00010000:00010000:0.0:1763343272.381474:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a189b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ce4 expref: 286 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.381501:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a18a2 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ce4 expref: 285 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.381510:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:0.0:1763343272.381513:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343272.381517:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089600, rc 0) 00000100:00100000:0.0:1763343272.381590:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57083:x1848998399746176:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 4009us (4113us total) trans 4294973362 rc 0/0 00000100:00100000:0.0:1763343272.381599:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10362 00010000:00010000:3.0:1763343272.384993:0:33856:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.40@tcp) returned -22 from blocking AST (req@000000004945da3f x1848998412934400) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a1839 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1eb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cc8 expref: 284 pid: 6524 timeout: 1165 lvb_type: 0 00010000:00010000:3.0:1763343272.385013:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a1839 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1eb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cc8 expref: 284 pid: 6524 timeout: 1165 lvb_type: 0 00000100:00100000:3.0:1763343272.385060:0:33856:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412934400:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343272.385080:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:3.0:1763343272.385087:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a1894 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.385095:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a1894 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.385100:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a1894 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00080000:3.0:1763343272.385389:0:33856:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x1eb:0x0] is inserted into orphan list, open count = 2 00010000:00010000:3.0:1763343272.385475:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a1894 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.385489:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a1894 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.385496:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a1894 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.385501:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd8e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343272.385506:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a1894 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.385513:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a1894 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.385526:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:3.0:1763343272.385529:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763343272.385533:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a1894 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.385538:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a1894 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.385551:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1886 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.385557:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1886 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.385562:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1886 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.385571:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343272.385574:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1886 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.385580:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1886 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.385587:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f669e500) 00010000:00010000:3.0:1763343272.385590:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343272.385592:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1886 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.385597:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1886 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:3.0:1763343272.385614:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000005b41848 reply state 00000000fec2e374 transno 4294973363 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a188d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.385626:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a188d lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.385633:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f669e900) 00010000:00010000:3.0:1763343272.385635:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343272.385638:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343272.385712:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57084:x1848998399745920:12345-192.168.201.40@tcp:36:rm.0 Request processed in 8972us (9774us total) trans 4294973363 rc 0/0 00000100:00100000:3.0:1763343272.385720:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10361 00000100:00100000:3.0:1763343272.385748:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399746304 00000100:00100000:3.0:1763343272.385754:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399746304 00000100:00100000:3.0:1763343272.394991:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.395147:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399746432 00000100:00100000:0.0:1763343272.395160:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399746432 00000100:00100000:0.0:1763343272.395226:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 6995 00000100:00100000:0.0:1763343272.395238:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+56:2409:x1848998399746432:12345-192.168.201.40@tcp:1:lfs.0 00010000:00010000:0.0:1763343272.395295:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a18b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.395326:0:35266:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9401c0030200/0x9104b1ba770a181d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cb3 expref: 56 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.395334:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343272.395337:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343272.395340:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a18b7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.395380:0:35266:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9401c0030200/0x9104b1ba770a181d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cb3 expref: 56 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.395401:0:35266:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9401c0030200/0x9104b1ba770a181d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cb3 expref: 56 pid: 28562 timeout: 1165 lvb_type: 0 00000100:00100000:0.0:1763343272.395417:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6e8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35266:1848998412934528:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343272.395504:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc526c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343272.397426:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6e8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35266:1848998412934528:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343272.397456:0:35266:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a18b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343272.398860:0:28389:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399746560 00000100:00100000:1.0:1763343272.398871:0:28389:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399746560 00002000:00100000:1.0:1763343272.398920:0:28389:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x280000400:0x29c:0x0] (0->4) req@ffff9400c5a3df80 x1848998399746560/t0(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:13/0 lens 496/0 e 0 to 0 dl 1763343283 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763343272.398932:0:28389:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5a3df80 with x1848998399746560 ext(0->4) 00010000:00010000:1.0:1763343272.398940:0:28389:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9401c0030200/0x9104b1ba770a181d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cb3 expref: 57 pid: 28562 timeout: 1165 lvb_type: 0 00010000:00010000:1.0:1763343272.398956:0:28389:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9401c0030200/0x9104b1ba770a181d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cb3 expref: 57 pid: 28562 timeout: 1165 lvb_type: 0 00002000:00010000:1.0:1763343272.398965:0:28389:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9400c5a3df80 00000100:00100000:1.0:1763343272.398999:0:28389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 114 00000100:00100000:1.0:1763343272.399009:0:28389:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+57:2407:x1848998399746560:12345-192.168.201.40@tcp:4:bash.0 00000100:00100000:1.0:1763343272.399736:0:28389:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+59:2407:x1848998399746560:12345-192.168.201.40@tcp:4:bash.0 Request processed in 723us (939us total) trans 21474839089 rc 0/0 00000100:00100000:1.0:1763343272.399749:0:28389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 114 00002000:00100000:1.0:1763343272.399757:0:28389:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x280000400:0x29c:0x0] (0->4) req@ffff9400c5a3df80 x1848998399746560/t21474839089(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:13/0 lens 496/448 e 0 to 0 dl 1763343283 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763343272.399767:0:28389:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5a3df80 with x1848998399746560 ext(0->4) 00010000:00010000:1.0:1763343272.399773:0:28389:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9401c0030200/0x9104b1ba770a181d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cb3 expref: 59 pid: 28562 timeout: 1165 lvb_type: 0 00010000:00010000:1.0:1763343272.399788:0:28389:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9401c0030200/0x9104b1ba770a181d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cb3 expref: 59 pid: 28562 timeout: 1165 lvb_type: 0 00002000:00010000:1.0:1763343272.399795:0:28389:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9400c5a3df80 00000100:00100000:1.0:1763343272.403223:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.403318:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399746688 00000100:00100000:0.0:1763343272.403327:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399746688 00010000:00010000:0.0:1763343272.403367:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9401c0030200/0x9104b1ba770a181d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cb3 expref: 59 pid: 28562 timeout: 1165 lvb_type: 0 00000100:00100000:0.0:1763343272.403413:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3362 00000100:00100000:0.0:1763343272.403422:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+59:2410:x1848998399746688:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343272.403438:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1763343272.403454:0:6510:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x29c:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:0.0:1763343272.403457:0:6510:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x29c:0x0] updating lvb atime from disk: 0 -> 1763343271 00002000:00010000:0.0:1763343272.403460:0:6510:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x29c:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1763343272.403465:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9401c0030200/0x9104b1ba770a181d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cb3 expref: 59 pid: 28562 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343272.403478:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9401c0030200/0x9104b1ba770a181d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cb3 expref: 59 pid: 28562 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343272.403502:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401c0030200/0x9104b1ba770a181d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cb3 expref: 59 pid: 28562 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343272.403520:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.403522:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.403527:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a18b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.403535:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a18b7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.403571:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343272.403607:0:35266:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a18b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.403619:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a18b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343272.403626:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+58:2410:x1848998399746688:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 202us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.403636:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3362 00010000:00010000:3.0:1763343272.403648:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a18b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.403658:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a18b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.403666:0:35266:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a18b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.403673:0:35266:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343272.403677:0:35266:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a18b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.403685:0:35266:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a18b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.403697:0:35266:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a18b7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.403703:0:35266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a18b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343272.405709:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.406628:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399746816 00000100:00100000:0.0:1763343272.406639:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399746816 00000100:00100000:3.0:1763343272.408206:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399747072 00000100:00100000:3.0:1763343272.408214:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399747072 00000100:00100000:3.0:1763343272.408241:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10365 00000100:00100000:3.0:1763343272.408248:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57083:x1848998399747072:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:3.0:1763343272.408282:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343272.408298:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a18b0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ceb expref: 286 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.408319:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:3.0:1763343272.408324:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343272.408342:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a18d3 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343272.408352:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a18d3 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343272.408360:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a18d3 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000001:00080000:0.0:1763343272.411427:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973364 is committed 00000004:00080000:0.0:1763343272.411440:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1048 committed 00000004:00080000:0.0:1763343272.411456:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1056 committed 00000004:00080000:0.0:1763343272.412230:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1055 committed 00000004:00080000:0.0:1763343272.412435:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1047 committed 00000100:00100000:0.0:1763343272.412697:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.412757:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399747200 00000100:00100000:3.0:1763343272.412762:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399747200 00000100:00100000:3.0:1763343272.412803:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10366 00000100:00100000:3.0:1763343272.412811:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:57085:x1848998399747200:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343272.412825:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343272.412845:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a18da lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48cf9 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.412906:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a18e1 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343272.412920:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a18e1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343272.412932:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a18e1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343272.412943:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a18e8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343272.412950:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a18e8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343272.412956:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a18e8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343272.412990:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a18e1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343272.412998:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a18e1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343272.413003:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a18e1 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343272.413009:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a18e1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343272.413015:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd9a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343272.413019:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a18e1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343272.413051:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a18e1 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343272.413062:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f669e500) 00010000:00010000:3.0:1763343272.413064:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343272.413069:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a18e1 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343272.413075:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a18e1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343272.413086:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a18e8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343272.413091:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a18e8 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343272.413096:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a18e8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343272.413101:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343272.413103:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a18e8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343272.413108:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a18e8 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343272.413112:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f669e900) 00010000:00010000:3.0:1763343272.413114:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343272.413117:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a18e8 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343272.413121:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a18e8 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343272.413142:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a18da lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cf9 expref: 279 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.413150:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f669e500) 00010000:00010000:3.0:1763343272.413153:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343272.413156:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a18da lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cf9 expref: 279 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.413167:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5bd9000, rc 0) 00000100:00100000:3.0:1763343272.413208:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:57085:x1848998399747200:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 399us (514us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343272.413214:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10366 00010000:00010000:1.0:1763343272.413355:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a188d lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.413363:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a188d lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.413369:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a188d lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.413373:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ec00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.413376:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a188d lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.413382:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a188d lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.413394:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f669e900) 00010000:00010000:1.0:1763343272.413396:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.413400:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a188d lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.413405:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a188d lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000100:00100000:0.0:1763343272.413519:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412934912:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343272.413553:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343272.414343:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763343272.414353:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412935040:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343272.414386:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343272.414485:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412934912 00000100:00100000:1.0:1763343272.414492:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412934912 00000100:00100000:1.0:1763343272.414533:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412935040 00000100:00100000:1.0:1763343272.414536:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412935040 00000100:00100000:1.0:1763343272.414554:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6998 00000100:00100000:1.0:1763343272.414561:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+39:3659:x1848998412934912:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763343272.414690:0:28561:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x29d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343272.414694:0:28561:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x29d:0x0] updating lvb mtime from disk: 1763343271 -> 1763343271 00002000:00010000:1.0:1763343272.414697:0:28561:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x29d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343272.414699:0:28561:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x29d:0x0] updating lvb ctime from disk: 1763343271 -> 1763343271 00002000:00010000:1.0:1763343272.414702:0:28561:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x29d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343272.414740:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+40:3659:x1848998412934912:12345-0@lo:2:osp-syn-1-1.0 Request processed in 179us (1185us total) trans 17179871818 rc 0/0 00000100:00100000:1.0:1763343272.414747:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6998 00000100:00100000:1.0:1763343272.414763:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6999 00000100:00100000:1.0:1763343272.414769:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+39:3659:x1848998412935040:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343272.414833:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+40:3659:x1848998412935040:12345-0@lo:2:osp-syn-1-1.0 Request processed in 64us (446us total) trans 17179871819 rc 0/0 00000100:00100000:1.0:1763343272.414839:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6999 00000004:00080000:1.0:1763343272.414874:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b9ce00/2, rc 0, transno 17179871819 00000100:00100000:1.0:1763343272.414880:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412935040:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763343272.414888:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b9f480/2, rc 0, transno 17179871818 00000100:00100000:1.0:1763343272.414892:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412934912:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1763343272.416712:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a18d3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.416725:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a18d3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.416731:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a18d3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.416737:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd8e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.416741:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a18d3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.416749:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a18d3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.416764:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:1.0:1763343272.416767:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343272.416771:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a18d3 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.416776:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a18d3 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000100:00100000:0.0:1763343272.418645:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.418696:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.424721:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.425459:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.425658:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399747584 00000100:00100000:0.0:1763343272.425670:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399747584 00000100:00100000:0.0:1763343272.425864:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399747712 00000100:00100000:0.0:1763343272.425868:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399747712 00000100:00100000:1.0:1763343272.425930:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10369 00000100:00100000:1.0:1763343272.425941:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+279:57083:x1848998399747584:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.425959:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.425982:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1904 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48d0e expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343272.426089:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10370 00000100:00100000:3.0:1763343272.426098:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57085:x1848998399747712:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343272.426105:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343272.426114:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a190b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48d15 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.426158:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a1912 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343272.426172:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a1912 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.426184:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a1912 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.426199:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a1919 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343272.426206:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a1919 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.426217:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a1919 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.426254:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a1912 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.426261:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a1912 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.426267:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a1912 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.426273:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c589be00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343272.426278:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a1912 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.426286:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a1912 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.426298:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8300) 00010000:00010000:3.0:1763343272.426302:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343272.426316:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a1912 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.426323:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a1912 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.426336:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a1919 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.426342:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a1919 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.426347:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a1919 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.426352:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd9000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343272.426355:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a1919 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.426360:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a1919 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.426368:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f669e500) 00010000:00010000:3.0:1763343272.426370:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343272.426373:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a1919 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.426379:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a1919 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.426410:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a190b lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d15 expref: 281 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.426419:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8300) 00010000:00010000:3.0:1763343272.426422:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343272.426425:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a190b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d15 expref: 281 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.426434:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c589ba00, rc 0) 00010000:00010000:1.0:1763343272.426603:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1920 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.426612:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1920 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.426620:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1920 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343272.426657:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1eb:0x0]: returning size 5 00000004:00200000:1.0:1763343272.426661:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343272.426679:0:7641:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1920 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.426697:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1904 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d0e expref: 281 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.426710:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1920 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d0e expref: 280 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.426717:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:1.0:1763343272.426719:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1763343272.426722:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121e200, rc 0) 00000100:00100000:3.0:1763343272.431448:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57085:x1848998399747712:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 5335us (5974us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343272.431466:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10370 00000100:00100000:1.0:1763343272.432958:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+279:57083:x1848998399747584:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 7009us (8241us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343272.432971:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10369 00000100:00100000:3.0:1763343272.435279:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.435368:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399747968 00000100:00100000:1.0:1763343272.435378:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399747968 00000100:00100000:1.0:1763343272.435435:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10371 00000100:00100000:1.0:1763343272.435449:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+279:57085:x1848998399747968:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.435472:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.435475:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343272.435505:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a18fd lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d07 expref: 279 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.435526:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8300) 00010000:00010000:1.0:1763343272.435536:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343272.435553:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1927 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48d1c expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.435667:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a192e lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.435679:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a192e lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.435688:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a192e lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.435703:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1935 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.435711:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1935 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.435717:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1935 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.436150:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a193c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.436160:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a193c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.436168:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a193c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343272.436176:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ec:0x0]: returning size 0 00010000:00010000:1.0:1763343272.436200:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a192e lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.436207:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a192e lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.436213:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a192e lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.436219:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a192e lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.436225:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121e800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.436228:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a192e lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.436236:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a192e lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.436242:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb100) 00010000:00010000:1.0:1763343272.436245:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.436248:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a192e lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.436253:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a192e lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00010000:1.0:1763343272.436262:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c997af8f reply state 000000006ddeb622 transno 4294973365 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1935 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.436277:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1935 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.436283:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadbd00) 00010000:00010000:1.0:1763343272.436286:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343272.436288:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343272.436329:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1927 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d1c expref: 281 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.436345:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a193c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d1c expref: 280 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.436353:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ec:0x0].0x0 (ffff9400ccadba00) 00010000:00010000:1.0:1763343272.436355:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343272.436357:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d1e9ec00, rc 0) 00000100:00100000:1.0:1763343272.436418:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57085:x1848998399747968:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 972us (1159us total) trans 4294973365 rc 0/0 00000100:00100000:1.0:1763343272.436426:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10371 00000100:00100000:3.0:1763343272.440327:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.440420:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399748096 00000100:00100000:0.0:1763343272.440432:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399748096 00000100:00100000:0.0:1763343272.440486:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7000 00000100:00100000:0.0:1763343272.440495:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+57:2407:x1848998399748096:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343272.440512:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.440532:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5089200/0x9104b1ba770a194a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48d23 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343272.440552:0:28562:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x29c:0x0] initial LVB size: 5, mtime: 0x691a7ba7, atime: 0x691a7ba7, ctime: 0x691a7ba7, blocks: 0x8 00010000:00010000:0.0:1763343272.440569:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.440571:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.440580:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089200/0x9104b1ba770a194a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d23 expref: 58 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343272.440594:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5089200/0x9104b1ba770a194a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d23 expref: 58 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343272.440606:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089200, rc 0) 00000100:00100000:0.0:1763343272.440668:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+58:2407:x1848998399748096:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 173us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.440676:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7000 00000100:00100000:3.0:1763343272.442793:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399748352 00000100:00100000:3.0:1763343272.442802:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399748352 00000100:00100000:1.0:1763343272.445098:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10372 00000100:00100000:1.0:1763343272.445124:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57085:x1848998399748352:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.445163:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.445190:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1951 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48d2a expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.445324:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1958 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.445340:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a193c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d1c expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.445363:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1958 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.445407:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a193c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d1c expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.445422:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a193c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d1c expref: 282 pid: 7641 timeout: 1165 lvb_type: 0 00000100:00100000:1.0:1763343272.445436:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b56a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412935168:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343272.445551:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd0480 going to sleep for 11 seconds 00000100:00100000:1.0:1763343272.450247:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b56a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412935168:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343272.450288:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1958 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343272.450392:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399748480 00000100:00100000:3.0:1763343272.450400:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399748480 00010000:00010000:3.0:1763343272.450434:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a193c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d1c expref: 283 pid: 7641 timeout: 1165 lvb_type: 0 00000100:00100000:3.0:1763343272.450476:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3363 00000100:00100000:3.0:1763343272.450486:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:2407:x1848998399748480:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343272.450502:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343272.450510:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a193c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d1c expref: 283 pid: 7641 timeout: 1165 lvb_type: 0 00010000:00010000:3.0:1763343272.450522:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a193c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d1c expref: 283 pid: 7641 timeout: 1165 lvb_type: 0 00010000:00010000:3.0:1763343272.450544:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a193c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d1c expref: 283 pid: 7641 timeout: 1165 lvb_type: 0 00010000:00010000:3.0:1763343272.450560:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ec:0x0].0x0 (ffff9400ccadba00) 00010000:00010000:3.0:1763343272.450565:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1958 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343272.450573:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1958 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343272.450580:0:6511:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1958 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.450787:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1958 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.450794:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1958 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343272.450827:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ec:0x0]: returning size 0 00000004:00080000:1.0:1763343272.450993:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x29f:0x0], index 1: 0 00000004:00080000:1.0:1763343272.451000:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x29e:0x0], index 0: 0 00000004:00080000:1.0:1763343272.451005:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x29f:0x0], index 0: 0 00000004:00080000:1.0:1763343272.451009:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2a0:0x0], index 1: 0 00010000:00010000:1.0:1763343272.451130:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1958 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.451141:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1958 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.451147:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1958 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.451153:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a2e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.451156:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1958 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.451162:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1958 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.451170:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ec:0x0].0x0 (ffff9400ccadba00) 00010000:00010000:1.0:1763343272.451173:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343272.451176:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1958 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.451181:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1958 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.451224:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1951 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1ec:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d2a expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.451234:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ec:0x0].0x0 (ffff9400ccadba00) 00010000:00010000:1.0:1763343272.451237:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343272.451240:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1951 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ec:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d2a expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.451253:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121fc00, rc 0) 00000100:00100000:1.0:1763343272.454141:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57085:x1848998399748352:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 9010us (11481us total) trans 4294973366 rc 301/301 00000100:00100000:1.0:1763343272.454158:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10372 00000100:00100000:1.0:1763343272.458122:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399748736 00000100:00100000:1.0:1763343272.458136:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399748736 00000100:00100000:1.0:1763343272.458210:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3658 00000100:00100000:1.0:1763343272.458223:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57085:x1848998399748736:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343272.458597:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57085:x1848998399748736:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 377us (693us total) trans 4294973367 rc 0/0 00000100:00100000:1.0:1763343272.458606:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3658 00000100:00100000:3.0:1763343272.462370:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399748992 00000100:00100000:3.0:1763343272.462380:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399748992 00000100:00100000:3.0:1763343272.462431:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3659 00000100:00100000:3.0:1763343272.462439:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8446850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57085:x1848998399748992:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343272.462646:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8446850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57085:x1848998399748992:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 207us (824us total) trans 4294973368 rc 0/0 00000100:00100000:3.0:1763343272.462654:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3659 00000100:00100000:1.0:1763343272.470805:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399749248 00000100:00100000:1.0:1763343272.470823:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399749248 00000100:00100000:1.0:1763343272.470911:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10373 00000100:00100000:1.0:1763343272.470928:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:55884:x1848998399749248:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343272.470958:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.470986:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1966 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48d31 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.471156:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a196d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.471170:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a196d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.471181:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a196d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.471191:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1974 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.471198:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1974 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.471204:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1974 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.471261:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a197b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.471267:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a197b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.471274:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a197b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343272.471286:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ec:0x0]: returning size 0 00010000:00010000:1.0:1763343272.471418:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a196d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.471426:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a196d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.471432:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a196d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.471439:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a196d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.471445:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a3000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.471450:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a196d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.471463:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a196d lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.471474:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadba00) 00010000:00010000:1.0:1763343272.471477:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.471483:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a196d lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.471488:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a196d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.471503:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1974 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.471509:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1974 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.471514:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1974 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.471519:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a2000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.471521:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1974 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.471526:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1974 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.471532:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadbd00) 00010000:00010000:1.0:1763343272.471534:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.471537:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1974 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.471543:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1974 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.471578:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1966 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d31 expref: 286 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.471595:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a197b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d31 expref: 285 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.471602:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ec:0x0].0x0 (ffff9400ccadb100) 00010000:00010000:1.0:1763343272.471604:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343272.471606:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121fc00, rc 0) 00000100:00100000:1.0:1763343272.471671:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:55884:x1848998399749248:12345-192.168.201.40@tcp:101:bash.0 Request processed in 748us (2242us total) trans 4294973369 rc 0/0 00000100:00100000:1.0:1763343272.471679:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10373 00000100:00100000:0.0:1763343272.478231:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399749376 00000100:00100000:0.0:1763343272.478243:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399749376 00000100:00100000:0.0:1763343272.478466:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10374 00000100:00100000:0.0:1763343272.478477:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:55884:x1848998399749376:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343272.478503:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.478529:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1989 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48d38 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.478567:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1990 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343272.478582:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1990 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.478595:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1990 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.478728:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1989 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d38 expref: 287 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.478753:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1990 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d38 expref: 286 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.478762:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ec:0x0].0x0 (ffff9400ccadb100) 00010000:00010000:0.0:1763343272.478765:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343272.478770:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5088a00, rc 0) 00000100:00100000:0.0:1763343272.480054:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:55884:x1848998399749376:12345-192.168.201.40@tcp:101:bash.0 Request processed in 1551us (1896us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.480065:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10374 00000100:00100000:0.0:1763343272.485947:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399749632 00000100:00100000:0.0:1763343272.485958:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399749632 00000100:00100000:0.0:1763343272.486020:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10375 00000100:00100000:0.0:1763343272.486054:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:55884:x1848998399749632:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:0.0:1763343272.486107:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343272.486135:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a197b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d31 expref: 286 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.486154:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ec:0x0].0x0 (ffff9400ccadb100) 00010000:00010000:0.0:1763343272.486160:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343272.486365:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1997 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343272.486379:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1997 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.486389:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1997 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000001:00080000:0.0:1763343272.486439:0:33856:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973370 00000004:00010000:0.0:1763343272.486467:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009a5bbc9c reply state 0000000017fc4846 transno 4294973371 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1997 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.486479:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1997 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.486485:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ec:0x0].0x0 (ffff9400ccadb100) 00010000:00010000:0.0:1763343272.486488:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343272.486490:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343272.486582:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:55884:x1848998399749632:12345-192.168.201.40@tcp:36:bash.0 Request processed in 529us (718us total) trans 4294973371 rc 0/0 00000100:00100000:0.0:1763343272.486590:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10375 00000020:00080000:0.0:1763343272.486595:0:33856:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343272.489320:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.489675:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10376 00000100:00100000:1.0:1763343272.489688:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:55884:x1848998399749760:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343272.489713:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.489735:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a199e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48d3f expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.489794:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a199e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d3f expref: 289 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.489810:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a199e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d3f expref: 289 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.489829:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ec:0x0].0x0 (ffff9400ccadb100) 00010000:00010000:1.0:1763343272.489832:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343272.489836:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121ea00, rc 0) 00000100:00100000:1.0:1763343272.489934:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:55884:x1848998399749760:12345-192.168.201.40@tcp:101:bash.0 Request processed in 248us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343272.489942:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10376 00000100:00100000:1.0:1763343272.493089:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399750016 00000100:00100000:1.0:1763343272.493102:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399750016 00000100:00100000:1.0:1763343272.493173:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10377 00000100:00100000:1.0:1763343272.493183:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:55884:x1848998399750016:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343272.493204:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.493208:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343272.493238:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a199e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d3f expref: 289 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.493257:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ec:0x0].0x0 (ffff9400ccadb100) 00010000:00010000:1.0:1763343272.493261:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343272.493273:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a19a5 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48d46 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.493331:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a19ac lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.493343:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a19ac lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.493353:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a19ac lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000040:00080000:1.0:1763343272.493668:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1647, 88 off137512 00000004:00080000:1.0:1763343272.493676:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1065617651117ns, next at 1065526239568ns, rc = 0 00000040:00080000:1.0:1763343272.493716:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1639, 88 off136816 00000004:00080000:1.0:1763343272.493722:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1065617697191ns, next at 1065528590468ns, rc = 0 00000040:00080000:1.0:1763343272.493743:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1640, 88 off136904 00000004:00080000:1.0:1763343272.493747:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1065617722235ns, next at 1065528590468ns, rc = 0 00000040:00080000:1.0:1763343272.493757:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1648, 88 off137600 00000004:00080000:1.0:1763343272.493761:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1065617736477ns, next at 1065526239568ns, rc = 0 00000001:00080000:0.0:1763343272.496389:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973372 is committed 00000004:00080000:0.0:1763343272.496403:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1058 committed 00000004:00080000:0.0:1763343272.496420:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1050 committed 00000004:00080000:0.0:1763343272.496441:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1049 committed 00000004:00080000:0.0:1763343272.496444:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1057 committed 00010000:00010000:1.0:1763343272.497528:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1935 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.497539:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1935 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.497547:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1935 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.497553:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.497558:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1935 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.497564:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1935 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.497581:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadbd00) 00010000:00010000:1.0:1763343272.497583:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.497588:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1935 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.497594:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1935 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.497615:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1997 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.497621:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1997 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.497626:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1997 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.497630:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.497634:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1997 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.497639:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1997 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.497646:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ec:0x0].0x0 (ffff9400ccadb100) 00010000:00010000:1.0:1763343272.497649:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.497652:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1997 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.497657:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1997 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.497714:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a19ac lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ec:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d46 expref: 281 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.497723:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ec:0x0].0x0 (ffff9400ccadb100) 00010000:00010000:1.0:1763343272.497726:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343272.497737:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a19a5 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d46 expref: 281 pid: 7641 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343272.497750:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a19ac lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ec:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d46 expref: 280 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.497775:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ec:0x0].0x0 (ffff9400ccadb100) 00010000:00010000:1.0:1763343272.497779:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343272.497781:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c89a2e00, rc 0) 00000100:00100000:1.0:1763343272.497838:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:55884:x1848998399750016:12345-192.168.201.40@tcp:101:bash.0 Request processed in 4656us (4888us total) trans 4294973372 rc 0/0 00000100:00100000:1.0:1763343272.497845:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10377 00000100:00100000:0.0:1763343272.497897:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412935552:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343272.497931:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343272.497956:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763343272.497962:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412935680:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343272.497980:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343272.498216:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412935552 00000100:00100000:1.0:1763343272.498222:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412935552 00000100:00100000:1.0:1763343272.498252:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412935680 00000100:00100000:1.0:1763343272.498255:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412935680 00000100:00100000:1.0:1763343272.498270:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7003 00000100:00100000:1.0:1763343272.498276:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+130:3659:x1848998412935552:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343272.498404:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+131:3659:x1848998412935552:12345-0@lo:2:osp-syn-0-1.0 Request processed in 127us (472us total) trans 21474839092 rc 0/0 00000100:00100000:1.0:1763343272.498410:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7003 00000100:00100000:1.0:1763343272.498423:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7004 00000100:00100000:1.0:1763343272.498442:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+130:3659:x1848998412935680:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343272.498508:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+131:3659:x1848998412935680:12345-0@lo:2:osp-syn-0-1.0 Request processed in 79us (527us total) trans 21474839093 rc 0/0 00000100:00100000:1.0:1763343272.498514:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7004 00000004:00080000:1.0:1763343272.498547:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5a3fb80/2, rc 0, transno 21474839093 00000100:00100000:1.0:1763343272.498552:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412935680:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763343272.498560:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c390c700/2, rc 0, transno 21474839092 00000100:00100000:1.0:1763343272.498563:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412935552:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343272.506820:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399750144 00000100:00100000:3.0:1763343272.506830:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399750144 00000100:00100000:3.0:1763343272.506878:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399750272 00000100:00100000:3.0:1763343272.506880:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399750272 00000100:00100000:3.0:1763343272.506906:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7005 00000100:00100000:3.0:1763343272.506914:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c511d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+58:2407:x1848998399750144:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:3.0:1763343272.507020:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c511d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+58:2407:x1848998399750144:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 106us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343272.507046:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7005 00000100:00100000:3.0:1763343272.507064:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7006 00000100:00100000:3.0:1763343272.507070:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c511dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:55884:x1848998399750272:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343272.507080:0:8626:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343272.507100:0:8626:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a19b3 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48d4d expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343272.507123:0:8626:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x29f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343272.507139:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.507141:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.507150:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a19b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d4d expref: 23 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.507166:0:8626:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a19b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d4d expref: 23 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.507178:0:8626:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5bd9a00, rc 0) 00000100:00100000:3.0:1763343272.507198:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c511dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:55884:x1848998399750272:12345-192.168.201.40@tcp:101:bash.0 Request processed in 129us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343272.507204:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7006 00000100:00100000:3.0:1763343272.512993:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.514438:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399750400 00000100:00100000:1.0:1763343272.514452:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399750400 00000100:00100000:1.0:1763343272.514513:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7007 00000100:00100000:1.0:1763343272.514525:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+58:2408:x1848998399750400:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:1.0:1763343272.514660:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+58:2408:x1848998399750400:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 136us (1675us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343272.514668:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7007 00000100:00100000:0.0:1763343272.517796:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399750528 00000100:00100000:0.0:1763343272.517807:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399750528 00000100:00100000:0.0:1763343272.517863:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7008 00000100:00100000:0.0:1763343272.517872:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+58:55884:x1848998399750528:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343272.517889:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.517911:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a19ba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48d54 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343272.517933:0:28562:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x29e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343272.517954:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.517956:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.517965:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a19ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d54 expref: 59 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.517980:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a19ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d54 expref: 59 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.517997:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089c00, rc 0) 00000100:00100000:0.0:1763343272.518089:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+59:55884:x1848998399750528:12345-192.168.201.40@tcp:101:bash.0 Request processed in 216us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.518096:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7008 00000100:00100000:1.0:1763343272.524087:0:28389:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399750656 00000100:00100000:1.0:1763343272.524099:0:28389:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399750656 00000100:00100000:1.0:1763343272.525339:0:28389:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399750784 00000100:00100000:1.0:1763343272.525347:0:28389:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399750784 00002000:00010000:1.0:1763343272.525427:0:28389:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/671 (0->18446744073709551615) 00002000:00100000:1.0:1763343272.525432:0:28389:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5951180 with x1848998399750784 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343272.525445:0:28389:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5951180. 00000100:00100000:1.0:1763343272.525467:0:28389:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399750912 00000100:00100000:1.0:1763343272.525470:0:28389:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399750912 00002000:00010000:1.0:1763343272.525483:0:28389:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/670 (0->18446744073709551615) 00002000:00100000:1.0:1763343272.525485:0:28389:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5953480 with x1848998399750912 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343272.525491:0:28389:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5953480. 00000100:00100000:1.0:1763343272.525517:0:28389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1677 00000100:00100000:1.0:1763343272.525530:0:28389:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5950700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+60:2408:x1848998399750656:12345-192.168.201.40@tcp:3:lfs.0 00010000:00010000:1.0:1763343272.525565:0:28389:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9400c89a2000/0x9104b1ba770a19c1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.525579:0:28389:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343272.525581:0:28389:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343272.525586:0:28389:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c89a2000/0x9104b1ba770a19c1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.525599:0:28389:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c89a2000/0x9104b1ba770a19c1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.525699:0:28389:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9400c89a2000/0x9104b1ba770a19c1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.525708:0:28389:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c89a2000/0x9104b1ba770a19c1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.525720:0:28389:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c89a2000/0x9104b1ba770a19c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.525726:0:28389:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a2000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343272.525730:0:28389:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c89a2000/0x9104b1ba770a19c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.525737:0:28389:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c89a2000/0x9104b1ba770a19c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.525752:0:28389:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c89a2000/0x9104b1ba770a19c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.525759:0:28389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c89a2000/0x9104b1ba770a19c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28389 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343272.525823:0:28389:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5950700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+60:2408:x1848998399750656:12345-192.168.201.40@tcp:3:lfs.0 Request processed in 298us (1826us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1763343272.525831:0:28389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1677 00000100:00100000:1.0:1763343272.525859:0:28389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1679 00000100:00100000:1.0:1763343272.525866:0:28389:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+59:2407:x1848998399750912:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:1.0:1763343272.525958:0:28389:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x29e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343272.525962:0:28389:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x29e:0x0] updating lvb mtime from disk: 0 -> 1763343271 00002000:00010000:1.0:1763343272.525964:0:28389:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x29e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343272.525966:0:28389:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x29e:0x0] updating lvb ctime from disk: 0 -> 1763343271 00002000:00010000:1.0:1763343272.525969:0:28389:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x29e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343272.525998:0:28389:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+60:2407:x1848998399750912:12345-192.168.201.40@tcp:10:bash.0 Request processed in 132us (1836us total) trans 21474839094 rc 0/0 00000100:00100000:1.0:1763343272.526004:0:28389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1679 00002000:00010000:1.0:1763343272.526008:0:28389:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/670 (0->18446744073709551615) 00002000:00100000:1.0:1763343272.526011:0:28389:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5953480 with x1848998399750912 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343272.526015:0:28389:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5953480. 00000100:00100000:3.0:1763343272.529729:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.529814:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.529823:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399751040 00000100:00100000:1.0:1763343272.529833:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399751040 00000100:00100000:1.0:1763343272.529899:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10378 00000100:00100000:1.0:1763343272.529910:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57083:x1848998399751040:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.529935:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.529958:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a19c8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48d5b expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.530009:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a19cf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.530054:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a19cf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.530066:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a19cf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.530225:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a19c8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d5b expref: 283 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.530244:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1660000/0x9104b1ba770a19cf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d5b expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.530253:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:0.0:1763343272.530255:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343272.530258:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c1660000, rc 0) 00000100:00100000:0.0:1763343272.530327:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57083:x1848998399751040:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 418us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.530334:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10378 00000100:00100000:3.0:1763343272.536140:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000001:00080000:0.0:1763343272.543119:0:25994:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871823 is committed 00000001:00080000:0.0:1763343272.543138:0:25994:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871821 is committed 00000100:00100000:0.0:1763343272.546096:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.546232:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399751552 00000100:00100000:1.0:1763343272.546242:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399751552 00000100:00100000:1.0:1763343272.546312:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10379 00000100:00100000:1.0:1763343272.546322:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57086:x1848998399751552:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:1.0:1763343272.546344:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.546368:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a19dd lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48d62 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.546438:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a19e4 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.546450:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a19e4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.546461:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a19e4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.546472:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a19eb lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.546477:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a19eb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.546482:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a19eb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.546546:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a19f2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.546553:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a19f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.546558:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a19f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343272.546594:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ec:0x0]: returning size 5 00000004:00200000:1.0:1763343272.546598:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343272.546616:0:7641:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a19f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.546627:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a19f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.546636:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a19e4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.546642:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a19e4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.546647:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a19e4 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.546653:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a19e4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.546659:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c1661000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.546663:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a19e4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.546670:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a19e4 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.546681:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadbd00) 00010000:00010000:1.0:1763343272.546684:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.546688:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a19e4 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.546694:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a19e4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.548461:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a19eb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.548478:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a19eb lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.548486:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a19eb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.548492:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a3000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.548497:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a19eb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.548505:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a19eb lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.548520:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadba00) 00010000:00010000:1.0:1763343272.548523:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.548527:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a19eb lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.548533:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a19eb lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.548587:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a19dd lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d62 expref: 284 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.548604:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a19f2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d62 expref: 283 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.548612:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ec:0x0].0x0 (ffff9400ccadb100) 00010000:00010000:1.0:1763343272.548615:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343272.548618:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c89a2000, rc 0) 00000100:00100000:1.0:1763343272.548701:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57086:x1848998399751552:12345-192.168.201.40@tcp:101:rm.0 Request processed in 2378us (2613us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343272.548710:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10379 00000100:00100000:1.0:1763343272.558351:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399751808 00000100:00100000:1.0:1763343272.558363:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399751808 00000100:00100000:1.0:1763343272.558429:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10380 00000100:00100000:1.0:1763343272.558493:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57086:x1848998399751808:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:1.0:1763343272.558563:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763343272.558593:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a19ac lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ec:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d46 expref: 283 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.558616:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a19f2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d62 expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.558629:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1990 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ec:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d38 expref: 281 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.558642:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ec:0x0].0x0 (ffff9400ccadb100) 00010000:00010000:1.0:1763343272.558652:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343272.558680:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a19f9 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.558693:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a19f9 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.558702:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a19f9 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.558715:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a1a00 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.558722:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a1a00 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.558729:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a1a00 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.558814:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a1a07 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.558822:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a1a07 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.558829:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a1a07 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000040:00080000:1.0:1763343272.559109:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1649, 64 off137664 00000004:00080000:1.0:1763343272.559118:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1065683092654ns, next at 1066683090291ns, rc = 0 00000040:00080000:1.0:1763343272.559258:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1641, 64 off136968 00000004:00080000:1.0:1763343272.559264:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1065683239554ns, next at 1066683237775ns, rc = 0 00000040:00080000:1.0:1763343272.559276:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1642, 64 off137032 00000040:00080000:1.0:1763343272.559287:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1650, 64 off137728 00010000:00010000:1.0:1763343272.559354:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a0e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.559364:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a0e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.559372:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a0e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.559379:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a0e lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.559386:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a0e lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.559391:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a0e lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.559409:0:7641:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343272.559428:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a1a07 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.559434:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a1a07 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.559447:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343272.559455:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a0e lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.559462:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a6800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343272.559466:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a0e lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.559478:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a0e lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.559488:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ec:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:0.0:1763343272.559491:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343272.559495:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a0e lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.559501:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a0e lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.559506:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a1a07 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.559514:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343272.559516:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c1661000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343272.559517:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343272.559521:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343272.559524:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a1a07 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.559532:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a1a07 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.559583:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ec:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:1.0:1763343272.559586:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343272.559589:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a1a07 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.559595:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a1a07 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.559710:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a19f9 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.559717:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a19f9 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.559722:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a19f9 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.559732:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a19f9 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.559737:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a3000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.559740:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a19f9 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.559746:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a19f9 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.559753:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadbd00) 00010000:00010000:1.0:1763343272.559756:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.559759:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a19f9 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.559764:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a19f9 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00010000:1.0:1763343272.559776:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000205ca368 reply state 000000005193a2d4 transno 4294973374 ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a1a00 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.559786:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a1a00 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.559792:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadba00) 00010000:00010000:1.0:1763343272.559794:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343272.559796:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343272.559882:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57086:x1848998399751808:12345-192.168.201.40@tcp:36:rm.0 Request processed in 1442us (2306us total) trans 4294973374 rc 0/0 00000100:00100000:1.0:1763343272.559891:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10380 00000100:00100000:3.0:1763343272.564160:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.564213:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399752064 00000100:00100000:1.0:1763343272.564224:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399752064 00000100:00100000:1.0:1763343272.564289:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10381 00000100:00100000:1.0:1763343272.564298:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57083:x1848998399752064:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:1.0:1763343272.564366:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343272.564393:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1920 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1eb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d0e expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.564410:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:1.0:1763343272.564415:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343272.564524:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a1a15 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343272.564538:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a1a15 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.564549:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a1a15 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00010000:1.0:1763343272.564664:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000036442b58 reply state 00000000315300c3 transno 4294973375 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a1a15 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.564677:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a1a15 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.564684:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:1.0:1763343272.564687:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343272.564689:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343272.564781:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57083:x1848998399752064:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 484us (631us total) trans 4294973375 rc 0/0 00000100:00100000:1.0:1763343272.564789:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10381 00000100:00100000:0.0:1763343272.569585:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.569835:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399752192 00000100:00100000:1.0:1763343272.569847:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399752192 00000100:00100000:1.0:1763343272.569909:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7009 00000100:00100000:1.0:1763343272.569920:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:57083:x1848998399752192:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.569938:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.569961:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a1a1c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48d69 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343272.569986:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x29e:0x0] initial LVB size: 4096, mtime: 0x691a7ba7, atime: 0x0, ctime: 0x691a7ba7, blocks: 0x8 00010000:00010000:1.0:1763343272.570009:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343272.570011:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343272.570020:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a1a1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d69 expref: 14 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.570161:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a1a1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d69 expref: 14 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.570176:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a7200, rc 0) 00000100:00100000:1.0:1763343272.570240:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:57083:x1848998399752192:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 321us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343272.570248:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7009 00000100:00100000:3.0:1763343272.577120:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399752448 00000100:00100000:3.0:1763343272.577132:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399752448 00000100:00100000:0.0:1763343272.577215:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7010 00000100:00100000:0.0:1763343272.577229:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+60:57083:x1848998399752448:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343272.577249:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1763343272.577269:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399752320 00010000:00010000:0.0:1763343272.577274:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5088a00/0x9104b1ba770a1a23 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48d77 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343272.577275:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399752320 00002000:00010000:0.0:1763343272.577300:0:28562:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x29d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343272.577336:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.577339:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.577347:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5088a00/0x9104b1ba770a1a23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d77 expref: 61 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343272.577348:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10382 00000100:00100000:1.0:1763343272.577361:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57087:x1848998399752320:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343272.577369:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5088a00/0x9104b1ba770a1a23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d77 expref: 61 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.577382:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.577389:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5088a00, rc 0) 00010000:00010000:1.0:1763343272.577400:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a1a2a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48d70 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343272.577458:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+61:57083:x1848998399752448:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 232us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.577466:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7010 00010000:00010000:1.0:1763343272.577468:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a31 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343272.577481:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a31 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.577492:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a31 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.577504:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a1a38 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343272.577511:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a1a38 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.577519:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a1a38 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.577560:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a31 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.577568:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a31 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.577574:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a31 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.577580:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a6800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.577584:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a31 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.577591:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a31 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.577605:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadbd00) 00010000:00010000:1.0:1763343272.577608:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.577613:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a31 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.577619:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a31 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.577632:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a1a38 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.577638:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a1a38 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.577643:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a1a38 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.577648:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c1661000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.577651:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a1a38 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.577657:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a1a38 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.577664:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadba00) 00010000:00010000:1.0:1763343272.577667:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.577670:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a1a38 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.577675:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a1a38 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.577699:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a1a2a lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d70 expref: 284 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.577709:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadbd00) 00010000:00010000:1.0:1763343272.577711:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.577715:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a1a2a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d70 expref: 284 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.577727:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a6a00, rc 0) 00000100:00100000:1.0:1763343272.577767:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57087:x1848998399752320:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 408us (962us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343272.577774:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10382 00000100:00100000:0.0:1763343272.582888:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399752576 00000100:00100000:0.0:1763343272.582900:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399752576 00002000:00010000:0.0:1763343272.582944:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/670 (5->18446744073709551615) 00002000:00100000:0.0:1763343272.582950:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401f6507100 with x1848998399752576 ext(5->18446744073709551615) 00002000:00010000:0.0:1763343272.582963:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401f6507100. 00000100:00100000:0.0:1763343272.582998:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1681 00000100:00100000:0.0:1763343272.583008:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399752576:12345-192.168.201.40@tcp:10:lfs.0 00002000:00010000:0.0:1763343272.583364:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x29e:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:0.0:1763343272.583368:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x29e:0x0] updating lvb mtime from disk: 1763343271 -> 1763343271 00002000:00010000:0.0:1763343272.583371:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x29e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343272.583373:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x29e:0x0] updating lvb ctime from disk: 1763343271 -> 1763343271 00002000:00010000:0.0:1763343272.583375:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x29e:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763343272.583438:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998399752576:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 431us (1998us total) trans 17179871824 rc 0/0 00000100:00100000:0.0:1763343272.583450:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1681 00002000:00010000:0.0:1763343272.583454:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/670 (5->18446744073709551615) 00002000:00100000:0.0:1763343272.583456:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401f6507100 with x1848998399752576 ext(5->18446744073709551615) 00002000:00010000:0.0:1763343272.583461:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401f6507100. 00000100:00100000:1.0:1763343272.585373:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399752832 00000100:00100000:1.0:1763343272.585382:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399752832 00000100:00100000:1.0:1763343272.585428:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10383 00000100:00100000:1.0:1763343272.585437:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57087:x1848998399752832:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.585459:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.585485:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1a3f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48d7e expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.585555:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1a46 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343272.585568:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1a46 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.585581:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1a46 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.585593:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a1a4d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343272.585605:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a1a4d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.585612:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a1a4d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.585646:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1a46 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.585653:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1a46 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.585659:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1a46 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.585666:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a2e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.585670:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1a46 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.585677:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1a46 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.585688:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:1.0:1763343272.585692:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.585696:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1a46 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.585702:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a1a46 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.585714:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a1a4d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.585719:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a1a4d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.585725:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a1a4d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.585730:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508b200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.585732:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a1a4d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.585738:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a1a4d lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.585745:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadba00) 00010000:00010000:1.0:1763343272.585747:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.585750:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a1a4d lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.585755:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a1a4d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.585780:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1a3f lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d7e expref: 284 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.585791:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:1.0:1763343272.585793:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.585797:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a1a3f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d7e expref: 284 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.585810:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c89a2000, rc 0) 00000100:00100000:1.0:1763343272.585868:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57087:x1848998399752832:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 432us (647us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343272.585876:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10383 00000100:00100000:3.0:1763343272.586010:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399752704 00000100:00100000:3.0:1763343272.586015:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399752704 00002000:00010000:3.0:1763343272.586067:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/669 (0->18446744073709551615) 00002000:00100000:3.0:1763343272.586071:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401f6505f80 with x1848998399752704 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343272.586078:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9401f6505f80. 00000100:00100000:3.0:1763343272.586103:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1682 00000100:00100000:3.0:1763343272.586109:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+61:2407:x1848998399752704:12345-192.168.201.40@tcp:10:lfs.0 00002000:00010000:3.0:1763343272.586258:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x29d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343272.586262:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x29d:0x0] updating lvb mtime from disk: 0 -> 1763343271 00002000:00010000:3.0:1763343272.586264:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x29d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343272.586267:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x29d:0x0] updating lvb ctime from disk: 0 -> 1763343271 00002000:00010000:3.0:1763343272.586269:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x29d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343272.586293:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+62:2407:x1848998399752704:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 184us (1114us total) trans 21474839095 rc 0/0 00000100:00100000:3.0:1763343272.586316:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1682 00002000:00010000:3.0:1763343272.586319:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/669 (0->18446744073709551615) 00002000:00100000:3.0:1763343272.586322:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401f6505f80 with x1848998399752704 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343272.586327:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9401f6505f80. 00000100:00100000:1.0:1763343272.588881:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.588921:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.588995:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399752960 00000100:00100000:0.0:1763343272.589004:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399752960 00000100:00100000:0.0:1763343272.589087:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399753216 00000100:00100000:0.0:1763343272.589091:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399753216 00000100:00100000:0.0:1763343272.589113:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10384 00000100:00100000:0.0:1763343272.589122:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57087:x1848998399752960:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343272.589143:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.589166:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1a54 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48d85 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.589223:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1a5b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343272.589235:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1a5b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.589246:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1a5b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:0.0:1763343272.589297:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343272.589302:0:33856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343272.589343:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1a54 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d85 expref: 286 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.589361:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1a5b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d85 expref: 285 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.589370:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c52ec700) 00010000:00010000:0.0:1763343272.589373:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343272.589377:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089000, rc 0) 00000100:00100000:0.0:1763343272.589429:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57087:x1848998399752960:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 308us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.589436:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10384 00000100:00100000:0.0:1763343272.589455:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10385 00000100:00100000:0.0:1763343272.589461:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57083:x1848998399753216:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:0.0:1763343272.589508:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1a62 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343272.589519:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1a62 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.589526:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1a62 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00010000:0.0:1763343272.589650:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f978192e reply state 0000000050eff844 transno 4294973376 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1a62 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.589664:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1a62 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.589671:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:0.0:1763343272.589674:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343272.589677:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343272.589720:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57083:x1848998399753216:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 259us (797us total) trans 4294973376 rc 0/0 00000100:00100000:0.0:1763343272.589726:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10385 00000100:00100000:0.0:1763343272.593193:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.596060:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399753472 00000100:00100000:1.0:1763343272.596069:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399753472 00000100:00100000:1.0:1763343272.596256:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10386 00000100:00100000:1.0:1763343272.596266:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57087:x1848998399753472:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.596296:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.596324:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a1a69 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48d8c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.596391:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a1a70 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343272.596405:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a1a70 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.596417:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a1a70 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.596427:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a1a77 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343272.596434:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a1a77 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.596440:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a1a77 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.596477:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a1a70 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.596485:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a1a70 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.596495:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a1a70 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.596501:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a1a70 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.596507:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508aa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.596510:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a1a70 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.596517:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a1a70 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.596529:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c52ec700) 00010000:00010000:1.0:1763343272.596532:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.596536:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a1a70 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.596541:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a1a70 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.596551:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a1a77 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.596557:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a1a77 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.596562:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a1a77 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.596566:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508be00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.596569:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a1a77 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.596577:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a1a77 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.596582:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadba00) 00010000:00010000:1.0:1763343272.596585:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.596587:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a1a77 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.596592:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a1a77 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.596616:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a1a69 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d8c expref: 287 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.596625:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c52ec700) 00010000:00010000:1.0:1763343272.596627:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.596630:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a1a69 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d8c expref: 287 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.596638:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c508a400, rc 0) 00000100:00100000:1.0:1763343272.596695:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57087:x1848998399753472:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 431us (802us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343272.596703:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10386 00000100:00100000:0.0:1763343272.597610:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.601013:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.601120:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399753984 00000100:00100000:1.0:1763343272.601130:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399753984 00000100:00100000:1.0:1763343272.601225:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10387 00000100:00100000:1.0:1763343272.601236:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57087:x1848998399753984:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.601253:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.601257:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343272.601283:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1a5b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d85 expref: 287 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.601312:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c52ec700) 00010000:00010000:1.0:1763343272.601324:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343272.601342:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a1a85 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48d93 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.601438:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a1a8c lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343272.601449:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a1a8c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.601458:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a1a8c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.601466:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a93 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343272.601473:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a93 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.601478:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a93 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.601835:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a1a9a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343272.601844:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a1a9a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.601851:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a1a9a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:1.0:1763343272.601862:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ee:0x0]: returning size 0 00010000:00010000:1.0:1763343272.601892:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a1a8c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.601899:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a1a8c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.601906:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a1a8c lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.601912:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a1a8c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.601918:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a6a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.601922:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a1a8c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.601930:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a1a8c lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.601938:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:1.0:1763343272.601941:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.601945:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a1a8c lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.601951:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a1a8c lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000004:00010000:1.0:1763343272.601962:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003b58b64b reply state 000000003316b0c8 transno 4294973377 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a93 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.601972:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a93 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.601983:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadba00) 00010000:00010000:1.0:1763343272.601985:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343272.601987:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343272.602013:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a1a85 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d93 expref: 289 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.602061:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a1a9a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d93 expref: 288 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.602069:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ee:0x0].0x0 (ffff9400ccadbd00) 00010000:00010000:1.0:1763343272.602071:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343272.602074:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c7ec1c00, rc 0) 00000100:00100000:1.0:1763343272.602131:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57087:x1848998399753984:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 897us (1127us total) trans 4294973377 rc 0/0 00000100:00100000:1.0:1763343272.602139:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10387 00000100:00100000:3.0:1763343272.605598:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.605696:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399754368 00000100:00100000:1.0:1763343272.605704:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399754368 00000100:00100000:1.0:1763343272.605748:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10388 00000100:00100000:1.0:1763343272.605757:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57087:x1848998399754368:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.605775:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.605792:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a1aa8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48d9a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343272.605884:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:1.0:1763343272.605894:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a1aaf lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343272.605909:0:6524:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a1a9a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d93 expref: 290 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.605925:0:6524:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a1aaf lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.605956:0:6524:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a1a9a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d93 expref: 290 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.605971:0:6524:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a1a9a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d93 expref: 291 pid: 6524 timeout: 1165 lvb_type: 0 00000100:00100000:1.0:1763343272.605985:0:6524:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b54700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412935936:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343272.606071:0:6524:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd03c0 going to sleep for 11 seconds 00010000:00010000:1.0:1763343272.606704:0:19639:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1a7e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00010000:00010000:1.0:1763343272.606714:0:19639:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1a7e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00000040:00080000:1.0:1763343272.606947:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1643, 88 off137120 00000004:00080000:1.0:1763343272.606955:0:19639:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1065730930259ns, next at 1066683237775ns, rc = 0 00000040:00080000:1.0:1763343272.607139:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1651, 88 off137816 00000004:00080000:1.0:1763343272.607145:0:19639:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1065731120569ns, next at 1066683090291ns, rc = 0 00000040:00080000:1.0:1763343272.607166:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1652, 88 off137904 00000004:00080000:1.0:1763343272.607171:0:19639:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1065731146237ns, next at 1066683090291ns, rc = 0 00000040:00080000:1.0:1763343272.607182:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1644, 88 off137208 00000004:00080000:1.0:1763343272.607186:0:19639:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1065731161684ns, next at 1066683237775ns, rc = 0 00000100:00100000:3.0:1763343272.611430:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.611652:0:6524:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b54700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412935936:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343272.611694:0:6524:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a1aaf lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000100:00100000:0.0:1763343272.611733:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399754496 00000100:00100000:0.0:1763343272.611741:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399754496 00010000:00010000:0.0:1763343272.611953:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a1a9a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d93 expref: 291 pid: 6524 timeout: 1165 lvb_type: 0 00000100:00100000:0.0:1763343272.612268:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3365 00000100:00100000:0.0:1763343272.612285:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:2409:x1848998399754496:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343272.612299:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343272.612316:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a1a9a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d93 expref: 291 pid: 6524 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343272.612331:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a1a9a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d93 expref: 291 pid: 6524 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343272.612353:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a1a9a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d93 expref: 291 pid: 6524 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343272.612368:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ee:0x0].0x0 (ffff9400ccadbd00) 00010000:00010000:0.0:1763343272.612373:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a1aaf lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.612382:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a1aaf lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.612390:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a1aaf lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.612426:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343272.612435:0:6524:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a1aaf lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.612445:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a1aaf lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:1.0:1763343272.612472:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ee:0x0]: returning size 0 00000100:00100000:0.0:1763343272.612480:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:2409:x1848998399754496:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 195us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.612489:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3365 00000004:00080000:1.0:1763343272.612919:0:6524:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2a0:0x0], index 0: 0 00000004:00080000:1.0:1763343272.612929:0:6524:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2a1:0x0], index 1: 0 00000004:00080000:1.0:1763343272.612934:0:6524:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2a2:0x0], index 1: 0 00000004:00080000:1.0:1763343272.612939:0:6524:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2a1:0x0], index 0: 0 00010000:00010000:1.0:1763343272.613095:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a1aaf lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.613105:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a1aaf lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.613112:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a1aaf lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.613118:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c7ec0600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.613123:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a1aaf lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.613131:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a1aaf lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.613142:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ee:0x0].0x0 (ffff9400ccadbd00) 00010000:00010000:1.0:1763343272.613146:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343272.613150:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a1aaf lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.613160:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a1aaf lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.613208:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a1aa8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d9a expref: 290 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.613218:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ee:0x0].0x0 (ffff9400ccadbd00) 00010000:00010000:1.0:1763343272.613220:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343272.613224:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a1aa8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d9a expref: 290 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.613238:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c7ec0c00, rc 0) 00000100:00100000:1.0:1763343272.613278:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57087:x1848998399754368:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 7523us (7684us total) trans 4294973379 rc 301/301 00000100:00100000:1.0:1763343272.613286:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10388 00000001:00080000:3.0:1763343272.614515:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973378 is committed 00000004:00080000:3.0:1763343272.614524:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1053 committed 00000004:00080000:3.0:1763343272.614537:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1061 committed 00000004:00080000:3.0:1763343272.614549:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1060 committed 00000004:00080000:3.0:1763343272.614551:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1052 committed 00000004:00080000:3.0:1763343272.614560:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1051 committed 00000004:00080000:3.0:1763343272.614562:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1059 committed 00000100:00100000:0.0:1763343272.616326:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412937088:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343272.616362:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343272.616380:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763343272.616386:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6e8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412936960:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343272.616406:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343272.616428:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412937088 00000100:00100000:0.0:1763343272.616432:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412937088 00000100:00100000:0.0:1763343272.616457:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412936960 00000100:00100000:0.0:1763343272.616460:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412936960 00000100:00100000:0.0:1763343272.616476:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7016 00000100:00100000:0.0:1763343272.616482:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3660:x1848998412937088:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1763343272.616560:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x29e:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763343272.616564:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x29e:0x0] updating lvb mtime from disk: 1763343271 -> 1763343271 00002000:00010000:0.0:1763343272.616566:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x29e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343272.616568:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x29e:0x0] updating lvb ctime from disk: 1763343271 -> 1763343271 00002000:00010000:0.0:1763343272.616571:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x29e:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763343272.616596:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3660:x1848998412937088:12345-0@lo:2:osp-syn-1-1.0 Request processed in 115us (234us total) trans 17179871825 rc 0/0 00000100:00100000:0.0:1763343272.616602:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7016 00000100:00100000:0.0:1763343272.616614:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7017 00000100:00100000:0.0:1763343272.616619:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3660:x1848998412936960:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1763343272.616657:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x29d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343272.616659:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x29d:0x0] updating lvb mtime from disk: 1763343271 -> 1763343271 00002000:00010000:0.0:1763343272.616661:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x29d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343272.616663:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x29d:0x0] updating lvb ctime from disk: 1763343271 -> 1763343271 00002000:00010000:0.0:1763343272.616665:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x29d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343272.616685:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3660:x1848998412936960:12345-0@lo:2:osp-syn-1-1.0 Request processed in 66us (278us total) trans 17179871826 rc 0/0 00000100:00100000:0.0:1763343272.616694:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7017 00000100:00100000:0.0:1763343272.616723:0:3660:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179871821 gen 2 00000004:00080000:0.0:1763343272.616736:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5950380, transno 17179871778 00000004:00080000:0.0:1763343272.616743:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5951500, transno 17179871779 00000004:00080000:0.0:1763343272.616746:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5953100, transno 17179871780 00000004:00080000:0.0:1763343272.616749:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5951c00, transno 17179871781 00000004:00080000:0.0:1763343272.616752:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400cc5dce00, transno 17179871782 00000004:00080000:0.0:1763343272.616754:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400cc5dd500, transno 17179871783 00000004:00080000:0.0:1763343272.616757:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5178000, transno 17179871785 00000004:00080000:0.0:1763343272.616760:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5179c00, transno 17179871786 00000004:00080000:0.0:1763343272.616763:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c3728380, transno 17179871787 00000004:00080000:0.0:1763343272.616765:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c372b100, transno 17179871788 00000004:00080000:0.0:1763343272.616768:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c3728e00, transno 17179871789 00000004:00080000:0.0:1763343272.616771:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c3728700, transno 17179871790 00000004:00080000:0.0:1763343272.616773:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c4b20380, transno 17179871792 00000004:00080000:0.0:1763343272.616775:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c4b20000, transno 17179871793 00000004:00080000:0.0:1763343272.616778:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c4b22680, transno 17179871794 00000004:00080000:0.0:1763343272.616781:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c4b23800, transno 17179871795 00000004:00080000:0.0:1763343272.616784:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c390d180, transno 17179871797 00000004:00080000:0.0:1763343272.616786:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c390fb80, transno 17179871798 00000004:00080000:0.0:1763343272.616789:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c59b7100, transno 17179871799 00000004:00080000:0.0:1763343272.616791:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c59b5f80, transno 17179871800 00000004:00080000:0.0:1763343272.616794:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c7ef7480, transno 17179871803 00000004:00080000:0.0:1763343272.616796:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c7ef5880, transno 17179871804 00000004:00080000:0.0:1763343272.616799:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c7ef6300, transno 17179871805 00000004:00080000:0.0:1763343272.616801:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c7ef7b80, transno 17179871806 00000004:00080000:0.0:1763343272.616804:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5954a80, transno 17179871808 00000004:00080000:0.0:1763343272.616807:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5956a00, transno 17179871809 00000004:00080000:0.0:1763343272.616810:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5956d80, transno 17179871810 00000004:00080000:0.0:1763343272.616812:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5954e00, transno 17179871811 00000004:00080000:0.0:1763343272.616815:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b9d500, transno 17179871813 00000004:00080000:0.0:1763343272.616818:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9832300, transno 17179871814 00000004:00080000:0.0:1763343272.616820:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5dcb480, transno 17179871815 00000004:00080000:0.0:1763343272.616823:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5953b80, transno 17179871816 00000004:00080000:0.0:1763343272.616825:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b9f480, transno 17179871818 00000004:00080000:0.0:1763343272.616827:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b9ce00, transno 17179871819 00000004:00080000:0.0:1763343272.616829:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c511ed80, transno 17179871820 00000004:00080000:0.0:1763343272.616832:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c511fb80, transno 17179871821 00000100:00100000:0.0:1763343272.616837:0:3660:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9400c6e8fb80 x1848998412936960/t17179871826(17179871826) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763343288 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1763343272.616846:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6e8fb80/2, rc 0, transno 17179871826 00000100:00100000:0.0:1763343272.616850:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6e8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412936960:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763343272.616861:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bfd880/2, rc 0, transno 17179871825 00000100:00100000:0.0:1763343272.616865:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412937088:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763343272.617065:0:9930:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 4 in progress, 2 in flight, 36 done 00010000:00010000:1.0:1763343272.617164:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a1a00 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.617174:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a1a00 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.617180:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a1a00 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.617186:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c1661c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.617191:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a1a00 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.617198:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a1a00 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.617219:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadba00) 00010000:00010000:1.0:1763343272.617222:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.617227:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a1a00 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.617233:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a1a00 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.617250:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a1a15 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.617256:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a1a15 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.617262:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a1a15 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.617267:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a7e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.617283:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a1a15 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.617289:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a1a15 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.617297:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:1.0:1763343272.617300:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.617315:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a1a15 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.617321:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a1a15 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.617332:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1a62 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.617338:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1a62 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.617343:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1a62 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.617348:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121e200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.617351:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1a62 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.617356:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1a62 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.617364:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:1.0:1763343272.617366:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.617368:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1a62 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.617373:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1a62 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.617385:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a93 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.617389:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a93 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.617394:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a93 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.617398:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a6800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.617402:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a93 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.617408:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a93 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.617415:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadba00) 00010000:00010000:1.0:1763343272.617418:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.617421:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a93 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.617426:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1a93 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000004:00010000:1.0:1763343272.617485:0:19639:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004d97af37 reply state 000000008c2bda71 transno 4294973378 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1a7e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00010000:00010000:1.0:1763343272.617499:0:19639:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1a7e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19639 initiator: MDT1 00010000:00010000:1.0:1763343272.617507:0:19639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:1.0:1763343272.617510:0:19639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1763343272.617512:0:19639:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343272.617519:0:19639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:1.0:1763343272.617521:0:19639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763343272.617528:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a18a2 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ce4 expref: 278 pid: 6524 timeout: 0 lvb_type: 0 00010000:00080000:1.0:1763343272.617621:0:19639:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763343272.617635:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:57083:x1848998399753728:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 19274us (20031us total) trans 4294973378 rc 0/0 00000100:00100000:1.0:1763343272.617643:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3661 00010000:00010000:1.0:1763343272.617663:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1a7e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19639 initiator: MDT1 00010000:00010000:1.0:1763343272.617671:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1a7e lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19639 initiator: MDT1 00010000:00010000:1.0:1763343272.617677:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1a7e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19639 initiator: MDT1 00010000:00010000:1.0:1763343272.617682:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3b4b600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.617685:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1a7e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19639 initiator: MDT1 00010000:00010000:1.0:1763343272.617691:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1a7e lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19639 initiator: MDT1 00010000:00010000:1.0:1763343272.617699:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:1.0:1763343272.617702:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343272.617704:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1a7e lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19639 initiator: MDT1 00010000:00010000:1.0:1763343272.617710:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1a7e lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19639 initiator: MDT1 00000100:00100000:3.0:1763343272.618148:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6e8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412936704:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343272.618198:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343272.618227:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343272.618233:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6e8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412936832:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343272.618250:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343272.618354:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412936704 00000100:00100000:0.0:1763343272.618362:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412936704 00000100:00100000:0.0:1763343272.618391:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412936832 00000100:00100000:0.0:1763343272.618393:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412936832 00000100:00100000:0.0:1763343272.618413:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7018 00000100:00100000:0.0:1763343272.618422:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+8:3661:x1848998412936704:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763343272.618450:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:671 count 1 00010000:00010000:0.0:1763343272.618476:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1acb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.618496:0:35266:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a19b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d4d expref: 14 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.618504:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343272.618507:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343272.618511:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1acb lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.618540:0:35266:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a19b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d4d expref: 14 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.618554:0:35266:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a19b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d4d expref: 14 pid: 8626 timeout: 1165 lvb_type: 0 00000100:00100000:0.0:1763343272.618565:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412937216:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343272.618607:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc52780 going to sleep for 11 seconds 00000100:00100000:0.0:1763343272.618625:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7019 00000100:00100000:0.0:1763343272.618632:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+8:3661:x1848998412936832:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763343272.618645:0:8414:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:672 count 1 00002000:00010000:0.0:1763343272.618664:0:8414:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343272.618669:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1ad2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.618677:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.618679:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.618683:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1ad2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.618695:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1ad2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.618703:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1ad2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.618710:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1ad2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.618722:0:8414:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343272.618889:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+9:3661:x1848998412936832:12345-0@lo:6:osp-syn-1-1.0 Request processed in 258us (637us total) trans 17179871827 rc 0/0 00000100:00100000:0.0:1763343272.618895:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7019 00000100:00100000:0.0:1763343272.618942:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:1.0:1763343272.619441:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343272.619449:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1ad2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.619457:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121ea00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343272.619461:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1ad2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.619469:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1ad2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.619491:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1ad2 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.619498:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1ad2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.619514:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343272.619515:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343272.619517:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343272.619540:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399754752 00000100:00100000:1.0:1763343272.619545:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399754752 00000100:00100000:1.0:1763343272.619573:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3662 00000100:00100000:1.0:1763343272.619579:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+277:57087:x1848998399754752:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343272.619770:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:57087:x1848998399754752:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 191us (827us total) trans 4294973380 rc 0/0 00000100:00100000:1.0:1763343272.619777:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3662 00000004:00080000:3.0:1763343272.621935:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6e8d180/2, rc 0, transno 17179871827 00000100:00100000:3.0:1763343272.621949:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6e8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412936832:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343272.622903:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.622995:0:28561:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28561:1848998412936576:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343272.623048:0:28561:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a1ac4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343272.623091:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.623114:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399755136 00000100:00100000:0.0:1763343272.623121:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399755136 00010000:00010000:0.0:1763343272.623155:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a19ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d54 expref: 63 pid: 28562 timeout: 1165 lvb_type: 0 00000100:00100000:0.0:1763343272.623185:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3366 00000100:00100000:0.0:1763343272.623195:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8391c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+63:2407:x1848998399755136:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343272.623210:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343272.623217:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a19ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d54 expref: 63 pid: 28562 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343272.623231:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a19ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d54 expref: 63 pid: 28562 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343272.623254:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a19ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d54 expref: 63 pid: 28562 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343272.623268:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.623270:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.623275:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a1ac4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.623284:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a1ac4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.623317:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343272.623359:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8391c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+62:2407:x1848998399755136:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 165us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.623367:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3366 00010000:00010000:0.0:1763343272.623426:0:28561:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a1ac4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.623435:0:28561:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a1ac4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.623444:0:28561:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a1ac4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.623454:0:28561:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a1ac4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.623471:0:28561:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343272.623684:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+135:3662:x1848998412936064:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8234us (8866us total) trans 21474839100 rc 0/0 00000100:00100000:0.0:1763343272.623692:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7013 00010000:00010000:0.0:1763343272.623713:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343272.623719:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a1ac4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.623726:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5b3d200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343272.623731:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a1ac4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.623740:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a1ac4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.623752:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a1ac4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.623759:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a1ac4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.623774:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343272.623776:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343272.623779:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343272.624386:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399754880 00000100:00100000:1.0:1763343272.624392:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399754880 00000100:00100000:1.0:1763343272.624437:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10389 00000100:00100000:1.0:1763343272.624445:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+278:57083:x1848998399754880:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.624465:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.624483:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0000/0x9104b1ba770a1ad9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48da1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.624534:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0000/0x9104b1ba770a1ad9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48da1 expref: 279 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.624555:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0000/0x9104b1ba770a1ad9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48da1 expref: 279 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.624572:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1eb:0x0].0x0 (ffff9400c48a8100) 00010000:00010000:1.0:1763343272.624576:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343272.624579:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c7ec0000, rc 0) 00000100:00100000:1.0:1763343272.624608:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+279:57083:x1848998399754880:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 164us (1710us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343272.624614:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10389 00000100:00100000:3.0:1763343272.625163:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412937216:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343272.625184:0:35266:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1acb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343272.625500:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399755008 00000100:00100000:3.0:1763343272.625506:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399755008 00010000:00010000:3.0:1763343272.625528:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a19b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d4d expref: 15 pid: 8626 timeout: 1165 lvb_type: 0 00000100:00100000:3.0:1763343272.625563:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3367 00000100:00100000:3.0:1763343272.625571:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998399755008:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343272.625581:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343272.625586:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a19b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d4d expref: 15 pid: 8626 timeout: 1165 lvb_type: 0 00010000:00010000:3.0:1763343272.625597:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a19b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d4d expref: 15 pid: 8626 timeout: 1165 lvb_type: 0 00010000:00010000:3.0:1763343272.625616:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a19b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d4d expref: 15 pid: 8626 timeout: 1165 lvb_type: 0 00010000:00010000:3.0:1763343272.625629:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.625631:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.625635:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1acb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.625644:0:6511:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1acb lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.625665:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343272.625697:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399755008:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 127us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343272.625704:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3367 00010000:00010000:3.0:1763343272.625725:0:35266:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1acb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.625733:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1acb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.625743:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1acb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.625750:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1acb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.625764:0:35266:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343272.625968:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3661:x1848998412936704:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7546us (7768us total) trans 17179871828 rc 0/0 00000100:00100000:3.0:1763343272.625976:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7018 00000004:00080000:3.0:1763343272.626011:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6e8e680/2, rc 0, transno 17179871828 00000100:00100000:3.0:1763343272.626017:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6e8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412936704:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343272.628881:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399755392 00000100:00100000:1.0:1763343272.628891:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399755392 00000100:00100000:1.0:1763343272.629174:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3663 00000100:00100000:1.0:1763343272.629185:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+279:57087:x1848998399755392:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343272.629426:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57087:x1848998399755392:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 241us (686us total) trans 4294973381 rc 0/0 00000100:00100000:1.0:1763343272.629434:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3663 00000100:00100000:3.0:1763343272.629922:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.632514:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399755648 00000100:00100000:1.0:1763343272.632531:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399755648 00000100:00100000:1.0:1763343272.632596:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3664 00000100:00100000:1.0:1763343272.632607:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8444050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57083:x1848998399755648:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:1.0:1763343272.632851:0:6527:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1eb:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1763343272.632926:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1645, 64 off137272 00000040:00080000:1.0:1763343272.632949:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1653, 64 off137968 00000040:00080000:1.0:1763343272.632959:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1654, 64 off138032 00000040:00080000:1.0:1763343272.632968:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1646, 64 off137336 00010000:00010000:1.0:1763343272.633048:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a1ae0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343272.633065:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a1ae0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343272.633078:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a1ae0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343272.633087:0:6527:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a1ae0 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343272.633093:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a1ae0 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343272.633098:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a1ae0 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343272.633134:0:6527:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343272.633354:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8444050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57083:x1848998399755648:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 747us (3432us total) trans 4294973382 rc 0/0 00000100:00100000:1.0:1763343272.633364:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3664 00000100:00100000:0.0:1763343272.635499:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.641846:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.642142:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399756032 00000100:00100000:1.0:1763343272.642153:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399756032 00000100:00100000:1.0:1763343272.642205:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399756288 00000100:00100000:1.0:1763343272.642209:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399756288 00000100:00100000:1.0:1763343272.642235:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10391 00000100:00100000:1.0:1763343272.642245:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:55884:x1848998399756032:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343272.642268:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.642290:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a1b0a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48daf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.642340:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a1b11 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343272.642356:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a1b11 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.642368:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a1b11 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.642480:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a1b0a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48daf expref: 286 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.642500:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a1b11 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48daf expref: 285 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.642509:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ee:0x0].0x0 (ffff9400c48a8800) 00010000:00010000:1.0:1763343272.642512:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343272.642516:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c7ec1c00, rc 0) 00000100:00100000:1.0:1763343272.642572:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:55884:x1848998399756032:12345-192.168.201.40@tcp:101:bash.0 Request processed in 328us (2158us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343272.642580:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10391 00000100:00100000:1.0:1763343272.642600:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10392 00000100:00100000:1.0:1763343272.642615:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57083:x1848998399756288:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.642624:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.642633:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1b18 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48db6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.642693:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1b1f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343272.642702:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1b1f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.642710:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1b1f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:1.0:1763343272.642719:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ee:0x0]: returning size 0 00010000:00010000:1.0:1763343272.642809:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1b18 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48db6 expref: 287 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.642822:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1b1f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48db6 expref: 286 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.642829:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ee:0x0].0x0 (ffff9400c48a8800) 00010000:00010000:1.0:1763343272.642832:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1763343272.642834:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3b4b600, rc 0) 00000100:00100000:1.0:1763343272.642856:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57083:x1848998399756288:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 249us (1019us total) trans 4294973384 rc 0/0 00000100:00100000:1.0:1763343272.642862:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10392 00000100:00100000:0.0:1763343272.646629:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399756544 00000100:00100000:0.0:1763343272.646639:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399756544 00000100:00100000:0.0:1763343272.646690:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10393 00000100:00100000:0.0:1763343272.646699:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:55884:x1848998399756544:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:0.0:1763343272.646746:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343272.646771:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a1afc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48da8 expref: 286 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.646789:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ee:0x0].0x0 (ffff9400c48a8800) 00010000:00010000:0.0:1763343272.646794:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343272.646976:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a1b2d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343272.646990:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a1b2d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.647000:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a1b2d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000001:00080000:0.0:1763343272.647060:0:7641:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973385 00000004:00010000:0.0:1763343272.647090:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004945da3f reply state 00000000d1a26d02 transno 4294973386 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a1b2d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.647102:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a1b2d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.647109:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ee:0x0].0x0 (ffff9400c48a8800) 00010000:00010000:0.0:1763343272.647112:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343272.647114:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343272.647208:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:55884:x1848998399756544:12345-192.168.201.40@tcp:36:bash.0 Request processed in 509us (723us total) trans 4294973386 rc 0/0 00000100:00100000:0.0:1763343272.647216:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10393 00000020:00080000:0.0:1763343272.647222:0:7641:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343272.647972:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.648206:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399756672 00000100:00100000:0.0:1763343272.648213:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399756672 00000100:00100000:0.0:1763343272.648448:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10394 00000100:00100000:0.0:1763343272.648458:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57083:x1848998399756672:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343272.648474:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.648488:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1b34 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48dbd expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.648565:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1b3b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343272.648577:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1b3b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.648586:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1b3b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343272.648609:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ee:0x0]: returning size 0 00000004:00200000:0.0:1763343272.648613:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343272.648627:0:7641:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1b3b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.648648:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1b34 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dbd expref: 290 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.648664:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1b3b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dbd expref: 289 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.648677:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ee:0x0].0x0 (ffff9400c48a8800) 00010000:00010000:0.0:1763343272.648679:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343272.648682:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121ea00, rc 0) 00000100:00100000:0.0:1763343272.648734:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57083:x1848998399756672:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 278us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.648741:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10394 00000100:00100000:1.0:1763343272.653350:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.653440:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.653497:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399757056 00000100:00100000:0.0:1763343272.653507:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399757056 00000100:00100000:0.0:1763343272.653571:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10395 00000100:00100000:0.0:1763343272.653582:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:55884:x1848998399757056:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343272.653611:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.653614:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1763343272.653641:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1b1f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48db6 expref: 289 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.653662:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1b3b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dbd expref: 288 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.653674:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ee:0x0].0x0 (ffff9400c48a8800) 00010000:00010000:0.0:1763343272.653679:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343272.653692:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1b42 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48dcb expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.653742:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1b49 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00000100:00100000:3.0:1763343272.653744:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399756800 00000100:00100000:3.0:1763343272.653751:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399756800 00010000:00010000:0.0:1763343272.653759:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1b49 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.653772:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1b49 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343272.653794:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7020 00000100:00100000:3.0:1763343272.653803:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+62:2407:x1848998399756800:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343272.653812:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343272.653826:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1b50 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48dc4 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343272.653845:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343272.653859:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.653861:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.653871:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1b50 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dc4 expref: 63 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343272.653887:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1b50 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dc4 expref: 63 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343272.653899:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d1e9ea00, rc 0) 00000100:00100000:3.0:1763343272.653952:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+63:2407:x1848998399756800:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 151us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343272.653961:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7020 00000040:00080000:0.0:1763343272.653999:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1647, 88 off137424 00000004:00080000:0.0:1763343272.654007:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1065777982318ns, next at 1066683237775ns, rc = 0 00000040:00080000:0.0:1763343272.654066:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1655, 88 off138120 00000004:00080000:0.0:1763343272.654071:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1065778046634ns, next at 1066683090291ns, rc = 0 00000040:00080000:0.0:1763343272.654127:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1656, 88 off138208 00000004:00080000:0.0:1763343272.654132:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1065778107654ns, next at 1066683090291ns, rc = 0 00000040:00080000:0.0:1763343272.654152:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1648, 88 off137512 00000004:00080000:0.0:1763343272.654156:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1065778131779ns, next at 1066683237775ns, rc = 0 00000100:00100000:1.0:1763343272.656350:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.657496:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399757184 00000100:00100000:0.0:1763343272.657508:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399757184 00000100:00100000:0.0:1763343272.657563:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10396 00000100:00100000:0.0:1763343272.657573:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57083:x1848998399757184:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343272.657594:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.657618:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1b57 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48dd2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.657672:0:6524:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1b49 lrc: 2/0,1 mode: EX/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.657684:0:6524:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1b57 lrc: 4/0,0 mode: --/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dd2 expref: 291 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.657702:0:6524:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1b49 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343272.657721:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1b57 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dd2 expref: 291 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.657734:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ee:0x0].0x0 (ffff9400c48a8800) 00010000:00010000:0.0:1763343272.657738:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343272.657741:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1b57 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dd2 expref: 291 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.657749:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089600, rc 0) 00000100:00100000:0.0:1763343272.657805:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57083:x1848998399757184:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 234us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.657813:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10396 00010000:00010000:1.0:1763343272.660415:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a1b2d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.660426:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a1b2d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.660432:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a1b2d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.660438:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121e800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.660443:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a1b2d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.660452:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a1b2d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.660464:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ee:0x0].0x0 (ffff9400c48a8800) 00010000:00010000:1.0:1763343272.660468:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.660471:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a1b2d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.660477:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a1b2d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000100:00100000:0.0:1763343272.660776:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412937728:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343272.660813:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343272.660833:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763343272.660837:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412937856:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343272.660851:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343272.660878:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412937728 00000100:00100000:0.0:1763343272.660883:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412937728 00000100:00100000:0.0:1763343272.660915:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412937856 00000100:00100000:0.0:1763343272.660917:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412937856 00000100:00100000:0.0:1763343272.660935:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7021 00000100:00100000:0.0:1763343272.660941:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+10:3659:x1848998412937728:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343272.661109:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+11:3659:x1848998412937728:12345-0@lo:2:osp-syn-1-1.0 Request processed in 167us (295us total) trans 17179871829 rc 0/0 00000100:00100000:0.0:1763343272.661116:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7021 00000100:00100000:0.0:1763343272.661131:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7022 00000100:00100000:0.0:1763343272.661136:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+10:3659:x1848998412937856:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343272.661194:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+11:3659:x1848998412937856:12345-0@lo:2:osp-syn-1-1.0 Request processed in 58us (341us total) trans 17179871830 rc 0/0 00000100:00100000:0.0:1763343272.661199:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7022 00000004:00080000:0.0:1763343272.661232:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bfea00/2, rc 0, transno 17179871830 00000100:00100000:0.0:1763343272.661238:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412937856:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763343272.661245:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bfc700/2, rc 0, transno 17179871829 00000100:00100000:0.0:1763343272.661248:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412937728:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343272.661328:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412937600:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343272.661354:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343272.661371:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763343272.661376:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412937472:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343272.661394:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343272.661419:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412937600 00000100:00100000:1.0:1763343272.661423:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412937600 00000100:00100000:1.0:1763343272.661446:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412937472 00000100:00100000:1.0:1763343272.661449:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412937472 00000100:00100000:1.0:1763343272.661466:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7023 00000100:00100000:1.0:1763343272.661471:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+12:3662:x1848998412937600:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343272.661484:0:11289:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:670 count 1 00010000:00010000:1.0:1763343272.661501:0:11289:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1b5e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.661518:0:11289:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a1a1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d69 expref: 13 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.661530:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343272.661532:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343272.661536:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1b5e lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.661557:0:11289:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a1a1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d69 expref: 13 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.661569:0:11289:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a1a1c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d69 expref: 13 pid: 35266 timeout: 1165 lvb_type: 0 00000100:00100000:1.0:1763343272.661579:0:11289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11289:1848998412937984:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343272.661617:0:11289:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1763343272.661632:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7024 00000100:00100000:1.0:1763343272.661637:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+12:3662:x1848998412937472:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343272.661647:0:8414:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:669 count 1 00010000:00010000:1.0:1763343272.661657:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1b65 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x29d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.661667:0:8414:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a182b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cc1 expref: 13 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.661673:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343272.661675:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343272.661677:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1b65 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x29d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.661696:0:8414:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a182b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x29d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cc1 expref: 13 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.661704:0:8414:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a182b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x29d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48cc1 expref: 13 pid: 8626 timeout: 1165 lvb_type: 0 00000100:00100000:1.0:1763343272.661712:0:8414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b54e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8414:1848998412938112:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343272.661728:0:8414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1763343272.662123:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412938368:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343272.662147:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343272.662170:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763343272.662175:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412938240:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343272.662191:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343272.662674:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412938624:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343272.662700:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343272.663635:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763343272.663645:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412938496:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343272.663676:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343272.663693:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412938624 00000100:00100000:1.0:1763343272.663699:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412938624 00000100:00100000:1.0:1763343272.663739:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7027 00000100:00100000:1.0:1763343272.663747:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+137:3660:x1848998412938624:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343272.663899:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+138:3660:x1848998412938624:12345-0@lo:2:osp-syn-0-1.0 Request processed in 153us (1196us total) trans 21474839101 rc 0/0 00000100:00100000:1.0:1763343272.663907:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7027 00000004:00080000:0.0:1763343272.664410:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b24a80/2, rc 0, transno 21474839101 00000100:00100000:0.0:1763343272.664418:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412938624:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763343272.664699:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b27800/2, rc 0, transno 21474839102 00000100:00100000:0.0:1763343272.664704:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412938496:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343272.666449:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.666485:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.666585:0:8414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b54e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8414:1848998412938112:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343272.666609:0:8414:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1b65 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x29d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343272.666805:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3369 00000100:00100000:0.0:1763343272.666814:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2410:x1848998399757440:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343272.666823:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343272.666827:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a1a1c lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d69 expref: 14 pid: 35266 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343272.666836:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a1a1c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d69 expref: 14 pid: 35266 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343272.666848:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.666849:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.666852:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1b5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.666860:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1b5e lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.666872:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343272.666895:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2410:x1848998399757440:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 83us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.666902:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3369 00010000:00010000:0.0:1763343272.666924:0:8414:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1b65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.666932:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1b65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.666940:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1b65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.666952:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1b65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.666967:0:8414:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343272.667183:0:11289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a1a1c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d69 expref: 13 pid: 35266 timeout: 1165 lvb_type: 0 00000100:00100000:3.0:1763343272.667194:0:11289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11289:1848998412937984:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343272.667208:0:11289:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1b5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.667215:0:11289:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1b5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343272.667220:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+13:3662:x1848998412937472:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5581us (5823us total) trans 17179871831 rc 0/0 00010000:00010000:3.0:1763343272.667223:0:11289:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1b5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343272.667228:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7024 00010000:00010000:3.0:1763343272.667235:0:11289:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1b5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.667242:0:11289:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1b5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.667246:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343272.667251:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1b65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.667256:0:11289:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343272.667259:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a6800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343272.667263:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1b65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.667272:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1b65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.667284:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1b65 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.667291:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a1b65 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.667318:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343272.667322:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1b5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.667328:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3b4ba00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343272.667331:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1b5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.667337:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1b5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.667345:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1b5e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.667352:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1b5e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.667364:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343272.667365:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343272.667367:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343272.667452:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+13:3662:x1848998412937600:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5979us (6095us total) trans 17179871832 rc 0/0 00000100:00100000:3.0:1763343272.667459:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7023 00000004:00080000:1.0:1763343272.667523:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bfd500/2, rc 0, transno 17179871831 00000100:00100000:1.0:1763343272.667529:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412937472:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1763343272.667539:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bfe680/2, rc 0, transno 17179871832 00000100:00100000:1.0:1763343272.667543:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412937600:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343272.668251:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.668466:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.668493:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.668866:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399757824 00000100:00100000:0.0:1763343272.668874:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399757824 00000100:00100000:0.0:1763343272.669232:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3665 00000100:00100000:0.0:1763343272.669244:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57083:x1848998399757824:12345-192.168.201.40@tcp:49:lfs.0 00000100:00100000:3.0:1763343272.669314:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399757568 00000100:00100000:3.0:1763343272.669319:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399757568 00010000:00010000:3.0:1763343272.669340:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5088a00/0x9104b1ba770a1a23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d77 expref: 63 pid: 28562 timeout: 1165 lvb_type: 0 00000100:00100000:0.0:1763343272.669351:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57083:x1848998399757824:12345-192.168.201.40@tcp:49:lfs.0 Request processed in 110us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.669358:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3665 00000100:00100000:3.0:1763343272.669360:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399757696 00000100:00100000:3.0:1763343272.669362:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399757696 00010000:00010000:3.0:1763343272.669372:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089200/0x9104b1ba770a194a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d23 expref: 64 pid: 28562 timeout: 1165 lvb_type: 1 00010000:00010000:1.0:1763343272.669768:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343272.669774:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcd400/0x9104b1ba770a1b6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.669781:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3bcd400 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343272.669784:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcd400/0x9104b1ba770a1b6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.669792:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcd400/0x9104b1ba770a1b6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.669803:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcd400/0x9104b1ba770a1b6c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.669809:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcd400/0x9104b1ba770a1b6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.669823:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343272.669824:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343272.669826:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343272.669983:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b25880/2, rc 0, transno 21474839103 00000100:00100000:1.0:1763343272.669989:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412938368:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343272.670111:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3371 00000100:00100000:3.0:1763343272.670118:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+62:2409:x1848998399757696:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343272.670126:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343272.670130:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5089200/0x9104b1ba770a194a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d23 expref: 62 pid: 28562 timeout: 1165 lvb_type: 1 00010000:00010000:3.0:1763343272.670146:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5089200/0x9104b1ba770a194a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d23 expref: 62 pid: 28562 timeout: 1165 lvb_type: 1 00010000:00010000:3.0:1763343272.670159:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5089200/0x9104b1ba770a194a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x29c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48d23 expref: 62 pid: 28562 timeout: 1165 lvb_type: 1 00010000:00010000:3.0:1763343272.670168:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.670169:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.670172:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a1b73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.670182:0:6511:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a1b73 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.670322:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343272.670546:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+61:2409:x1848998399757696:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 427us (2078us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.670554:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3371 00010000:00010000:3.0:1763343272.670814:0:8412:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a1b73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.670824:0:8412:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a1b73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343272.670827:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:3.0:1763343272.670833:0:8412:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a1b73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.670840:0:8412:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a1b73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.670853:0:8412:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343272.670864:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343272.670869:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a1b73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.670876:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3bcca00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343272.670879:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a1b73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.670887:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a1b73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.670898:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a1b73 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.670905:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a1b73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.670932:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343272.670934:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343272.670936:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343272.671464:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+139:3662:x1848998412938240:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9014us (9268us total) trans 21474839104 rc 0/0 00000100:00100000:3.0:1763343272.671473:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7026 00000004:00080000:1.0:1763343272.671659:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b25f80/2, rc 0, transno 21474839104 00000100:00100000:1.0:1763343272.671666:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412938240:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343272.674092:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.674194:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399758208 00000100:00100000:3.0:1763343272.674205:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399758208 00000100:00100000:0.0:1763343272.674521:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.674886:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3667 00000100:00100000:3.0:1763343272.674896:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57083:x1848998399758208:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343272.675160:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57083:x1848998399758208:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 265us (1079us total) trans 4294973388 rc 0/0 00000100:00100000:3.0:1763343272.675168:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3667 00000100:00100000:1.0:1763343272.678605:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.678770:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399758720 00000100:00100000:3.0:1763343272.678778:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399758720 00010000:00010000:3.0:1763343272.678808:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1b50 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dc4 expref: 63 pid: 35266 timeout: 1165 lvb_type: 1 00000100:00100000:0.0:1763343272.678847:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.678894:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3372 00000100:00100000:3.0:1763343272.678904:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+62:2409:x1848998399758720:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343272.678919:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343272.678925:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1b50 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dc4 expref: 62 pid: 35266 timeout: 1165 lvb_type: 1 00010000:00010000:3.0:1763343272.678938:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1b50 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dc4 expref: 62 pid: 35266 timeout: 1165 lvb_type: 1 00010000:00010000:3.0:1763343272.678961:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1b50 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dc4 expref: 62 pid: 35266 timeout: 1165 lvb_type: 1 00010000:00010000:3.0:1763343272.679084:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.679086:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.679093:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcc200/0x9104b1ba770a1b7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dd9 expref: 61 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.679104:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcc200/0x9104b1ba770a1b7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dd9 expref: 61 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.679136:0:6510:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcc200/0x9104b1ba770a1b7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dd9 expref: 61 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343272.679149:0:6510:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b25180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6510:1848998412939136:192.168.201.40@tcp:105: 00000100:00100000:3.0:1763343272.679298:0:6510:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc440e40 going to sleep for 11 seconds 00000100:00100000:0.0:1763343272.681619:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.682668:0:6510:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b25180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6510:1848998412939136:192.168.201.40@tcp:105: 00010000:00010000:3.0:1763343272.682689:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343272.682720:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+61:2409:x1848998399758720:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 3818us (4127us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343272.682730:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3372 00000100:00100000:0.0:1763343272.683992:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.684126:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399759104 00000100:00100000:3.0:1763343272.684134:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399759104 00000100:00100000:3.0:1763343272.684179:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3668 00000100:00100000:3.0:1763343272.684189:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57083:x1848998399759104:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343272.684411:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57083:x1848998399759104:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 223us (423us total) trans 4294973390 rc 0/0 00000100:00100000:3.0:1763343272.684418:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3668 00000100:00100000:0.0:1763343272.685406:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.685505:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.685562:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399759232 00000100:00100000:3.0:1763343272.685568:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399759232 00002000:00010000:3.0:1763343272.685596:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/672 (0->18446744073709551615) 00002000:00100000:3.0:1763343272.685601:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6e8c000 with x1848998399759232 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343272.685612:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c6e8c000. 00000100:00100000:3.0:1763343272.685635:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399759360 00000100:00100000:3.0:1763343272.685639:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399759360 00002000:00010000:3.0:1763343272.685652:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/673 (0->18446744073709551615) 00002000:00100000:3.0:1763343272.685655:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6e8c700 with x1848998399759360 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343272.685661:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c6e8c700. 00000100:00100000:3.0:1763343272.685678:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1683 00000100:00100000:3.0:1763343272.685686:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+61:2408:x1848998399759232:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:3.0:1763343272.685832:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2a0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343272.685836:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2a0:0x0] updating lvb mtime from disk: 0 -> 1763343271 00002000:00010000:3.0:1763343272.685839:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2a0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343272.685841:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2a0:0x0] updating lvb ctime from disk: 0 -> 1763343271 00002000:00010000:3.0:1763343272.685843:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2a0:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343272.685880:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+62:2408:x1848998399759232:12345-192.168.201.40@tcp:10:bash.0 Request processed in 194us (612us total) trans 21474839105 rc 0/0 00000100:00100000:3.0:1763343272.685888:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1683 00002000:00010000:3.0:1763343272.685892:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/672 (0->18446744073709551615) 00002000:00100000:3.0:1763343272.685894:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6e8c000 with x1848998399759232 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343272.685898:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c6e8c000. 00000100:00100000:3.0:1763343272.685914:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1684 00000100:00100000:3.0:1763343272.685920:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2408:x1848998399759360:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:3.0:1763343272.686005:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2a1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343272.686008:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2a1:0x0] updating lvb mtime from disk: 0 -> 1763343271 00002000:00010000:3.0:1763343272.686010:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2a1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343272.686012:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2a1:0x0] updating lvb ctime from disk: 0 -> 1763343271 00002000:00010000:3.0:1763343272.686014:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2a1:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343272.686060:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399759360:12345-192.168.201.40@tcp:10:bash.0 Request processed in 139us (554us total) trans 17179871833 rc 0/0 00000100:00100000:3.0:1763343272.686067:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1684 00002000:00010000:3.0:1763343272.686070:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/673 (0->18446744073709551615) 00002000:00100000:3.0:1763343272.686073:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6e8c700 with x1848998399759360 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343272.686077:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c6e8c700. 00000100:00100000:0.0:1763343272.688926:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.691761:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.692887:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.692915:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.693183:0:32306:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399759744 00000100:00100000:1.0:1763343272.693190:0:32306:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399759744 00000100:00100000:1.0:1763343272.693235:0:32306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 146 00000100:00100000:1.0:1763343272.693244:0:32306:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3ad8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:115d5667-a2e7-4faf-8d77-45fb38721d60+9:2409:x1848998399759744:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:1.0:1763343272.693292:0:32306:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3ad8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:115d5667-a2e7-4faf-8d77-45fb38721d60+9:2409:x1848998399759744:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 49us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343272.693310:0:32306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 146 00000100:00080000:0.0:1763343272.694561:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1763343272.695262:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.695404:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399760256 00000100:00100000:3.0:1763343272.695410:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399760256 00000100:00100000:3.0:1763343272.695449:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3670 00000100:00100000:3.0:1763343272.695458:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57083:x1848998399760256:12345-192.168.201.40@tcp:35:lfs.0 00000004:00010000:3.0:1763343272.695515:0:19639:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x1ee:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a1bb2 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1ee:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dee expref: 286 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.695553:0:19639:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1bc0 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19639 initiator: MDT0 00010000:00010000:3.0:1763343272.695566:0:19639:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a1b11 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48daf expref: 286 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.695573:0:19639:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a1b96 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48de0 expref: 286 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.695582:0:19639:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1b49 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dcb expref: 286 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.695594:0:19639:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1b57 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dd2 expref: 286 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.695602:0:19639:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1bc0 lrc: 7/0,1 mode: --/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343272.695635:0:19639:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1b57 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dd2 expref: 286 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.695649:0:19639:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1b57 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dd2 expref: 286 pid: 6524 timeout: 1165 lvb_type: 0 00000100:00100000:3.0:1763343272.695663:0:19639:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b25180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998412939264:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343272.695745:0:19639:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1b49 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dcb expref: 286 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.695754:0:19639:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1b49 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dcb expref: 286 pid: 7641 timeout: 1165 lvb_type: 0 00000100:00100000:3.0:1763343272.695764:0:19639:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b26d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998412939392:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343272.695797:0:19639:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a1b96 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48de0 expref: 286 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.695805:0:19639:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a1b96 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48de0 expref: 286 pid: 7641 timeout: 1165 lvb_type: 0 00000100:00100000:3.0:1763343272.695814:0:19639:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5178000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998412939520:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343272.695846:0:19639:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a1b11 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48daf expref: 286 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.695855:0:19639:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a1b11 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48daf expref: 286 pid: 6524 timeout: 1165 lvb_type: 0 00000100:00100000:3.0:1763343272.695864:0:19639:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5179c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998412939648:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343272.695886:0:19639:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc440a80 going to sleep for 11 seconds 00010000:00010000:3.0:1763343272.698786:0:19639:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.40@tcp) returned -22 from blocking AST (req@00000000f03b6f41 x1848998412939264) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1b57 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dd2 expref: 286 pid: 6524 timeout: 1165 lvb_type: 0 00010000:00010000:3.0:1763343272.698812:0:19639:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1b57 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dd2 expref: 286 pid: 6524 timeout: 1165 lvb_type: 0 00010000:00010000:3.0:1763343272.698837:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1b57 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dd2 expref: 286 pid: 6524 timeout: 1165 lvb_type: 0 00000100:00100000:3.0:1763343272.698852:0:19639:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b25180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998412939264:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343272.698867:0:19639:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.40@tcp) returned -22 from blocking AST (req@00000000ac3313e7 x1848998412939392) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1b49 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dcb expref: 285 pid: 7641 timeout: 1165 lvb_type: 0 00010000:00010000:3.0:1763343272.698878:0:19639:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1b49 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dcb expref: 285 pid: 7641 timeout: 1165 lvb_type: 0 00010000:00010000:3.0:1763343272.698889:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1b49 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ee:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dcb expref: 285 pid: 7641 timeout: 1165 lvb_type: 0 00000100:00100000:3.0:1763343272.698904:0:19639:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b26d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998412939392:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343272.700800:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:3.0:1763343272.700886:0:19639:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.40@tcp) returned -22 from blocking AST (req@000000007fe570fd x1848998412939520) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a1b96 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48de0 expref: 284 pid: 7641 timeout: 1165 lvb_type: 0 00010000:00010000:3.0:1763343272.700904:0:19639:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a1b96 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48de0 expref: 284 pid: 7641 timeout: 1165 lvb_type: 0 00010000:00010000:3.0:1763343272.700923:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a1b96 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48de0 expref: 284 pid: 7641 timeout: 1165 lvb_type: 0 00000100:00100000:3.0:1763343272.700936:0:19639:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5178000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998412939520:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343272.701153:0:19639:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.40@tcp) returned -22 from blocking AST (req@00000000ce6e5da0 x1848998412939648) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a1b11 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48daf expref: 284 pid: 6524 timeout: 1165 lvb_type: 0 00010000:00010000:3.0:1763343272.701164:0:19639:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a1b11 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48daf expref: 284 pid: 6524 timeout: 1165 lvb_type: 0 00010000:00010000:3.0:1763343272.701175:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a1b11 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ee:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48daf expref: 284 pid: 6524 timeout: 1165 lvb_type: 0 00000100:00100000:3.0:1763343272.701184:0:19639:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5179c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998412939648:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343272.701218:0:19639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ee:0x0].0x0 (ffff9400c48a8800) 00010000:00010000:3.0:1763343272.701223:0:19639:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1bc0 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343272.701235:0:19639:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1bc0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343272.701241:0:19639:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1bc0 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343272.701258:0:19639:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1bc0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343272.701264:0:19639:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1bc0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343272.702721:0:19639:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1bc0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00000004:00020000:3.0:1763343272.702835:0:19639:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0001-mdtlov: can not set all stale mirrors for [0x240000404:0x1ee:0x0]: rc = -1 00010000:00010000:3.0:1763343272.702867:0:19639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1bc0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343272.702874:0:19639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1bc0 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343272.702881:0:19639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1bc0 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343272.702886:0:19639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343272.702890:0:19639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1bc0 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343272.702896:0:19639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1bc0 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343272.702907:0:19639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ee:0x0].0x0 (ffff9400c48a8800) 00010000:00010000:3.0:1763343272.702911:0:19639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1763343272.702914:0:19639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1bc0 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343272.702920:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1bc0 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1ee:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343272.702930:0:19639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ee:0x0].0x0 (ffff9400c48a8800) 00010000:00010000:3.0:1763343272.702932:0:19639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763343272.702938:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a1bb2 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1ee:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dee expref: 284 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343272.703090:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57083:x1848998399760256:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 7632us (7829us total) trans 4294973393 rc -1/-1 00000100:00100000:3.0:1763343272.703098:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3670 00000100:00100000:0.0:1763343272.709714:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.716402:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399760896 00000100:00100000:3.0:1763343272.716412:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399760896 00000100:00100000:0.0:1763343272.718852:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3671 00000100:00100000:0.0:1763343272.718878:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57083:x1848998399760896:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:0.0:1763343272.719197:0:6527:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1ee:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:1.0:1763343272.719649:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399761024 00000100:00100000:1.0:1763343272.719658:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399761024 00000040:00080000:0.0:1763343272.720056:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1649, 64 off137576 00000040:00080000:0.0:1763343272.720100:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1657, 64 off138272 00000040:00080000:0.0:1763343272.720113:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1658, 64 off138336 00000040:00080000:0.0:1763343272.720126:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1650, 64 off137640 00010000:00010000:0.0:1763343272.720200:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1be3 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343272.720219:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1be3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343272.720231:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1be3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343272.720239:0:6527:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1be3 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343272.720245:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1be3 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343272.720250:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1be3 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT1 00000100:00100000:1.0:1763343272.720441:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10401 00000100:00100000:1.0:1763343272.720453:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57089:x1848998399761024:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.720468:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.720487:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a1bea lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48dfc expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.720544:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a1bf1 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343272.720553:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a1bf1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.720561:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a1bf1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.720570:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1bf8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343272.720578:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1bf8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.720585:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1bf8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.720613:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a1bf1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.720620:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a1bf1 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.720626:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a1bf1 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.720631:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b98200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.720635:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a1bf1 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.720643:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a1bf1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.720654:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadba00) 00010000:00010000:1.0:1763343272.720657:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.720661:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a1bf1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.720667:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a1bf1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.720680:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1bf8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.720685:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1bf8 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.720692:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1bf8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.720697:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b99600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.720700:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1bf8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.720706:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1bf8 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.720713:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8200) 00010000:00010000:1.0:1763343272.720715:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.720718:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1bf8 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.720724:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1bf8 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.720749:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a1bea lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dfc expref: 288 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.720758:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadba00) 00010000:00010000:1.0:1763343272.720760:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.720764:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a1bea lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dfc expref: 288 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.720776:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c6b98000, rc 0) 00000100:00100000:1.0:1763343272.720841:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57089:x1848998399761024:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 391us (3851us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343272.720849:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10401 00010000:00010000:0.0:1763343272.720894:0:6527:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343272.721074:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57083:x1848998399760896:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 2208us (4908us total) trans 4294973394 rc 0/0 00000100:00100000:0.0:1763343272.721082:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3671 00010000:00010000:3.0:1763343272.723949:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343272.723963:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1be3 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343272.723974:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343272.723978:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1be3 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343272.723987:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1be3 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343272.724007:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ee:0x0].0x0 (ffff9400c48a8c00) 00010000:00010000:3.0:1763343272.724010:0:7451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343272.724016:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1be3 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343272.727153:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1be3 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343272.727175:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343272.727178:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343272.727181:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343272.727345:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.727419:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399761152 00000100:00100000:0.0:1763343272.727428:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399761152 00000100:00100000:0.0:1763343272.727496:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10402 00000100:00100000:0.0:1763343272.727506:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57089:x1848998399761152:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343272.727526:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.727548:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1bff lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48e03 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.727614:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1c06 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343272.727628:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1c06 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.727640:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1c06 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.727652:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1c0d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343272.727659:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1c0d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.727665:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1c0d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.727707:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1c06 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.727715:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1c06 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.727721:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1c06 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.727727:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343272.727731:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1c06 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.727739:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1c06 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.727751:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:0.0:1763343272.727754:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343272.727760:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1c06 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.727766:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1c06 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.727775:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1c0d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.727781:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1c0d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.727787:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1c0d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.727791:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343272.727794:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1c0d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.727804:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1c0d lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.727811:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8200) 00010000:00010000:0.0:1763343272.727814:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343272.727817:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1c0d lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.727822:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1c0d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.727847:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1bff lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e03 expref: 287 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.727857:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:0.0:1763343272.727860:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343272.727864:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1bff lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e03 expref: 287 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.727877:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5088800, rc 0) 00000100:00100000:0.0:1763343272.727942:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57089:x1848998399761152:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 436us (600us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343272.727950:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10402 00000100:00100000:0.0:1763343272.730696:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.731898:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399761280 00000100:00100000:3.0:1763343272.731910:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399761280 00000100:00100000:1.0:1763343272.737847:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.744207:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.748870:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.758871:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.758916:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.758947:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399762176 00000100:00100000:0.0:1763343272.758958:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399762176 00000100:00100000:0.0:1763343272.759015:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399762432 00000100:00100000:0.0:1763343272.759019:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399762432 00000100:00100000:0.0:1763343272.759065:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10407 00000100:00100000:0.0:1763343272.759076:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57089:x1848998399762176:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343272.759104:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.759126:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1c6f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48e26 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.759230:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1c76 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343272.759246:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1c61 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e1f expref: 291 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.759255:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1c76 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.759292:0:33856:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1c61 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e1f expref: 291 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.759600:0:33856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1c61 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e1f expref: 292 pid: 7641 timeout: 1165 lvb_type: 0 00000100:00100000:0.0:1763343272.759616:0:33856:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c7ef5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412939776:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343272.759763:0:33856:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc52780 going to sleep for 11 seconds 00000100:00100000:0.0:1763343272.765214:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.765401:0:33856:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c7ef5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412939776:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343272.765428:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1c76 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.766098:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1c76 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.766106:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1c76 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:0.0:1763343272.766130:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f0:0x0]: returning size 0 00000004:00080000:0.0:1763343272.766314:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2a3:0x0], index 1: 0 00000004:00080000:0.0:1763343272.766323:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2a2:0x0], index 0: 0 00000004:00080000:0.0:1763343272.766327:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2a3:0x0], index 0: 0 00000004:00080000:0.0:1763343272.766331:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2a4:0x0], index 1: 0 00010000:00010000:0.0:1763343272.766435:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1c76 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.766443:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1c76 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.766449:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1c76 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.766455:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343272.766469:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1c76 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.766477:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1c76 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.766486:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c48a8700) 00010000:00010000:0.0:1763343272.766489:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343272.766492:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1c76 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.766497:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1c76 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.766543:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1c6f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e26 expref: 291 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.766552:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c48a8700) 00010000:00010000:0.0:1763343272.766555:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343272.766558:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1c6f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e26 expref: 291 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.766570:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089000, rc 0) 00000100:00100000:0.0:1763343272.766613:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57089:x1848998399762176:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 7539us (7752us total) trans 4294973397 rc 301/301 00000100:00100000:0.0:1763343272.766620:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10407 00000100:00100000:3.0:1763343272.766860:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.769471:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.773689:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.775119:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399763328 00000100:00100000:0.0:1763343272.775133:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399763328 00000100:00100000:0.0:1763343272.775197:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10409 00000100:00100000:0.0:1763343272.775210:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57091:x1848998399763328:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343272.775410:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.775436:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1c99 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48e34 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.775519:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1ca0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343272.775532:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1ca0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.775543:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1ca0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.775554:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1ca7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343272.775562:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1ca7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.775568:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1ca7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.775684:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1cae lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343272.775692:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1cae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.775699:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1cae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:0.0:1763343272.775710:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f0:0x0]: returning size 0 00010000:00010000:0.0:1763343272.775792:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1ca0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.775799:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1ca0 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.775806:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1ca0 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.775812:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343272.775817:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1ca0 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.775823:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1ca0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.775835:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:0.0:1763343272.775838:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343272.775843:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1ca0 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.775848:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1ca0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.775866:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1ca7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.775872:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1ca7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.775877:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1ca7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.775881:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5088800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343272.775884:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1ca7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.775890:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1ca7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.775897:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8200) 00010000:00010000:0.0:1763343272.775900:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343272.775903:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1ca7 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.775908:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1ca7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.775943:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1c99 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e34 expref: 295 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.775963:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1cae lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e34 expref: 294 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.775969:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecd00) 00010000:00010000:0.0:1763343272.775972:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343272.775975:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089200, rc 0) 00000100:00100000:0.0:1763343272.776062:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57091:x1848998399763328:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 855us (2382us total) trans 4294973400 rc 0/0 00000100:00100000:0.0:1763343272.776072:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10409 00000100:00100000:3.0:1763343272.779835:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399763584 00000100:00100000:3.0:1763343272.779851:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399763584 00000100:00100000:3.0:1763343272.779927:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3674 00000100:00100000:3.0:1763343272.779938:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8447850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57089:x1848998399763584:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343272.780562:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8447850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57089:x1848998399763584:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 622us (5439us total) trans 4294973401 rc 0/0 00000100:00100000:0.0:1763343272.780575:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3674 00000100:00100000:1.0:1763343272.780636:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399763712 00000100:00100000:1.0:1763343272.780643:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399763712 00000100:00100000:1.0:1763343272.780682:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7031 00000100:00100000:1.0:1763343272.780691:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399763712:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.780702:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.780723:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a1cbc lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48e3b expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343272.780743:0:28562:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343272.780759:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343272.780762:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343272.780771:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a1cbc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e3b expref: 15 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343272.780786:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a1cbc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e3b expref: 15 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343272.780797:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fd2dea00, rc 0) 00000100:00100000:1.0:1763343272.780835:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998399763712:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 146us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343272.780842:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7031 00000100:00100000:3.0:1763343272.789108:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.789190:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399763968 00000100:00100000:0.0:1763343272.789202:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399763968 00000100:00100000:0.0:1763343272.789278:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10410 00000100:00100000:0.0:1763343272.789289:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:55884:x1848998399763968:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343272.789328:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.789331:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343272.789360:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1cae lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e34 expref: 295 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.789378:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecd00) 00010000:00010000:0.0:1763343272.789389:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343272.789404:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1cc3 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48e42 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.789514:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1cca lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343272.789526:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1cca lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1f0:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.789535:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1cca lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1f0:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:0.0:1763343272.789549:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f0:0x0]: returning size 0 00010000:00010000:0.0:1763343272.789657:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1cc3 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e42 expref: 297 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.789671:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1cca lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1f0:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e42 expref: 296 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.789678:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:0.0:1763343272.789681:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:0.0:1763343272.789684:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3b4ba00, rc 0) 00000100:00100000:0.0:1763343272.789754:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:55884:x1848998399763968:12345-192.168.201.40@tcp:101:bash.0 Request processed in 466us (657us total) trans 4294973402 rc 0/0 00000100:00100000:0.0:1763343272.789763:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10410 00000100:00100000:0.0:1763343272.791174:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.794797:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.794859:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399764224 00000100:00100000:0.0:1763343272.794870:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399764224 00000100:00100000:0.0:1763343272.794948:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10412 00000100:00100000:0.0:1763343272.794958:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:55884:x1848998399764224:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343272.794981:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.795003:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1cdf lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48e50 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.795060:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1ce6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343272.795074:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1ce6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.795090:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1ce6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.795199:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1cdf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e50 expref: 299 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.795218:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1ce6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e50 expref: 298 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.795227:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:0.0:1763343272.795230:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343272.795233:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5088800, rc 0) 00000100:00100000:3.0:1763343272.795292:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.795292:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:55884:x1848998399764224:12345-192.168.201.40@tcp:101:bash.0 Request processed in 335us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.795308:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10412 00000100:00100000:0.0:1763343272.795332:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399764480 00000100:00100000:0.0:1763343272.795335:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399764480 00000100:00100000:0.0:1763343272.795356:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3675 00000100:00100000:0.0:1763343272.795363:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57091:x1848998399764480:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343272.795507:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57091:x1848998399764480:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 143us (213us total) trans 4294973403 rc 0/0 00000100:00100000:0.0:1763343272.795515:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3675 00000100:00100000:3.0:1763343272.800119:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.800167:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.800561:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399764736 00000100:00100000:0.0:1763343272.800573:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399764736 00000100:00100000:0.0:1763343272.800636:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399764992 00000100:00100000:0.0:1763343272.800640:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399764992 00000100:00100000:0.0:1763343272.800667:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10413 00000100:00100000:0.0:1763343272.800677:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5179180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:55884:x1848998399764736:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:0.0:1763343272.800732:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343272.800761:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1cca lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1f0:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e42 expref: 300 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.800780:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:0.0:1763343272.800785:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343272.800967:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1cfb lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343272.800975:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1cfb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.800982:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1cfb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000001:00080000:0.0:1763343272.801057:0:33856:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973404 00000004:00010000:0.0:1763343272.801096:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009f53b3bf reply state 00000000d7504dcb transno 4294973405 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1cfb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.801107:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1cfb lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.801769:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:0.0:1763343272.801772:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343272.801776:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343272.801877:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5179180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:55884:x1848998399764736:12345-192.168.201.40@tcp:36:bash.0 Request processed in 1200us (1767us total) trans 4294973405 rc 0/0 00000100:00100000:0.0:1763343272.801947:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10413 00000020:00080000:0.0:1763343272.801952:0:33856:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343272.806906:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.809998:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.810526:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399765504 00000100:00100000:3.0:1763343272.810536:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399765504 00000100:00100000:1.0:1763343272.814389:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.814538:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399765632 00000100:00100000:3.0:1763343272.814548:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399765632 00000100:00100000:3.0:1763343272.814595:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3677 00000100:00100000:3.0:1763343272.814605:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57091:x1848998399765632:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:3.0:1763343272.814754:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57091:x1848998399765632:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 150us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343272.814761:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3677 00000100:00100000:0.0:1763343272.814936:0:6524:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412939904:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343272.814960:0:6524:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1d1e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000100:00100000:1.0:1763343272.815096:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.815160:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399765760 00000100:00100000:0.0:1763343272.815164:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399765760 00010000:00010000:0.0:1763343272.815183:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1d09 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e57 expref: 305 pid: 6524 timeout: 1165 lvb_type: 0 00000100:00100000:0.0:1763343272.815213:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3374 00000100:00100000:0.0:1763343272.815220:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6489c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:2408:x1848998399765760:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343272.815231:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343272.815237:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1d09 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e57 expref: 305 pid: 6524 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343272.815249:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1d09 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e57 expref: 305 pid: 6524 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343272.815371:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1d09 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e57 expref: 305 pid: 6524 timeout: 1165 lvb_type: 0 00010000:00010000:0.0:1763343272.815392:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:0.0:1763343272.815398:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1d1e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.815412:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1d1e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.815420:0:6511:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1d1e lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.815458:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343272.815497:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6489c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:2408:x1848998399765760:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 277us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.815504:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3374 00000001:00080000:0.0:1763343272.817908:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973408 is committed 00000004:00080000:0.0:1763343272.817923:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1065 committed 00000004:00080000:0.0:1763343272.817937:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1057 committed 00010000:00010000:1.0:1763343272.818019:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a1bce lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.818050:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a1bce lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.818057:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a1bce lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.818063:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85abe00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.818068:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a1bce lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.818076:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a1bce lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.818092:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8200) 00010000:00010000:1.0:1763343272.818095:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.818100:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a1bce lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.818107:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a1bce lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.818130:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1c5a lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.818135:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1c5a lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.818140:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1c5a lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.818145:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4515600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.818147:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1c5a lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.818152:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1c5a lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.818160:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8200) 00010000:00010000:1.0:1763343272.818162:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.818165:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1c5a lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.818170:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1c5a lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343272.818187:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1cfb lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.818193:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1cfb lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.818198:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1cfb lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.818206:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.818208:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1cfb lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.818213:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1cfb lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.818220:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:1.0:1763343272.818223:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.818226:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1cfb lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.818231:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a1cfb lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00080000:0.0:1763343272.818291:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1056 committed 00000100:00100000:3.0:1763343272.818678:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7033 00000100:00100000:3.0:1763343272.818686:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c511ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+14:3661:x1848998412940160:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763343272.818698:0:11289:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:674 count 1 00002000:00010000:3.0:1763343272.818719:0:11289:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343272.818725:0:11289:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a1d2c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.818733:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.818735:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.818739:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a1d2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.818751:0:11289:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a1d2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.818759:0:11289:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a1d2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.818766:0:11289:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a1d2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.818782:0:11289:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343272.818975:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c511ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+15:3661:x1848998412940160:12345-0@lo:6:osp-syn-1-1.0 Request processed in 289us (579us total) trans 17179871834 rc 0/0 00000100:00100000:3.0:1763343272.818982:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7033 00000100:00100000:3.0:1763343272.818999:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7035 00000100:00100000:3.0:1763343272.819006:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c511c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+141:3662:x1848998412940544:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343272.819016:0:11289:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:672 count 1 00010000:00010000:3.0:1763343272.819057:0:11289:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a1d3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.819069:0:11289:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcc200/0x9104b1ba770a1b7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dd9 expref: 61 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.819076:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343272.819077:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343272.819080:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a1d3a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.819099:0:11289:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcc200/0x9104b1ba770a1b7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dd9 expref: 61 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.819109:0:11289:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcc200/0x9104b1ba770a1b7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48dd9 expref: 61 pid: 8412 timeout: 1165 lvb_type: 0 00000100:00100000:3.0:1763343272.819120:0:11289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b25180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11289:1848998412941184:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343272.819148:0:11289:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc440840 going to sleep for 11 seconds 00000004:00080000:3.0:1763343272.819176:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c390ce00/2, rc 0, transno 17179871834 00000100:00100000:3.0:1763343272.819181:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412940160:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1763343272.819218:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c517b800/2, rc 0, transno 21474839106 00000100:00100000:3.0:1763343272.819223:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c517b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412940800:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1763343272.819902:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1064 committed 00000100:00100000:0.0:1763343272.819977:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412940288:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343272.820010:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343272.820052:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412940928:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343272.820071:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343272.820093:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1763343272.820099:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412940416:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343272.820117:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343272.820132:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412941056:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343272.820149:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343272.820179:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412940288 00000100:00100000:0.0:1763343272.820184:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412940288 00000100:00100000:0.0:1763343272.820211:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412940928 00000100:00100000:0.0:1763343272.820214:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412940928 00000100:00100000:0.0:1763343272.820230:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412940416 00000100:00100000:0.0:1763343272.820232:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412940416 00000100:00100000:0.0:1763343272.820245:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412941056 00000100:00100000:0.0:1763343272.820248:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412941056 00000100:00100000:0.0:1763343272.820259:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7036 00000100:00100000:0.0:1763343272.820265:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+16:3659:x1848998412940288:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1763343272.820409:0:8414:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2a3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343272.820413:0:8414:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2a3:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343272.820414:0:8414:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2a3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343272.820416:0:8414:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2a3:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343272.820418:0:8414:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2a3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343272.820450:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+17:3659:x1848998412940288:12345-0@lo:2:osp-syn-1-1.0 Request processed in 184us (439us total) trans 17179871835 rc 0/0 00000100:00100000:0.0:1763343272.820457:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7036 00000100:00100000:0.0:1763343272.820471:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7037 00000100:00100000:0.0:1763343272.820478:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+142:3659:x1848998412940928:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343272.820556:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+143:3659:x1848998412940928:12345-0@lo:2:osp-syn-0-1.0 Request processed in 79us (482us total) trans 21474839107 rc 0/0 00000100:00100000:0.0:1763343272.820561:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7037 00000100:00100000:0.0:1763343272.820574:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7038 00000100:00100000:0.0:1763343272.820580:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+16:3659:x1848998412940416:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343272.820645:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+17:3659:x1848998412940416:12345-0@lo:2:osp-syn-1-1.0 Request processed in 65us (526us total) trans 17179871836 rc 0/0 00000100:00100000:0.0:1763343272.820651:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7038 00000100:00100000:0.0:1763343272.820662:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7039 00000100:00100000:0.0:1763343272.820667:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+142:3659:x1848998412941056:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343272.820727:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+143:3659:x1848998412941056:12345-0@lo:2:osp-syn-0-1.0 Request processed in 59us (577us total) trans 21474839108 rc 0/0 00000100:00100000:0.0:1763343272.820733:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7039 00010000:00010000:0.0:1763343272.820752:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343272.820780:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bfce00/2, rc 0, transno 17179871836 00000100:00100000:0.0:1763343272.820786:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412940416:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763343272.820795:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b26d80/2, rc 0, transno 21474839108 00000100:00100000:0.0:1763343272.820798:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412941056:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763343272.820804:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bfc000/2, rc 0, transno 17179871835 00000100:00100000:0.0:1763343272.820807:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412940288:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763343272.820814:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5179c00/2, rc 0, transno 21474839107 00000100:00100000:0.0:1763343272.820816:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412940928:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1763343272.821068:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1d1e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f0:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e5e expref: 281 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.821079:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:1.0:1763343272.821083:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343272.821098:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1d17 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e5e expref: 281 pid: 6524 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343272.821115:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1d1e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f0:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e5e expref: 280 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.821141:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:1.0:1763343272.821144:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343272.821146:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4514400, rc 0) 00000100:00100000:1.0:1763343272.821189:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:55884:x1848998399765248:12345-192.168.201.40@tcp:101:bash.0 Request processed in 13238us (14292us total) trans 4294973408 rc 0/0 00000100:00100000:1.0:1763343272.821196:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10415 00000100:00100000:1.0:1763343272.824784:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.824848:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.824919:0:11289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b25180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11289:1848998412941184:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343272.824934:0:11289:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a1d3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343272.825657:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.825705:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399766144 00000100:00100000:3.0:1763343272.825710:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399766144 00000100:00100000:3.0:1763343272.825750:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7040 00000100:00100000:3.0:1763343272.825758:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f648b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:55884:x1848998399766144:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343272.825772:0:8413:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343272.825788:0:8413:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1d41 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48e65 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.825809:0:8413:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a1cbc lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e3b expref: 15 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343272.825816:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.825817:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.825821:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1d41 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e65 expref: 15 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.825849:0:8413:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a1cbc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e3b expref: 15 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343272.825862:0:8413:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a1cbc lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e3b expref: 15 pid: 28562 timeout: 1165 lvb_type: 1 00000100:00100000:3.0:1763343272.825877:0:8413:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b25180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8413:1848998412941312:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343272.825926:0:8413:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc440840 going to sleep for 11 seconds 00010000:00010000:3.0:1763343272.826158:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343272.826164:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c3bcca00/0x9104b1ba770a1d25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.826172:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3bcca00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343272.826176:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c3bcca00/0x9104b1ba770a1d25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.826184:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c3bcca00/0x9104b1ba770a1d25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.826196:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c3bcca00/0x9104b1ba770a1d25 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.826203:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c3bcca00/0x9104b1ba770a1d25 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.826217:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343272.826219:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343272.826221:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343272.826490:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c390fb80/2, rc 0, transno 17179871837 00000100:00100000:3.0:1763343272.826497:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412940032:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1763343272.826648:0:11289:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a1d3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.826657:0:11289:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a1d3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.826666:0:11289:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a1d3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.826673:0:11289:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a1d3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.826692:0:11289:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343272.826841:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c511c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+143:3662:x1848998412940544:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7835us (8054us total) trans 21474839109 rc 0/0 00000100:00100000:1.0:1763343272.826849:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7035 00000004:00080000:3.0:1763343272.827282:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c517a680/2, rc 0, transno 21474839109 00000100:00100000:3.0:1763343272.827288:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c517a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412940544:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343272.827778:0:8413:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b25180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8413:1848998412941312:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343272.827804:0:8413:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1d41 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e65 expref: 15 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.827821:0:8413:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d1e9ea00, rc 0) 00000100:00100000:3.0:1763343272.828278:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f648b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:55884:x1848998399766144:12345-192.168.201.40@tcp:101:bash.0 Request processed in 2518us (2618us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343272.828286:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7040 00000100:00100000:3.0:1763343272.829507:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.829878:0:14179:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412941440 00000100:00100000:1.0:1763343272.829901:0:14179:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412941440 00000100:00100000:1.0:1763343272.829944:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:1.0:1763343272.829953:0:14179:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c511fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+17:3661:x1848998412941440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1763343272.829976:0:14179:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 28672 granted 484925888 pending 0 free 3920220160 avail 3688640512 00000100:00100000:1.0:1763343272.830047:0:14179:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c511fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+17:3661:x1848998412941440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343272.830055:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00000100:00100000:3.0:1763343272.833067:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.833107:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399766528 00000100:00100000:1.0:1763343272.833120:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399766528 00000100:00100000:1.0:1763343272.833187:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10416 00000100:00100000:1.0:1763343272.833198:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57092:x1848998399766528:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.833225:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.833249:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a1d48 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48e6c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.833946:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a1d4f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343272.833962:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a1d4f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.833974:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a1d4f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.833987:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a1d56 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343272.833994:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a1d56 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00000100:00100000:3.0:1763343272.834000:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:1.0:1763343272.834001:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a1d56 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.834133:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1d5d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343272.834143:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1d5d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.834155:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1d5d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:1.0:1763343272.834166:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f0:0x0]: returning size 2 00010000:00010000:1.0:1763343272.834261:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a1d4f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000100:00100000:0.0:1763343272.834364:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399766656 00000100:00100000:0.0:1763343272.834371:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399766656 00000100:00100000:0.0:1763343272.834408:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7041 00000100:00100000:0.0:1763343272.834416:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+61:55884:x1848998399766656:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343272.834427:0:8413:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.834440:0:8413:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5089600/0x9104b1ba770a1d6b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48e73 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343272.834461:0:8413:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343272.834476:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.834479:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.834486:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089600/0x9104b1ba770a1d6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e73 expref: 62 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.834500:0:8413:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5089600/0x9104b1ba770a1d6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e73 expref: 62 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.834512:0:8413:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089600, rc 0) 00000100:00100000:0.0:1763343272.834566:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+62:55884:x1848998399766656:12345-192.168.201.40@tcp:101:bash.0 Request processed in 150us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.834574:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7041 00010000:00010000:1.0:1763343272.835813:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a1d4f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.835825:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a1d4f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.835832:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a1d4f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.835839:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fd2df600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.835843:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a1d4f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.835850:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a1d4f lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.835865:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401c85cc400) 00010000:00010000:1.0:1763343272.835868:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.835872:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a1d4f lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.835878:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a1d4f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.835892:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a1d56 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.835902:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a1d56 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.835907:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a1d56 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.835910:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b98000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.835913:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a1d56 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.835917:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a1d56 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.835924:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401c85cc600) 00010000:00010000:1.0:1763343272.835927:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.835929:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a1d56 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.835940:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a1d56 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.835992:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a1d48 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e6c expref: 283 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.836007:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1d5d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e6c expref: 282 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.836013:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:1.0:1763343272.836015:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343272.836018:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c6b99600, rc 0) 00000100:00100000:1.0:1763343272.836077:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57092:x1848998399766528:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2881us (3054us total) trans 4294973409 rc 0/0 00000100:00100000:1.0:1763343272.836085:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10416 00000100:00100000:0.0:1763343272.837879:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399766912 00000100:00100000:0.0:1763343272.837889:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399766912 00002000:00010000:0.0:1763343272.837930:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/674 (0->18446744073709551615) 00002000:00100000:0.0:1763343272.837935:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c511d880 with x1848998399766912 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343272.837946:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c511d880. 00000100:00100000:0.0:1763343272.837975:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399766784 00000100:00100000:0.0:1763343272.837979:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399766784 00002000:00010000:0.0:1763343272.837990:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/675 (0->18446744073709551615) 00002000:00100000:0.0:1763343272.837993:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c511dc00 with x1848998399766784 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343272.837999:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c511dc00. 00000100:00100000:0.0:1763343272.838055:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1685 00000100:00100000:0.0:1763343272.838066:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c511d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+62:2408:x1848998399766912:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:0.0:1763343272.838262:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2a2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343272.838266:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2a2:0x0] updating lvb mtime from disk: 0 -> 1763343272 00002000:00010000:0.0:1763343272.838281:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2a2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343272.838283:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2a2:0x0] updating lvb ctime from disk: 0 -> 1763343272 00002000:00010000:0.0:1763343272.838285:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2a2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343272.838346:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c511d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+63:2408:x1848998399766912:12345-192.168.201.40@tcp:10:bash.0 Request processed in 282us (861us total) trans 21474839110 rc 0/0 00000100:00100000:0.0:1763343272.838354:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1685 00002000:00010000:0.0:1763343272.838358:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/674 (0->18446744073709551615) 00002000:00100000:0.0:1763343272.838361:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c511d880 with x1848998399766912 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343272.838365:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c511d880. 00000100:00100000:0.0:1763343272.838381:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1686 00000100:00100000:0.0:1763343272.838388:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c511dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399766784:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:0.0:1763343272.838472:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2a3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343272.838475:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2a3:0x0] updating lvb mtime from disk: 0 -> 1763343272 00002000:00010000:0.0:1763343272.838477:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2a3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343272.838480:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2a3:0x0] updating lvb ctime from disk: 0 -> 1763343272 00002000:00010000:0.0:1763343272.838482:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2a3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343272.838506:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c511dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998399766784:12345-192.168.201.40@tcp:10:bash.0 Request processed in 117us (970us total) trans 17179871838 rc 0/0 00000100:00100000:0.0:1763343272.838512:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1686 00002000:00010000:0.0:1763343272.838516:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/675 (0->18446744073709551615) 00002000:00100000:0.0:1763343272.838518:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c511dc00 with x1848998399766784 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343272.838522:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c511dc00. 00000100:00100000:3.0:1763343272.839918:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.844815:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399767424 00000100:00100000:0.0:1763343272.844826:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399767424 00000100:00100000:0.0:1763343272.844882:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3679 00000100:00100000:0.0:1763343272.844892:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:55884:x1848998399767424:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:0.0:1763343272.845228:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:55884:x1848998399767424:12345-192.168.201.40@tcp:35:bash.0 Request processed in 336us (496us total) trans 4294973411 rc 0/0 00000100:00100000:0.0:1763343272.845236:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3679 00000100:00100000:1.0:1763343272.849323:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.856510:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.856599:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.856630:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399767808 00000100:00100000:3.0:1763343272.856637:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399767808 00010000:00010000:3.0:1763343272.856678:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1d5d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e6c expref: 286 pid: 6524 timeout: 1165 lvb_type: 0 00000100:00100000:3.0:1763343272.856721:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3378 00000100:00100000:3.0:1763343272.856733:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6489500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:2407:x1848998399767808:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343272.856748:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343272.856754:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1d5d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e6c expref: 286 pid: 6524 timeout: 1165 lvb_type: 0 00010000:00010000:3.0:1763343272.856766:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1d5d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e6c expref: 286 pid: 6524 timeout: 1165 lvb_type: 0 00010000:00010000:3.0:1763343272.856791:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1d5d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e6c expref: 286 pid: 6524 timeout: 1165 lvb_type: 0 00010000:00010000:3.0:1763343272.856809:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:3.0:1763343272.856814:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1d79 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1f0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343272.856824:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1d79 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1f0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343272.856832:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1d79 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x1f0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT1 00000100:00100000:0.0:1763343272.856933:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399767936 00000100:00100000:0.0:1763343272.856938:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399767936 00000100:00100000:0.0:1763343272.856971:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10418 00000100:00100000:0.0:1763343272.856978:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f648a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57093:x1848998399767936:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:0.0:1763343272.856999:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.857018:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1d80 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48e81 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.857121:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1d87 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343272.857133:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1d87 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.857142:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1d87 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.857155:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1d8e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343272.857162:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1d8e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.857168:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1d8e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.857247:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1d95 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343272.857256:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1d79 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x1f0:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.857263:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1d95 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343272.857291:0:33856:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1d79 lrc: 5/0,1 mode: CW/CW res: [0x240000404:0x1f0:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.857313:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1d95 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.857497:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343272.857803:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6489500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:2407:x1848998399767808:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1071us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343272.857811:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3378 00000100:00100000:1.0:1763343272.860625:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.860659:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399768064 00000100:00100000:3.0:1763343272.860670:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399768064 00010000:00010000:3.0:1763343272.860709:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1d79 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1f0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e7a expref: 287 pid: 6524 timeout: 1165 lvb_type: 0 00000100:00100000:1.0:1763343272.860791:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.860963:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399768192 00000100:00100000:0.0:1763343272.860968:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399768192 00000100:00100000:0.0:1763343272.861250:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10419 00000100:00100000:0.0:1763343272.861259:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f648bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57092:x1848998399768192:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343272.861283:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.861307:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1da3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48e88 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.861410:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1daa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343272.861420:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1daa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.861429:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1daa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:0.0:1763343272.861459:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f0:0x0]: returning size 5 00000004:00200000:0.0:1763343272.861463:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343272.861482:0:6524:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1daa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.861507:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1da3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e88 expref: 289 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.861522:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1daa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e88 expref: 288 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.861530:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:0.0:1763343272.861532:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343272.861535:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4515600, rc 0) 00000100:00100000:0.0:1763343272.861592:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f648bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57092:x1848998399768192:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 334us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.861600:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10419 00010000:00010000:3.0:1763343272.861761:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1d95 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343272.861770:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1d95 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:1.0:1763343272.864981:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.865254:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.865375:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.865393:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399768832 00000100:00100000:0.0:1763343272.865400:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399768832 00000100:00100000:0.0:1763343272.865438:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10421 00000100:00100000:0.0:1763343272.865448:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57093:x1848998399768832:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:0.0:1763343272.865476:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1763343272.865494:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1d1e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f0:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e5e expref: 289 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.865516:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1daa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e88 expref: 288 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.865535:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1ce6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e50 expref: 287 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.865545:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:0.0:1763343272.865548:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343272.865569:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1dc6 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343272.865576:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1dc6 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.865586:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1dc6 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.865604:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1dcd lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343272.865611:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1dcd lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.865619:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1dcd lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.865677:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1dd4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343272.865686:0:6524:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1d95 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e81 expref: 285 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.865695:0:6524:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1dd4 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.865732:0:6524:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1d95 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e81 expref: 285 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.865746:0:6524:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1d95 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e81 expref: 285 pid: 33856 timeout: 1165 lvb_type: 0 00000100:00100000:0.0:1763343272.865759:0:6524:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5950380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412941824:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343272.865839:0:6524:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c3be8000 going to sleep for 11 seconds 00000100:00100000:3.0:1763343272.866183:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399768576 00000100:00100000:3.0:1763343272.866189:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399768576 00000100:00100000:3.0:1763343272.866357:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3380 00000100:00100000:3.0:1763343272.866369:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8390850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:2409:x1848998399768576:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343272.868278:0:6524:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.40@tcp) returned -22 from blocking AST (req@0000000094442d37 x1848998412941824) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1d95 lrc: 1/0,0 mode: --/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e81 expref: 285 pid: 33856 timeout: 1165 lvb_type: 0 00000100:00100000:1.0:1763343272.868295:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399768960 00010000:00010000:0.0:1763343272.868311:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1d95 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e81 expref: 285 pid: 33856 timeout: 1165 lvb_type: 0 00000100:00100000:1.0:1763343272.868316:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399768960 00000100:00100000:0.0:1763343272.868332:0:6524:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5950380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412941824:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343272.868359:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:0.0:1763343272.868368:0:6524:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1dd4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000100:00100000:1.0:1763343272.868371:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10422 00010000:00010000:0.0:1763343272.868383:0:6524:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1dd4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000100:00100000:1.0:1763343272.868386:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57092:x1848998399768960:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343272.868393:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1dd4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.868422:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.868439:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1ddb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48e96 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.868494:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1ddb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e96 expref: 286 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.868508:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1ddb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e96 expref: 286 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.868524:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:1.0:1763343272.868528:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343272.868530:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c6b99600, rc 0) 00000100:00100000:1.0:1763343272.868586:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57092:x1848998399768960:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 203us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343272.868592:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10422 00000004:00080000:0.0:1763343272.868669:0:6524:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x1f0:0x0] is inserted into orphan list, open count = 2 00010000:00010000:0.0:1763343272.868766:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1dd4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.868774:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1dd4 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.868781:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1dd4 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.868787:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3b4b600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343272.868791:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1dd4 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.868798:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1dd4 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.868809:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:0.0:1763343272.868811:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763343272.868816:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1dd4 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.868821:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1dd4 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.868834:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1dc6 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.868840:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1dc6 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.868844:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1dc6 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.868849:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1dc6 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.868853:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343272.868857:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1dc6 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.868862:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1dc6 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.868869:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c52ec900) 00010000:00010000:0.0:1763343272.868872:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343272.868874:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1dc6 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.868878:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1dc6 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000004:00010000:0.0:1763343272.868894:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007a9f45f3 reply state 000000007b561ce2 transno 4294973414 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1dcd lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.868903:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1dcd lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.868908:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c52ecc00) 00010000:00010000:0.0:1763343272.868910:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343272.868913:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343272.868965:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57093:x1848998399768832:12345-192.168.201.40@tcp:36:rm.0 Request processed in 3519us (3589us total) trans 4294973414 rc 0/0 00000100:00100000:0.0:1763343272.868971:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10421 00000100:00100000:3.0:1763343272.872248:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399769088 00000100:00100000:3.0:1763343272.872261:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399769088 00000100:00100000:3.0:1763343272.872342:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7042 00000100:00100000:3.0:1763343272.872354:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998399769088:12345-192.168.201.40@tcp:1:lfs.0 00010000:00010000:3.0:1763343272.872411:0:11289:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a1de2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.872437:0:11289:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1d41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e65 expref: 15 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.872445:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343272.872448:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343272.872453:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a1de2 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.872497:0:11289:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1d41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e65 expref: 15 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.872512:0:11289:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1d41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e65 expref: 15 pid: 8413 timeout: 1165 lvb_type: 0 00000100:00100000:3.0:1763343272.872529:0:11289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5954e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11289:1848998412941952:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343272.872628:0:11289:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc440840 going to sleep for 11 seconds 00000100:00100000:0.0:1763343272.883801:0:11289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5954e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11289:1848998412941952:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343272.883840:0:11289:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a1de2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343272.887730:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399769216 00000100:00100000:1.0:1763343272.887740:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399769216 00002000:00100000:1.0:1763343272.887790:0:28399:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_017: refresh rw locks for [0x2c0000400:0x2a3:0x0] (0->4) req@ffff9400c5a3f480 x1848998399769216/t0(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:13/0 lens 496/0 e 0 to 0 dl 1763343283 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763343272.887801:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5a3f480 with x1848998399769216 ext(0->4) 00010000:00010000:1.0:1763343272.887811:0:28399:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1d41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e65 expref: 16 pid: 8413 timeout: 1165 lvb_type: 0 00010000:00010000:1.0:1763343272.887828:0:28399:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1d41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e65 expref: 16 pid: 8413 timeout: 1166 lvb_type: 0 00002000:00010000:1.0:1763343272.887836:0:28399:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9400c5a3f480 00000100:00100000:1.0:1763343272.887870:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 115 00000100:00100000:1.0:1763343272.887880:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998399769216:12345-192.168.201.40@tcp:4:bash.0 00000100:00100000:0.0:1763343272.890507:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2407:x1848998399769216:12345-192.168.201.40@tcp:4:bash.0 Request processed in 2608us (2837us total) trans 17179871839 rc 0/0 00000100:00100000:0.0:1763343272.890527:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 115 00002000:00100000:0.0:1763343272.890545:0:28399:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_017: refresh rw locks for [0x2c0000400:0x2a3:0x0] (0->4) req@ffff9400c5a3f480 x1848998399769216/t17179871839(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:13/0 lens 496/448 e 0 to 0 dl 1763343283 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763343272.890557:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5a3f480 with x1848998399769216 ext(0->4) 00010000:00010000:0.0:1763343272.890568:0:28399:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1d41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e65 expref: 18 pid: 8413 timeout: 1166 lvb_type: 0 00010000:00010000:0.0:1763343272.890593:0:28399:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1d41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e65 expref: 18 pid: 8413 timeout: 1166 lvb_type: 0 00002000:00010000:0.0:1763343272.890602:0:28399:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9400c5a3f480 00000100:00100000:0.0:1763343272.898662:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.898756:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:2.0:1763343272.899646:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1df7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343272.899651:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1df7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343272.899655:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343272.899658:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1df7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343272.899663:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1df7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343272.899670:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c52ecc00) 00010000:00010000:2.0:1763343272.899673:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343272.899676:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1df7 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343272.899681:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1df7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343272.899706:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a1de9 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e9d expref: 288 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343272.899715:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8300) 00010000:00010000:2.0:1763343272.899717:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343272.899721:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a1de9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e9d expref: 288 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343272.899733:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fd2df600, rc 0) 00000100:00100000:2.0:1763343272.899785:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57094:x1848998399769344:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 428us (1132us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343272.899792:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10423 00000100:00100000:3.0:1763343272.900060:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399769472 00000100:00100000:3.0:1763343272.900067:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399769472 00010000:00010000:3.0:1763343272.900093:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1d41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e65 expref: 18 pid: 8413 timeout: 1166 lvb_type: 0 00000100:00100000:3.0:1763343272.900118:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3381 00000100:00100000:3.0:1763343272.900125:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5951500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998399769472:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343272.900135:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1763343272.900151:0:6510:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2a3:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:3.0:1763343272.900155:0:6510:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2a3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1763343272.900160:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1d41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e65 expref: 18 pid: 8413 timeout: 1166 lvb_type: 0 00010000:00010000:3.0:1763343272.900171:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1d41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e65 expref: 18 pid: 8413 timeout: 1166 lvb_type: 0 00010000:00010000:3.0:1763343272.900188:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1d41 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e65 expref: 18 pid: 8413 timeout: 1166 lvb_type: 0 00010000:00010000:3.0:1763343272.900201:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.900203:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.900207:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a1de2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.900217:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a1de2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.900237:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343272.900273:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5951500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998399769472:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 147us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343272.900280:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3381 00010000:00010000:0.0:1763343272.900338:0:11289:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a1de2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.900348:0:11289:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a1de2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.900369:0:11289:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a1de2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.900377:0:11289:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a1de2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.900384:0:11289:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a1de2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.900391:0:11289:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3bcc200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343272.900394:0:11289:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a1de2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.900401:0:11289:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a1de2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.900411:0:11289:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a1de2 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.900418:0:11289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a1de2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343272.900460:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998399769088:12345-192.168.201.40@tcp:1:lfs.0 Request processed in 28109us (28301us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.900467:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7042 00000100:00100000:0.0:1763343272.905796:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343272.905886:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399769600 00000100:00100000:2.0:1763343272.905896:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399769600 00000100:00100000:2.0:1763343272.905960:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10424 00000100:00100000:2.0:1763343272.905971:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57094:x1848998399769600:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343272.905992:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343272.906018:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1dfe lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48ea4 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343272.906498:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.906567:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399769856 00000100:00100000:0.0:1763343272.906572:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399769856 00000100:00100000:0.0:1763343272.906612:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10425 00000100:00100000:0.0:1763343272.906620:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57092:x1848998399769856:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:0.0:1763343272.906667:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343272.906693:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1ddb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e96 expref: 288 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.906719:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:0.0:1763343272.906725:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343272.906753:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1e05 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343272.906766:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1e05 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.906776:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1e05 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000040:00080000:0.0:1763343272.906994:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1661, 88 off138600 00000004:00080000:0.0:1763343272.907003:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1066030977846ns, next at 1066683090291ns, rc = 0 00000040:00080000:0.0:1763343272.907081:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1653, 88 off137904 00000004:00080000:0.0:1763343272.907087:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1066031062696ns, next at 1066683237775ns, rc = 0 00000040:00080000:0.0:1763343272.907104:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1654, 88 off137992 00000004:00080000:0.0:1763343272.907108:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1066031083414ns, next at 1066683237775ns, rc = 0 00000040:00080000:0.0:1763343272.907119:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1662, 88 off138688 00000004:00080000:0.0:1763343272.907123:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1066031098087ns, next at 1066683090291ns, rc = 0 00010000:00010000:2.0:1763343272.907811:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1e0c lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343272.907821:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1e0c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.907831:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1e0c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.907840:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1e13 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343272.907848:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1e13 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.907853:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1e13 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.907881:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1e0c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.907888:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1e0c lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.907894:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1e0c lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.907901:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343272.907905:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1e0c lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.907912:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1e0c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.907921:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8500) 00010000:00010000:2.0:1763343272.907924:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343272.907928:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1e0c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.907934:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1e0c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.907942:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1e13 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.907948:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1e13 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.907953:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1e13 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.907958:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343272.907961:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1e13 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.907967:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1e13 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.907973:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c52ecc00) 00010000:00010000:2.0:1763343272.907975:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343272.907979:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1e13 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.907984:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1e13 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.908010:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1dfe lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ea4 expref: 289 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343272.908018:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8500) 00010000:00010000:2.0:1763343272.908047:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343272.908053:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1dfe lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ea4 expref: 289 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343272.908065:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5088800, rc 0) 00000100:00100000:2.0:1763343272.908133:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57094:x1848998399769600:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2163us (2346us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343272.908141:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10424 00000001:00080000:0.0:1763343272.913139:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973415 is committed 00000004:00080000:0.0:1763343272.913153:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1067 committed 00010000:00010000:1.0:1763343272.913306:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1dcd lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.913319:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1dcd lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.913326:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1dcd lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.913333:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3b4ba00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.913337:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1dcd lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.913344:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1dcd lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.913360:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c52ecc00) 00010000:00010000:1.0:1763343272.913363:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.913368:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1dcd lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.913374:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1dcd lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000004:00080000:0.0:1763343272.913933:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1059 committed 00000100:00100000:3.0:1763343272.914328:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412942080:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343272.914389:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343272.914432:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412942208:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343272.914451:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343272.914480:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412942080 00000100:00100000:3.0:1763343272.914486:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412942080 00000100:00100000:3.0:1763343272.914515:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412942208 00000100:00100000:3.0:1763343272.914518:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412942208 00000100:00100000:3.0:1763343272.914536:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7043 00000100:00100000:3.0:1763343272.914542:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+18:3662:x1848998412942080:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343272.914691:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+19:3662:x1848998412942080:12345-0@lo:2:osp-syn-1-1.0 Request processed in 148us (301us total) trans 17179871840 rc 0/0 00000100:00100000:3.0:1763343272.914698:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7043 00000100:00100000:3.0:1763343272.914712:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7044 00000100:00100000:3.0:1763343272.914718:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+18:3659:x1848998412942208:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343272.914786:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+19:3659:x1848998412942208:12345-0@lo:2:osp-syn-1-1.0 Request processed in 67us (332us total) trans 17179871841 rc 0/0 00000100:00100000:3.0:1763343272.914791:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7044 00000004:00080000:3.0:1763343272.914825:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5955500/2, rc 0, transno 17179871841 00000100:00100000:3.0:1763343272.914831:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412942208:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763343272.914848:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5955880/2, rc 0, transno 17179871840 00000100:00100000:3.0:1763343272.914853:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412942080:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343272.914969:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000004:00080000:0.0:1763343272.915057:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1058 committed 00000100:00100000:1.0:1763343272.915476:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c3728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412942336:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343272.915506:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343272.915535:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412942336 00000100:00100000:1.0:1763343272.915539:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412942336 00000100:00100000:1.0:1763343272.915561:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7045 00000100:00100000:1.0:1763343272.915567:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401ede68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+143:3660:x1848998412942336:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1763343272.915651:0:35266:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2a2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343272.915655:0:35266:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2a2:0x0] updating lvb mtime from disk: 1763343272 -> 1763343272 00002000:00010000:1.0:1763343272.915657:0:35266:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2a2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343272.915659:0:35266:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2a2:0x0] updating lvb ctime from disk: 1763343272 -> 1763343272 00002000:00010000:1.0:1763343272.915662:0:35266:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2a2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343272.915688:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401ede68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+144:3660:x1848998412942336:12345-0@lo:2:osp-syn-0-1.0 Request processed in 120us (180us total) trans 21474839111 rc 0/0 00000100:00100000:1.0:1763343272.915694:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7045 00000004:00080000:1.0:1763343272.915802:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c3728700/2, rc 0, transno 21474839111 00000100:00100000:1.0:1763343272.915807:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c3728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412942336:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343272.915818:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763343272.915823:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412942464:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343272.915843:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343272.915864:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412942464 00000100:00100000:1.0:1763343272.915868:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412942464 00000100:00100000:1.0:1763343272.915887:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7046 00000100:00100000:1.0:1763343272.915892:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+144:3662:x1848998412942464:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343272.915963:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+145:3662:x1848998412942464:12345-0@lo:2:osp-syn-0-1.0 Request processed in 71us (119us total) trans 21474839112 rc 0/0 00000100:00100000:1.0:1763343272.915969:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7046 00000004:00080000:1.0:1763343272.915989:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c372ad80/2, rc 0, transno 21474839112 00000100:00100000:1.0:1763343272.915993:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412942464:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763343272.916142:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1066 committed 00000004:00010000:0.0:1763343272.916211:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f6683ffd reply state 0000000039a0f991 transno 4294973415 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1e05 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.916231:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1e05 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.916239:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:0.0:1763343272.916243:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763343272.916247:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1763343272.916326:0:6524:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763343272.916338:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57092:x1848998399769856:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 9718us (9840us total) trans 4294973415 rc 0/0 00000100:00100000:0.0:1763343272.916344:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10425 00000100:00100000:0.0:1763343272.916361:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399769984 00000100:00100000:0.0:1763343272.916364:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399769984 00000100:00100000:0.0:1763343272.916384:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10426 00000100:00100000:0.0:1763343272.916390:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+280:57094:x1848998399769984:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343272.916402:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.916420:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1e1a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48eab expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.916465:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1e21 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343272.916476:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1e21 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.916485:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1e21 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:0.0:1763343272.916512:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343272.916516:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343272.916543:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1e1a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48eab expref: 282 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.916559:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1e21 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48eab expref: 281 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.916566:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5e00) 00010000:00010000:0.0:1763343272.916569:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343272.916571:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4514400, rc 0) 00000100:00100000:0.0:1763343272.916592:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57094:x1848998399769984:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 201us (1626us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.916598:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10426 00010000:00010000:1.0:1763343272.916755:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1e05 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.916763:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1e05 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.916768:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1e05 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.916774:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3b4b600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.916777:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1e05 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.916784:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1e05 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.916792:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:1.0:1763343272.916795:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343272.916799:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1e05 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343272.916804:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1e05 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000100:00100000:0.0:1763343272.922230:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.922283:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343272.922373:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399770112 00000100:00100000:2.0:1763343272.922390:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399770112 00000100:00100000:2.0:1763343272.922449:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399770240 00000100:00100000:2.0:1763343272.922452:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399770240 00000100:00100000:2.0:1763343272.922491:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10427 00000100:00100000:2.0:1763343272.922503:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57092:x1848998399770112:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343272.922535:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343272.922559:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1e28 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48eb2 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343272.922618:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1e28 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48eb2 expref: 282 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343272.922634:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1e28 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48eb2 expref: 282 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343272.922653:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:2.0:1763343272.922656:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343272.922660:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5088800, rc 0) 00000100:00100000:2.0:1763343272.922721:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57092:x1848998399770112:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 220us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343272.922729:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10427 00000100:00100000:2.0:1763343272.922750:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10428 00000100:00100000:2.0:1763343272.922757:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57094:x1848998399770240:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343272.922765:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343272.922774:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1e2f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48eb9 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343272.923969:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1e36 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343272.923986:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1e36 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.923997:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1e36 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.924013:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1e3d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343272.924019:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1e3d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.924053:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1e3d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.924101:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1e36 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.924108:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1e36 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.924115:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1e36 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.924121:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343272.924126:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1e36 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.924133:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1e36 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.924145:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5e00) 00010000:00010000:2.0:1763343272.924149:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343272.924153:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1e36 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.924159:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1e36 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.924173:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1e3d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.924179:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1e3d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.924184:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1e3d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.924189:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343272.924192:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1e3d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.924198:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1e3d lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.924204:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8500) 00010000:00010000:2.0:1763343272.924206:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343272.924209:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1e3d lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.924215:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1e3d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.924252:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1e2f lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48eb9 expref: 282 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343272.924262:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5e00) 00010000:00010000:2.0:1763343272.924265:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343272.924282:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1e2f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48eb9 expref: 282 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343272.924292:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089000, rc 0) 00000100:00100000:2.0:1763343272.924367:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57094:x1848998399770240:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1610us (2083us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343272.924374:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10428 00000100:00100000:0.0:1763343272.927254:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343272.927386:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399770368 00000100:00100000:2.0:1763343272.927397:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399770368 00000100:00100000:2.0:1763343272.927460:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10429 00000100:00100000:2.0:1763343272.927477:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+281:57092:x1848998399770368:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343272.927499:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343272.927520:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1e44 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48ec0 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343272.927594:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a1e4b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343272.927609:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a1e4b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.927619:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a1e4b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:2.0:1763343272.927665:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f0:0x0]: returning size 5 00000004:00200000:2.0:1763343272.927670:0:33856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343272.927688:0:33856:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a1e4b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.927715:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1e44 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ec0 expref: 283 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343272.927734:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a1e4b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ec0 expref: 282 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343272.927744:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:2.0:1763343272.927747:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1763343272.927751:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fd2df600, rc 0) 00000100:00100000:2.0:1763343272.927817:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57092:x1848998399770368:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 348us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343272.927838:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10429 00000100:00100000:1.0:1763343272.929110:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.929358:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399770624 00000100:00100000:0.0:1763343272.929368:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399770624 00000100:00100000:0.0:1763343272.929429:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10430 00000100:00100000:0.0:1763343272.929439:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57094:x1848998399770624:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343272.929455:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.929458:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343272.929483:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1e21 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48eab expref: 282 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.929499:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5e00) 00010000:00010000:0.0:1763343272.929509:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343272.929522:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1e52 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48ec7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.929626:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1e59 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343272.929637:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1e59 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.929646:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1e59 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.929657:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1e60 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343272.929663:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1e60 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.929668:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1e60 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.930111:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1e67 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343272.930121:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1e67 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.930129:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1e67 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:0.0:1763343272.930138:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f1:0x0]: returning size 0 00010000:00010000:0.0:1763343272.930164:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1e59 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.930172:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1e59 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.930178:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1e59 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.930184:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1e59 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.930189:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343272.930192:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1e59 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.930198:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1e59 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.930207:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5000) 00010000:00010000:0.0:1763343272.930210:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343272.930213:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1e59 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.930218:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1e59 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000004:00010000:0.0:1763343272.930229:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006e91971c reply state 0000000033873e9b transno 4294973416 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1e60 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.930238:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1e60 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.930243:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401cc2f5300) 00010000:00010000:0.0:1763343272.930245:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343272.930247:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343272.930275:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1e52 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ec7 expref: 284 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.930305:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1e67 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ec7 expref: 283 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.930312:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f1:0x0].0x0 (ffff9401cc2f5800) 00010000:00010000:0.0:1763343272.930315:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343272.930317:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121ea00, rc 0) 00000100:00100000:0.0:1763343272.930382:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57094:x1848998399770624:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 945us (1280us total) trans 4294973416 rc 0/0 00000100:00100000:0.0:1763343272.930390:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10430 00000100:00100000:1.0:1763343272.934811:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.934865:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.934926:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399771008 00000100:00100000:0.0:1763343272.934937:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399771008 00000100:00100000:2.0:1763343272.934997:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399770880 00000100:00100000:2.0:1763343272.935004:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399770880 00000100:00100000:0.0:1763343272.935008:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7047 00000100:00100000:0.0:1763343272.935054:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998399771008:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:2.0:1763343272.935065:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10431 00010000:00010000:0.0:1763343272.935075:0:11289:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1763343272.935076:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c372bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57094:x1848998399770880:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343272.935099:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.935099:0:11289:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1e75 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48ed5 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343272.935115:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a1e7c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48ece expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343272.935127:0:11289:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2a3:0x0] initial LVB size: 5, mtime: 0x691a7ba8, atime: 0x0, ctime: 0x691a7ba8, blocks: 0x8 00010000:00010000:0.0:1763343272.935148:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.935150:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.935162:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1e75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ed5 expref: 17 pid: 11289 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343272.935178:0:11289:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1e75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ed5 expref: 17 pid: 11289 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343272.935196:0:11289:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121e200, rc 0) 00010000:00010000:2.0:1763343272.935231:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1e83 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343272.935249:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1e67 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ec7 expref: 285 pid: 6524 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343272.935258:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998399771008:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 239us (391us total) trans 0 rc 0/0 00010000:00010000:2.0:1763343272.935260:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1e83 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00000100:00100000:0.0:1763343272.935273:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7047 00010000:00010000:2.0:1763343272.935317:0:33856:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1e67 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ec7 expref: 285 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343272.935332:0:33856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1e67 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ec7 expref: 285 pid: 6524 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343272.935346:0:33856:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3f100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412942592:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343272.935403:0:33856:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401cbf74600 going to sleep for 11 seconds 00000100:00100000:2.0:1763343272.937912:0:33856:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3f100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412942592:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343272.937943:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1e83 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:1.0:1763343272.942276:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343272.942425:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399771136 00000100:00100000:2.0:1763343272.942437:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399771136 00010000:00010000:2.0:1763343272.942480:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1e67 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ec7 expref: 286 pid: 6524 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343272.942522:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3382 00000100:00100000:2.0:1763343272.942531:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c372b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:2408:x1848998399771136:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343272.942546:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343272.942552:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1e67 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ec7 expref: 286 pid: 6524 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343272.942565:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1e67 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ec7 expref: 286 pid: 6524 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343272.942587:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a1e67 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ec7 expref: 286 pid: 6524 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343272.942604:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f1:0x0].0x0 (ffff9401cc2f5800) 00010000:00010000:2.0:1763343272.942610:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1e83 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.942619:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1e83 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.942626:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1e83 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.942654:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343272.942716:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c372b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:2408:x1848998399771136:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 185us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343272.942724:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3382 00010000:00010000:1.0:1763343272.942790:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1e83 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.942798:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1e83 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:1.0:1763343272.942821:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f1:0x0]: returning size 0 00000004:00080000:1.0:1763343272.943057:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2a4:0x0], index 0: 0 00000004:00080000:1.0:1763343272.943067:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2a5:0x0], index 1: 0 00000004:00080000:1.0:1763343272.943073:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2a6:0x0], index 1: 0 00000004:00080000:1.0:1763343272.943076:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2a5:0x0], index 0: 0 00010000:00010000:1.0:1763343272.943181:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1e83 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.943189:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1e83 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.943195:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1e83 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.943200:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5088a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.943205:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1e83 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.943216:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1e83 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.943225:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f1:0x0].0x0 (ffff9401cc2f5800) 00010000:00010000:1.0:1763343272.943228:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343272.943232:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1e83 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.943238:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1e83 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.943284:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a1e7c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1f1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ece expref: 285 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.943293:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f1:0x0].0x0 (ffff9401cc2f5800) 00010000:00010000:1.0:1763343272.943296:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343272.943309:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a1e7c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ece expref: 285 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.943323:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fd2dea00, rc 0) 00000100:00100000:1.0:1763343272.943363:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c372bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57094:x1848998399770880:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 8290us (8564us total) trans 4294973417 rc 301/301 00000100:00100000:1.0:1763343272.943371:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10431 00000100:00100000:1.0:1763343272.949781:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.949845:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399771392 00000100:00100000:3.0:1763343272.949857:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399771392 00000100:00100000:3.0:1763343272.949922:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3680 00000100:00100000:3.0:1763343272.949933:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8447450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57094:x1848998399771392:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343272.950259:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8447450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57094:x1848998399771392:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 328us (487us total) trans 4294973418 rc 0/0 00000100:00100000:3.0:1763343272.950267:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3680 00000100:00100000:2.0:1763343272.953576:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.953660:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399771648 00000100:00100000:3.0:1763343272.953675:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399771648 00000100:00100000:3.0:1763343272.953771:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3681 00000100:00100000:3.0:1763343272.953782:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57094:x1848998399771648:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343272.954629:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57094:x1848998399771648:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 844us (1059us total) trans 4294973419 rc 0/0 00000100:00100000:2.0:1763343272.954638:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3681 00000100:00100000:2.0:1763343272.962184:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.962335:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399771904 00000100:00100000:1.0:1763343272.962347:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399771904 00000100:00100000:1.0:1763343272.962413:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10432 00000100:00100000:1.0:1763343272.962425:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:55884:x1848998399771904:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343272.962458:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.962484:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1e91 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48edc expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.962627:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a1e98 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343272.962644:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a1e98 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.962655:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a1e98 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.962665:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a1e9f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343272.962673:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a1e9f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.962679:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a1e9f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.962740:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1ea6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343272.962747:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1ea6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.962754:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1ea6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:1.0:1763343272.962764:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f1:0x0]: returning size 0 00010000:00010000:1.0:1763343272.962866:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a1e98 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.966394:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a1e98 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.966410:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a1e98 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.966416:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b98000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.966421:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a1e98 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.966431:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a1e98 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.966450:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401c85cc400) 00010000:00010000:1.0:1763343272.966453:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.966458:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a1e98 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.966465:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a1e98 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.966485:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a1e9f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.966491:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a1e9f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.966497:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a1e9f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.966502:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fd2dea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343272.966505:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a1e9f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.966515:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a1e9f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.966521:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401cc2f5300) 00010000:00010000:1.0:1763343272.966523:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343272.966526:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a1e9f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.966531:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a1e9f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.966588:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1e91 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48edc expref: 289 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.966609:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1ea6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48edc expref: 288 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.966616:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f1:0x0].0x0 (ffff9401c85cc600) 00010000:00010000:1.0:1763343272.966618:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343272.966620:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3b4b600, rc 0) 00000100:00100000:1.0:1763343272.966715:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:55884:x1848998399771904:12345-192.168.201.40@tcp:101:bash.0 Request processed in 4292us (4544us total) trans 4294973420 rc 0/0 00000100:00100000:1.0:1763343272.966725:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10432 00000100:00100000:1.0:1763343272.970420:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343272.970497:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399772032 00000100:00100000:2.0:1763343272.970512:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399772032 00000100:00100000:0.0:1763343272.971382:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10433 00000100:00100000:0.0:1763343272.971396:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:55884:x1848998399772032:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343272.971421:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.971443:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a1eb4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48ee3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.971476:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1ebb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343272.971490:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1ebb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.971502:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1ebb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343272.971611:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a1eb4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ee3 expref: 290 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.971629:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1ebb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ee3 expref: 289 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.971639:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f1:0x0].0x0 (ffff9401c85cc600) 00010000:00010000:0.0:1763343272.971641:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343272.971646:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121fc00, rc 0) 00000100:00100000:0.0:1763343272.971705:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:55884:x1848998399772032:12345-192.168.201.40@tcp:101:bash.0 Request processed in 313us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343272.971712:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10433 00000100:00100000:2.0:1763343272.974768:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.975307:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399772288 00000100:00100000:1.0:1763343272.975319:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399772288 00000100:00100000:1.0:1763343272.975392:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10434 00000100:00100000:1.0:1763343272.975404:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:55884:x1848998399772288:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:1.0:1763343272.975474:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343272.975504:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1ea6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48edc expref: 289 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.975521:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f1:0x0].0x0 (ffff9401c85cc600) 00010000:00010000:1.0:1763343272.975527:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343272.975705:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1ec2 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343272.975719:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1ec2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.975729:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1ec2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000001:00080000:1.0:1763343272.975771:0:33856:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973421 00000004:00010000:1.0:1763343272.975792:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fd5f2f3f reply state 00000000336c4442 transno 4294973422 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1ec2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.975803:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1ec2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.975808:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f1:0x0].0x0 (ffff9401c85cc600) 00010000:00010000:1.0:1763343272.975811:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343272.975813:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343272.975906:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:55884:x1848998399772288:12345-192.168.201.40@tcp:36:bash.0 Request processed in 502us (1145us total) trans 4294973422 rc 0/0 00000100:00100000:1.0:1763343272.975913:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10434 00000020:00080000:1.0:1763343272.975918:0:33856:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763343272.980629:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.980721:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399772416 00000100:00100000:1.0:1763343272.980732:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399772416 00000100:00100000:1.0:1763343272.980792:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10435 00000100:00100000:1.0:1763343272.980802:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:55884:x1848998399772416:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343272.980827:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.980847:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1ec9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48eea expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.980901:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1ec9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48eea expref: 292 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.980915:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1ec9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48eea expref: 292 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.980932:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f1:0x0].0x0 (ffff9401c85cc600) 00010000:00010000:1.0:1763343272.980936:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343272.980940:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3b4b600, rc 0) 00000100:00100000:1.0:1763343272.981004:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:55884:x1848998399772416:12345-192.168.201.40@tcp:101:bash.0 Request processed in 203us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343272.981012:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10435 00000100:00100000:3.0:1763343272.982382:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.982822:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399772544 00000100:00100000:1.0:1763343272.982833:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399772544 00000100:00100000:1.0:1763343272.982885:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7048 00000100:00100000:1.0:1763343272.982894:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998399772544:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:1.0:1763343272.983048:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998399772544:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 154us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343272.983056:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7048 00000100:00100000:3.0:1763343272.986674:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343272.987103:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399772800 00000100:00100000:2.0:1763343272.987115:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399772800 00000100:00100000:1.0:1763343272.987197:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10436 00000100:00100000:1.0:1763343272.987210:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:55884:x1848998399772800:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343272.987231:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.987234:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343272.987260:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a1ec9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48eea expref: 292 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.987278:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f1:0x0].0x0 (ffff9401c85cc600) 00010000:00010000:1.0:1763343272.987283:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343272.987306:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a1ed0 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48ef1 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.987354:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a1ed7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343272.987368:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a1ed7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.987377:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a1ed7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000040:00080000:1.0:1763343272.987627:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1655, 88 off138080 00000004:00080000:1.0:1763343272.987634:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1066111609438ns, next at 1066683237775ns, rc = 0 00000040:00080000:1.0:1763343272.987671:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1663, 88 off138776 00000004:00080000:1.0:1763343272.987676:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1066111651010ns, next at 1066683090291ns, rc = 0 00000040:00080000:1.0:1763343272.987700:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1664, 88 off138864 00000004:00080000:1.0:1763343272.987704:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1066111679793ns, next at 1066683090291ns, rc = 0 00000040:00080000:1.0:1763343272.987713:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1656, 88 off138168 00000004:00080000:1.0:1763343272.987717:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1066111692088ns, next at 1066683237775ns, rc = 0 00000100:00100000:1.0:1763343272.990220:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000001:00080000:0.0:1763343272.990641:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973423 is committed 00000004:00080000:0.0:1763343272.990649:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1061 committed 00000004:00080000:0.0:1763343272.990656:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1069 committed 00000004:00080000:0.0:1763343272.990663:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1068 committed 00000004:00080000:0.0:1763343272.990665:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1060 committed 00010000:00010000:2.0:1763343272.990671:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1e60 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343272.990683:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1e60 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343272.990690:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1e60 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343272.990696:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343272.990700:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1e60 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343272.990706:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1e60 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343272.990722:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401cc2f5300) 00010000:00010000:2.0:1763343272.990725:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343272.990731:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1e60 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343272.990737:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1e60 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000100:00100000:0.0:1763343272.990757:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412942720:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1763343272.990764:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1ec2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.990769:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1ec2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.990774:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1ec2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.990778:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3b4ba00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343272.990781:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1ec2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.990785:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1ec2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.990792:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f1:0x0].0x0 (ffff9401c85cc600) 00010000:00010000:2.0:1763343272.990794:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343272.990797:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1ec2 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343272.990803:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a1ec2 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000100:00100000:0.0:1763343272.990805:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343272.990849:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412942848:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343272.990875:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343272.990911:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399772928 00000100:00100000:0.0:1763343272.990913:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412942720 00000100:00100000:2.0:1763343272.990920:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399772928 00000100:00100000:0.0:1763343272.990920:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412942720 00000100:00100000:2.0:1763343272.991051:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412942848 00000100:00100000:2.0:1763343272.991055:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412942848 00000100:00100000:3.0:1763343272.991067:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7049 00000100:00100000:3.0:1763343272.991082:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+20:3662:x1848998412942720:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343272.991089:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7050 00000100:00100000:2.0:1763343272.991094:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998399772928:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:2.0:1763343272.991187:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998399772928:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 91us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343272.991194:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7050 00000100:00100000:2.0:1763343272.991210:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7051 00000100:00100000:2.0:1763343272.991216:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+21:3659:x1848998412942848:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343272.991258:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+22:3662:x1848998412942720:12345-0@lo:2:osp-syn-1-1.0 Request processed in 182us (451us total) trans 17179871842 rc 0/0 00000100:00100000:3.0:1763343272.991264:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7049 00000100:00100000:2.0:1763343272.991289:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+21:3659:x1848998412942848:12345-0@lo:2:osp-syn-1-1.0 Request processed in 73us (413us total) trans 17179871843 rc 0/0 00000100:00100000:2.0:1763343272.991295:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7051 00000100:00100000:3.0:1763343272.991334:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412943104:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763343272.991354:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b9ce00/2, rc 0, transno 17179871843 00000100:00100000:2.0:1763343272.991359:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412942848:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343272.991361:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343272.991367:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763343272.991372:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412942976:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343272.991394:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343272.991399:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412943104 00000100:00100000:3.0:1763343272.991403:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412943104 00000100:00100000:2.0:1763343272.991412:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412942976 00000100:00100000:2.0:1763343272.991415:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412942976 00000100:00100000:3.0:1763343272.991426:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7052 00000100:00100000:2.0:1763343272.991430:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7053 00000100:00100000:3.0:1763343272.991432:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+146:3661:x1848998412943104:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343272.991435:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+146:3659:x1848998412942976:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343272.991522:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+148:3661:x1848998412943104:12345-0@lo:2:osp-syn-0-1.0 Request processed in 89us (159us total) trans 21474839113 rc 0/0 00000100:00100000:2.0:1763343272.991527:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+148:3659:x1848998412942976:12345-0@lo:2:osp-syn-0-1.0 Request processed in 92us (133us total) trans 21474839114 rc 0/0 00000100:00100000:3.0:1763343272.991529:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7052 00000100:00100000:2.0:1763343272.991533:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7053 00000004:00080000:3.0:1763343272.991554:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5957800/2, rc 0, transno 21474839113 00000004:00080000:2.0:1763343272.991554:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5954380/2, rc 0, transno 21474839114 00000100:00100000:3.0:1763343272.991559:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412943104:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343272.991559:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412942976:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763343272.991575:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b9f480/2, rc 0, transno 17179871842 00000100:00100000:3.0:1763343272.991579:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412942720:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1763343272.992086:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a1ed7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f1:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ef1 expref: 284 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.992103:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f1:0x0].0x0 (ffff9401c85cc600) 00010000:00010000:1.0:1763343272.992106:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343272.992122:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a1ed0 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ef1 expref: 284 pid: 33856 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343272.992136:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a1ed7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f1:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ef1 expref: 283 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.992160:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f1:0x0].0x0 (ffff9401c85cc600) 00010000:00010000:1.0:1763343272.992162:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343272.992165:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3200, rc 0) 00000100:00100000:1.0:1763343272.992197:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:55884:x1848998399772800:12345-192.168.201.40@tcp:101:bash.0 Request processed in 4991us (5535us total) trans 4294973423 rc 0/0 00000100:00100000:1.0:1763343272.992205:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10436 00000100:00100000:1.0:1763343272.996139:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343272.996249:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343272.996308:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399773056 00000100:00100000:0.0:1763343272.996321:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399773056 00000100:00100000:0.0:1763343272.996527:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7054 00000100:00100000:0.0:1763343272.996538:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+63:55884:x1848998399773056:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343272.996556:0:11289:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343272.996580:0:11289:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401d121e800/0x9104b1ba770a1ede lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48ef8 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343272.996603:0:11289:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343272.996625:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343272.996628:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1763343272.996633:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399773184 00010000:00010000:0.0:1763343272.996638:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401d121e800/0x9104b1ba770a1ede lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ef8 expref: 64 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343272.996641:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399773184 00010000:00010000:0.0:1763343272.996664:0:11289:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9401d121e800/0x9104b1ba770a1ede lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ef8 expref: 64 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343272.996676:0:11289:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121e800, rc 0) 00000100:00100000:2.0:1763343272.996700:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1687 00000100:00100000:2.0:1763343272.996709:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2409:x1848998399773184:12345-192.168.201.40@tcp:3:lfs.0 00000100:00100000:0.0:1763343272.996731:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+64:55884:x1848998399773056:12345-192.168.201.40@tcp:101:bash.0 Request processed in 194us (602us total) trans 0 rc 0/0 00010000:00010000:2.0:1763343272.996738:0:28399:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1ee5 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343272.996739:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7054 00010000:00010000:2.0:1763343272.996751:0:28399:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343272.996754:0:28399:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343272.996758:0:28399:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1ee5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343272.996771:0:28399:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1ee5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343272.996859:0:28399:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1ee5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343272.996869:0:28399:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1ee5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343272.996877:0:28399:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1ee5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343272.996884:0:28399:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343272.996889:0:28399:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1ee5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343272.996898:0:28399:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1ee5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343272.996914:0:28399:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1ee5 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343272.996922:0:28399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1ee5 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343272.996977:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2409:x1848998399773184:12345-192.168.201.40@tcp:3:lfs.0 Request processed in 268us (727us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763343272.996984:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1687 00000100:00100000:1.0:1763343272.998549:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343272.998731:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399773312 00000100:00100000:3.0:1763343272.999117:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399773312 00000100:00100000:3.0:1763343272.999169:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7055 00000100:00100000:3.0:1763343272.999179:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:55884:x1848998399773312:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343272.999200:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343272.999220:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1eec lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48eff expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343272.999228:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00002000:00010000:3.0:1763343272.999249:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343272.999270:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.999272:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343272.999280:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1eec lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48eff expref: 18 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.999306:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1eec lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48eff expref: 18 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343272.999318:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c6b99600, rc 0) 00000100:00100000:3.0:1763343272.999376:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:55884:x1848998399773312:12345-192.168.201.40@tcp:101:bash.0 Request processed in 198us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343272.999384:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7055 00000100:00100000:1.0:1763343272.999499:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399773440 00000100:00100000:1.0:1763343272.999505:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399773440 00000100:00100000:1.0:1763343272.999540:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10437 00000100:00100000:1.0:1763343272.999547:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57092:x1848998399773440:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343272.999562:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343272.999577:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a1ef3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48f06 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.999611:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3e00/0x9104b1ba770a1efa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343272.999628:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3e00/0x9104b1ba770a1efa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.999640:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3e00/0x9104b1ba770a1efa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343272.999758:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a1ef3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f06 expref: 285 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.999777:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3e00/0x9104b1ba770a1efa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f06 expref: 284 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343272.999785:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:1.0:1763343272.999802:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343272.999806:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3e00, rc 0) 00000100:00100000:1.0:1763343272.999839:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57092:x1848998399773440:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 292us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343272.999846:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10437 00000100:00100000:2.0:1763343273.004158:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.004371:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.004373:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399773696 00000100:00100000:1.0:1763343273.004385:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399773696 00000100:00100000:3.0:1763343273.004404:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.004424:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399773568 00000100:00100000:3.0:1763343273.004429:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399773568 00002000:00010000:3.0:1763343273.004461:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/676 (0->18446744073709551615) 00002000:00100000:3.0:1763343273.004466:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5957480 with x1848998399773568 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343273.004478:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5957480. 00000100:00080000:0.0:1763343273.004493:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1763343273.004513:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399773824 00000100:00100000:2.0:1763343273.004518:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399773824 00000100:00100000:3.0:1763343273.004523:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1688 00000100:00100000:3.0:1763343273.004534:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+65:2407:x1848998399773568:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:2.0:1763343273.004547:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/677 (0->18446744073709551615) 00002000:00100000:2.0:1763343273.004552:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5955180 with x1848998399773824 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343273.004560:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5955180. 00000100:00100000:2.0:1763343273.004583:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1689 00000100:00100000:2.0:1763343273.004592:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998399773824:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:3.0:1763343273.004725:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2a4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343273.004726:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2a5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343273.004730:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2a4:0x0] updating lvb mtime from disk: 0 -> 1763343272 00002000:00010000:2.0:1763343273.004732:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2a5:0x0] updating lvb mtime from disk: 0 -> 1763343272 00002000:00010000:3.0:1763343273.004734:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2a4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343273.004737:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2a5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343273.004738:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2a4:0x0] updating lvb ctime from disk: 0 -> 1763343272 00002000:00010000:3.0:1763343273.004742:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2a4:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1763343273.004745:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2a5:0x0] updating lvb ctime from disk: 0 -> 1763343272 00002000:00010000:2.0:1763343273.004749:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2a5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343273.004793:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+66:2407:x1848998399773568:12345-192.168.201.40@tcp:10:bash.0 Request processed in 261us (422us total) trans 21474839115 rc 0/0 00000100:00100000:3.0:1763343273.004802:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1688 00002000:00010000:3.0:1763343273.004806:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/676 (0->18446744073709551615) 00002000:00100000:3.0:1763343273.004808:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5957480 with x1848998399773568 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343273.004813:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5957480. 00000100:00100000:1.0:1763343273.004816:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1690 00000100:00100000:1.0:1763343273.004828:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f648b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+65:2408:x1848998399773696:12345-192.168.201.40@tcp:4:lfs.0 00000100:00080000:3.0:1763343273.004849:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1763343273.004864:0:28386:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343273.004873:0:28386:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2000/0x9104b1ba770a1f01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.004887:0:28386:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.004890:0:28386:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.004896:0:28386:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2000/0x9104b1ba770a1f01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.004916:0:28386:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2000/0x9104b1ba770a1f01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343273.005670:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2408:x1848998399773824:12345-192.168.201.40@tcp:10:bash.0 Request processed in 1074us (1258us total) trans 17179871844 rc 0/0 00000100:00100000:2.0:1763343273.005680:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1689 00002000:00010000:2.0:1763343273.005684:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/677 (0->18446744073709551615) 00002000:00100000:2.0:1763343273.005687:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5955180 with x1848998399773824 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343273.005694:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5955180. 00000100:00100000:2.0:1763343273.007716:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.007807:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399774080 00000100:00100000:0.0:1763343273.007818:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399774080 00000100:00100000:0.0:1763343273.007888:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3682 00000100:00100000:0.0:1763343273.007900:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:55884:x1848998399774080:12345-192.168.201.40@tcp:35:bash.0 00000100:00080000:3.0:1763343273.008134:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1763343273.008221:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:55884:x1848998399774080:12345-192.168.201.40@tcp:35:bash.0 Request processed in 322us (513us total) trans 4294973424 rc 0/0 00000100:00100000:0.0:1763343273.008230:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3682 00000001:00080000:1.0:1763343273.010433:0:24675:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839116 is committed 00000001:00080000:1.0:1763343273.010453:0:24675:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839113 is committed 00000001:00080000:1.0:1763343273.010457:0:24675:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839114 is committed 00002000:00010000:0.0:1763343273.010850:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2a3:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:0.0:1763343273.010855:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2a3:0x0] updating lvb mtime from disk: 0 -> 1763343272 00002000:00010000:0.0:1763343273.010858:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2a3:0x0] updating lvb ctime from disk: 0 -> 1763343272 00002000:00010000:0.0:1763343273.010861:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2a3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1763343273.010873:0:28386:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2000/0x9104b1ba770a1f01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.010885:0:28386:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2000/0x9104b1ba770a1f01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.010902:0:28386:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2000/0x9104b1ba770a1f01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.010910:0:28386:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba2000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343273.010914:0:28386:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2000/0x9104b1ba770a1f01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.010923:0:28386:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2000/0x9104b1ba770a1f01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.010943:0:28386:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2000/0x9104b1ba770a1f01 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.010951:0:28386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2000/0x9104b1ba770a1f01 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343273.011227:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f648b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:2408:x1848998399773696:12345-192.168.201.40@tcp:4:lfs.0 Request processed in 6396us (7073us total) trans 21474839116 rc 0/0 00000100:00100000:0.0:1763343273.011238:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1690 00000100:00100000:2.0:1763343273.013248:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.013439:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399774208 00000100:00100000:0.0:1763343273.013449:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399774208 00000100:00100000:0.0:1763343273.013904:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10438 00000100:00100000:0.0:1763343273.013915:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57095:x1848998399774208:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:0.0:1763343273.013939:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343273.013961:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1f08 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48f0d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.014063:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1f0f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343273.014077:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1f0f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.014088:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1f0f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.014099:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1f16 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343273.014106:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1f16 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.014112:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1f16 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.014178:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1f1d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343273.014186:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1f1d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.014192:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1f1d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:0.0:1763343273.014226:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f1:0x0]: returning size 5 00000004:00200000:0.0:1763343273.014230:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343273.014247:0:6524:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1f1d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.014256:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1f1d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.014264:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1f0f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.014270:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1f0f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.014275:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1f0f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.014282:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1f0f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.014287:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.014291:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1f0f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.014307:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1f0f lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.014322:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f66a1f00) 00010000:00010000:0.0:1763343273.014325:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.014329:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1f0f lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.014335:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1f0f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.014347:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1f16 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.014352:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1f16 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.014356:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1f16 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.014361:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.014364:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1f16 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.014370:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1f16 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.014377:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1b00) 00010000:00010000:0.0:1763343273.014379:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.014381:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1f16 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.014387:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1f16 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.014413:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a1f08 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f0d expref: 287 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.014426:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1f1d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f0d expref: 286 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.014432:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f1:0x0].0x0 (ffff9401c85cc600) 00010000:00010000:0.0:1763343273.014434:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343273.014436:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4514200, rc 0) 00000100:00100000:0.0:1763343273.014497:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57095:x1848998399774208:12345-192.168.201.40@tcp:101:rm.0 Request processed in 584us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343273.014504:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10438 00000100:00100000:2.0:1763343273.018645:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.018705:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399774464 00000100:00100000:0.0:1763343273.018716:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399774464 00000100:00100000:0.0:1763343273.018774:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10439 00000100:00100000:0.0:1763343273.018783:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57095:x1848998399774464:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:0.0:1763343273.018832:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1763343273.018858:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a1ed7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ef1 expref: 286 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.018879:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1f1d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f0d expref: 285 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.018892:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a1ebb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ee3 expref: 284 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.018901:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f1:0x0].0x0 (ffff9401c85cc600) 00010000:00010000:0.0:1763343273.018909:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343273.018934:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1f24 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343273.018946:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1f24 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.018954:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1f24 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.018966:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a1f2b lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343273.018972:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a1f2b lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.018977:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a1f2b lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.019095:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1f32 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343273.019102:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1f32 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.019108:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1f32 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000040:00080000:0.0:1763343273.019337:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1657, 64 off138232 00000040:00080000:0.0:1763343273.019366:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1665, 64 off138928 00000040:00080000:0.0:1763343273.019376:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1666, 64 off138992 00000040:00080000:0.0:1763343273.019384:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1658, 64 off138296 00010000:00010000:0.0:1763343273.019431:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1f39 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343273.019439:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1f39 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.019445:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1f39 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.019451:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1f39 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1f1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.019456:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1f39 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1f1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.019462:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1f39 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1f1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.019489:0:6524:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343273.019505:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1f32 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.019511:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1f32 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.019516:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1f32 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.019521:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff940202040c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.019525:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1f32 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.019531:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1f32 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.019538:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f1:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:0.0:1763343273.019541:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763343273.019545:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1f32 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.019549:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a1f32 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.019649:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1f24 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.019655:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1f24 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.019659:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1f24 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.019664:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1f24 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.019668:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c0030200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.019671:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1f24 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.019676:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1f24 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.019683:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f66a1800) 00010000:00010000:0.0:1763343273.019685:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.019687:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1f24 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.019692:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1f24 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000004:00010000:0.0:1763343273.019704:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d1f529f5 reply state 0000000041ca7e28 transno 4294973425 ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a1f2b lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.019713:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a1f2b lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.019719:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1700) 00010000:00010000:0.0:1763343273.019721:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343273.019723:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343273.019801:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57095:x1848998399774464:12345-192.168.201.40@tcp:36:rm.0 Request processed in 1016us (1164us total) trans 4294973425 rc 0/0 00000100:00100000:0.0:1763343273.019808:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10439 00010000:00010000:2.0:1763343273.020178:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343273.020185:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1f39 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1f1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.020191:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff940202040400 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343273.020194:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1f39 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1f1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.020201:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1f39 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1f1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.020210:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f1:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:2.0:1763343273.020213:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763343273.020216:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1f39 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1f1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.020221:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1f39 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1f1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.020235:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343273.020236:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343273.020238:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343273.021586:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.022338:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399774720 00000100:00100000:1.0:1763343273.022350:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399774720 00000100:00100000:1.0:1763343273.022406:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10440 00000100:00100000:1.0:1763343273.022415:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57092:x1848998399774720:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:1.0:1763343273.022467:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343273.022490:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a1e4b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f0:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ec0 expref: 285 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.022507:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:1.0:1763343273.022511:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343273.022575:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a1f40 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343273.022589:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a1f40 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.022599:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a1f40 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00010000:1.0:1763343273.022709:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fbdffc34 reply state 00000000d774c58f transno 4294973426 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a1f40 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.022725:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a1f40 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.022731:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:1.0:1763343273.022734:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343273.022737:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343273.022825:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57092:x1848998399774720:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 410us (1245us total) trans 4294973426 rc 0/0 00000100:00100000:1.0:1763343273.022833:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10440 00000100:00100000:3.0:1763343273.025725:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.025799:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399774848 00000100:00100000:0.0:1763343273.025815:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399774848 00000100:00100000:0.0:1763343273.025878:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7056 00000100:00100000:0.0:1763343273.025889:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:57092:x1848998399774848:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343273.025909:0:11289:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343273.025932:0:11289:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff940202040c00/0x9104b1ba770a1f47 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48f14 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343273.025957:0:11289:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2a3:0x0] initial LVB size: 4096, mtime: 0x691a7ba8, atime: 0x0, ctime: 0x691a7ba8, blocks: 0x8 00010000:00010000:0.0:1763343273.025980:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343273.025983:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343273.025992:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff940202040c00/0x9104b1ba770a1f47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f14 expref: 13 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.026009:0:11289:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff940202040c00/0x9104b1ba770a1f47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f14 expref: 13 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.026144:0:11289:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940202040c00, rc 0) 00000100:00100000:0.0:1763343273.026318:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:57092:x1848998399774848:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 431us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343273.026326:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7056 00000100:00100000:2.0:1763343273.030737:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.030778:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.030791:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399774976 00000100:00100000:3.0:1763343273.030801:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399774976 00000100:00100000:0.0:1763343273.030846:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399775104 00000100:00100000:0.0:1763343273.030851:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399775104 00000100:00100000:0.0:1763343273.030898:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10441 00000100:00100000:0.0:1763343273.030911:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57096:x1848998399775104:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343273.030936:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343273.030957:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1f4e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48f22 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.031020:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1f55 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343273.031053:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1f55 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.031068:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1f55 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.031078:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1f5c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343273.031084:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1f5c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.031089:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1f5c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.031126:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1f55 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.031131:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1f55 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.031136:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1f55 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.031142:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1f55 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.031147:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c0030200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.031151:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1f55 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.031157:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1f55 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.031166:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f66a1b00) 00010000:00010000:0.0:1763343273.031169:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.031172:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1f55 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.031178:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a1f55 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.031190:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1f5c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.031195:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1f5c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.031200:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1f5c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.031204:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.031206:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1f5c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.031210:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1f5c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.031215:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1700) 00010000:00010000:0.0:1763343273.031217:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.031219:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1f5c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.031224:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1f5c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.031244:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1f4e lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f22 expref: 287 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.031252:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f66a1b00) 00010000:00010000:0.0:1763343273.031255:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.031258:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a1f4e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f22 expref: 287 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.031280:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940202040400, rc 0) 00000100:00100000:0.0:1763343273.031339:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57096:x1848998399775104:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 429us (560us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343273.031345:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10441 00000100:00100000:1.0:1763343273.031745:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7057 00000100:00100000:1.0:1763343273.031756:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:57092:x1848998399774976:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343273.031765:0:11289:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.031780:0:11289:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a1f63 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48f1b expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343273.031801:0:11289:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343273.031816:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.031818:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.031829:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a1f63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f1b expref: 20 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.031843:0:11289:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a1f63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f1b expref: 20 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.031853:0:11289:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba2c00, rc 0) 00000100:00100000:1.0:1763343273.031893:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:57092:x1848998399774976:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 140us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343273.031903:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7057 00000100:00100000:2.0:1763343273.035241:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.035318:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.035453:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399775232 00000100:00100000:3.0:1763343273.035464:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399775232 00002000:00010000:3.0:1763343273.035503:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/675 (5->18446744073709551615) 00002000:00100000:3.0:1763343273.035508:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6274e00 with x1848998399775232 ext(5->18446744073709551615) 00002000:00010000:3.0:1763343273.035519:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c6274e00. 00000100:00100000:3.0:1763343273.035547:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399775360 00000100:00100000:3.0:1763343273.035551:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399775360 00002000:00010000:3.0:1763343273.035563:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/676 (0->18446744073709551615) 00002000:00100000:3.0:1763343273.035565:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c59b7100 with x1848998399775360 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343273.035572:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c59b7100. 00000100:00100000:3.0:1763343273.035718:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1691 00000100:00100000:3.0:1763343273.035728:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2408:x1848998399775232:12345-192.168.201.40@tcp:10:lfs.0 00000100:00100000:1.0:1763343273.035879:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1692 00000100:00100000:1.0:1763343273.035889:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399775360:12345-192.168.201.40@tcp:10:lfs.0 00002000:00010000:1.0:1763343273.036448:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2a4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343273.036453:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2a4:0x0] updating lvb mtime from disk: 0 -> 1763343272 00002000:00010000:1.0:1763343273.036455:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2a4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343273.036457:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2a4:0x0] updating lvb ctime from disk: 0 -> 1763343272 00002000:00010000:1.0:1763343273.036460:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2a4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343273.036525:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399775360:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 636us (1205us total) trans 17179871845 rc 0/0 00000100:00100000:1.0:1763343273.036534:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1692 00002000:00010000:1.0:1763343273.036539:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/676 (0->18446744073709551615) 00002000:00100000:1.0:1763343273.036542:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c59b7100 with x1848998399775360 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343273.036548:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c59b7100. 00002000:00010000:2.0:1763343273.036791:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2a3:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:2.0:1763343273.036794:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2a3:0x0] updating lvb mtime from disk: 1763343272 -> 1763343272 00002000:00010000:2.0:1763343273.036797:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2a3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343273.036799:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2a3:0x0] updating lvb ctime from disk: 1763343272 -> 1763343272 00002000:00010000:2.0:1763343273.036801:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2a3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763343273.036826:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399775232:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 1098us (1594us total) trans 21474839117 rc 0/0 00000100:00100000:2.0:1763343273.036832:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1691 00002000:00010000:2.0:1763343273.036835:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/675 (5->18446744073709551615) 00002000:00100000:2.0:1763343273.036838:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6274e00 with x1848998399775232 ext(5->18446744073709551615) 00002000:00010000:2.0:1763343273.036842:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c6274e00. 00000100:00100000:1.0:1763343273.038471:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.038554:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399775488 00000100:00100000:2.0:1763343273.038563:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399775488 00000100:00100000:2.0:1763343273.038764:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10442 00000100:00100000:2.0:1763343273.038775:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57096:x1848998399775488:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343273.038794:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.038818:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1f6a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48f29 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.038898:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1f71 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343273.038911:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1f71 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.038922:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1f71 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.038934:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1f78 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343273.038940:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1f78 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.038947:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1f78 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.038985:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1f71 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.038991:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1f71 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.038998:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1f71 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.039003:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5088a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.039008:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1f71 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.039015:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1f71 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.039058:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8500) 00010000:00010000:2.0:1763343273.039062:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.039066:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1f71 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.039073:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a1f71 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.039085:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1f78 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.039090:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1f78 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.039095:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1f78 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.039100:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.039103:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1f78 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.039109:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1f78 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.039116:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1700) 00010000:00010000:2.0:1763343273.039118:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.039121:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1f78 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.039127:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1f78 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.039154:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1f6a lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f29 expref: 287 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.039164:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8500) 00010000:00010000:2.0:1763343273.039166:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.039169:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1f6a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f29 expref: 287 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.039182:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089c00, rc 0) 00000100:00100000:2.0:1763343273.039241:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57096:x1848998399775488:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 468us (775us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343273.039249:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10442 00000100:00100000:3.0:1763343273.039654:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.039715:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399775744 00000100:00100000:2.0:1763343273.039721:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399775744 00000100:00100000:2.0:1763343273.039819:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10443 00000100:00100000:2.0:1763343273.039828:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57092:x1848998399775744:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:2.0:1763343273.039980:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1f7f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343273.039992:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1f7f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.039999:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1f7f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00010000:2.0:1763343273.040602:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005f50fabc reply state 000000001352c77d transno 4294973427 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1f7f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.040617:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1f7f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.040623:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:2.0:1763343273.040626:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343273.040629:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343273.040716:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57092:x1848998399775744:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 887us (1059us total) trans 4294973427 rc 0/0 00000100:00100000:2.0:1763343273.040723:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10443 00000100:00100000:0.0:1763343273.041293:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.041403:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399775872 00000100:00100000:2.0:1763343273.041410:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399775872 00000100:00100000:2.0:1763343273.041488:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10444 00000100:00100000:2.0:1763343273.041497:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57096:x1848998399775872:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343273.041511:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.041528:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1f86 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48f30 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.041583:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1f8d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343273.041593:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1f8d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.041601:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1f8d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:2.0:1763343273.041632:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763343273.041637:0:33856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763343273.041666:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a1f86 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f30 expref: 290 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.041682:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1f8d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f30 expref: 289 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.041689:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8300) 00010000:00010000:2.0:1763343273.041692:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763343273.041695:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8693c00, rc 0) 00000100:00100000:2.0:1763343273.042062:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57096:x1848998399775872:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 565us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.042069:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10444 00000100:00100000:1.0:1763343273.042190:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.042320:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399776000 00000100:00100000:0.0:1763343273.042326:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399776000 00000100:00100000:0.0:1763343273.042367:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7058 00000100:00100000:0.0:1763343273.042375:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399776000:12345-192.168.201.40@tcp:2:lfs.0 00002000:00010000:0.0:1763343273.042485:0:11289:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2a3:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763343273.042488:0:11289:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2a3:0x0] updating lvb mtime from disk: 1763343272 -> 1763343272 00002000:00010000:0.0:1763343273.042491:0:11289:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2a3:0x0] updating lvb atime from disk: 0 -> 1763343272 00002000:00010000:0.0:1763343273.042493:0:11289:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2a3:0x0] updating lvb ctime from disk: 1763343272 -> 1763343272 00002000:00010000:0.0:1763343273.042495:0:11289:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2a3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763343273.042539:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399776000:12345-192.168.201.40@tcp:2:lfs.0 Request processed in 164us (349us total) trans 17179871846 rc 0/0 00000100:00100000:0.0:1763343273.042546:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7058 00000100:00100000:1.0:1763343273.044639:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.044879:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399776256 00000100:00100000:0.0:1763343273.044888:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399776256 00000100:00100000:0.0:1763343273.045005:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3683 00000100:00100000:0.0:1763343273.045114:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57092:x1848998399776256:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343273.045125:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000004:00010000:0.0:1763343273.045178:0:19639:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x1f0:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a1db8 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1f0:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e8f expref: 289 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.045231:0:19639:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1f94 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19639 initiator: MDT0 00010000:00010000:0.0:1763343273.045244:0:19639:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1e28 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48eb2 expref: 289 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.045253:0:19639:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1f94 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343273.045322:0:19639:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1e28 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48eb2 expref: 289 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.045336:0:19639:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1e28 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48eb2 expref: 289 pid: 33856 timeout: 1166 lvb_type: 0 00000100:00100000:0.0:1763343273.045351:0:19639:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5ded80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998412943232:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343273.045429:0:19639:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401caf84840 going to sleep for 11 seconds 00000100:00100000:2.0:1763343273.045781:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399776384 00000100:00100000:2.0:1763343273.045787:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399776384 00000100:00100000:2.0:1763343273.045825:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10445 00000100:00100000:2.0:1763343273.045834:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57096:x1848998399776384:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343273.045845:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.045859:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a1f9b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48f37 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.046494:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1fa2 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343273.046508:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1fa2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.046524:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1fa2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.046535:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a1fa9 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343273.046542:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a1fa9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.046548:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a1fa9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.046939:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1fa2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.046947:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1fa2 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.046954:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1fa2 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.046960:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.046964:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1fa2 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.046970:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1fa2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.046983:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8300) 00010000:00010000:2.0:1763343273.046986:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.046990:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1fa2 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.046996:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a1fa2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.047007:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a1fa9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.047012:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a1fa9 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.047017:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a1fa9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.047021:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ec00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.047043:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a1fa9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.047048:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a1fa9 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.047056:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1700) 00010000:00010000:2.0:1763343273.047059:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.047062:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a1fa9 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.047066:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a1fa9 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.047095:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a1f9b lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f37 expref: 291 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343273.047099:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:2.0:1763343273.047105:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8300) 00010000:00010000:2.0:1763343273.047108:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.047111:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a1f9b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f37 expref: 291 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.047119:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8692c00, rc 0) 00000100:00100000:2.0:1763343273.047172:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57096:x1848998399776384:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1339us (2045us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343273.047179:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10445 00000100:00100000:0.0:1763343273.047196:0:19639:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5ded80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998412943232:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343273.047215:0:19639:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1f94 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00000100:00100000:3.0:1763343273.047258:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399776512 00000100:00100000:3.0:1763343273.047265:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399776512 00010000:00010000:3.0:1763343273.047388:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1e28 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48eb2 expref: 290 pid: 33856 timeout: 1166 lvb_type: 0 00000100:00100000:3.0:1763343273.047420:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3383 00000100:00100000:3.0:1763343273.047470:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:2407:x1848998399776512:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343273.047481:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343273.047487:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1e28 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48eb2 expref: 290 pid: 33856 timeout: 1166 lvb_type: 0 00010000:00010000:3.0:1763343273.047500:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1e28 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48eb2 expref: 290 pid: 33856 timeout: 1166 lvb_type: 0 00010000:00010000:3.0:1763343273.047514:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a1e28 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48eb2 expref: 290 pid: 33856 timeout: 1166 lvb_type: 0 00010000:00010000:3.0:1763343273.047526:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:3.0:1763343273.047530:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1f94 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343273.047539:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1f94 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343273.047544:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1f94 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343273.047569:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343273.047592:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:2407:x1848998399776512:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 124us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343273.047599:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3383 00010000:00010000:0.0:1763343273.047643:0:19639:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1f94 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343273.047651:0:19639:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1f94 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00000040:00080000:0.0:1763343273.047866:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1667, 88 off139080 00000004:00080000:0.0:1763343273.047874:0:19639:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1066171849142ns, next at 1066683090291ns, rc = 0 00000040:00080000:0.0:1763343273.048359:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1659, 88 off138384 00000004:00080000:0.0:1763343273.048366:0:19639:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1066172341506ns, next at 1066683237775ns, rc = 0 00000040:00080000:0.0:1763343273.048391:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1660, 88 off138472 00000004:00080000:0.0:1763343273.048396:0:19639:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1066172371122ns, next at 1066683237775ns, rc = 0 00000040:00080000:0.0:1763343273.048406:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1668, 88 off139168 00000004:00080000:0.0:1763343273.048410:0:19639:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1066172385016ns, next at 1066683090291ns, rc = 0 00000100:00100000:3.0:1763343273.049887:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.049934:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399776768 00000100:00100000:2.0:1763343273.049945:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399776768 00000100:00100000:2.0:1763343273.050004:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10446 00000100:00100000:2.0:1763343273.050015:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57096:x1848998399776768:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343273.050472:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.050476:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343273.050509:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a1f8d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f30 expref: 290 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.050526:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8300) 00010000:00010000:2.0:1763343273.050535:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343273.050552:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a1fb0 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48f3e expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.050657:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a1fb7 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343273.050671:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a1fb7 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.050680:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a1fb7 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.050691:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a1fbe lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343273.050697:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a1fbe lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.050703:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a1fbe lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.051098:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a1fc5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343273.051108:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a1fc5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.051115:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a1fc5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:2.0:1763343273.051126:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f3:0x0]: returning size 0 00010000:00010000:2.0:1763343273.051148:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a1fb7 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.051155:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a1fb7 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.051161:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a1fb7 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.051166:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85abe00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.051170:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a1fb7 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.051177:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a1fb7 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.051186:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53900) 00010000:00010000:2.0:1763343273.051188:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.051192:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a1fb7 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.051198:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a1fb7 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:2.0:1763343273.051207:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000063efc6e0 reply state 00000000b9c3eb30 transno 4294973429 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a1fbe lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.051218:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a1fbe lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.051224:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1700) 00010000:00010000:2.0:1763343273.051226:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343273.051229:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343273.051256:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a1fb0 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f3e expref: 292 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.051288:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a1fc5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f3e expref: 291 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.051303:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401edc53e00) 00010000:00010000:2.0:1763343273.051306:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343273.051308:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e90600, rc 0) 00000100:00100000:2.0:1763343273.051376:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57096:x1848998399776768:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1362us (1497us total) trans 4294973429 rc 0/0 00000100:00100000:2.0:1763343273.051387:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10446 00000001:00080000:2.0:1763343273.051543:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973428 is committed 00000004:00080000:2.0:1763343273.051550:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1071 committed 00000004:00080000:2.0:1763343273.051564:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1063 committed 00000004:00080000:2.0:1763343273.051570:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1062 committed 00000004:00080000:2.0:1763343273.051572:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1070 committed 00000004:00010000:2.0:1763343273.051611:0:19639:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e2f03b8b reply state 00000000ec9c9eca transno 4294973428 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1f94 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343273.051623:0:19639:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1f94 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343273.051629:0:19639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:2.0:1763343273.051631:0:19639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1763343273.051633:0:19639:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343273.051638:0:19639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:2.0:1763343273.051640:0:19639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343273.051644:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a1db8 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1f0:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e8f expref: 286 pid: 33856 timeout: 0 lvb_type: 0 00010000:00080000:2.0:1763343273.051694:0:19639:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1763343273.051707:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57092:x1848998399776256:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 6693us (7077us total) trans 4294973428 rc 0/0 00000100:00100000:2.0:1763343273.051715:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3683 00010000:00010000:2.0:1763343273.051736:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1f94 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343273.051743:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1f94 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343273.051748:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1f94 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343273.051754:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.051756:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1f94 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343273.051762:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1f94 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343273.051769:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:2.0:1763343273.051771:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343273.051774:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1f94 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343273.051779:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a1f94 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343273.051876:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a1f2b lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343273.051884:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a1f2b lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343273.051890:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a1f2b lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343273.051895:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff940202041000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343273.051898:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a1f2b lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343273.051904:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a1f2b lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343273.051913:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1700) 00010000:00010000:3.0:1763343273.051916:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343273.051918:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a1f2b lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343273.051922:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a1f2b lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343273.051935:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a1f40 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.051941:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a1f40 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.051950:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a1f40 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.051954:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343273.051957:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a1f40 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.051962:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a1f40 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.051969:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:3.0:1763343273.051971:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343273.051973:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a1f40 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.051978:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a1f40 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.051987:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1f7f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.051992:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1f7f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.051996:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1f7f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.052000:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343273.052002:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1f7f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.052007:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1f7f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.052014:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:3.0:1763343273.052016:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343273.052018:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1f7f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.052080:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a1f7f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000100:00100000:3.0:1763343273.052103:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412943744:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343273.052103:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412943488:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343273.052173:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412943360:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343273.053285:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412943616:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343273.053773:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343273.053824:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412944000:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763343273.053857:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343273.053877:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763343273.053883:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412944128:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343273.053899:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343273.053995:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343273.054047:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412944256:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343273.054072:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343273.054089:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763343273.054094:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412943872:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343273.054116:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343273.054143:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412943488 00000100:00100000:0.0:1763343273.054150:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412943488 00000100:00100000:2.0:1763343273.054182:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412944000 00000100:00100000:2.0:1763343273.054186:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412944000 00000100:00100000:0.0:1763343273.054196:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412944128 00000100:00100000:0.0:1763343273.054198:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412944128 00000100:00100000:2.0:1763343273.054209:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412943744 00000100:00100000:0.0:1763343273.054211:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412944256 00000100:00100000:2.0:1763343273.054212:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412943744 00000100:00100000:0.0:1763343273.054213:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412944256 00000100:00100000:2.0:1763343273.054224:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412943872 00000100:00100000:2.0:1763343273.054226:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412943872 00000100:00100000:0.0:1763343273.054230:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7059 00000100:00100000:2.0:1763343273.054237:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7060 00000100:00100000:0.0:1763343273.054237:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+22:3659:x1848998412943488:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343273.054242:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3659:x1848998412944000:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763343273.054263:0:8626:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:677 count 1 00002000:00080000:0.0:1763343273.054263:0:11289:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:678 count 1 00002000:00010000:2.0:1763343273.054312:0:8626:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343273.054320:0:8626:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba770a1fd3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343273.054324:0:11289:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343273.054329:0:11289:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1fda lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.054334:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.054336:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343273.054336:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343273.054337:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.054342:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba770a1fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.054342:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1fda lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.054355:0:8626:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba770a1fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.054357:0:11289:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1fda lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.054364:0:8626:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba770a1fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.054365:0:11289:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1fda lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.054373:0:11289:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1fda lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.054374:0:8626:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba770a1fd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.054388:0:11289:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1763343273.054392:0:8626:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1763343273.054588:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3659:x1848998412944000:12345-0@lo:6:osp-syn-0-1.0 Request processed in 344us (728us total) trans 21474839118 rc 0/0 00000100:00100000:2.0:1763343273.054595:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7060 00000100:00100000:2.0:1763343273.054610:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7061 00000100:00100000:2.0:1763343273.054617:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3659:x1848998412944128:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1763343273.054696:0:8626:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2a2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343273.054700:0:8626:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2a2:0x0] updating lvb mtime from disk: 1763343272 -> 1763343272 00002000:00010000:2.0:1763343273.054703:0:8626:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2a2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343273.054706:0:8626:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2a2:0x0] updating lvb ctime from disk: 1763343272 -> 1763343272 00002000:00010000:2.0:1763343273.054708:0:8626:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2a2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343273.054809:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7062 00000100:00100000:3.0:1763343273.054820:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3661:x1848998412944256:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763343273.054876:0:35266:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2a3:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763343273.054879:0:35266:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2a3:0x0] updating lvb mtime from disk: 1763343272 -> 1763343272 00002000:00010000:3.0:1763343273.054881:0:35266:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2a3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343273.054883:0:35266:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2a3:0x0] updating lvb ctime from disk: 1763343272 -> 1763343272 00002000:00010000:3.0:1763343273.054886:0:35266:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2a3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343273.054926:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+10:3661:x1848998412944256:12345-0@lo:2:osp-syn-0-1.0 Request processed in 109us (852us total) trans 21474839120 rc 0/0 00000100:00100000:3.0:1763343273.054932:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7062 00000100:00100000:3.0:1763343273.054945:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7063 00000100:00100000:3.0:1763343273.054951:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+23:3661:x1848998412943744:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343273.055047:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1763343273.055475:0:35266:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2a4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343273.055479:0:35266:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2a4:0x0] updating lvb mtime from disk: 1763343272 -> 1763343272 00002000:00010000:3.0:1763343273.055481:0:35266:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2a4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343273.055484:0:35266:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2a4:0x0] updating lvb ctime from disk: 1763343272 -> 1763343272 00002000:00010000:3.0:1763343273.055486:0:35266:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2a4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343273.055513:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+24:3661:x1848998412943744:12345-0@lo:2:osp-syn-1-1.0 Request processed in 562us (1518us total) trans 17179871848 rc 0/0 00000100:00100000:3.0:1763343273.055525:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7063 00000100:00100000:3.0:1763343273.055536:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412943360 00000100:00100000:3.0:1763343273.055541:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412943360 00000100:00100000:3.0:1763343273.055559:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7064 00000100:00100000:3.0:1763343273.055565:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3661:x1848998412943872:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763343273.055575:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3659:x1848998412944128:12345-0@lo:2:osp-syn-0-1.0 Request processed in 959us (1674us total) trans 21474839119 rc 0/0 00002000:00080000:3.0:1763343273.055577:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:676 count 1 00000100:00100000:2.0:1763343273.055582:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7061 00010000:00010000:3.0:1763343273.055591:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba770a1fe1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343273.055595:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7065 00000100:00100000:2.0:1763343273.055600:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+24:3662:x1848998412943360:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763343273.055607:0:35266:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9401d121e800/0x9104b1ba770a1ede lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ef8 expref: 13 pid: 11289 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1763343273.055609:0:8626:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:677 count 1 00010000:00010000:3.0:1763343273.055614:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343273.055616:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343273.055619:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba770a1fe1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.055619:0:8626:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a1fe8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2a5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.055630:0:8626:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1eec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48eff expref: 21 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.055635:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343273.055637:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343273.055639:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a1fe8 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.055647:0:35266:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9401d121e800/0x9104b1ba770a1ede lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ef8 expref: 13 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.055654:0:8626:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1eec lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48eff expref: 21 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.055662:0:35266:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9401d121e800/0x9104b1ba770a1ede lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ef8 expref: 13 pid: 11289 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.055662:0:8626:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1eec lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48eff expref: 21 pid: 35266 timeout: 1166 lvb_type: 0 00000100:00100000:3.0:1763343273.055676:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5179500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35266:1848998412944384:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343273.055677:0:8626:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998412944512:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343273.055946:0:8626:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c3be8300 going to sleep for 11 seconds 00010000:00010000:2.0:1763343273.055959:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763343273.055965:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1fda lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.055973:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343273.055976:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1fda lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.055984:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1fda lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.055999:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1fda lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.056006:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a1fda lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.056038:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343273.056042:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba770a1fd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.056048:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e91e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343273.056050:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba770a1fd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.056056:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba770a1fd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.056065:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba770a1fd3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.056071:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e91e00/0x9104b1ba770a1fd3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.056085:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343273.056086:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343273.056088:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343273.056111:0:3659:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474839114 gen 2 00000004:00080000:2.0:1763343273.056116:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c7ef4e00, transno 21474838928 00000004:00080000:2.0:1763343273.056125:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c8599f80, transno 21474838929 00000004:00080000:2.0:1763343273.056127:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c7ef6680, transno 21474838930 00000004:00080000:2.0:1763343273.056129:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c859ad80, transno 21474838931 00000004:00080000:2.0:1763343273.056132:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5dc8000, transno 21474838932 00000004:00080000:2.0:1763343273.056134:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5dcb800, transno 21474838933 00000004:00080000:2.0:1763343273.056136:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5dcbb80, transno 21474838934 00000004:00080000:2.0:1763343273.056138:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c517b100, transno 21474838935 00000004:00080000:2.0:1763343273.056140:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9dc9880, transno 21474838937 00000004:00080000:2.0:1763343273.056142:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9dc9c00, transno 21474838938 00000004:00080000:2.0:1763343273.056144:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9dcbb80, transno 21474838939 00000004:00080000:2.0:1763343273.056147:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6275880, transno 21474838940 00000004:00080000:2.0:1763343273.056149:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400cc5dc700, transno 21474838943 00000004:00080000:2.0:1763343273.056151:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400cc5dc000, transno 21474838944 00000004:00080000:2.0:1763343273.056160:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c8bc2a00, transno 21474838946 00000004:00080000:2.0:1763343273.056162:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c8bc0000, transno 21474838947 00000004:00080000:2.0:1763343273.056164:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9833480, transno 21474838951 00000004:00080000:2.0:1763343273.056166:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9830a80, transno 21474838952 00000004:00080000:2.0:1763343273.056168:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9832a00, transno 21474838953 00000004:00080000:2.0:1763343273.056170:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b9c700, transno 21474838954 00000004:00080000:2.0:1763343273.056173:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c39b5c00, transno 21474838955 00000004:00080000:2.0:1763343273.056175:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c39b7480, transno 21474838956 00000004:00080000:2.0:1763343273.056178:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c39b4e00, transno 21474838957 00000004:00080000:2.0:1763343273.056180:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c39b7800, transno 21474838958 00000004:00080000:2.0:1763343273.056182:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c39b5f80, transno 21474838961 00000004:00080000:2.0:1763343273.056184:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c514df80, transno 21474838962 00000004:00080000:2.0:1763343273.056187:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6277100, transno 21474838963 00000004:00080000:2.0:1763343273.056189:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6274700, transno 21474838964 00000004:00080000:2.0:1763343273.056191:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5951880, transno 21474838968 00000004:00080000:2.0:1763343273.056193:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5950000, transno 21474838969 00000004:00080000:2.0:1763343273.056195:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc2df80, transno 21474838970 00000004:00080000:2.0:1763343273.056197:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc2c000, transno 21474838971 00000004:00080000:2.0:1763343273.056199:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6b57100, transno 21474838972 00000004:00080000:2.0:1763343273.056201:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6b55180, transno 21474838973 00000004:00080000:2.0:1763343273.056203:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6b54380, transno 21474838974 00000004:00080000:2.0:1763343273.056205:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6b56d80, transno 21474838975 00000004:00080000:2.0:1763343273.056207:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6e8c380, transno 21474838978 00000004:00080000:2.0:1763343273.056210:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6e8ce00, transno 21474838979 00000004:00080000:2.0:1763343273.056212:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6e8df80, transno 21474838980 00000004:00080000:2.0:1763343273.056214:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c3728a80, transno 21474838981 00000004:00080000:2.0:1763343273.056216:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9dc8700, transno 21474838985 00000004:00080000:2.0:1763343273.056218:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6275500, transno 21474838986 00000004:00080000:2.0:1763343273.056221:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9dc9500, transno 21474838987 00000004:00080000:2.0:1763343273.056223:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9dc8380, transno 21474838988 00000004:00080000:2.0:1763343273.056225:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9831c00, transno 21474838989 00000004:00080000:2.0:1763343273.056227:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9831880, transno 21474838990 00000004:00080000:2.0:1763343273.056229:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9831500, transno 21474838991 00000004:00080000:2.0:1763343273.056231:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9832d80, transno 21474838992 00000004:00080000:2.0:1763343273.056233:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9833b80, transno 21474838995 00000004:00080000:2.0:1763343273.056235:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c517bb80, transno 21474838996 00000100:00100000:3.0:1763343273.056287:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc440780 going to sleep for 11 seconds 00000100:00080000:3.0:1763343273.056318:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1763343273.056324:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1763343273.056330:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343273.056344:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343273.056344:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+24:3659:x1848998412943488:12345-0@lo:6:osp-syn-1-1.0 Request processed in 2106us (3071us total) trans 17179871847 rc 0/0 00000100:00100000:0.0:1763343273.056352:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7059 00000100:00100000:0.0:1763343273.056366:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412943616 00000100:00100000:0.0:1763343273.056370:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412943616 00000100:00100000:0.0:1763343273.056394:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7066 00000100:00100000:0.0:1763343273.056400:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+24:3660:x1848998412943616:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343273.056456:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00002000:00010000:0.0:1763343273.056478:0:11289:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2a3:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763343273.056481:0:11289:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2a3:0x0] updating lvb mtime from disk: 1763343272 -> 1763343272 00002000:00010000:0.0:1763343273.056483:0:11289:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2a3:0x0] updating lvb atime from disk: 1763343272 -> 1763343272 00002000:00010000:0.0:1763343273.056485:0:11289:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2a3:0x0] updating lvb ctime from disk: 1763343272 -> 1763343272 00002000:00010000:0.0:1763343273.056487:0:11289:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2a3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763343273.056518:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+25:3660:x1848998412943616:12345-0@lo:2:osp-syn-1-1.0 Request processed in 118us (172us total) trans 17179871849 rc 0/0 00000100:00100000:0.0:1763343273.056523:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7066 00000004:00080000:2.0:1763343273.056675:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6281180, transno 21474838997 00000004:00080000:2.0:1763343273.056780:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6276d80, transno 21474838998 00000004:00080000:2.0:1763343273.056784:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c59b4700, transno 21474839002 00000004:00080000:2.0:1763343273.056786:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c59b5500, transno 21474839003 00000004:00080000:2.0:1763343273.056789:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c59b6300, transno 21474839004 00000004:00080000:2.0:1763343273.056791:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c59b6680, transno 21474839005 00000004:00080000:2.0:1763343273.056793:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400cc5df800, transno 21474839006 00000004:00080000:2.0:1763343273.056795:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400cc5dfb80, transno 21474839007 00000004:00080000:2.0:1763343273.056797:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400cc5dca80, transno 21474839008 00000004:00080000:2.0:1763343273.056800:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400cc5df100, transno 21474839009 00000004:00080000:2.0:1763343273.056802:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c390f100, transno 21474839011 00000004:00080000:2.0:1763343273.056805:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c390ed80, transno 21474839012 00000004:00080000:2.0:1763343273.056808:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c8bc0380, transno 21474839013 00000004:00080000:2.0:1763343273.056810:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c8599c00, transno 21474839014 00000004:00080000:2.0:1763343273.056812:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6505880, transno 21474839016 00000004:00080000:2.0:1763343273.056814:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6280380, transno 21474839017 00000004:00080000:2.0:1763343273.056817:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6507b80, transno 21474839018 00000004:00080000:2.0:1763343273.056819:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6504a80, transno 21474839019 00000004:00080000:2.0:1763343273.056822:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b18700, transno 21474839021 00000004:00080000:2.0:1763343273.056824:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b18000, transno 21474839022 00000004:00080000:2.0:1763343273.056826:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b1b480, transno 21474839023 00000004:00080000:2.0:1763343273.056828:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b19c00, transno 21474839024 00000004:00080000:2.0:1763343273.056831:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c7918e00, transno 21474839026 00000004:00080000:2.0:1763343273.056833:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c791b800, transno 21474839027 00000004:00080000:2.0:1763343273.056835:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c791a680, transno 21474839028 00000004:00080000:2.0:1763343273.056838:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c7918380, transno 21474839029 00000004:00080000:2.0:1763343273.056840:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5dcb100, transno 21474839031 00000004:00080000:2.0:1763343273.056842:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5dcad80, transno 21474839032 00000004:00080000:2.0:1763343273.056895:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5dc8700, transno 21474839033 00000004:00080000:2.0:1763343273.056898:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5dc9880, transno 21474839034 00000004:00080000:2.0:1763343273.056901:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c4b23480, transno 21474839036 00000004:00080000:2.0:1763343273.056903:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c4b21500, transno 21474839037 00000004:00080000:2.0:1763343273.056905:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b9ed80, transno 21474839038 00000004:00080000:2.0:1763343273.056908:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b9c380, transno 21474839039 00000004:00080000:2.0:1763343273.056911:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5952680, transno 21474839042 00000004:00080000:2.0:1763343273.056913:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5952a00, transno 21474839043 00000004:00080000:2.0:1763343273.056915:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c859aa00, transno 21474839044 00000004:00080000:2.0:1763343273.056917:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c8599880, transno 21474839045 00000004:00080000:2.0:1763343273.056919:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401efc73800, transno 21474839049 00000004:00080000:2.0:1763343273.056921:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401efc71500, transno 21474839050 00000004:00080000:2.0:1763343273.056923:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401efc70700, transno 21474839051 00000004:00080000:2.0:1763343273.056926:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401efc71c00, transno 21474839052 00000004:00080000:2.0:1763343273.056928:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6401500, transno 21474839053 00000004:00080000:2.0:1763343273.056930:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6402680, transno 21474839054 00000004:00080000:2.0:1763343273.056940:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b1a680, transno 21474839057 00000004:00080000:2.0:1763343273.056942:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b19180, transno 21474839058 00000004:00080000:2.0:1763343273.056944:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc1ad80, transno 21474839059 00000004:00080000:2.0:1763343273.056946:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc19f80, transno 21474839060 00000004:00080000:2.0:1763343273.056948:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc19500, transno 21474839061 00000004:00080000:2.0:1763343273.056950:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc1b480, transno 21474839062 00000004:00080000:2.0:1763343273.056952:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c791b100, transno 21474839064 00000004:00080000:2.0:1763343273.056955:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c7919c00, transno 21474839065 00000004:00080000:2.0:1763343273.056957:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c791ad80, transno 21474839066 00000004:00080000:2.0:1763343273.056959:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c7918a80, transno 21474839067 00000004:00080000:2.0:1763343273.056962:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c4788380, transno 21474839069 00000004:00080000:2.0:1763343273.056964:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c478aa00, transno 21474839070 00000004:00080000:2.0:1763343273.056967:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c4788e00, transno 21474839071 00000004:00080000:2.0:1763343273.056969:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c4788a80, transno 21474839072 00000004:00080000:2.0:1763343273.056972:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c39b6680, transno 21474839074 00000100:00100000:1.0:1763343273.056973:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000004:00080000:2.0:1763343273.056974:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c39b6300, transno 21474839075 00000004:00080000:2.0:1763343273.056977:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c39b4a80, transno 21474839076 00000004:00080000:2.0:1763343273.056979:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c39b7b80, transno 21474839077 00000004:00080000:2.0:1763343273.056982:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5dc8a80, transno 21474839079 00000004:00080000:2.0:1763343273.056984:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401efc71180, transno 21474839080 00000004:00080000:2.0:1763343273.056987:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401efc72d80, transno 21474839081 00000004:00080000:2.0:1763343273.056989:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401efc70a80, transno 21474839082 00000004:00080000:2.0:1763343273.056992:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b27100, transno 21474839084 00000004:00080000:2.0:1763343273.056994:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b24700, transno 21474839085 00000004:00080000:2.0:1763343273.056996:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b25500, transno 21474839086 00000004:00080000:2.0:1763343273.056999:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b26680, transno 21474839087 00000004:00080000:2.0:1763343273.057002:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5a3c000, transno 21474839090 00000004:00080000:2.0:1763343273.057004:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5a3f800, transno 21474839091 00000004:00080000:2.0:1763343273.057006:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c390c700, transno 21474839092 00000004:00080000:2.0:1763343273.057008:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5a3fb80, transno 21474839093 00000004:00080000:2.0:1763343273.057011:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6507800, transno 21474839097 00000004:00080000:2.0:1763343273.057017:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c7ef6a00, transno 21474839098 00000004:00080000:2.0:1763343273.057020:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6506d80, transno 21474839099 00000100:00100000:0.0:1763343273.057056:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399776896 00000004:00080000:2.0:1763343273.057057:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6505500, transno 21474839100 00000004:00080000:2.0:1763343273.057060:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b24a80, transno 21474839101 00000100:00100000:0.0:1763343273.057061:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399776896 00000004:00080000:2.0:1763343273.057063:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b27800, transno 21474839102 00000004:00080000:2.0:1763343273.057065:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b25880, transno 21474839103 00000004:00080000:2.0:1763343273.057067:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b25f80, transno 21474839104 00000004:00080000:2.0:1763343273.057070:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c517b800, transno 21474839106 00000004:00080000:2.0:1763343273.057072:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5179c00, transno 21474839107 00000004:00080000:2.0:1763343273.057074:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b26d80, transno 21474839108 00000004:00080000:2.0:1763343273.057076:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c517a680, transno 21474839109 00000004:00080000:2.0:1763343273.057079:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c3728700, transno 21474839111 00000004:00080000:2.0:1763343273.057081:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c372ad80, transno 21474839112 00000004:00080000:2.0:1763343273.057083:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5957800, transno 21474839113 00000004:00080000:2.0:1763343273.057086:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5954380, transno 21474839114 00000100:00100000:0.0:1763343273.057091:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399777152 00000100:00100000:0.0:1763343273.057093:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399777152 00000100:00100000:2.0:1763343273.057094:0:3659:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9400c5954700 x1848998412944128/t21474839119(21474839119) o2->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763343289 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1763343273.057106:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5954700/2, rc 0, transno 21474839119 00000100:00100000:2.0:1763343273.057111:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412944128:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343273.057111:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10447 00000100:00100000:0.0:1763343273.057117:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57092:x1848998399776896:12345-192.168.201.40@tcp:101:lfs.0 00000004:00080000:2.0:1763343273.057129:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5957100/2, rc 0, transno 21474839118 00000100:00100000:2.0:1763343273.057132:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412944000:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763343273.057132:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:2.0:1763343273.057142:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400cc5de300/2, rc 0, transno 17179871847 00000100:00100000:2.0:1763343273.057146:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412943488:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1763343273.057147:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1fef lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48f45 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343273.057176:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10448 00000100:00100000:2.0:1763343273.057183:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57096:x1848998399777152:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343273.057190:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343273.057192:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1fef lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f45 expref: 284 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.057199:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1ff6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48f4c expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.057205:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514a00/0x9104b1ba770a1fef lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f45 expref: 284 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.057220:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:0.0:1763343273.057223:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343273.057227:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4514a00, rc 0) 00000100:00100000:0.0:1763343273.057250:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57092:x1848998399776896:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 133us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343273.057256:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10447 00010000:00010000:2.0:1763343273.057288:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1ffd lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343273.057307:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a1fc5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f3e expref: 284 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.057315:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1ffd lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.057340:0:33856:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a1fc5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f3e expref: 284 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.057350:0:33856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a1fc5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f3e expref: 284 pid: 33856 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.057366:0:33856:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412944640:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343273.057400:0:33856:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c3be8000 going to sleep for 11 seconds 00000004:00080000:3.0:1763343273.057845:0:8616:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 4 in progress, 2 in flight, 140 done 00000004:00080000:3.0:1763343273.057876:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400cc5dea00/2, rc 0, transno 17179871849 00000100:00100000:3.0:1763343273.057965:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412943616:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763343273.057992:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5954e00/2, rc 0, transno 21474839120 00000100:00100000:3.0:1763343273.057996:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412944256:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763343273.058006:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400cc5de680/2, rc 0, transno 17179871848 00000100:00100000:3.0:1763343273.058010:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412943744:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343273.062930:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.062965:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399777280 00000100:00100000:1.0:1763343273.062975:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399777280 00010000:00010000:1.0:1763343273.063017:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1eec lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48eff expref: 22 pid: 35266 timeout: 1166 lvb_type: 0 00000100:00100000:1.0:1763343273.063079:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3384 00000100:00100000:1.0:1763343273.063090:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2410:x1848998399777280:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343273.063106:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343273.063113:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1eec lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48eff expref: 22 pid: 35266 timeout: 1166 lvb_type: 0 00010000:00010000:1.0:1763343273.063124:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1eec lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48eff expref: 22 pid: 35266 timeout: 1166 lvb_type: 0 00010000:00010000:1.0:1763343273.063156:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.063158:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.063164:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a1fe8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.063175:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a1fe8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.063198:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343273.063248:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2410:x1848998399777280:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 160us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343273.063256:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3384 00000100:00100000:1.0:1763343273.063305:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.063324:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399777536 00000100:00100000:1.0:1763343273.063328:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399777536 00010000:00010000:1.0:1763343273.063344:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a1fc5 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f3e expref: 285 pid: 33856 timeout: 1166 lvb_type: 0 00000100:00100000:1.0:1763343273.063362:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3385 00000100:00100000:1.0:1763343273.063367:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:2410:x1848998399777536:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343273.063374:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343273.063379:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a1fc5 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f3e expref: 285 pid: 33856 timeout: 1166 lvb_type: 0 00010000:00010000:1.0:1763343273.063386:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a1fc5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f3e expref: 285 pid: 33856 timeout: 1166 lvb_type: 0 00010000:00010000:1.0:1763343273.063400:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401edc53e00) 00010000:00010000:1.0:1763343273.063406:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1ffd lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.063413:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1ffd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.063419:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1ffd lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.063429:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343273.063447:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:2410:x1848998399777536:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 79us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343273.063453:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3385 00000100:00100000:1.0:1763343273.063525:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.063539:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399777408 00000100:00100000:1.0:1763343273.063542:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399777408 00010000:00010000:1.0:1763343273.063557:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9401d121e800/0x9104b1ba770a1ede lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ef8 expref: 14 pid: 11289 timeout: 1166 lvb_type: 0 00000100:00100000:1.0:1763343273.063579:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3386 00000100:00100000:1.0:1763343273.063585:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2410:x1848998399777408:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343273.063594:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343273.063599:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9401d121e800/0x9104b1ba770a1ede lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ef8 expref: 14 pid: 11289 timeout: 1166 lvb_type: 0 00010000:00010000:1.0:1763343273.063609:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9401d121e800/0x9104b1ba770a1ede lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ef8 expref: 14 pid: 11289 timeout: 1166 lvb_type: 0 00010000:00010000:1.0:1763343273.063623:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.063625:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.063628:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba770a1fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.063634:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba770a1fe1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.063645:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343273.063670:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2410:x1848998399777408:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 85us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343273.063676:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3386 00010000:00010000:3.0:1763343273.063842:0:35266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401d121e800/0x9104b1ba770a1ede lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ef8 expref: 13 pid: 11289 timeout: 1166 lvb_type: 0 00000100:00100000:3.0:1763343273.063857:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5179500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35266:1848998412944384:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343273.063879:0:35266:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba770a1fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.063890:0:35266:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba770a1fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.063898:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba770a1fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.063907:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba770a1fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.063915:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba770a1fe1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.063932:0:35266:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343273.063981:0:8626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a1eec lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48eff expref: 21 pid: 35266 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.063996:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998412944512:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343273.064012:0:8626:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a1fe8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.064020:0:8626:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a1fe8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.064044:0:8626:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a1fe8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.064053:0:8626:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a1fe8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.064060:0:8626:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a1fe8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.064075:0:8626:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763343273.064202:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3661:x1848998412943872:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8634us (10082us total) trans 21474839121 rc 0/0 00000100:00100000:3.0:1763343273.064212:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7064 00000100:00100000:2.0:1763343273.064229:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+25:3662:x1848998412943360:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8628us (9180us total) trans 17179871850 rc 0/0 00000100:00100000:2.0:1763343273.064238:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7065 00000004:00080000:3.0:1763343273.064260:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5956a00/2, rc 0, transno 21474839121 00010000:00010000:2.0:1763343273.064262:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1763343273.064270:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412943872:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1763343273.064270:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba770a1fe1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.064285:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b98000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343273.064289:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba770a1fe1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.064309:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba770a1fe1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.064322:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba770a1fe1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.064329:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba770a1fe1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.064344:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343273.064348:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a1fe8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.064353:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e90800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343273.064356:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a1fe8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.064363:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a1fe8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.064377:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a1fe8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.064384:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a1fe8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.064396:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343273.064398:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343273.064399:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343273.064406:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763343273.064425:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400cc5ded80/2, rc 0, transno 17179871850 00000100:00100000:2.0:1763343273.064430:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412943360:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1763343273.064585:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a1fc5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f3e expref: 284 pid: 33856 timeout: 1166 lvb_type: 0 00000100:00100000:0.0:1763343273.064598:0:33856:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412944640:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343273.064617:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1ffd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.064635:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1ffd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.064642:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1ffd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:0.0:1763343273.064667:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f3:0x0]: returning size 0 00000004:00080000:0.0:1763343273.064829:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2a7:0x0], index 1: 0 00000004:00080000:0.0:1763343273.064836:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2a6:0x0], index 0: 0 00000004:00080000:0.0:1763343273.064841:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2a7:0x0], index 0: 0 00000004:00080000:0.0:1763343273.064845:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2a8:0x0], index 1: 0 00010000:00010000:0.0:1763343273.064948:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1ffd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.064955:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1ffd lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.064961:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1ffd lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.064966:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.064969:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1ffd lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.064975:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1ffd lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.064986:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401edc53e00) 00010000:00010000:0.0:1763343273.064989:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343273.064992:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1ffd lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.065001:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a1ffd lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.065075:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1ff6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f4c expref: 284 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.065086:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401edc53e00) 00010000:00010000:0.0:1763343273.065088:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343273.065092:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a1ff6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f4c expref: 284 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.065105:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089c00, rc 0) 00000100:00100000:0.0:1763343273.065150:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57096:x1848998399777152:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 7968us (8176us total) trans 4294973430 rc 301/301 00000100:00100000:0.0:1763343273.065157:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10448 00000100:00100000:1.0:1763343273.065600:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.065754:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399777792 00000100:00100000:2.0:1763343273.065761:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399777792 00000100:00100000:2.0:1763343273.065807:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3684 00000100:00100000:2.0:1763343273.065816:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57092:x1848998399777792:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:2.0:1763343273.066009:0:19639:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1f0:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1763343273.066155:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1669, 64 off139232 00000040:00080000:2.0:1763343273.066182:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1661, 64 off138536 00000040:00080000:2.0:1763343273.066192:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1662, 64 off138600 00000040:00080000:2.0:1763343273.066210:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1671, 64 off139328 00010000:00010000:2.0:1763343273.066257:0:19639:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a200b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19639 initiator: MDT0 00010000:00010000:2.0:1763343273.066277:0:19639:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a200b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343273.066288:0:19639:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a200b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343273.066307:0:19639:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a200b lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343273.066313:0:19639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a200b lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343273.066319:0:19639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a200b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343273.066340:0:19639:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343273.066496:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57092:x1848998399777792:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 679us (896us total) trans 4294973431 rc 0/0 00000100:00100000:2.0:1763343273.066504:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3684 00010000:00010000:3.0:1763343273.066623:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343273.066630:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a200b lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343273.066637:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5088a00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343273.066641:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a200b lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343273.066692:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a200b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343273.066720:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f0:0x0].0x0 (ffff9400c52ecb00) 00010000:00010000:3.0:1763343273.066723:0:7451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343273.066728:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a200b lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343273.066734:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a200b lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343273.066748:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343273.066751:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343273.066752:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343273.068425:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.068502:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.068678:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399778304 00000100:00100000:1.0:1763343273.068690:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399778304 00000100:00100000:1.0:1763343273.068946:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10449 00000100:00100000:1.0:1763343273.068957:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57092:x1848998399778304:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343273.069262:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.069306:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a2012 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48f53 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343273.069389:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399778048 00000100:00100000:0.0:1763343273.069395:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399778048 00010000:00010000:1.0:1763343273.069402:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a2019 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343273.069416:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a2019 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.069428:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a2019 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:0.0:1763343273.069432:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3685 00010000:00010000:1.0:1763343273.069440:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a2020 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00000100:00100000:0.0:1763343273.069440:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8447050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57096:x1848998399778048:12345-192.168.201.40@tcp:35:lfs.0 00010000:00010000:1.0:1763343273.069448:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a2020 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.069454:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a2020 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.069558:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2000/0x9104b1ba770a2027 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343273.069566:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2000/0x9104b1ba770a2027 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.069572:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2000/0x9104b1ba770a2027 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.069666:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a2019 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.069673:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a2019 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.069679:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a2019 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.069684:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.069688:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a2019 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.069694:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a2019 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.069707:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fc4f1800) 00010000:00010000:1.0:1763343273.069709:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.069714:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a2019 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.069719:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a2019 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.069729:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a2020 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00000100:00100000:0.0:1763343273.069734:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8447050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57096:x1848998399778048:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 294us (1324us total) trans 4294973432 rc 0/0 00010000:00010000:1.0:1763343273.069735:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a2020 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.069741:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a2020 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00000100:00100000:0.0:1763343273.069742:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3685 00010000:00010000:1.0:1763343273.069746:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.069748:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a2020 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.069754:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a2020 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.069763:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1700) 00010000:00010000:1.0:1763343273.069765:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.069768:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a2020 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.069773:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a2020 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.069800:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a2012 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f53 expref: 288 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.069815:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2000/0x9104b1ba770a2027 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f53 expref: 287 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.069822:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:1.0:1763343273.069824:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343273.069826:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba2000, rc 0) 00000100:00100000:1.0:1763343273.069865:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57092:x1848998399778304:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 910us (1362us total) trans 4294973433 rc 0/0 00000100:00100000:1.0:1763343273.069871:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10449 00000100:00100000:3.0:1763343273.072973:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.073059:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399778560 00000100:00100000:2.0:1763343273.073071:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399778560 00000100:00100000:2.0:1763343273.073131:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3686 00000100:00100000:2.0:1763343273.073142:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57096:x1848998399778560:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343273.073813:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57096:x1848998399778560:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 671us (848us total) trans 4294973434 rc 0/0 00000100:00100000:2.0:1763343273.073822:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3686 00000100:00100000:1.0:1763343273.074140:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.074306:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.074446:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399778688 00000100:00100000:2.0:1763343273.074452:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399778688 00000100:00100000:2.0:1763343273.074487:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399778816 00000100:00100000:2.0:1763343273.074491:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399778816 00000100:00100000:2.0:1763343273.074600:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7067 00000100:00100000:2.0:1763343273.074610:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2408:x1848998399778688:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343273.074622:0:8626:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.074643:0:8626:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a2035 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48f5a expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343273.074666:0:8626:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343273.074684:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.074686:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.074694:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a2035 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f5a expref: 14 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343273.074709:0:8626:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a2035 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f5a expref: 14 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343273.074720:0:8626:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089c00, rc 0) 00000100:00100000:2.0:1763343273.074757:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399778688:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 149us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.074762:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7067 00000100:00100000:2.0:1763343273.074776:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7068 00000100:00100000:2.0:1763343273.074782:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399778816:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343273.074789:0:8626:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.074801:0:8626:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a203c lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48f61 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343273.074814:0:8626:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343273.074822:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.074824:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.074828:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a203c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f61 expref: 22 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343273.074843:0:8626:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a203c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f61 expref: 22 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343273.074851:0:8626:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089200, rc 0) 00000100:00100000:2.0:1763343273.074873:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2408:x1848998399778816:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 91us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.074879:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7068 00000100:00100000:1.0:1763343273.078340:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.078868:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.078968:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399779200 00000100:00100000:2.0:1763343273.078978:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399779200 00000100:00100000:3.0:1763343273.079051:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399779072 00000100:00100000:3.0:1763343273.079056:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399779072 00000100:00100000:2.0:1763343273.079061:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10450 00000100:00100000:2.0:1763343273.079070:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57092:x1848998399779200:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:3.0:1763343273.079079:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10451 00000100:00100000:3.0:1763343273.079085:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:55884:x1848998399779072:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343273.079095:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.079096:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343273.079098:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343273.079115:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a2043 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48f6f expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.079122:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2000/0x9104b1ba770a2027 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f53 expref: 289 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.079135:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:3.0:1763343273.079139:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343273.079145:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a204a lrc: 2/0,0 mode: --/CW res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48f68 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.079164:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a2043 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f6f expref: 290 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.079176:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a2043 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f6f expref: 290 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.079189:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:2.0:1763343273.079192:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343273.079194:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5088800, rc 0) 00010000:00010000:3.0:1763343273.079221:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a2051 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343273.079230:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a2051 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1f3:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343273.079245:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57092:x1848998399779200:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 176us (915us total) trans 0 rc 0/0 00010000:00010000:3.0:1763343273.079251:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a2051 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1f3:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343273.079255:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10450 00000004:00200000:3.0:1763343273.079264:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f3:0x0]: returning size 0 00010000:00010000:3.0:1763343273.079378:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a204a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f68 expref: 291 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.079397:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a2051 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1f3:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f68 expref: 290 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.079404:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:3.0:1763343273.079406:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:3.0:1763343273.079409:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c6b98000, rc 0) 00000100:00100000:3.0:1763343273.079446:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:55884:x1848998399779072:12345-192.168.201.40@tcp:101:bash.0 Request processed in 360us (578us total) trans 4294973435 rc 0/0 00000100:00100000:3.0:1763343273.079452:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10451 00000100:00100000:0.0:1763343273.082288:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.082371:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.082429:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399779328 00000100:00100000:3.0:1763343273.082439:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399779328 00000100:00100000:3.0:1763343273.082494:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10452 00000100:00100000:3.0:1763343273.082504:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:55884:x1848998399779328:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343273.082533:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343273.082554:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a205f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48f76 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.082589:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2066 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343273.082602:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2066 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.082612:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2066 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.082735:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a205f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f76 expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.082758:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2066 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f76 expref: 291 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.082766:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:3.0:1763343273.082769:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343273.082772:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3a00, rc 0) 00000100:00100000:3.0:1763343273.082831:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:55884:x1848998399779328:12345-192.168.201.40@tcp:101:bash.0 Request processed in 329us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343273.082838:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10452 00000100:00100000:2.0:1763343273.082898:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399779584 00000100:00100000:2.0:1763343273.082903:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399779584 00000100:00100000:2.0:1763343273.082939:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3687 00000100:00100000:2.0:1763343273.082946:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57092:x1848998399779584:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343273.083112:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57092:x1848998399779584:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 166us (739us total) trans 4294973436 rc 0/0 00000100:00100000:2.0:1763343273.083119:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3687 00000100:00100000:0.0:1763343273.086611:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.087854:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399779840 00000100:00100000:3.0:1763343273.087868:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399779840 00000100:00100000:0.0:1763343273.088066:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10453 00000100:00100000:0.0:1763343273.088077:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:55884:x1848998399779840:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:0.0:1763343273.088135:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343273.088162:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a2051 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1f3:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f68 expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.088180:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:0.0:1763343273.088185:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343273.088387:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a206d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343273.088401:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a206d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.088410:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a206d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000001:00080000:0.0:1763343273.088470:0:6524:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973437 00000004:00010000:0.0:1763343273.088495:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000043032210 reply state 000000005301d4f3 transno 4294973438 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a206d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.088506:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a206d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.088512:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:0.0:1763343273.088515:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343273.088517:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343273.088604:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:55884:x1848998399779840:12345-192.168.201.40@tcp:36:bash.0 Request processed in 528us (2002us total) trans 4294973438 rc 0/0 00000100:00100000:0.0:1763343273.088612:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10453 00000020:00080000:0.0:1763343273.088618:0:6524:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343273.088781:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.088992:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399780096 00000100:00100000:3.0:1763343273.088997:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399780096 00000100:00100000:3.0:1763343273.089054:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10454 00000100:00100000:3.0:1763343273.089062:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57092:x1848998399780096:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343273.089074:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343273.089089:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2000/0x9104b1ba770a2074 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48f7d expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.089198:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a207b lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343273.089210:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a207b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.089220:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a207b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.089231:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a2082 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343273.089238:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a2082 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.089245:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a2082 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.089346:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a2089 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343273.089355:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a2089 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.089366:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a2089 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343273.089374:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f3:0x0]: returning size 0 00010000:00010000:2.0:1763343273.089428:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a207b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.089435:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a207b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.089440:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a207b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.089445:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a207b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.089450:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5088a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.089455:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a207b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.089461:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a207b lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.089471:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f669ee00) 00010000:00010000:2.0:1763343273.089474:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.089478:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a207b lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.089484:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a207b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.089493:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a2082 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.089503:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a2082 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.089508:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a2082 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.089513:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.089515:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a2082 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.089521:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a2082 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.089527:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1700) 00010000:00010000:2.0:1763343273.089529:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.089532:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a2082 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.089537:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a2082 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.089568:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2000/0x9104b1ba770a2074 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f7d expref: 297 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.089584:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a2089 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f7d expref: 296 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.089591:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:2.0:1763343273.089593:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343273.089595:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e90800, rc 0) 00000100:00100000:2.0:1763343273.089642:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57092:x1848998399780096:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 581us (861us total) trans 4294973439 rc 0/0 00000100:00100000:2.0:1763343273.089649:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10454 00000100:00100000:1.0:1763343273.092429:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.092484:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399780352 00000100:00100000:0.0:1763343273.092494:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399780352 00000100:00100000:0.0:1763343273.092551:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3688 00000100:00100000:0.0:1763343273.092562:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57092:x1848998399780352:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343273.092812:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57092:x1848998399780352:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 251us (393us total) trans 4294973440 rc 0/0 00000100:00100000:0.0:1763343273.092820:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3688 00000100:00100000:0.0:1763343273.096521:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.096600:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399780608 00000100:00100000:2.0:1763343273.096612:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399780608 00000100:00100000:0.0:1763343273.096672:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.096921:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10455 00000100:00100000:2.0:1763343273.096931:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:55884:x1848998399780608:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343273.096955:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.096959:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:3.0:1763343273.096966:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399780736 00000100:00100000:3.0:1763343273.096971:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399780736 00010000:00010000:2.0:1763343273.096985:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a2043 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f6f expref: 298 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.097004:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00000100:00100000:3.0:1763343273.097007:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3689 00010000:00010000:2.0:1763343273.097009:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343273.097014:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57092:x1848998399780736:12345-192.168.201.40@tcp:33:lfs.0 00010000:00010000:2.0:1763343273.097049:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a2097 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48f84 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.097122:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a209e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343273.097134:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a2089 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f7d expref: 298 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.097143:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a209e lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.097172:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a2089 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f7d expref: 298 pid: 7641 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343273.097175:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57092:x1848998399780736:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 162us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343273.097183:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3689 00010000:00010000:2.0:1763343273.097185:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a2089 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f7d expref: 298 pid: 7641 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.097203:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412944768:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343273.097253:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c3be8300 going to sleep for 11 seconds 00000100:00100000:3.0:1763343273.101146:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.102830:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412944768:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343273.102864:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a209e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:0.0:1763343273.102948:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399780864 00000100:00100000:0.0:1763343273.102957:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399780864 00010000:00010000:0.0:1763343273.102996:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a2089 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f7d expref: 298 pid: 7641 timeout: 1166 lvb_type: 0 00000100:00100000:0.0:1763343273.103051:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3387 00000100:00100000:0.0:1763343273.103061:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8392050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:2407:x1848998399780864:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343273.103077:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343273.103083:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a2089 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f7d expref: 298 pid: 7641 timeout: 1166 lvb_type: 0 00010000:00010000:0.0:1763343273.103095:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a2089 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f7d expref: 298 pid: 7641 timeout: 1166 lvb_type: 0 00010000:00010000:0.0:1763343273.103117:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a2089 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f7d expref: 298 pid: 7641 timeout: 1166 lvb_type: 0 00010000:00010000:0.0:1763343273.103132:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:0.0:1763343273.103136:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a209e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.103146:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a209e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.103153:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a209e lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.103178:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343273.103247:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8392050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:2407:x1848998399780864:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 186us (2110us total) trans 0 rc 0/0 00010000:00010000:2.0:1763343273.103255:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a209e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:0.0:1763343273.103255:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3387 00010000:00010000:2.0:1763343273.103262:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a209e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000040:00080000:2.0:1763343273.103899:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1672, 88 off139416 00000004:00080000:2.0:1763343273.103908:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1066227883481ns, next at 1066683090291ns, rc = 0 00000040:00080000:2.0:1763343273.103950:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1663, 88 off138688 00000004:00080000:2.0:1763343273.103955:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1066227930536ns, next at 1066683237775ns, rc = 0 00000040:00080000:2.0:1763343273.104040:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1664, 88 off138776 00000004:00080000:2.0:1763343273.104046:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1066228021066ns, next at 1066683237775ns, rc = 0 00000040:00080000:2.0:1763343273.104073:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1673, 88 off139504 00000004:00080000:2.0:1763343273.104078:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1066228053211ns, next at 1066683090291ns, rc = 0 00000001:00080000:1.0:1763343273.107779:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973441 is committed 00000004:00080000:1.0:1763343273.107792:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1073 committed 00000004:00080000:1.0:1763343273.107803:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1065 committed 00000004:00080000:1.0:1763343273.107818:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1064 committed 00000004:00080000:1.0:1763343273.107821:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1072 committed 00010000:00010000:3.0:1763343273.107823:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a1fbe lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.107836:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a1fbe lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.107844:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a1fbe lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.107851:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85aa600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343273.107856:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a1fbe lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.107865:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a1fbe lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.107882:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1700) 00010000:00010000:3.0:1763343273.107885:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343273.107890:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a1fbe lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.107896:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a1fbe lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.107921:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a206d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343273.107927:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a206d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343273.107933:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a206d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343273.107938:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343273.107942:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a206d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343273.107947:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a206d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343273.107954:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:3.0:1763343273.107957:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343273.107960:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a206d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343273.107966:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a206d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000100:00100000:3.0:1763343273.109142:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343273.109177:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412944896:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763343273.109207:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412945152:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343273.111231:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412945408:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343273.111349:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343273.111396:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343273.111409:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412945664:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343273.111432:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343273.111451:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1763343273.111458:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412945024:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763343273.111480:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343273.111503:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412945536:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343273.111523:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343273.111558:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412945152 00000100:00100000:2.0:1763343273.111565:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412945152 00000100:00100000:2.0:1763343273.111607:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412944896 00000100:00100000:2.0:1763343273.111611:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412944896 00000100:00100000:2.0:1763343273.111627:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412945664 00000100:00100000:2.0:1763343273.111630:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412945664 00000100:00100000:2.0:1763343273.111646:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412945024 00000100:00100000:2.0:1763343273.111648:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412945024 00000100:00100000:2.0:1763343273.111659:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412945536 00000100:00100000:2.0:1763343273.111662:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412945536 00000100:00100000:2.0:1763343273.111679:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7069 00000100:00100000:2.0:1763343273.111687:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+11:3660:x1848998412945152:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343273.111878:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+12:3660:x1848998412945152:12345-0@lo:2:osp-syn-0-1.0 Request processed in 190us (527us total) trans 21474839122 rc 0/0 00000100:00100000:2.0:1763343273.111885:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7069 00000100:00100000:2.0:1763343273.111902:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7070 00000100:00100000:2.0:1763343273.111907:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+11:3661:x1848998412944896:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763343273.111922:0:8412:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:674 count 1 00010000:00010000:2.0:1763343273.111940:0:8412:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5088800/0x9104b1ba770a20a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.111960:0:8412:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5089600/0x9104b1ba770a1d6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e73 expref: 13 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.111967:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343273.111970:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343273.111974:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5088800/0x9104b1ba770a20a5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.112005:0:8412:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5089600/0x9104b1ba770a1d6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e73 expref: 13 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.112020:0:8412:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5089600/0x9104b1ba770a1d6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e73 expref: 13 pid: 8413 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.112058:0:8412:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998412945920:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343273.112121:0:8412:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c3be8000 going to sleep for 11 seconds 00000100:00100000:3.0:1763343273.112130:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7071 00000100:00100000:3.0:1763343273.112142:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+26:3660:x1848998412945664:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343273.112147:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7072 00000100:00100000:2.0:1763343273.112157:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+11:3660:x1848998412945024:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763343273.112171:0:35281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:675 count 1 00010000:00010000:2.0:1763343273.112184:0:35281:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a20ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.112196:0:35281:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff940202040c00/0x9104b1ba770a1f47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f14 expref: 13 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.112202:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343273.112204:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343273.112207:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a20ac lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.112229:0:35281:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff940202040c00/0x9104b1ba770a1f47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f14 expref: 13 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343273.112243:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+27:3660:x1848998412945664:12345-0@lo:2:osp-syn-1-1.0 Request processed in 103us (807us total) trans 17179871851 rc 0/0 00010000:00010000:2.0:1763343273.112246:0:35281:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff940202040c00/0x9104b1ba770a1f47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f14 expref: 13 pid: 11289 timeout: 1166 lvb_type: 0 00000100:00100000:3.0:1763343273.112255:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7071 00000100:00100000:2.0:1763343273.112266:0:35281:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35281:1848998412946048:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343273.112273:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7073 00000100:00100000:3.0:1763343273.112281:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+26:3660:x1848998412945536:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763343273.112305:0:28562:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:676 count 1 00000100:00100000:2.0:1763343273.112308:0:35281:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401caf84840 going to sleep for 11 seconds 00010000:00010000:3.0:1763343273.112319:0:28562:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a20b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.112334:0:28562:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a1f63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f1b expref: 21 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.112348:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343273.112350:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343273.112354:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a20b3 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1763343273.112355:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b1a680/2, rc 0, transno 17179871851 00000100:00100000:2.0:1763343273.112363:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412945664:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1763343273.112373:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c59b4700/2, rc 0, transno 21474839122 00000100:00100000:2.0:1763343273.112377:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412945152:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1763343273.112546:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a209e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f84 expref: 283 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.112558:0:28562:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a1f63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f1b expref: 21 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.112559:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:2.0:1763343273.112565:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763343273.112576:0:28562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a1f63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f1b expref: 21 pid: 11289 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.112583:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a2097 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f84 expref: 283 pid: 7641 timeout: 0 lvb_type: 3 00000100:00100000:3.0:1763343273.112593:0:28562:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6e8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28562:1848998412946176:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343273.112605:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a209e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f84 expref: 282 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.112635:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:2.0:1763343273.112638:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:3.0:1763343273.112641:0:28562:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc440e40 going to sleep for 11 seconds 00010000:00010000:2.0:1763343273.112641:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e91e00, rc 0) 00000100:00100000:2.0:1763343273.112672:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:55884:x1848998399780608:12345-192.168.201.40@tcp:101:bash.0 Request processed in 15742us (16161us total) trans 4294973441 rc 0/0 00000100:00100000:2.0:1763343273.112682:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10455 00000100:00100000:0.0:1763343273.112817:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412945280:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343273.112849:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343273.112868:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412945792:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343273.112886:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343273.112911:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412945280 00000100:00100000:0.0:1763343273.112915:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412945280 00000100:00100000:1.0:1763343273.113017:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343273.114417:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412945792 00000100:00100000:0.0:1763343273.114426:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412945792 00000100:00100000:0.0:1763343273.114462:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412945408 00000100:00100000:0.0:1763343273.114465:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412945408 00000100:00100000:0.0:1763343273.114481:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7074 00000100:00100000:0.0:1763343273.114488:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+12:3661:x1848998412945280:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763343273.114620:0:11289:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2a7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343273.114624:0:11289:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2a7:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343273.114626:0:11289:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2a7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343273.114628:0:11289:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2a7:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343273.114630:0:11289:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2a7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343273.114677:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+13:3661:x1848998412945280:12345-0@lo:2:osp-syn-0-1.0 Request processed in 189us (1827us total) trans 21474839123 rc 0/0 00000100:00100000:0.0:1763343273.114683:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7074 00000100:00100000:0.0:1763343273.114700:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7075 00000100:00100000:0.0:1763343273.114706:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+28:3661:x1848998412945792:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1763343273.114769:0:11289:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2a8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343273.114772:0:11289:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2a8:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343273.114774:0:11289:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2a8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343273.114776:0:11289:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2a8:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343273.114778:0:11289:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2a8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343273.114803:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+29:3661:x1848998412945792:12345-0@lo:2:osp-syn-1-1.0 Request processed in 98us (1916us total) trans 17179871852 rc 0/0 00000100:00100000:0.0:1763343273.114809:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7075 00000100:00100000:0.0:1763343273.114823:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7076 00000100:00100000:0.0:1763343273.114828:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+28:3662:x1848998412945408:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763343273.114841:0:11289:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:675 count 1 00010000:00010000:0.0:1763343273.114857:0:11289:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c4515600/0x9104b1ba770a20ba lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.114875:0:11289:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1e75 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ed5 expref: 21 pid: 11289 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343273.116121:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343273.116124:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343273.116131:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c4515600/0x9104b1ba770a20ba lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.116175:0:11289:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1e75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ed5 expref: 21 pid: 11289 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343273.116193:0:11289:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1e75 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ed5 expref: 21 pid: 11289 timeout: 1166 lvb_type: 1 00000100:00100000:0.0:1763343273.116209:0:11289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b57100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11289:1848998412946304:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343273.116281:0:11289:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401cbf74d80 going to sleep for 11 seconds 00000004:00080000:0.0:1763343273.116355:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c59b5500/2, rc 0, transno 21474839123 00000100:00100000:0.0:1763343273.116362:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412945280:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763343273.116378:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b19180/2, rc 0, transno 17179871852 00000100:00100000:0.0:1763343273.116383:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412945792:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343273.119958:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.120076:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399781120 00000100:00100000:0.0:1763343273.120088:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399781120 00000100:00100000:0.0:1763343273.120144:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10456 00000100:00100000:0.0:1763343273.120155:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57097:x1848998399781120:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343273.120176:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343273.120200:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a20c1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48f8b expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.120281:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a20c8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343273.120308:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a20c8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.120321:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a20c8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.120334:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a20cf lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343273.120341:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a20cf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.120347:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a20cf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.120460:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a20d6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343273.120470:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a20d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.120477:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a20d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343273.120488:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f3:0x0]: returning size 2 00010000:00010000:0.0:1763343273.120585:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a20c8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.120592:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a20c8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.120598:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a20c8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.120603:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a20c8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.120609:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e90800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.120614:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a20c8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.120620:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a20c8 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.120636:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f66a1500) 00010000:00010000:0.0:1763343273.120638:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.120643:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a20c8 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.120649:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a20c8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.120662:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a20cf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.120667:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a20cf lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.120672:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a20cf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.120676:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff940202041000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.120678:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a20cf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.120683:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a20cf lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.120688:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1000) 00010000:00010000:0.0:1763343273.120690:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.120693:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a20cf lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.120697:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a20cf lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.120738:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a20c1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f8b expref: 285 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.120754:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a20d6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f8b expref: 284 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.120761:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:0.0:1763343273.120763:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343273.120766:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940202040400, rc 0) 00000100:00100000:0.0:1763343273.120827:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57097:x1848998399781120:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 673us (879us total) trans 4294973442 rc 0/0 00000100:00100000:0.0:1763343273.120835:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10456 00000100:00100000:1.0:1763343273.124865:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.124895:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399781376 00000100:00100000:1.0:1763343273.124903:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399781376 00000100:00100000:1.0:1763343273.124955:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7077 00000100:00100000:1.0:1763343273.124966:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:55884:x1848998399781376:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343273.124985:0:8626:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.125009:0:8626:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a20e4 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48f92 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343273.125064:0:8626:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343273.125088:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.125091:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.125101:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a20e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f92 expref: 23 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.125118:0:8626:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a20e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f92 expref: 23 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.125132:0:8626:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fd2dea00, rc 0) 00000100:00100000:1.0:1763343273.125190:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:55884:x1848998399781376:12345-192.168.201.40@tcp:101:bash.0 Request processed in 225us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343273.125197:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7077 00000100:00100000:1.0:1763343273.125243:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.125374:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.125393:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.125411:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399781248 00000100:00100000:1.0:1763343273.125416:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399781248 00010000:00010000:1.0:1763343273.125437:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089600/0x9104b1ba770a1d6b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e73 expref: 14 pid: 8413 timeout: 1166 lvb_type: 0 00000100:00100000:1.0:1763343273.125457:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399781504 00000100:00100000:1.0:1763343273.125459:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399781504 00010000:00010000:1.0:1763343273.125470:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff940202040c00/0x9104b1ba770a1f47 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f14 expref: 15 pid: 11289 timeout: 1166 lvb_type: 0 00000100:00100000:1.0:1763343273.125484:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399781632 00000100:00100000:1.0:1763343273.125486:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399781632 00010000:00010000:1.0:1763343273.125497:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a1f63 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f1b expref: 23 pid: 11289 timeout: 1166 lvb_type: 0 00000100:00100000:1.0:1763343273.125513:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3388 00000100:00100000:1.0:1763343273.125519:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998399781248:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343273.125531:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343273.125536:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5089600/0x9104b1ba770a1d6b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e73 expref: 15 pid: 8413 timeout: 1166 lvb_type: 0 00010000:00010000:1.0:1763343273.125548:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5089600/0x9104b1ba770a1d6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e73 expref: 15 pid: 8413 timeout: 1166 lvb_type: 0 00010000:00010000:1.0:1763343273.125567:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.125570:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.125574:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5088800/0x9104b1ba770a20a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.125588:0:6511:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5088800/0x9104b1ba770a20a5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.125606:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343273.125630:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998399781248:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 111us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343273.125637:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3388 00000100:00100000:1.0:1763343273.125650:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3389 00000100:00100000:1.0:1763343273.125657:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399781504:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343273.125664:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343273.125669:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff940202040c00/0x9104b1ba770a1f47 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f14 expref: 14 pid: 11289 timeout: 1166 lvb_type: 0 00010000:00010000:1.0:1763343273.125678:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff940202040c00/0x9104b1ba770a1f47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f14 expref: 14 pid: 11289 timeout: 1166 lvb_type: 0 00010000:00010000:1.0:1763343273.125689:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.125691:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.125694:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a20ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.125700:0:6511:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a20ac lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.125711:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343273.125728:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399781504:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 73us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343273.125735:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3389 00000100:00100000:1.0:1763343273.125748:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3390 00000100:00100000:1.0:1763343273.125755:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2409:x1848998399781632:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343273.125762:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343273.125767:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a1f63 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f1b expref: 23 pid: 11289 timeout: 1166 lvb_type: 0 00010000:00010000:1.0:1763343273.125775:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a1f63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f1b expref: 23 pid: 11289 timeout: 1166 lvb_type: 0 00010000:00010000:1.0:1763343273.125787:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.125789:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.125792:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a20b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.125799:0:6511:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a20b3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.125810:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343273.125828:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2409:x1848998399781632:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 74us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343273.125835:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3390 00000100:00100000:1.0:1763343273.125878:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.125894:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399781760 00000100:00100000:1.0:1763343273.125897:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399781760 00010000:00010000:1.0:1763343273.125910:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1e75 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ed5 expref: 23 pid: 11289 timeout: 1166 lvb_type: 1 00000100:00100000:1.0:1763343273.125934:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3391 00000100:00100000:1.0:1763343273.125940:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2408:x1848998399781760:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343273.125947:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343273.125951:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1e75 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ed5 expref: 23 pid: 11289 timeout: 1166 lvb_type: 1 00010000:00010000:1.0:1763343273.125960:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1e75 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ed5 expref: 23 pid: 11289 timeout: 1166 lvb_type: 1 00010000:00010000:1.0:1763343273.125974:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.125976:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.125979:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c4515600/0x9104b1ba770a20ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.125986:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c4515600/0x9104b1ba770a20ba lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.125996:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343273.126013:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2408:x1848998399781760:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 73us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343273.126019:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3391 00010000:00010000:3.0:1763343273.126224:0:28562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a1f63 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f1b expref: 22 pid: 11289 timeout: 1166 lvb_type: 0 00000100:00100000:3.0:1763343273.126239:0:28562:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6e8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28562:1848998412946176:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343273.126260:0:28562:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a20b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.126269:0:28562:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a20b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.126276:0:28562:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a20b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.126291:0:28562:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a20b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.126313:0:28562:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a20b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.126337:0:28562:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343273.126549:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+29:3660:x1848998412945536:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14268us (15023us total) trans 17179871853 rc 0/0 00000100:00100000:3.0:1763343273.126557:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7073 00000004:00080000:3.0:1763343273.126603:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b19c00/2, rc 0, transno 17179871853 00000100:00100000:3.0:1763343273.126609:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412945536:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1763343273.127048:0:35281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff940202040c00/0x9104b1ba770a1f47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f14 expref: 13 pid: 11289 timeout: 1166 lvb_type: 0 00000100:00100000:0.0:1763343273.127063:0:35281:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35281:1848998412946048:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343273.127078:0:35281:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a20ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.127086:0:35281:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a20ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.127092:0:35281:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a20ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.127098:0:35281:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a20ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.127109:0:35281:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a20ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.127125:0:35281:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1763343273.127351:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+13:3660:x1848998412945024:12345-0@lo:6:osp-syn-0-1.0 Request processed in 15194us (15868us total) trans 21474839124 rc 0/0 00000100:00100000:0.0:1763343273.127358:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7072 00010000:00010000:0.0:1763343273.127395:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763343273.127401:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a20b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.127408:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343273.127412:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a20b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.127421:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a20b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.127436:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a20b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.127443:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a20b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.127458:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343273.127461:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a20ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.127467:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343273.127469:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a20ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.127475:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a20ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.127484:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a20ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.127490:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a20ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.127500:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343273.127502:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343273.127504:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343273.127527:0:11289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a1e75 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ed5 expref: 21 pid: 11289 timeout: 1166 lvb_type: 1 00000100:00100000:0.0:1763343273.127536:0:11289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b57100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11289:1848998412946304:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343273.127551:0:11289:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c4515600/0x9104b1ba770a20ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.127559:0:11289:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c4515600/0x9104b1ba770a20ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.127570:0:11289:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c4515600/0x9104b1ba770a20ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.127577:0:11289:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c4515600/0x9104b1ba770a20ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.127583:0:11289:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c4515600/0x9104b1ba770a20ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.127594:0:11289:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343273.127758:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+29:3662:x1848998412945408:12345-0@lo:6:osp-syn-1-1.0 Request processed in 12928us (14740us total) trans 17179871854 rc 0/0 00000100:00100000:0.0:1763343273.127765:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7076 00000004:00080000:0.0:1763343273.127802:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b1b480/2, rc 0, transno 17179871854 00000100:00100000:0.0:1763343273.127807:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412945408:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763343273.127886:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343273.127891:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c4515600/0x9104b1ba770a20ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.127898:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4515600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343273.127901:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c4515600/0x9104b1ba770a20ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.127907:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c4515600/0x9104b1ba770a20ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.127918:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c4515600/0x9104b1ba770a20ba lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.127928:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c4515600/0x9104b1ba770a20ba lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.127940:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343273.127941:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343273.127943:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343273.128048:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c59b7800/2, rc 0, transno 21474839124 00000100:00100000:3.0:1763343273.128053:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412945024:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1763343273.128240:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5089600/0x9104b1ba770a1d6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48e73 expref: 12 pid: 8413 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.128250:0:8412:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998412945920:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343273.128267:0:8412:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5088800/0x9104b1ba770a20a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.128274:0:8412:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5088800/0x9104b1ba770a20a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.128280:0:8412:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5088800/0x9104b1ba770a20a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.128287:0:8412:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5088800/0x9104b1ba770a20a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.128303:0:8412:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5088800/0x9104b1ba770a20a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.128318:0:8412:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343273.128436:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+13:3661:x1848998412944896:12345-0@lo:6:osp-syn-0-1.0 Request processed in 16527us (17039us total) trans 21474839125 rc 0/0 00000100:00100000:2.0:1763343273.128442:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7070 00000004:00080000:3.0:1763343273.128500:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c59b6a00/2, rc 0, transno 21474839125 00000100:00100000:3.0:1763343273.128505:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412944896:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763343273.128566:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343273.128571:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5088800/0x9104b1ba770a20a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.128577:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5088800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343273.128921:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5088800/0x9104b1ba770a20a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.128931:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5088800/0x9104b1ba770a20a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.128949:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5088800/0x9104b1ba770a20a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.128956:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5088800/0x9104b1ba770a20a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.128971:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343273.128973:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343273.128975:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343273.129151:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343273.129413:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.129473:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399781888 00000100:00100000:2.0:1763343273.129481:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399781888 00000100:00100000:2.0:1763343273.129523:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7078 00000100:00100000:2.0:1763343273.129532:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399781888:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343273.129546:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.129562:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a20eb lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48f99 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343273.129615:0:8412:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8412:1848998412946432:192.168.201.40@tcp:106: 00000100:00100000:2.0:1763343273.129980:0:8412:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401caf84840 going to sleep for 11 seconds 00000100:00100000:3.0:1763343273.132851:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.133630:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399782016 00000100:00100000:0.0:1763343273.133641:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399782016 00000100:00100000:0.0:1763343273.133697:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7079 00000100:00100000:0.0:1763343273.133707:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:55884:x1848998399782016:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343273.133728:0:11289:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343273.133753:0:11289:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff940202041000/0x9104b1ba770a20f2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48fa0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343273.133775:0:11289:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343273.133799:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343273.133802:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343273.133811:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff940202041000/0x9104b1ba770a20f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fa0 expref: 13 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.133827:0:11289:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff940202041000/0x9104b1ba770a20f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fa0 expref: 13 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.133839:0:11289:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940202041000, rc 0) 00000100:00100000:0.0:1763343273.133904:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:55884:x1848998399782016:12345-192.168.201.40@tcp:101:bash.0 Request processed in 199us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343273.133911:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7079 00002000:00010000:0.0:1763343273.134796:0:8412:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000400:0x2a7:0x0] updating lvb mtime: 0 -> 1763343272 00002000:00010000:0.0:1763343273.134802:0:8412:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000400:0x2a7:0x0] updating lvb atime: 0 -> 1763343272 00002000:00010000:0.0:1763343273.134804:0:8412:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000400:0x2a7:0x0] updating lvb ctime: 0 -> 1763343272 00000100:00100000:0.0:1763343273.134820:0:8412:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8412:1848998412946432:192.168.201.40@tcp:106: 00010000:00010000:0.0:1763343273.134852:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a20eb lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f99 expref: 22 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343273.134868:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a20eb lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f99 expref: 22 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343273.134878:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5088a00, rc 0) 00000100:00100000:0.0:1763343273.135618:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399781888:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 6082us (6201us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343273.135627:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7078 00000100:00100000:3.0:1763343273.138205:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.138963:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.139070:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.139198:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399782144 00000100:00100000:0.0:1763343273.139209:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399782144 00002000:00010000:0.0:1763343273.139250:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/679 (0->18446744073709551615) 00002000:00100000:0.0:1763343273.139256:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c9dc9880 with x1848998399782144 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343273.139269:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401c9dc9880. 00000100:00100000:0.0:1763343273.139314:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399782400 00000100:00100000:0.0:1763343273.139318:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399782400 00002000:00010000:0.0:1763343273.139331:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/678 (0->18446744073709551615) 00002000:00100000:0.0:1763343273.139334:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400cc5df100 with x1848998399782400 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343273.139341:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400cc5df100. 00000100:00100000:0.0:1763343273.139360:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1693 00000100:00100000:0.0:1763343273.139377:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399782144:12345-192.168.201.40@tcp:10:bash.0 00000100:00100000:2.0:1763343273.139634:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1694 00000100:00100000:2.0:1763343273.139645:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2408:x1848998399782400:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:2.0:1763343273.139751:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2a6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343273.139755:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2a6:0x0] updating lvb mtime from disk: 0 -> 1763343272 00002000:00010000:2.0:1763343273.139758:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2a6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343273.139761:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2a6:0x0] updating lvb ctime from disk: 0 -> 1763343272 00002000:00010000:2.0:1763343273.139763:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2a6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343273.139831:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399782400:12345-192.168.201.40@tcp:10:bash.0 Request processed in 183us (864us total) trans 21474839126 rc 0/0 00000100:00100000:2.0:1763343273.139839:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1694 00002000:00010000:2.0:1763343273.139844:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/678 (0->18446744073709551615) 00002000:00100000:2.0:1763343273.139846:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400cc5df100 with x1848998399782400 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343273.139850:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400cc5df100. 00002000:00010000:0.0:1763343273.139957:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2a7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343273.139961:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2a7:0x0] updating lvb mtime from disk: 1763343272 -> 1763343272 00002000:00010000:0.0:1763343273.139964:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2a7:0x0] updating lvb atime from disk: 1763343272 -> 0 00002000:00010000:0.0:1763343273.139966:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2a7:0x0] updating lvb ctime from disk: 1763343272 -> 1763343272 00002000:00010000:0.0:1763343273.139968:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2a7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343273.139976:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399782528 00000100:00100000:1.0:1763343273.139981:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399782528 00000100:00100000:0.0:1763343273.139993:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399782144:12345-192.168.201.40@tcp:10:bash.0 Request processed in 619us (1796us total) trans 17179871855 rc 0/0 00000100:00100000:0.0:1763343273.139999:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1693 00002000:00010000:0.0:1763343273.140002:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/679 (0->18446744073709551615) 00002000:00100000:0.0:1763343273.140005:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c9dc9880 with x1848998399782144 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343273.140009:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401c9dc9880. 00000100:00100000:1.0:1763343273.140020:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3690 00000100:00100000:1.0:1763343273.140049:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57097:x1848998399782528:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343273.140208:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57097:x1848998399782528:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 161us (1137us total) trans 4294973443 rc 0/0 00000100:00100000:1.0:1763343273.140215:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3690 00000100:00100000:3.0:1763343273.149019:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.149798:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399782784 00000100:00100000:2.0:1763343273.149810:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399782784 00000100:00100000:2.0:1763343273.149874:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10457 00000100:00100000:2.0:1763343273.149885:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57097:x1848998399782784:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343273.149909:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.149930:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a20f9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48fa7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.150058:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a2100 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343273.150075:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a2100 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.150086:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a2100 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:2.0:1763343273.150099:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f3:0x0]: returning size 2 00010000:00010000:2.0:1763343273.150203:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a20f9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fa7 expref: 288 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.150221:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a2100 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fa7 expref: 287 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.150244:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:2.0:1763343273.150247:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343273.150251:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5088a00, rc 0) 00000100:00100000:2.0:1763343273.150331:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57097:x1848998399782784:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 447us (1321us total) trans 4294973444 rc 0/0 00000100:00100000:2.0:1763343273.150339:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10457 00000100:00100000:1.0:1763343273.159586:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.159662:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399783040 00000100:00100000:0.0:1763343273.159676:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399783040 00000100:00100000:0.0:1763343273.159746:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10458 00000100:00100000:0.0:1763343273.159758:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57098:x1848998399783040:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:0.0:1763343273.159818:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1763343273.159848:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a209e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f84 expref: 287 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.159870:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a20d6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f8b expref: 286 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.159883:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2066 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f76 expref: 285 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.159899:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:0.0:1763343273.159904:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343273.159935:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a210e lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343273.159947:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a210e lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.159957:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a210e lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.159971:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a2115 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343273.159977:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a2115 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.159983:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a2115 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.160147:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a211c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343273.160156:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a211c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.160163:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a211c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00080000:1.0:1763343273.160401:0:7641:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x1f3:0x0] is inserted into orphan list, open count = 2 00010000:00010000:1.0:1763343273.160485:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a211c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.160492:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a211c lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.160499:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a211c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.160505:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fd2dfa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.160509:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a211c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.160516:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a211c lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.160524:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:1.0:1763343273.160527:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343273.160531:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a211c lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.160537:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a211c lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.160550:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a210e lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.160556:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a210e lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.160561:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a210e lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.160567:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a210e lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.160571:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff940202040c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.160574:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a210e lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.160580:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a210e lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.160586:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f66a1800) 00010000:00010000:1.0:1763343273.160589:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.160591:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a210e lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.160596:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a210e lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00010000:1.0:1763343273.160609:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009a6fdd45 reply state 00000000006241a3 transno 4294973445 ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a2115 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.160623:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a2115 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.160629:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1f00) 00010000:00010000:1.0:1763343273.160631:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343273.160633:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343273.160686:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.160696:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57098:x1848998399783040:12345-192.168.201.40@tcp:36:rm.0 Request processed in 941us (1121us total) trans 4294973445 rc 0/0 00000100:00100000:1.0:1763343273.160704:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10458 00000100:00100000:1.0:1763343273.161928:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399783168 00000100:00100000:1.0:1763343273.161940:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399783168 00000100:00100000:1.0:1763343273.161989:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10459 00000100:00100000:1.0:1763343273.161998:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57097:x1848998399783168:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343273.162014:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.162043:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a2123 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48fae expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.162101:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a2123 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fae expref: 287 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.162115:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a2123 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fae expref: 287 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.162132:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:1.0:1763343273.162135:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343273.162139:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fd2df600, rc 0) 00000100:00100000:1.0:1763343273.162185:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57097:x1848998399783168:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 188us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343273.162195:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10459 00000100:00100000:0.0:1763343273.167210:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.167322:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399783296 00000100:00100000:2.0:1763343273.167338:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399783296 00000100:00100000:2.0:1763343273.167394:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7080 00000100:00100000:2.0:1763343273.167405:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2409:x1848998399783296:12345-192.168.201.40@tcp:1:lfs.0 00010000:00010000:2.0:1763343273.167456:0:8412:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a212a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.167473:0:8412:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a20e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f92 expref: 22 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.167480:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343273.167482:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343273.167485:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a212a lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.167517:0:8412:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a20e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f92 expref: 22 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.167528:0:8412:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a20e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f92 expref: 22 pid: 8626 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.167542:0:8412:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8412:1848998412946560:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343273.167620:0:8412:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c3be8300 going to sleep for 11 seconds 00000100:00100000:0.0:1763343273.172097:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.172195:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399783424 00000100:00100000:3.0:1763343273.172205:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399783424 00002000:00100000:3.0:1763343273.172251:0:8419:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x2a7:0x0] (0->4) req@ffff9400c6b55180 x1848998399783424/t0(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:14/0 lens 496/0 e 0 to 0 dl 1763343284 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343273.172263:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6b55180 with x1848998399783424 ext(0->4) 00010000:00010000:3.0:1763343273.172271:0:8419:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a20e4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f92 expref: 23 pid: 8626 timeout: 1166 lvb_type: 0 00010000:00010000:3.0:1763343273.172287:0:8419:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a20e4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f92 expref: 23 pid: 8626 timeout: 1166 lvb_type: 0 00002000:00010000:3.0:1763343273.172311:0:8419:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9400c6b55180 00000100:00100000:3.0:1763343273.172345:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 116 00000100:00100000:3.0:1763343273.172355:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2410:x1848998399783424:12345-192.168.201.40@tcp:4:bash.0 00000100:00100000:2.0:1763343273.172700:0:8412:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8412:1848998412946560:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343273.172728:0:8412:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a212a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343273.174289:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2410:x1848998399783424:12345-192.168.201.40@tcp:4:bash.0 Request processed in 1673us (1942us total) trans 17179871856 rc 0/0 00000100:00100000:3.0:1763343273.174312:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 116 00002000:00100000:3.0:1763343273.174324:0:8419:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x2a7:0x0] (0->4) req@ffff9400c6b55180 x1848998399783424/t17179871856(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:14/0 lens 496/448 e 0 to 0 dl 1763343284 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343273.174333:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6b55180 with x1848998399783424 ext(0->4) 00010000:00010000:3.0:1763343273.174340:0:8419:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a20e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f92 expref: 25 pid: 8626 timeout: 1166 lvb_type: 0 00010000:00010000:3.0:1763343273.174354:0:8419:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a20e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f92 expref: 25 pid: 8626 timeout: 1166 lvb_type: 0 00002000:00010000:3.0:1763343273.174360:0:8419:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9400c6b55180 00000100:00100000:3.0:1763343273.176842:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.177418:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399783552 00000100:00100000:1.0:1763343273.177428:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399783552 00000100:00100000:1.0:1763343273.177489:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10460 00000100:00100000:1.0:1763343273.177498:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57099:x1848998399783552:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343273.177521:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.177545:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a2131 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48fb5 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.177614:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a2138 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343273.177627:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a2138 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.177637:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a2138 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.177647:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a213f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343273.177653:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a213f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.177659:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a213f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.177697:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a2138 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.177704:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a2138 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.177716:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a2138 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.177721:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a2138 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.177726:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3b4ba00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.177730:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a2138 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.177738:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a2138 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.177794:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497ed00) 00010000:00010000:1.0:1763343273.177797:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.177802:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a2138 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.177808:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a2138 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.177820:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a213f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.177826:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a213f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.177831:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a213f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.177836:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3b4b600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.177839:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a213f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.177850:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a213f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.177857:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1f00) 00010000:00010000:1.0:1763343273.177860:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.177863:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a213f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.177868:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a213f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.177894:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a2131 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fb5 expref: 288 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.177903:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497ed00) 00010000:00010000:1.0:1763343273.177905:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.177909:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a2131 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fb5 expref: 288 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.177921:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fd2dfa00, rc 0) 00000100:00100000:1.0:1763343273.177996:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57099:x1848998399783552:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 499us (1164us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343273.178004:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10460 00000100:00100000:0.0:1763343273.182996:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.183289:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399783680 00000100:00100000:2.0:1763343273.183309:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399783680 00010000:00010000:2.0:1763343273.183351:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a20e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f92 expref: 25 pid: 8626 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.183444:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3392 00000100:00100000:2.0:1763343273.183454:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6489c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2409:x1848998399783680:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343273.183472:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1763343273.183490:0:6509:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2a7:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:2.0:1763343273.183493:0:6509:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2a7:0x0] updating lvb atime from disk: 0 -> 1763343272 00002000:00010000:2.0:1763343273.183495:0:6509:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2a7:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1763343273.183501:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a20e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f92 expref: 25 pid: 8626 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.183516:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a20e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f92 expref: 25 pid: 8626 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.183540:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a20e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f92 expref: 25 pid: 8626 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.183556:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.183558:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.183563:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a212a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343273.183569:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:2.0:1763343273.183575:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a212a lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.183613:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343273.183623:0:8412:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a212a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.183632:0:8412:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a212a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.183656:0:8412:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a212a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.183663:0:8412:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a212a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343273.183669:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6489c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2409:x1848998399783680:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 217us (683us total) trans 0 rc 0/0 00010000:00010000:0.0:1763343273.183672:0:8412:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a212a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343273.183677:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3392 00010000:00010000:0.0:1763343273.183678:0:8412:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343273.183682:0:8412:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a212a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.183690:0:8412:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a212a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343273.184016:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399783808 00000100:00100000:1.0:1763343273.184041:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399783808 00000100:00100000:1.0:1763343273.184089:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10461 00000100:00100000:1.0:1763343273.184098:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57099:x1848998399783808:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343273.184117:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.184142:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba770a2146 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48fbc expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.184208:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a214d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343273.184220:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a214d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.184229:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a214d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.184239:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a2154 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343273.184247:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a2154 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.184253:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a2154 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.184310:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a214d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.184318:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a214d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.184324:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a214d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.184328:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a214d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.184332:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a4200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.184336:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a214d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.184342:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a214d lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.184351:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497ed00) 00010000:00010000:1.0:1763343273.184354:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.184357:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a214d lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.184362:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a214d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.184371:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a2154 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.184382:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a2154 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.184387:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a2154 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.184392:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fd2dfa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.184395:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a2154 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.184402:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a2154 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.184410:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1f00) 00010000:00010000:0.0:1763343273.184412:0:8412:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a212a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.184413:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.184418:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a2154 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.184429:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a212a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.184431:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a2154 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.184468:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba770a2146 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fbc expref: 288 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.184477:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497ed00) 00010000:00010000:1.0:1763343273.184479:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.184483:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba770a2146 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fbc expref: 288 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.184496:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a4000, rc 0) 00000100:00100000:0.0:1763343273.184509:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2409:x1848998399783296:12345-192.168.201.40@tcp:1:lfs.0 Request processed in 17105us (17310us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343273.184520:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7080 00000100:00100000:1.0:1763343273.184525:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57099:x1848998399783808:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 426us (952us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343273.186063:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10461 00000100:00100000:0.0:1763343273.187099:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.187144:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.187145:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399783936 00000100:00100000:1.0:1763343273.187155:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399783936 00000100:00100000:1.0:1763343273.187207:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399784192 00000100:00100000:1.0:1763343273.187211:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399784192 00000100:00100000:1.0:1763343273.187244:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10462 00000100:00100000:1.0:1763343273.187253:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57099:x1848998399783936:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:3.0:1763343273.187371:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10463 00000100:00100000:3.0:1763343273.187382:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57097:x1848998399784192:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:3.0:1763343273.187426:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343273.187455:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a2123 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fae expref: 288 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.187474:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:3.0:1763343273.187479:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343273.187510:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a215b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343273.187523:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a215b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.187531:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a215b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000040:00080000:3.0:1763343273.188920:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1674, 88 off139592 00000004:00080000:3.0:1763343273.188929:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1066312903339ns, next at 1066683090291ns, rc = 0 00000040:00080000:3.0:1763343273.188975:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1665, 88 off138864 00000004:00080000:3.0:1763343273.188980:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1066312955747ns, next at 1066683237775ns, rc = 0 00000040:00080000:3.0:1763343273.189007:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1666, 88 off138952 00000004:00080000:3.0:1763343273.189013:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1066312988123ns, next at 1066683237775ns, rc = 0 00000040:00080000:3.0:1763343273.189038:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1675, 88 off139680 00000004:00080000:3.0:1763343273.189044:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1066313019734ns, next at 1066683090291ns, rc = 0 00010000:00010000:1.0:1763343273.191185:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.191225:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a2162 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48fc3 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.191313:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a2169 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343273.191327:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a2169 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.191340:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a2169 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343273.191381:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763343273.191387:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763343273.191421:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a2162 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fc3 expref: 290 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.191437:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a2169 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fc3 expref: 289 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.191446:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497e500) 00010000:00010000:1.0:1763343273.191449:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343273.191452:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3b4b600, rc 0) 00000100:00100000:1.0:1763343273.191528:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57099:x1848998399783936:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 4274us (4431us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343273.191538:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10462 00000001:00080000:3.0:1763343273.201262:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973446 is committed 00000004:00080000:3.0:1763343273.201276:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1075 committed 00000100:00100000:2.0:1763343273.201284:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000004:00080000:3.0:1763343273.201307:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1067 committed 00000004:00080000:3.0:1763343273.201319:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1066 committed 00000004:00080000:3.0:1763343273.201322:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1074 committed 00000100:00100000:2.0:1763343273.201338:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399784320 00000100:00100000:2.0:1763343273.201349:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399784320 00000004:00010000:3.0:1763343273.201387:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a7d80524 reply state 000000008f2aca58 transno 4294973446 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a215b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343273.201402:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10464 00010000:00010000:3.0:1763343273.201412:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a215b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343273.201414:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57099:x1848998399784320:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343273.201429:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:3.0:1763343273.201432:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1763343273.201437:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343273.201440:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.201462:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a2170 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48fca expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.201529:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a2177 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343273.201541:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a2177 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00080000:3.0:1763343273.201546:0:7641:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00010000:00010000:2.0:1763343273.201551:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a2177 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:3.0:1763343273.201562:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57097:x1848998399784192:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 14180us (14415us total) trans 4294973446 rc 0/0 00010000:00010000:2.0:1763343273.201563:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a217e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00000100:00100000:3.0:1763343273.201576:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10463 00010000:00010000:2.0:1763343273.201578:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a217e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.201587:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a217e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.201605:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a215b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.201614:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a215b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.201621:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a215b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.201623:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a2177 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.201633:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba2c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.201636:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a2177 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.201639:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a215b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.201647:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a2177 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.201652:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a215b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.201654:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a2177 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.201667:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.201671:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a2177 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.201672:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:3.0:1763343273.201679:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343273.201683:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a2177 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.201684:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a215b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.201698:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a215b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.201701:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497e500) 00010000:00010000:2.0:1763343273.201707:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.201710:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a2177 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.201717:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a2177 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.201727:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a217e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.201733:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a217e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.201739:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a217e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.201744:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5088800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.201747:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a217e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.201756:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a217e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.201763:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1f00) 00010000:00010000:2.0:1763343273.201766:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.201769:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a217e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.201776:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a217e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.201803:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a2170 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fca expref: 285 pid: 9827 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343273.201812:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1763343273.201815:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497e500) 00010000:00010000:2.0:1763343273.201819:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.201823:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a2170 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fca expref: 285 pid: 9827 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343273.201829:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9dc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412946688:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1763343273.201835:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089000, rc 0) 00000100:00100000:2.0:1763343273.201868:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57099:x1848998399784320:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 457us (592us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343273.201876:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10464 00000100:00100000:3.0:1763343273.201885:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343273.201904:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9dc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412946816:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343273.201937:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343273.201974:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412946688 00000100:00100000:2.0:1763343273.201978:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412946688 00000100:00100000:2.0:1763343273.202002:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412946816 00000100:00100000:2.0:1763343273.202005:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412946816 00000100:00100000:2.0:1763343273.202066:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7081 00000100:00100000:2.0:1763343273.202075:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401ede69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+14:3661:x1848998412946688:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343273.202120:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7082 00000100:00100000:3.0:1763343273.202130:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+14:3659:x1848998412946816:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1763343273.202193:0:35281:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2a6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343273.202197:0:35281:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2a6:0x0] updating lvb mtime from disk: 1763343272 -> 1763343272 00002000:00010000:2.0:1763343273.202200:0:35281:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2a6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343273.202202:0:35281:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2a6:0x0] updating lvb ctime from disk: 1763343272 -> 1763343272 00002000:00010000:3.0:1763343273.202205:0:28562:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2a7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343273.202205:0:35281:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2a6:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1763343273.202212:0:28562:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2a7:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343273.202216:0:28562:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2a7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343273.202218:0:28562:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2a7:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343273.202221:0:28562:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2a7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343273.202246:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401ede69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+16:3661:x1848998412946688:12345-0@lo:2:osp-syn-0-1.0 Request processed in 173us (362us total) trans 21474839127 rc 0/0 00000100:00100000:2.0:1763343273.202254:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7081 00000100:00100000:3.0:1763343273.202264:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+15:3659:x1848998412946816:12345-0@lo:2:osp-syn-0-1.0 Request processed in 135us (326us total) trans 21474839128 rc 0/0 00000100:00100000:3.0:1763343273.202273:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7082 00000004:00080000:3.0:1763343273.202339:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c9dc9500/2, rc 0, transno 21474839127 00000100:00100000:3.0:1763343273.202345:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9dc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412946688:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763343273.202373:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c9dc8380/2, rc 0, transno 21474839128 00000100:00100000:3.0:1763343273.202377:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9dc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412946816:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1763343273.204493:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a2115 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.204510:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a2115 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.204517:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a2115 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.204524:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c0030200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.204528:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a2115 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.204543:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a2115 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.204560:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1f00) 00010000:00010000:0.0:1763343273.204563:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.204569:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a2115 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.204575:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a2115 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000100:00100000:0.0:1763343273.204818:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763343273.204835:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c7ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412947072:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343273.204892:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343273.205266:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412947072 00000100:00100000:1.0:1763343273.205274:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412947072 00000100:00100000:1.0:1763343273.205330:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7083 00000100:00100000:1.0:1763343273.205339:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+29:3662:x1848998412947072:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763343273.205473:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2a8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343273.205476:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2a8:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343273.205478:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2a8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343273.205481:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2a8:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763343273.205484:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2a8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343273.205525:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+30:3662:x1848998412947072:12345-0@lo:2:osp-syn-1-1.0 Request processed in 187us (632us total) trans 17179871857 rc 0/0 00000100:00100000:1.0:1763343273.205532:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7083 00000004:00080000:0.0:1763343273.205615:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c7ef5880/2, rc 0, transno 17179871857 00000100:00100000:0.0:1763343273.205621:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c7ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412947072:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343273.205759:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c7ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412946944:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343273.205789:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343273.205843:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412946944 00000100:00100000:0.0:1763343273.205847:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412946944 00000100:00100000:0.0:1763343273.205881:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7084 00000100:00100000:0.0:1763343273.205888:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+30:3660:x1848998412946944:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343273.205980:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+31:3660:x1848998412946944:12345-0@lo:2:osp-syn-1-1.0 Request processed in 92us (189us total) trans 17179871858 rc 0/0 00000100:00100000:0.0:1763343273.205986:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7084 00000004:00080000:3.0:1763343273.206069:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c7ef7b80/2, rc 0, transno 17179871858 00000100:00100000:3.0:1763343273.206074:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c7ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412946944:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343273.209724:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.209803:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399784576 00000100:00100000:3.0:1763343273.209815:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.209815:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399784576 00000100:00100000:2.0:1763343273.209864:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399784704 00000100:00100000:2.0:1763343273.209867:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399784704 00000100:00100000:3.0:1763343273.209881:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10465 00000100:00100000:3.0:1763343273.209892:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57099:x1848998399784576:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:2.0:1763343273.209897:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10466 00000100:00100000:2.0:1763343273.209902:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6274700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57097:x1848998399784704:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343273.209918:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.209918:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343273.209921:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343273.209938:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a2185 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48fd8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.209944:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a2169 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fc3 expref: 283 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.209964:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497e500) 00010000:00010000:3.0:1763343273.209972:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343273.209981:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a218c lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48fd1 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.209988:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a2185 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fd8 expref: 283 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.210000:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a2185 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fd8 expref: 284 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.210016:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:2.0:1763343273.210018:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343273.210021:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089000, rc 0) 00010000:00010000:3.0:1763343273.210100:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2193 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00000100:00100000:2.0:1763343273.210104:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6274700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57097:x1848998399784704:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 201us (287us total) trans 0 rc 0/0 00010000:00010000:3.0:1763343273.210109:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2193 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343273.210111:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10466 00010000:00010000:3.0:1763343273.210117:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2193 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.210128:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a219a lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343273.210134:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a219a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.210140:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a219a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.210648:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a21a1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343273.210658:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a21a1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.210665:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a21a1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343273.210675:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f4:0x0]: returning size 0 00010000:00010000:2.0:1763343273.210699:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2193 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.210705:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2193 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.210711:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2193 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.210718:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2193 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.210724:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba2c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.210728:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2193 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.210735:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2193 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.210743:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cb9f2c00) 00010000:00010000:2.0:1763343273.210746:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.210750:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2193 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.210756:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2193 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00010000:2.0:1763343273.210765:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ac0249a6 reply state 0000000089931c72 transno 4294973447 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a219a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.210776:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a219a lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.210781:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401cb9f2f00) 00010000:00010000:2.0:1763343273.210783:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343273.210786:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343273.210812:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a218c lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fd1 expref: 285 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.210828:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a21a1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fd1 expref: 284 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.210835:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f4:0x0].0x0 (ffff9401edc53d00) 00010000:00010000:2.0:1763343273.210837:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343273.210839:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089600, rc 0) 00000100:00100000:2.0:1763343273.212106:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57099:x1848998399784576:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2206us (2383us total) trans 4294973447 rc 0/0 00000100:00100000:2.0:1763343273.212117:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10465 00000100:00100000:3.0:1763343273.213500:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.213736:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399784832 00000100:00100000:2.0:1763343273.213747:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399784832 00000100:00100000:1.0:1763343273.214327:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10467 00000100:00100000:1.0:1763343273.214343:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6275500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57097:x1848998399784832:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343273.214363:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.214384:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a21af lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48fdf expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.214454:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba770a21b6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343273.214467:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba770a21b6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.214477:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba770a21b6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343273.214518:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f3:0x0]: returning size 2 00000004:00200000:1.0:1763343273.214523:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343273.214539:0:9827:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba770a21b6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.214563:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a21af lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fdf expref: 287 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.214579:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba770a21b6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fdf expref: 286 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.214587:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:1.0:1763343273.214590:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1763343273.214593:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a4000, rc 0) 00000100:00100000:1.0:1763343273.214651:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6275500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57097:x1848998399784832:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 314us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343273.214659:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10467 00000100:00100000:3.0:1763343273.217342:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.217500:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399785088 00000100:00100000:2.0:1763343273.217511:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399785088 00000100:00100000:2.0:1763343273.217565:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10468 00000100:00100000:2.0:1763343273.217574:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57099:x1848998399785088:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343273.217596:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.217617:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a21bd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48fe6 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.220018:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a21c4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343273.220067:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a21a1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fd1 expref: 287 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.220076:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a21c4 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.220115:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a21a1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fd1 expref: 287 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.220131:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a21a1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fd1 expref: 287 pid: 7641 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.220145:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412947200:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343273.220230:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401ed059000 going to sleep for 11 seconds 00000100:00100000:2.0:1763343273.223695:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.224066:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399785216 00000100:00100000:0.0:1763343273.224076:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399785216 00010000:00010000:0.0:1763343273.224115:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a21a1 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fd1 expref: 288 pid: 7641 timeout: 1166 lvb_type: 0 00000100:00100000:0.0:1763343273.224158:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3393 00000100:00100000:0.0:1763343273.224168:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:2407:x1848998399785216:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343273.224184:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343273.224192:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a21a1 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fd1 expref: 288 pid: 7641 timeout: 1166 lvb_type: 0 00010000:00010000:0.0:1763343273.224205:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a21a1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fd1 expref: 288 pid: 7641 timeout: 1166 lvb_type: 0 00010000:00010000:0.0:1763343273.224228:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f4:0x0].0x0 (ffff9401edc53d00) 00010000:00010000:0.0:1763343273.224234:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a21c4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.224244:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a21c4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.224251:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a21c4 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.224283:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343273.224348:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:2407:x1848998399785216:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 181us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343273.224356:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3393 00000100:00100000:2.0:1763343273.224526:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:3.0:1763343273.224816:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a21a1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fd1 expref: 287 pid: 7641 timeout: 1166 lvb_type: 0 00000100:00100000:3.0:1763343273.224832:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412947200:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343273.224855:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a21c4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.224864:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a21c4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.224869:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a21c4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:3.0:1763343273.224891:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f4:0x0]: returning size 0 00000004:00080000:3.0:1763343273.225092:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2a8:0x0], index 0: 0 00000004:00080000:3.0:1763343273.225100:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2a9:0x0], index 1: 0 00000004:00080000:3.0:1763343273.225105:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2aa:0x0], index 1: 0 00000004:00080000:3.0:1763343273.225109:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2a9:0x0], index 0: 0 00010000:00010000:3.0:1763343273.225217:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a21c4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.225225:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a21c4 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.225232:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a21c4 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.225239:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e91e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343273.225243:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a21c4 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.225250:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a21c4 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.225261:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f4:0x0].0x0 (ffff9401edc53d00) 00010000:00010000:3.0:1763343273.225264:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343273.225267:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a21c4 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.225300:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a21c4 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.225351:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a21bd lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1f4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fe6 expref: 287 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.225362:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f4:0x0].0x0 (ffff9401edc53d00) 00010000:00010000:3.0:1763343273.225364:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343273.225368:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a21bd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fe6 expref: 287 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.225382:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5088800, rc 0) 00000100:00100000:3.0:1763343273.225426:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57099:x1848998399785088:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 7854us (8093us total) trans 4294973448 rc 301/301 00000100:00100000:3.0:1763343273.225434:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10468 00000100:00100000:1.0:1763343273.227084:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399785344 00000100:00100000:1.0:1763343273.227097:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399785344 00000100:00100000:1.0:1763343273.227153:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7085 00000100:00100000:1.0:1763343273.227163:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2410:x1848998399785344:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343273.227180:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.227200:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a21d2 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48fed expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343273.227225:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2a7:0x0] initial LVB size: 5, mtime: 0x691a7ba8, atime: 0x691a7ba8, ctime: 0x691a7ba8, blocks: 0x8 00010000:00010000:1.0:1763343273.227243:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.227245:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.227254:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a21d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fed expref: 24 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343273.227282:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a21d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fed expref: 24 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343273.227303:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a4200, rc 0) 00000100:00100000:1.0:1763343273.227347:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2410:x1848998399785344:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 185us (2821us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343273.227354:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7085 00000100:00100000:0.0:1763343273.229990:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.231159:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399785600 00000100:00100000:1.0:1763343273.231174:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399785600 00000100:00100000:1.0:1763343273.231242:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3691 00000100:00100000:1.0:1763343273.231253:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8446450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57099:x1848998399785600:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343273.231608:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8446450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57099:x1848998399785600:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 355us (1626us total) trans 4294973449 rc 0/0 00000100:00100000:1.0:1763343273.231618:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3691 00000100:00100000:0.0:1763343273.234603:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.234694:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399785856 00000100:00100000:2.0:1763343273.234706:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399785856 00000100:00100000:2.0:1763343273.235393:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3692 00000100:00100000:2.0:1763343273.235407:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57099:x1848998399785856:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343273.235682:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57099:x1848998399785856:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 278us (1088us total) trans 4294973450 rc 0/0 00000100:00100000:2.0:1763343273.235691:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3692 00000100:00100000:2.0:1763343273.244639:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.244776:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399786112 00000100:00100000:3.0:1763343273.244789:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399786112 00000100:00100000:3.0:1763343273.244856:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10469 00000100:00100000:3.0:1763343273.244955:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:55884:x1848998399786112:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343273.244981:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343273.245242:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a21d9 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48ff4 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.245406:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2000/0x9104b1ba770a21e0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343273.245420:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2000/0x9104b1ba770a21e0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.245436:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2000/0x9104b1ba770a21e0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.245459:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a21e7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343273.245466:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a21e7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.245473:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a21e7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.245533:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a21ee lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343273.245540:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a21ee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.245547:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a21ee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:3.0:1763343273.245558:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f4:0x0]: returning size 0 00010000:00010000:3.0:1763343273.245642:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2000/0x9104b1ba770a21e0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.245649:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2000/0x9104b1ba770a21e0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.245654:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2000/0x9104b1ba770a21e0 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.245660:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2000/0x9104b1ba770a21e0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.245664:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba2000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343273.245669:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2000/0x9104b1ba770a21e0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.245675:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2000/0x9104b1ba770a21e0 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.245687:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cb9f2500) 00010000:00010000:3.0:1763343273.245690:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343273.245695:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2000/0x9104b1ba770a21e0 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.245701:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2000/0x9104b1ba770a21e0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.245717:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a21e7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.245723:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a21e7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.245728:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a21e7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.245732:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343273.245735:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a21e7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.245741:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a21e7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.245747:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401cb9f2f00) 00010000:00010000:3.0:1763343273.245750:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343273.245753:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a21e7 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.245762:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a21e7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.246006:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a21d9 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ff4 expref: 291 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.246046:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a21ee lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ff4 expref: 290 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.246056:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f4:0x0].0x0 (ffff9401cb9f2200) 00010000:00010000:0.0:1763343273.246059:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343273.246061:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba2c00, rc 0) 00000100:00100000:0.0:1763343273.246127:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:55884:x1848998399786112:12345-192.168.201.40@tcp:101:bash.0 Request processed in 1175us (1497us total) trans 4294973451 rc 0/0 00000100:00100000:0.0:1763343273.246136:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10469 00000100:00100000:0.0:1763343273.253609:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.253694:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399786240 00000100:00100000:1.0:1763343273.253704:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399786240 00000100:00100000:1.0:1763343273.253775:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10470 00000100:00100000:1.0:1763343273.253786:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:55884:x1848998399786240:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343273.253809:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.253834:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a21fc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b48ffb expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.253869:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2203 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343273.253882:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2203 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.253892:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2203 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.254002:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a21fc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ffb expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.254019:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2203 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ffb expref: 291 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.254059:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f4:0x0].0x0 (ffff9401cb9f2200) 00010000:00010000:1.0:1763343273.254063:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343273.254066:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c7bb3800, rc 0) 00000100:00100000:1.0:1763343273.254128:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:55884:x1848998399786240:12345-192.168.201.40@tcp:101:bash.0 Request processed in 343us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343273.254137:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10470 00000100:00100000:3.0:1763343273.257593:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.257711:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399786496 00000100:00100000:1.0:1763343273.257722:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399786496 00000100:00100000:1.0:1763343273.257800:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10471 00000100:00100000:1.0:1763343273.257812:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:55884:x1848998399786496:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:1.0:1763343273.257877:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343273.257904:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a21ee lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ff4 expref: 291 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.257923:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f4:0x0].0x0 (ffff9401cb9f2200) 00010000:00010000:1.0:1763343273.257929:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343273.258147:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a220a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343273.258161:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a220a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.258170:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a220a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000001:00080000:1.0:1763343273.258211:0:9827:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973452 00000004:00010000:1.0:1763343273.258229:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009ce6e8e8 reply state 000000008ff6ce80 transno 4294973453 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a220a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.258239:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a220a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.258244:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f4:0x0].0x0 (ffff9401cb9f2200) 00010000:00010000:1.0:1763343273.258247:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343273.258249:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343273.258350:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:55884:x1848998399786496:12345-192.168.201.40@tcp:36:bash.0 Request processed in 539us (766us total) trans 4294973453 rc 0/0 00000100:00100000:1.0:1763343273.258357:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10471 00000020:00080000:1.0:1763343273.258363:0:9827:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343273.269761:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.269997:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399786624 00000100:00100000:1.0:1763343273.270009:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399786624 00000100:00100000:1.0:1763343273.270110:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10472 00000100:00100000:1.0:1763343273.270120:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:55884:x1848998399786624:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343273.270148:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.270177:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2211 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49002 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.270245:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2211 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49002 expref: 294 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.270260:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2211 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49002 expref: 294 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.270279:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f4:0x0].0x0 (ffff9401cb9f2200) 00010000:00010000:1.0:1763343273.270282:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343273.270286:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c7bb2400, rc 0) 00000100:00100000:1.0:1763343273.270352:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:55884:x1848998399786624:12345-192.168.201.40@tcp:101:bash.0 Request processed in 234us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343273.270360:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10472 00000100:00100000:3.0:1763343273.275339:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.276077:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399786880 00000100:00100000:1.0:1763343273.276088:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399786880 00000100:00100000:1.0:1763343273.276158:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10473 00000100:00100000:1.0:1763343273.276168:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:55884:x1848998399786880:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343273.276192:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.276195:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343273.276224:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2211 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49002 expref: 294 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.276244:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f4:0x0].0x0 (ffff9401cb9f2200) 00010000:00010000:1.0:1763343273.276249:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343273.276263:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a2218 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49009 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.276323:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a221f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343273.276334:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a221f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.276343:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a221f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000040:00080000:1.0:1763343273.276573:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1667, 88 off139040 00000004:00080000:1.0:1763343273.276581:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1066400555828ns, next at 1066683237775ns, rc = 0 00000040:00080000:1.0:1763343273.276627:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1676, 88 off139768 00000004:00080000:1.0:1763343273.276632:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1066400607168ns, next at 1066683090291ns, rc = 0 00000040:00080000:1.0:1763343273.276680:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1677, 88 off139856 00000004:00080000:1.0:1763343273.276686:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1066400661037ns, next at 1066683090291ns, rc = 0 00000040:00080000:1.0:1763343273.276706:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1668, 88 off139128 00000004:00080000:1.0:1763343273.276710:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1066400685346ns, next at 1066683237775ns, rc = 0 00000100:00100000:0.0:1763343273.279055:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.279699:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399787008 00000100:00100000:3.0:1763343273.279711:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399787008 00000100:00100000:3.0:1763343273.279773:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7086 00000100:00100000:3.0:1763343273.279782:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2410:x1848998399787008:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:3.0:1763343273.279928:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2410:x1848998399787008:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 146us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343273.279935:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7086 00000001:00080000:0.0:1763343273.280839:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973454 is committed 00000004:00080000:0.0:1763343273.280846:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1069 committed 00000004:00080000:0.0:1763343273.280863:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1077 committed 00000004:00080000:0.0:1763343273.280872:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1076 committed 00000004:00080000:0.0:1763343273.280874:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1068 committed 00000100:00100000:1.0:1763343273.280952:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763343273.280970:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412947712:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343273.280970:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412947456:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1763343273.281055:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a219a lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.281067:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a219a lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.281074:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a219a lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.281080:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343273.281084:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a219a lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.281092:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a219a lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.281106:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401cb9f2f00) 00010000:00010000:3.0:1763343273.281109:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343273.281113:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a219a lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.281119:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a219a lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.281140:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a220a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.281145:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a220a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.281150:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a220a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.281155:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb3e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343273.281157:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a220a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.281161:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a220a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.281167:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f4:0x0].0x0 (ffff9401cb9f2200) 00010000:00010000:3.0:1763343273.281169:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343273.281171:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a220a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.281176:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a220a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000100:00100000:0.0:1763343273.281335:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343273.281374:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4b23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412947328:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343273.281397:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343273.281439:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412947456 00000100:00100000:0.0:1763343273.281446:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412947456 00000100:00100000:1.0:1763343273.281452:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763343273.281466:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a221f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49009 expref: 286 pid: 9827 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343273.281476:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4b21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412947584:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343273.281477:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412947328 00010000:00010000:2.0:1763343273.281480:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f4:0x0].0x0 (ffff9401cb9f2200) 00000100:00100000:0.0:1763343273.281481:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412947328 00010000:00010000:2.0:1763343273.281485:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343273.281502:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a2218 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49009 expref: 286 pid: 9827 timeout: 0 lvb_type: 3 00000100:00100000:1.0:1763343273.281502:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343273.281502:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412947712 00000100:00100000:0.0:1763343273.281506:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412947712 00010000:00010000:2.0:1763343273.281524:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a221f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49009 expref: 285 pid: 9827 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343273.281526:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412947584 00000100:00100000:0.0:1763343273.281531:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412947584 00000100:00100000:1.0:1763343273.281535:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7087 00000100:00100000:1.0:1763343273.281543:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+32:3662:x1848998412947456:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343273.281550:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7088 00000100:00100000:0.0:1763343273.281556:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+16:3662:x1848998412947328:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1763343273.281557:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f4:0x0].0x0 (ffff9401cb9f2200) 00010000:00010000:2.0:1763343273.281563:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343273.281566:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c6b99600, rc 0) 00000100:00100000:2.0:1763343273.281603:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:55884:x1848998399786880:12345-192.168.201.40@tcp:101:bash.0 Request processed in 5436us (6276us total) trans 4294973454 rc 0/0 00000100:00100000:2.0:1763343273.281610:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10473 00000100:00100000:2.0:1763343273.281645:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7089 00000100:00100000:2.0:1763343273.281654:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+33:3660:x1848998412947712:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343273.281686:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+33:3662:x1848998412947456:12345-0@lo:2:osp-syn-1-1.0 Request processed in 142us (350us total) trans 17179871859 rc 0/0 00000100:00100000:1.0:1763343273.281693:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7087 00000100:00100000:3.0:1763343273.281708:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7090 00000100:00100000:3.0:1763343273.281718:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+17:3660:x1848998412947584:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343273.281747:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+33:3660:x1848998412947712:12345-0@lo:2:osp-syn-1-1.0 Request processed in 95us (294us total) trans 17179871860 rc 0/0 00000100:00100000:2.0:1763343273.281754:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7089 00000004:00080000:1.0:1763343273.281765:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6401880/2, rc 0, transno 17179871860 00000100:00100000:1.0:1763343273.281773:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412947712:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343273.281817:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+18:3660:x1848998412947584:12345-0@lo:2:osp-syn-0-1.0 Request processed in 101us (315us total) trans 21474839130 rc 0/0 00000100:00100000:3.0:1763343273.281827:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7090 00000100:00100000:0.0:1763343273.282331:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+17:3662:x1848998412947328:12345-0@lo:2:osp-syn-0-1.0 Request processed in 773us (930us total) trans 21474839129 rc 0/0 00000100:00100000:0.0:1763343273.282339:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7088 00000004:00080000:0.0:1763343273.282367:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6401180/2, rc 0, transno 17179871859 00000100:00100000:0.0:1763343273.282371:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412947456:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763343273.282382:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c4b23480/2, rc 0, transno 21474839129 00000100:00100000:0.0:1763343273.282386:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4b23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412947328:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763343273.282514:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c4b21500/2, rc 0, transno 21474839130 00000100:00100000:1.0:1763343273.282519:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4b21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412947584:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343273.283151:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.283430:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399787136 00000100:00100000:3.0:1763343273.283438:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399787136 00000100:00100000:3.0:1763343273.283486:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7091 00000100:00100000:3.0:1763343273.283495:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2407:x1848998399787136:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:3.0:1763343273.283588:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2407:x1848998399787136:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 93us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343273.283596:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7091 00000100:00100000:2.0:1763343273.284476:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.285203:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399787264 00000100:00100000:1.0:1763343273.285212:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399787264 00000100:00100000:1.0:1763343273.285260:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7092 00000100:00100000:1.0:1763343273.285269:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:55884:x1848998399787264:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343273.285283:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.285314:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98200/0x9104b1ba770a2226 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49010 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343273.285339:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343273.285362:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.285365:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.285373:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98200/0x9104b1ba770a2226 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49010 expref: 15 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.285393:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98200/0x9104b1ba770a2226 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49010 expref: 15 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.285406:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c6b98200, rc 0) 00000100:00100000:1.0:1763343273.285449:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:55884:x1848998399787264:12345-192.168.201.40@tcp:101:bash.0 Request processed in 181us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343273.285457:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7092 00000100:00100000:3.0:1763343273.286579:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.287245:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399787392 00000100:00100000:2.0:1763343273.287255:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399787392 00000100:00100000:2.0:1763343273.287346:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1695 00000100:00100000:2.0:1763343273.287356:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2410:x1848998399787392:12345-192.168.201.40@tcp:3:lfs.0 00010000:00010000:2.0:1763343273.287392:0:8419:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a222d lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.287406:0:8419:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.287408:0:8419:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.287413:0:8419:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a222d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.287426:0:8419:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a222d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.287524:0:8419:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a222d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.287533:0:8419:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a222d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.287540:0:8419:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a222d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.287547:0:8419:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e90600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343273.287551:0:8419:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a222d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.287559:0:8419:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a222d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.287574:0:8419:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a222d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.287581:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a222d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343273.287640:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2410:x1848998399787392:12345-192.168.201.40@tcp:3:lfs.0 Request processed in 285us (1066us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763343273.287647:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1695 00000100:00100000:3.0:1763343273.288304:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.288601:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399787520 00000100:00100000:1.0:1763343273.288608:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399787520 00000100:00100000:1.0:1763343273.288645:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7093 00000100:00100000:1.0:1763343273.288654:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:55884:x1848998399787520:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343273.288667:0:11289:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.288684:0:11289:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2234 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49017 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343273.288703:0:11289:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343273.288719:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.288721:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.288727:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2234 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49017 expref: 25 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.288741:0:11289:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2234 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49017 expref: 25 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.288752:0:11289:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c7bb2400, rc 0) 00000100:00100000:1.0:1763343273.288788:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:55884:x1848998399787520:12345-192.168.201.40@tcp:101:bash.0 Request processed in 135us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343273.288796:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7093 00000100:00100000:3.0:1763343273.290658:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.290741:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399787648 00000100:00100000:0.0:1763343273.290750:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399787648 00002000:00010000:0.0:1763343273.290783:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/680 (0->18446744073709551615) 00002000:00100000:0.0:1763343273.290788:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5951880 with x1848998399787648 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343273.290798:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5951880. 00000100:00100000:0.0:1763343273.290828:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1696 00000100:00100000:0.0:1763343273.290837:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998399787648:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:0.0:1763343273.290996:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2a8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343273.291001:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2a8:0x0] updating lvb mtime from disk: 0 -> 1763343272 00002000:00010000:0.0:1763343273.291003:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2a8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343273.291005:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2a8:0x0] updating lvb ctime from disk: 0 -> 1763343272 00002000:00010000:0.0:1763343273.291007:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2a8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343273.291100:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998399787648:12345-192.168.201.40@tcp:10:bash.0 Request processed in 263us (448us total) trans 21474839131 rc 0/0 00000100:00100000:0.0:1763343273.291108:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1696 00002000:00010000:0.0:1763343273.291111:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/680 (0->18446744073709551615) 00002000:00100000:0.0:1763343273.291114:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5951880 with x1848998399787648 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343273.291119:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5951880. 00000100:00100000:2.0:1763343273.293446:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.293516:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399787776 00000100:00100000:3.0:1763343273.293526:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399787776 00002000:00010000:3.0:1763343273.293559:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/681 (0->18446744073709551615) 00002000:00100000:3.0:1763343273.293563:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400cc5dc700 with x1848998399787776 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343273.293574:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400cc5dc700. 00000100:00100000:3.0:1763343273.293606:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1697 00000100:00100000:3.0:1763343273.293614:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2408:x1848998399787776:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:3.0:1763343273.293946:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2a9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343273.293950:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2a9:0x0] updating lvb mtime from disk: 0 -> 1763343272 00002000:00010000:3.0:1763343273.293953:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2a9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343273.293955:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2a9:0x0] updating lvb ctime from disk: 0 -> 1763343272 00002000:00010000:3.0:1763343273.293957:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2a9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343273.294004:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2408:x1848998399787776:12345-192.168.201.40@tcp:10:bash.0 Request processed in 390us (567us total) trans 17179871861 rc 0/0 00000100:00100000:3.0:1763343273.294017:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1697 00002000:00010000:3.0:1763343273.294021:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/681 (0->18446744073709551615) 00002000:00100000:3.0:1763343273.294052:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400cc5dc700 with x1848998399787776 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343273.294057:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400cc5dc700. 00000100:00100000:1.0:1763343273.294354:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.294930:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399787904 00000100:00100000:3.0:1763343273.294938:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399787904 00000100:00100000:2.0:1763343273.295456:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10474 00000100:00100000:2.0:1763343273.295468:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57097:x1848998399787904:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343273.295492:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.295510:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a223b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4901e expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.295543:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a2242 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343273.295557:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a2242 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.295568:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a2242 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.295674:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a223b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4901e expref: 287 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.295696:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90800/0x9104b1ba770a2242 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4901e expref: 286 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.295706:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:2.0:1763343273.295709:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343273.295712:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e90800, rc 0) 00000100:00100000:2.0:1763343273.295767:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57097:x1848998399787904:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 302us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.295775:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10474 00000100:00100000:1.0:1763343273.300009:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.300441:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399788032 00000100:00100000:0.0:1763343273.300453:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399788032 00000100:00100000:0.0:1763343273.300522:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1698 00000100:00100000:0.0:1763343273.300532:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2409:x1848998399788032:12345-192.168.201.40@tcp:4:lfs.0 00010000:00010000:0.0:1763343273.300568:0:28386:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2249 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.300586:0:28386:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a2035 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f5a expref: 16 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343273.300594:0:28386:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343273.300596:0:28386:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343273.300599:0:28386:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2249 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.300637:0:28386:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a2035 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f5a expref: 16 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343273.300655:0:28386:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a2035 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f5a expref: 16 pid: 8626 timeout: 1166 lvb_type: 1 00000100:00100000:0.0:1763343273.300669:0:28386:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b29500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:28386:1848998412947840:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343273.301471:0:28386:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c32170c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343273.301639:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.301688:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399788288 00000100:00100000:2.0:1763343273.301695:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399788288 00000100:00100000:2.0:1763343273.301744:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3693 00000100:00100000:2.0:1763343273.301754:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:55884:x1848998399788288:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:2.0:1763343273.302119:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:55884:x1848998399788288:12345-192.168.201.40@tcp:35:bash.0 Request processed in 366us (481us total) trans 4294973455 rc 0/0 00000100:00100000:2.0:1763343273.302127:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3693 00000100:00100000:3.0:1763343273.304885:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.305010:0:28386:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b29500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:28386:1848998412947840:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343273.305073:0:28386:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2249 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343273.305148:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399788416 00000100:00100000:1.0:1763343273.305156:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399788416 00010000:00010000:1.0:1763343273.305190:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a2035 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f5a expref: 17 pid: 8626 timeout: 1166 lvb_type: 1 00000100:00100000:1.0:1763343273.305227:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3394 00000100:00100000:1.0:1763343273.305236:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8391050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2410:x1848998399788416:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343273.305251:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343273.305271:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a2035 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f5a expref: 17 pid: 8626 timeout: 1166 lvb_type: 1 00010000:00010000:1.0:1763343273.305283:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a2035 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f5a expref: 17 pid: 8626 timeout: 1166 lvb_type: 1 00010000:00010000:1.0:1763343273.305315:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a2035 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f5a expref: 17 pid: 8626 timeout: 1166 lvb_type: 1 00010000:00010000:1.0:1763343273.305330:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.305332:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.305336:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2249 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.305345:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2249 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.305376:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343273.305426:0:28386:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2249 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343273.305430:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8391050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2410:x1848998399788416:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 193us (554us total) trans 0 rc 0/0 00010000:00010000:2.0:1763343273.305445:0:28386:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2249 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343273.305446:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3394 00000100:00100000:0.0:1763343273.311449:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.311533:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399788544 00000100:00100000:2.0:1763343273.311542:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399788544 00000100:00100000:2.0:1763343273.311613:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10475 00000100:00100000:2.0:1763343273.311623:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57100:x1848998399788544:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:2.0:1763343273.311647:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.311669:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a2250 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49025 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.311737:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a2257 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343273.311750:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a2257 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.311761:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a2257 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.311787:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a225e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343273.311794:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a225e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.311800:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a225e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.311868:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2265 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343273.311877:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2265 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.311884:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2265 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:2.0:1763343273.311921:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f4:0x0]: returning size 5 00000004:00200000:2.0:1763343273.311926:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343273.311944:0:9827:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2265 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.311956:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2265 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.311964:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a2257 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.311971:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a2257 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.311977:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a2257 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.311984:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a2257 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.311990:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e90600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.311994:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a2257 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.312001:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a2257 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.312018:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53500) 00010000:00010000:2.0:1763343273.312021:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.312046:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a2257 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.312052:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a2257 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.312065:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a225e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.312070:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a225e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.312077:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a225e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.312081:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b98000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.312084:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a225e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.312089:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a225e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.312096:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53200) 00010000:00010000:2.0:1763343273.312098:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.312101:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a225e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.312106:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a225e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.312134:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a2250 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49025 expref: 289 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.312148:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2265 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49025 expref: 288 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.312155:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f4:0x0].0x0 (ffff9401cb9f2200) 00010000:00010000:2.0:1763343273.312157:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343273.312160:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c85aa600, rc 0) 00000100:00100000:2.0:1763343273.312217:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57100:x1848998399788544:12345-192.168.201.40@tcp:101:rm.0 Request processed in 595us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.312225:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10475 00000001:00080000:1.0:1763343273.315605:0:24675:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839132 is committed 00000001:00080000:1.0:1763343273.315631:0:24675:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839130 is committed 00002000:00010000:2.0:1763343273.316201:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2a7:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:2.0:1763343273.316207:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2a7:0x0] updating lvb mtime from disk: 0 -> 1763343272 00002000:00010000:2.0:1763343273.316210:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2a7:0x0] updating lvb ctime from disk: 0 -> 1763343272 00002000:00010000:2.0:1763343273.316213:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2a7:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1763343273.316226:0:28386:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2249 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.316238:0:28386:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2249 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.316246:0:28386:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2249 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.316254:0:28386:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401f1bf0200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343273.316259:0:28386:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2249 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.316267:0:28386:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2249 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.316284:0:28386:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2249 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.316302:0:28386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2249 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343273.316387:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:2409:x1848998399788032:12345-192.168.201.40@tcp:4:lfs.0 Request processed in 15851us (16384us total) trans 21474839132 rc 0/0 00000100:00100000:2.0:1763343273.316398:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1698 00000100:00100000:3.0:1763343273.316587:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.316849:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399788800 00000100:00100000:2.0:1763343273.316857:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399788800 00000100:00100000:2.0:1763343273.316902:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10476 00000100:00100000:2.0:1763343273.316911:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57100:x1848998399788800:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:2.0:1763343273.316961:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763343273.316983:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a221f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f4:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49009 expref: 288 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.317002:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2265 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49025 expref: 287 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.317014:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2203 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48ffb expref: 286 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.317993:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f4:0x0].0x0 (ffff9401cb9f2200) 00010000:00010000:2.0:1763343273.318011:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343273.318201:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a226c lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343273.318215:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a226c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.318227:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a226c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.318237:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2273 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343273.318244:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2273 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.318250:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2273 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.318357:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a227a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343273.318365:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a227a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.318371:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a227a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000040:00080000:2.0:1763343273.318648:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1669, 64 off139192 00000040:00080000:2.0:1763343273.318673:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1678, 64 off139920 00000040:00080000:2.0:1763343273.318684:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1679, 64 off139984 00000040:00080000:2.0:1763343273.318701:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1671, 64 off139328 00010000:00010000:2.0:1763343273.318751:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2281 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343273.318760:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2281 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.318767:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2281 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.318790:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2281 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.318796:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2281 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.318803:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2281 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.318827:0:9827:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343273.318847:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a227a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.318853:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a227a lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.318858:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a227a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.318864:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ec00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.318867:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a227a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.318874:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a227a lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.318883:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f4:0x0].0x0 (ffff9401edc53300) 00010000:00010000:2.0:1763343273.318885:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763343273.318889:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a227a lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.318895:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a227a lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.319008:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a226c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.319015:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a226c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.319021:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a226c lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.319052:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a226c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.319059:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343273.319059:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85ab400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.319065:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a226c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.319070:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2281 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.319073:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a226c lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.319086:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ea00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343273.319091:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2281 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.319091:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53900) 00010000:00010000:2.0:1763343273.319098:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.319105:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a226c lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.319106:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2281 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.319120:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a226c lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.319127:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f4:0x0].0x0 (ffff9401edc53300) 00010000:00010000:3.0:1763343273.319132:0:7451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343273.319136:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2281 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9827 initiator: MDT1 00000004:00010000:2.0:1763343273.319138:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000dae4687 reply state 00000000e87da087 transno 4294973456 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2273 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.319145:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2281 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.319155:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2273 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.319163:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53a00) 00010000:00010000:3.0:1763343273.319166:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343273.319166:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343273.319170:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343273.319171:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343273.319175:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343273.319259:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57100:x1848998399788800:12345-192.168.201.40@tcp:36:rm.0 Request processed in 2346us (2670us total) trans 4294973456 rc 0/0 00000100:00100000:2.0:1763343273.319268:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10476 00000100:00100000:3.0:1763343273.331627:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.331724:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399789056 00000100:00100000:2.0:1763343273.331734:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399789056 00000100:00100000:2.0:1763343273.331841:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10477 00000100:00100000:2.0:1763343273.331853:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57097:x1848998399789056:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:2.0:1763343273.331912:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343273.331941:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba770a21b6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fdf expref: 287 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.331960:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:2.0:1763343273.331965:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343273.332425:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2288 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343273.332441:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2288 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.332450:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2288 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00010000:2.0:1763343273.332568:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000df78ad0d reply state 000000006f2f57ea transno 4294973457 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2288 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.332580:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2288 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.332586:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:2.0:1763343273.332589:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343273.332592:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343273.332694:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57097:x1848998399789056:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 842us (1076us total) trans 4294973457 rc 0/0 00000100:00100000:2.0:1763343273.332702:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10477 00000100:00100000:3.0:1763343273.336194:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.336248:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.336375:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399789312 00000100:00100000:2.0:1763343273.336386:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399789312 00000100:00100000:2.0:1763343273.336443:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10478 00000100:00100000:2.0:1763343273.336453:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57101:x1848998399789312:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343273.336476:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1763343273.336487:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399789184 00000100:00100000:1.0:1763343273.336491:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399789184 00010000:00010000:2.0:1763343273.336502:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a228f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49033 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343273.336522:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7094 00000100:00100000:1.0:1763343273.336528:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:57097:x1848998399789184:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343273.336536:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.336547:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c4515600/0x9104b1ba770a2296 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4902c expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343273.336566:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2a7:0x0] initial LVB size: 4096, mtime: 0x691a7ba8, atime: 0x0, ctime: 0x691a7ba8, blocks: 0x8 00010000:00010000:2.0:1763343273.336571:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a229d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343273.336579:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.336581:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.336582:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a229d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.336587:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c4515600/0x9104b1ba770a2296 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4902c expref: 13 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.336593:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a229d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.336598:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c4515600/0x9104b1ba770a2296 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4902c expref: 13 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.336602:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a22a4 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343273.336609:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a22a4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.336610:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4515600, rc 0) 00010000:00010000:2.0:1763343273.336621:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a22a4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.336664:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a229d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.336672:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a229d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.336678:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a229d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.336684:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a229d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.336690:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85ab400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.336694:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a229d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.336706:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a229d lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.336717:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53900) 00010000:00010000:2.0:1763343273.336720:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.336724:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a229d lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.336729:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a229d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.336742:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a22a4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.336747:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a22a4 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.336753:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a22a4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.336757:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85aa600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.336760:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a22a4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.336765:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a22a4 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.336771:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53a00) 00010000:00010000:2.0:1763343273.336773:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.336775:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a22a4 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.336780:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a22a4 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.336803:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a228f lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49033 expref: 289 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.336812:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53900) 00010000:00010000:2.0:1763343273.336814:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.336817:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a228f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49033 expref: 289 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.336829:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d1e9ea00, rc 0) 00000100:00100000:2.0:1763343273.336877:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57101:x1848998399789312:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 425us (628us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343273.336884:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10478 00000100:00100000:1.0:1763343273.337180:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:57097:x1848998399789184:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 650us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343273.337191:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7094 00000100:00100000:3.0:1763343273.339935:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.339996:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399789440 00000100:00100000:0.0:1763343273.340006:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399789440 00000100:00100000:0.0:1763343273.340232:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10479 00000100:00100000:0.0:1763343273.340241:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57101:x1848998399789440:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343273.340264:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343273.340299:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a22ab lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4903a expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.340371:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a22b2 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343273.340384:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a22b2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.340396:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a22b2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.340412:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a22b9 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343273.340419:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a22b9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.340425:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a22b9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.340463:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a22b2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.340471:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a22b2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.340477:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a22b2 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.340483:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a22b2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.340488:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401f1bf0200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.340492:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a22b2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.340499:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a22b2 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.340511:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f66a1f00) 00010000:00010000:0.0:1763343273.340514:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.340519:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a22b2 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.340525:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a22b2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.340539:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a22b9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.340545:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a22b9 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.340551:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a22b9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.340555:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401f1bf1e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.340557:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a22b9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.340563:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a22b9 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.340570:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53a00) 00010000:00010000:0.0:1763343273.340572:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.340575:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a22b9 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.340581:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a22b9 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.340606:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a22ab lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4903a expref: 289 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.340616:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f66a1f00) 00010000:00010000:0.0:1763343273.340618:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.340622:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a22ab lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4903a expref: 289 pid: 7641 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343273.340768:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.340814:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399789568 00000100:00100000:1.0:1763343273.340820:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399789568 00000100:00100000:1.0:1763343273.340858:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7095 00000100:00100000:1.0:1763343273.340867:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:57097:x1848998399789568:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343273.340875:0:11289:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.340886:0:11289:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c4514400/0x9104b1ba770a22c0 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49041 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.340908:0:11289:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a203c lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f61 expref: 27 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343273.340916:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.340918:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.340922:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c4514400/0x9104b1ba770a22c0 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49041 expref: 27 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.340956:0:11289:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a203c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f61 expref: 27 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343273.340970:0:11289:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a203c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f61 expref: 27 pid: 8626 timeout: 1166 lvb_type: 1 00000100:00100000:1.0:1763343273.340983:0:11289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9831c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11289:1848998412947968:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343273.341071:0:11289:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd09c0 going to sleep for 11 seconds 00010000:00010000:0.0:1763343273.341544:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401f1bf1c00, rc 0) 00000100:00100000:0.0:1763343273.341582:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57101:x1848998399789440:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1341us (1657us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343273.341589:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10479 00000100:00100000:0.0:1763343273.346888:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.347128:0:11289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9831c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11289:1848998412947968:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343273.347159:0:11289:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c4514400/0x9104b1ba770a22c0 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49041 expref: 27 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.347178:0:11289:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4514400, rc 0) 00000100:00100000:1.0:1763343273.347227:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:57097:x1848998399789568:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 6361us (6459us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343273.347235:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7095 00000100:00100000:0.0:1763343273.348527:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.348936:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399789696 00000100:00100000:2.0:1763343273.348948:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399789696 00010000:00010000:2.0:1763343273.348993:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a203c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f61 expref: 27 pid: 8626 timeout: 1166 lvb_type: 1 00000100:00100000:2.0:1763343273.349072:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3395 00000100:00100000:2.0:1763343273.349086:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2407:x1848998399789696:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343273.349101:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343273.349123:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a203c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f61 expref: 27 pid: 8626 timeout: 1166 lvb_type: 1 00010000:00010000:2.0:1763343273.349137:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a203c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f61 expref: 27 pid: 8626 timeout: 1166 lvb_type: 1 00010000:00010000:2.0:1763343273.349166:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a203c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48f61 expref: 27 pid: 8626 timeout: 1166 lvb_type: 1 00010000:00010000:2.0:1763343273.349182:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.349184:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.349190:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c4514400/0x9104b1ba770a22c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49041 expref: 26 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.349200:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c4514400/0x9104b1ba770a22c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49041 expref: 26 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.349238:0:6509:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9400c4514400/0x9104b1ba770a22c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49041 expref: 26 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343273.349253:0:6509:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5dd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6509:1848998412948096:192.168.201.40@tcp:105: 00000100:00100000:2.0:1763343273.349342:0:6509:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401ed0596c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343273.349469:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399789824 00000100:00100000:3.0:1763343273.349474:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399789824 00000100:00100000:3.0:1763343273.349519:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10480 00000100:00100000:3.0:1763343273.349527:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57101:x1848998399789824:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343273.349544:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343273.349564:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a22c7 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49048 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.349619:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a22ce lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343273.349631:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a22ce lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.349641:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a22ce lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:3.0:1763343273.349687:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763343273.349693:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1763343273.349723:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a22c7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49048 expref: 290 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.349736:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a22ce lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49048 expref: 289 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.349744:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b000) 00010000:00010000:3.0:1763343273.349748:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763343273.349750:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089c00, rc 0) 00000100:00100000:3.0:1763343273.349781:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57101:x1848998399789824:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 255us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343273.349789:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10480 00000100:00100000:2.0:1763343273.353118:0:6509:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5dd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6509:1848998412948096:192.168.201.40@tcp:105: 00010000:00010000:2.0:1763343273.353143:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343273.353555:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2407:x1848998399789696:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 4471us (6674us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.353566:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3395 00000100:00100000:0.0:1763343273.355079:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.357131:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.357924:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399789952 00000100:00100000:2.0:1763343273.357936:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399789952 00002000:00010000:2.0:1763343273.357977:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/679 (5->18446744073709551615) 00002000:00100000:2.0:1763343273.357982:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b2b800 with x1848998399789952 ext(5->18446744073709551615) 00002000:00010000:2.0:1763343273.357994:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5b2b800. 00000100:00100000:2.0:1763343273.358055:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399790080 00000100:00100000:2.0:1763343273.358060:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399790080 00002000:00010000:2.0:1763343273.358073:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/680 (0->18446744073709551615) 00002000:00100000:2.0:1763343273.358076:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b28a80 with x1848998399790080 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343273.358082:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5b28a80. 00000100:00100000:2.0:1763343273.358111:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1699 00000100:00100000:2.0:1763343273.358121:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2408:x1848998399789952:12345-192.168.201.40@tcp:10:lfs.0 00000100:00100000:1.0:1763343273.358146:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1700 00000100:00100000:1.0:1763343273.358162:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2407:x1848998399790080:12345-192.168.201.40@tcp:10:lfs.0 00002000:00010000:1.0:1763343273.358314:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2a8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343273.358318:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2a8:0x0] updating lvb mtime from disk: 0 -> 1763343272 00002000:00010000:1.0:1763343273.358321:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2a8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343273.358323:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2a8:0x0] updating lvb ctime from disk: 0 -> 1763343272 00002000:00010000:1.0:1763343273.358326:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2a8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343273.358386:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2407:x1848998399790080:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 230us (1263us total) trans 17179871862 rc 0/0 00000100:00100000:1.0:1763343273.358395:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1700 00002000:00010000:1.0:1763343273.358400:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/680 (0->18446744073709551615) 00002000:00100000:1.0:1763343273.358403:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b28a80 with x1848998399790080 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343273.358408:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5b28a80. 00002000:00010000:2.0:1763343273.358433:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2a7:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:2.0:1763343273.358438:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2a7:0x0] updating lvb mtime from disk: 1763343272 -> 1763343272 00002000:00010000:2.0:1763343273.358440:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2a7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343273.358443:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2a7:0x0] updating lvb ctime from disk: 1763343272 -> 1763343272 00002000:00010000:2.0:1763343273.358445:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2a7:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763343273.358469:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399789952:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 350us (3399us total) trans 21474839133 rc 0/0 00000100:00100000:2.0:1763343273.358476:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1699 00002000:00010000:2.0:1763343273.358480:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/679 (5->18446744073709551615) 00002000:00100000:2.0:1763343273.358482:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b2b800 with x1848998399789952 ext(5->18446744073709551615) 00002000:00010000:2.0:1763343273.358487:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5b2b800. 00000100:00100000:0.0:1763343273.363594:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.363681:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399790208 00000100:00100000:3.0:1763343273.363693:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399790208 00000100:00100000:3.0:1763343273.363752:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10481 00000100:00100000:3.0:1763343273.363762:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57101:x1848998399790208:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343273.363781:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343273.363803:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a22d5 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4904f expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.363870:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a22dc lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343273.363884:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a22dc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.363896:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a22dc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.363909:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a22e3 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343273.363917:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a22e3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.363923:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a22e3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.363961:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a22dc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.363969:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a22dc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.363974:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a22dc lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.363980:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a22dc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.363987:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343273.363990:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a22dc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.363997:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a22dc lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.364008:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b000) 00010000:00010000:3.0:1763343273.364012:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343273.364017:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a22dc lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.364057:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a22dc lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.364072:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a22e3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.364078:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a22e3 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.364084:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a22e3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.364089:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb3800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343273.364092:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a22e3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.364098:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a22e3 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.364105:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53a00) 00010000:00010000:3.0:1763343273.364109:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343273.364112:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a22e3 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.364117:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a22e3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.364144:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a22d5 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4904f expref: 290 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.364155:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b000) 00010000:00010000:3.0:1763343273.364157:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343273.364161:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a22d5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4904f expref: 290 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.364169:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5088800, rc 0) 00000100:00100000:3.0:1763343273.364215:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57101:x1848998399790208:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 455us (633us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343273.364222:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10481 00000100:00100000:3.0:1763343273.367936:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.368062:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399790464 00000100:00100000:1.0:1763343273.368074:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399790464 00000100:00100000:1.0:1763343273.368125:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10482 00000100:00100000:1.0:1763343273.368133:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57097:x1848998399790464:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:1.0:1763343273.368214:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a22ea lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343273.368231:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a22ea lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.368241:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a22ea lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00010000:1.0:1763343273.368362:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009bb308a7 reply state 0000000079a17f20 transno 4294973458 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a22ea lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.368373:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a22ea lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.368380:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:1.0:1763343273.368382:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343273.368385:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343273.368463:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57097:x1848998399790464:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 330us (537us total) trans 4294973458 rc 0/0 00000100:00100000:1.0:1763343273.368470:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10482 00000100:00100000:0.0:1763343273.375358:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.375402:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.375495:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399790848 00000100:00100000:2.0:1763343273.375506:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399790848 00000100:00100000:2.0:1763343273.375562:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7096 00000100:00100000:2.0:1763343273.375572:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2407:x1848998399790848:12345-192.168.201.40@tcp:2:lfs.0 00002000:00010000:2.0:1763343273.375741:0:11289:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2a7:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763343273.375745:0:11289:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2a7:0x0] updating lvb mtime from disk: 1763343272 -> 1763343272 00002000:00010000:2.0:1763343273.375747:0:11289:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2a7:0x0] updating lvb atime from disk: 1763343272 -> 1763343272 00002000:00010000:2.0:1763343273.375750:0:11289:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2a7:0x0] updating lvb ctime from disk: 1763343272 -> 1763343272 00002000:00010000:2.0:1763343273.375752:0:11289:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2a7:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763343273.375809:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2407:x1848998399790848:12345-192.168.201.40@tcp:2:lfs.0 Request processed in 237us (405us total) trans 17179871863 rc 0/0 00000100:00100000:2.0:1763343273.375816:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7096 00000100:00100000:3.0:1763343273.375946:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399790720 00000100:00100000:3.0:1763343273.375951:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399790720 00000100:00100000:3.0:1763343273.375995:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10483 00000100:00100000:3.0:1763343273.376003:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57101:x1848998399790720:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343273.376016:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343273.376019:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343273.376066:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a22ce lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49048 expref: 291 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.376084:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b000) 00010000:00010000:3.0:1763343273.376093:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343273.376107:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a22f1 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49056 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.376198:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a22f8 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343273.376209:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a22f8 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.376218:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a22f8 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.376229:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a22ff lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343273.376236:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a22ff lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.376242:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a22ff lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.376598:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2306 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343273.376607:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2306 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.376618:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2306 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:3.0:1763343273.376628:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f6:0x0]: returning size 0 00010000:00010000:3.0:1763343273.376653:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a22f8 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.376660:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a22f8 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.376665:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a22f8 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.376672:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a22f8 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.376677:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343273.376682:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a22f8 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.376689:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a22f8 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.376696:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b200) 00010000:00010000:3.0:1763343273.376699:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343273.376703:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a22f8 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.376708:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a22f8 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000004:00010000:3.0:1763343273.376718:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f807d322 reply state 00000000d7b58bb7 transno 4294973459 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a22ff lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.376733:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a22ff lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.376738:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53a00) 00010000:00010000:3.0:1763343273.376741:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343273.376743:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343273.376768:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a22f1 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49056 expref: 293 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.376783:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2306 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49056 expref: 292 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.376791:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f6:0x0].0x0 (ffff9400c488b400) 00010000:00010000:3.0:1763343273.376793:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343273.376795:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba2c00, rc 0) 00000100:00100000:3.0:1763343273.376837:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57101:x1848998399790720:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 834us (1489us total) trans 4294973459 rc 0/0 00000100:00100000:3.0:1763343273.376844:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10483 00000100:00100000:2.0:1763343273.381395:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.381484:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399791360 00000100:00100000:3.0:1763343273.381495:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399791360 00000100:00100000:3.0:1763343273.381774:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10484 00000100:00100000:3.0:1763343273.381786:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57101:x1848998399791360:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343273.381812:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343273.381835:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2314 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4905d expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.381943:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a231b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343273.381959:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2306 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49056 expref: 294 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.381968:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a231b lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00000100:00100000:1.0:1763343273.382004:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:3.0:1763343273.382007:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2306 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49056 expref: 294 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.382019:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2306 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49056 expref: 294 pid: 9827 timeout: 1166 lvb_type: 0 00000100:00100000:0.0:1763343273.382095:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399791104 00000100:00100000:0.0:1763343273.382101:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399791104 00000100:00100000:0.0:1763343273.382130:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3694 00000100:00100000:0.0:1763343273.382138:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57097:x1848998399791104:12345-192.168.201.40@tcp:35:lfs.0 00000004:00010000:0.0:1763343273.382170:0:19639:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x1f3:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a2100 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fa7 expref: 295 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.382203:0:19639:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a2322 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19639 initiator: MDT0 00010000:00010000:0.0:1763343273.382212:0:19639:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a2185 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fd8 expref: 295 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.382219:0:19639:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a2322 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343273.382238:0:19639:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a2185 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fd8 expref: 295 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.382245:0:19639:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a2185 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fd8 expref: 295 pid: 6524 timeout: 1166 lvb_type: 0 00000100:00100000:0.0:1763343273.382256:0:19639:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b29c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998412948352:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343273.382405:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6505880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412948224:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343273.382833:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc440e40 going to sleep for 11 seconds 00000100:00100000:0.0:1763343273.382833:0:19639:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c32170c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343273.385152:0:19639:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b29c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998412948352:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343273.385186:0:19639:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a2322 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00000100:00100000:3.0:1763343273.385254:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6505880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412948224:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343273.385434:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a231b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:1.0:1763343273.385520:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.385556:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.385650:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399791616 00000100:00100000:3.0:1763343273.385657:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399791616 00010000:00010000:3.0:1763343273.385690:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2306 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49056 expref: 296 pid: 9827 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.385720:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399791488 00000100:00100000:2.0:1763343273.385724:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399791488 00000100:00100000:3.0:1763343273.385725:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3396 00000100:00100000:3.0:1763343273.385733:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9831880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:2408:x1848998399791616:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343273.385740:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a2185 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fd8 expref: 297 pid: 6524 timeout: 1166 lvb_type: 0 00010000:00010000:3.0:1763343273.385757:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343273.385764:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2306 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49056 expref: 297 pid: 9827 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.385765:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3397 00000100:00100000:2.0:1763343273.385771:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9831500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:2408:x1848998399791488:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343273.385779:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343273.385783:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2306 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49056 expref: 297 pid: 9827 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.385784:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a2185 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fd8 expref: 297 pid: 6524 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.385792:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a2185 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fd8 expref: 297 pid: 6524 timeout: 1166 lvb_type: 0 00010000:00010000:3.0:1763343273.385805:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2306 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49056 expref: 297 pid: 9827 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.385805:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a2185 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fd8 expref: 297 pid: 6524 timeout: 1166 lvb_type: 0 00010000:00010000:3.0:1763343273.385820:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f6:0x0].0x0 (ffff9400c488b400) 00010000:00010000:2.0:1763343273.385820:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:3.0:1763343273.385826:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a231b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.385826:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a2322 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343273.385835:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a231b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.385835:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a2322 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343273.385843:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a231b lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.385843:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a2322 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343273.385860:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343273.385862:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343273.385970:0:19639:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a2322 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343273.385977:0:19639:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a2322 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00000100:00100000:2.0:1763343273.386110:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9831500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:2408:x1848998399791488:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 338us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.386118:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3397 00010000:00010000:2.0:1763343273.386152:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a231b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.386159:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a231b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343273.386177:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f6:0x0]: returning size 0 00000040:00080000:0.0:1763343273.386229:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1680, 88 off140072 00000004:00080000:0.0:1763343273.386237:0:19639:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1066510211944ns, next at 1066683090291ns, rc = 0 00000040:00080000:0.0:1763343273.386263:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1672, 88 off139416 00000004:00080000:0.0:1763343273.386267:0:19639:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1066510242423ns, next at 1066683237775ns, rc = 0 00000040:00080000:0.0:1763343273.386283:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1673, 88 off139504 00000004:00080000:0.0:1763343273.386287:0:19639:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1066510262678ns, next at 1066683237775ns, rc = 0 00000040:00080000:0.0:1763343273.386309:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1681, 88 off140160 00000004:00080000:0.0:1763343273.386313:0:19639:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1066510288194ns, next at 1066683090291ns, rc = 0 00000100:00100000:3.0:1763343273.386590:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9831880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:2408:x1848998399791616:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 855us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343273.386598:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3396 00000004:00080000:2.0:1763343273.386670:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2ab:0x0], index 1: 0 00000004:00080000:2.0:1763343273.386678:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2aa:0x0], index 0: 0 00000004:00080000:2.0:1763343273.386682:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2ab:0x0], index 0: 0 00000004:00080000:2.0:1763343273.386687:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2ac:0x0], index 1: 0 00010000:00010000:2.0:1763343273.387932:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a231b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.387945:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a231b lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.387952:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a231b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.387958:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.387962:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a231b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.387974:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a231b lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.387989:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f6:0x0].0x0 (ffff9400c488b400) 00010000:00010000:2.0:1763343273.387992:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343273.387996:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a231b lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.388002:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a231b lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.388073:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2314 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4905d expref: 295 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.388084:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f6:0x0].0x0 (ffff9400c488b400) 00010000:00010000:2.0:1763343273.388087:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343273.388090:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2314 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4905d expref: 295 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.388105:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3a00, rc 0) 00000100:00100000:2.0:1763343273.388160:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57101:x1848998399791360:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 6376us (6777us total) trans 4294973461 rc 301/301 00000100:00100000:2.0:1763343273.388168:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10484 00000001:00080000:0.0:1763343273.389506:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973460 is committed 00000004:00080000:0.0:1763343273.389519:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1079 committed 00000004:00080000:0.0:1763343273.389535:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1071 committed 00000004:00080000:0.0:1763343273.389547:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1070 committed 00000004:00080000:0.0:1763343273.389549:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1078 committed 00000004:00010000:0.0:1763343273.389597:0:19639:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000082874cca reply state 000000003b9cfbc2 transno 4294973460 ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a2322 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343273.389615:0:19639:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a2322 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343273.389634:0:19639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:0.0:1763343273.389637:0:19639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763343273.389640:0:19639:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343273.389646:0:19639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:0.0:1763343273.389648:0:19639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343273.389655:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a2100 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fa7 expref: 287 pid: 6524 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343273.389664:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c7ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412948864:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343273.389715:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1763343273.389726:0:19639:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763343273.389736:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57097:x1848998399791104:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 7600us (8469us total) trans 4294973460 rc 0/0 00000100:00100000:0.0:1763343273.389744:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3694 00000100:00100000:1.0:1763343273.389746:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763343273.389751:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412948736:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343273.389770:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412948608:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343273.389771:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343273.389793:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343273.389809:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763343273.389814:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412948480:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343273.389816:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412948864 00000100:00100000:1.0:1763343273.389822:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412948864 00000100:00100000:0.0:1763343273.389834:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343273.389853:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412948736 00000100:00100000:1.0:1763343273.389856:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412948736 00010000:00010000:0.0:1763343273.389858:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a2322 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343273.389865:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a2322 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19639 initiator: MDT1 00000100:00100000:1.0:1763343273.389871:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412948608 00000100:00100000:1.0:1763343273.389873:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412948608 00010000:00010000:0.0:1763343273.389873:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a2322 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343273.389878:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401f1bf1e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.389882:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a2322 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19639 initiator: MDT1 00000100:00100000:1.0:1763343273.389885:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412948480 00000100:00100000:1.0:1763343273.389887:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412948480 00010000:00010000:0.0:1763343273.389890:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a2322 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19639 initiator: MDT1 00000100:00100000:1.0:1763343273.389900:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7097 00010000:00010000:0.0:1763343273.389900:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:0.0:1763343273.389903:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343273.389906:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a2322 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19639 initiator: MDT1 00000100:00100000:1.0:1763343273.389907:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+36:3660:x1848998412948864:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1763343273.389912:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a2322 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19639 initiator: MDT1 00000100:00100000:0.0:1763343273.389933:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7098 00000100:00100000:0.0:1763343273.389939:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+36:3660:x1848998412948736:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763343273.390018:0:28562:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2a8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343273.390052:0:28562:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2a8:0x0] updating lvb mtime from disk: 1763343272 -> 1763343272 00002000:00010000:1.0:1763343273.390056:0:28562:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2a8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343273.390058:0:28562:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2a8:0x0] updating lvb ctime from disk: 1763343272 -> 1763343272 00002000:00010000:1.0:1763343273.390061:0:28562:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2a8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343273.390093:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+38:3660:x1848998412948864:12345-0@lo:2:osp-syn-1-1.0 Request processed in 186us (378us total) trans 17179871865 rc 0/0 00000100:00100000:1.0:1763343273.390100:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7097 00000100:00100000:1.0:1763343273.390113:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7099 00000100:00100000:1.0:1763343273.390119:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+37:3662:x1848998412948608:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343273.390132:0:28562:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:682 count 1 00002000:00010000:1.0:1763343273.390155:0:28562:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343273.390161:0:28562:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a2330 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.390172:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.390174:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.390178:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a2330 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.390189:0:28562:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a2330 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.390202:0:28562:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a2330 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.390209:0:28562:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a2330 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.390234:0:28562:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343273.390298:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343273.390306:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a2330 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.390313:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121ea00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343273.390316:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a2330 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.390322:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a2330 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.390335:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a2330 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.390342:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a2330 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.390354:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343273.390356:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343273.390357:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343273.390392:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+38:3662:x1848998412948608:12345-0@lo:6:osp-syn-1-1.0 Request processed in 273us (598us total) trans 17179871866 rc 0/0 00000100:00100000:1.0:1763343273.390399:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7099 00000100:00100000:1.0:1763343273.390411:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7100 00000100:00100000:1.0:1763343273.390417:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+37:3662:x1848998412948480:12345-0@lo:6:osp-syn-1-1.0 00002000:00010000:0.0:1763343273.390418:0:27798:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2a7:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763343273.390421:0:27798:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2a7:0x0] updating lvb mtime from disk: 1763343272 -> 1763343272 00002000:00010000:0.0:1763343273.390423:0:27798:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2a7:0x0] updating lvb atime from disk: 1763343272 -> 1763343272 00002000:00010000:0.0:1763343273.390425:0:27798:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2a7:0x0] updating lvb ctime from disk: 1763343272 -> 1763343272 00002000:00080000:1.0:1763343273.390428:0:28562:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:681 count 1 00002000:00010000:0.0:1763343273.390428:0:27798:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2a7:0x0] updating lvb blocks from disk: 8 -> 8 00010000:00010000:1.0:1763343273.390438:0:28562:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a2337 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.390450:0:28562:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2234 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49017 expref: 27 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343273.390451:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+37:3660:x1848998412948736:12345-0@lo:2:osp-syn-1-1.0 Request processed in 512us (679us total) trans 17179871864 rc 0/0 00010000:00010000:1.0:1763343273.390457:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1763343273.390457:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7098 00010000:00010000:1.0:1763343273.390459:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343273.390462:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a2337 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343273.390476:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412949120:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1763343273.390484:0:28562:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2234 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49017 expref: 27 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343273.390497:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343273.390503:0:28562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2234 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49017 expref: 27 pid: 11289 timeout: 1166 lvb_type: 0 00000100:00100000:1.0:1763343273.390514:0:28562:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c8599f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28562:1848998412949504:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343273.390588:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2273 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.390595:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2273 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.390601:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2273 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.390610:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85abe00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.390613:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2273 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.390619:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2273 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.390628:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53a00) 00010000:00010000:2.0:1763343273.390630:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.390633:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2273 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.390639:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2273 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.390651:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2288 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.390657:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2288 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.390663:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2288 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.390667:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ec00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.390670:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2288 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.390675:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2288 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.390686:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:2.0:1763343273.390689:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.390692:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2288 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.390696:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2288 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.390705:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a22ea lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.390711:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a22ea lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.390716:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a22ea lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.390720:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.390722:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a22ea lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.390727:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a22ea lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.390732:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:2.0:1763343273.390734:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.390736:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a22ea lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.390744:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a22ea lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.390751:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a22ff lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.390756:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a22ff lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.390761:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a22ff lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.390766:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.390768:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a22ff lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.390773:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a22ff lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.390778:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53a00) 00010000:00010000:2.0:1763343273.390780:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.390782:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a22ff lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.390786:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a22ff lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000100:00100000:2.0:1763343273.390806:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412948992:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763343273.390833:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412949248:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343273.390893:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343273.391803:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412949120 00000100:00100000:3.0:1763343273.391812:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412949120 00000100:00100000:3.0:1763343273.391845:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412949248 00000100:00100000:3.0:1763343273.391848:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412949248 00000100:00100000:3.0:1763343273.391863:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7101 00000100:00100000:2.0:1763343273.391955:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7102 00000100:00100000:2.0:1763343273.391965:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3659:x1848998412949248:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343273.392014:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343273.392051:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412948992 00000100:00100000:0.0:1763343273.392055:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412948992 00000100:00100000:0.0:1763343273.392071:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7103 00000100:00100000:0.0:1763343273.392077:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+8:3661:x1848998412948992:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763343273.392090:0:8414:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:680 count 1 00002000:00010000:2.0:1763343273.392091:0:28561:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2a6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343273.392094:0:28561:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2a6:0x0] updating lvb mtime from disk: 1763343272 -> 1763343272 00002000:00010000:2.0:1763343273.392096:0:28561:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2a6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343273.392098:0:28561:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2a6:0x0] updating lvb ctime from disk: 1763343272 -> 1763343272 00002000:00010000:2.0:1763343273.392100:0:28561:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2a6:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:0.0:1763343273.392105:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a233e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.392121:0:8414:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98200/0x9104b1ba770a2226 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49010 expref: 13 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.392128:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343273.392129:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343273.392133:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a233e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343273.392143:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+8:3659:x1848998412949248:12345-0@lo:2:osp-syn-0-1.0 Request processed in 180us (1249us total) trans 21474839134 rc 0/0 00000100:00100000:2.0:1763343273.392150:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7102 00010000:00010000:0.0:1763343273.392158:0:8414:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98200/0x9104b1ba770a2226 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49010 expref: 13 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.392169:0:8414:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98200/0x9104b1ba770a2226 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49010 expref: 13 pid: 8412 timeout: 1166 lvb_type: 0 00000100:00100000:0.0:1763343273.392181:0:8414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c514f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1848998412949632:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343273.392654:0:28562:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd00c0 going to sleep for 11 seconds 00000004:00080000:2.0:1763343273.392797:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c9833b80/2, rc 0, transno 17179871866 00000100:00100000:2.0:1763343273.392805:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412948608:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343273.392834:0:3659:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474839130 gen 2 00000004:00080000:2.0:1763343273.392838:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5957100, transno 21474839118 00000004:00080000:2.0:1763343273.392846:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5954700, transno 21474839119 00000004:00080000:2.0:1763343273.392848:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5954e00, transno 21474839120 00000004:00080000:2.0:1763343273.392850:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5956a00, transno 21474839121 00000004:00080000:2.0:1763343273.392852:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c59b4700, transno 21474839122 00000004:00080000:2.0:1763343273.392855:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c59b5500, transno 21474839123 00000004:00080000:2.0:1763343273.392857:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c59b7800, transno 21474839124 00000004:00080000:2.0:1763343273.392859:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c59b6a00, transno 21474839125 00000004:00080000:2.0:1763343273.392862:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9dc9500, transno 21474839127 00000004:00080000:2.0:1763343273.392864:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9dc8380, transno 21474839128 00000004:00080000:2.0:1763343273.392866:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c4b23480, transno 21474839129 00000004:00080000:2.0:1763343273.392868:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c4b21500, transno 21474839130 00000100:00100000:2.0:1763343273.392874:0:3659:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9401f6504a80 x1848998412949248/t21474839134(21474839134) o2->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763343289 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1763343273.392881:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6504a80/2, rc 0, transno 21474839134 00000100:00100000:2.0:1763343273.392885:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412949248:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763343273.392986:0:8616:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 4 in progress, 3 in flight, 12 done 00000100:00100000:1.0:1763343273.393017:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412949376:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343273.393064:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1763343273.393091:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c9832300/2, rc 0, transno 17179871864 00000100:00100000:1.0:1763343273.393095:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412948736:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763343273.393104:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c7ef4e00/2, rc 0, transno 17179871865 00000100:00100000:1.0:1763343273.393107:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c7ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412948864:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343273.393542:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+7:3662:x1848998412949120:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343273.393749:0:8414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c3217540 going to sleep for 11 seconds 00000100:00100000:2.0:1763343273.393816:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412949376 00000100:00100000:2.0:1763343273.393823:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412949376 00000100:00100000:0.0:1763343273.393831:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.393865:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7104 00000100:00100000:2.0:1763343273.393874:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+8:3660:x1848998412949376:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1763343273.393968:0:35281:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2a7:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763343273.393972:0:35281:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2a7:0x0] updating lvb mtime from disk: 1763343272 -> 1763343272 00002000:00010000:2.0:1763343273.393975:0:35281:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2a7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343273.393977:0:35281:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2a7:0x0] updating lvb ctime from disk: 1763343272 -> 1763343272 00002000:00010000:2.0:1763343273.393979:0:35281:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2a7:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763343273.393995:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399791872 00000100:00100000:1.0:1763343273.393999:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399791872 00000100:00100000:2.0:1763343273.394044:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+9:3660:x1848998412949376:12345-0@lo:2:osp-syn-0-1.0 Request processed in 151us (958us total) trans 21474839135 rc 0/0 00000100:00100000:2.0:1763343273.394051:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7104 00002000:00080000:3.0:1763343273.394068:0:27798:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:681 count 1 00000100:00100000:1.0:1763343273.394149:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3695 00000100:00100000:1.0:1763343273.394157:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+282:57101:x1848998399791872:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343273.394366:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57101:x1848998399791872:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 209us (535us total) trans 4294973462 rc 0/0 00000100:00100000:1.0:1763343273.394374:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3695 00000004:00080000:0.0:1763343273.394899:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6507800/2, rc 0, transno 21474839135 00000100:00100000:0.0:1763343273.394907:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412949376:0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1763343273.395222:0:27798:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343273.395232:0:27798:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a2345 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.395244:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.395246:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.395252:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a2345 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.395264:0:27798:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a2345 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.395284:0:27798:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a2345 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.395303:0:27798:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a2345 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.395474:0:27798:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343273.395857:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:1.0:1763343273.395887:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343273.395893:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a2345 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.395901:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b99600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343273.395906:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a2345 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.395915:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a2345 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.395932:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a2345 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.395939:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a2345 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.395956:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343273.395958:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343273.395960:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343273.395985:0:8414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c514f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1848998412949632:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343273.396003:0:8414:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a233e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343273.396069:0:28562:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c8599f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28562:1848998412949504:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343273.396081:0:28562:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a2337 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343273.396423:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+9:3662:x1848998412949120:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4552us (5922us total) trans 21474839136 rc 0/0 00000100:00100000:2.0:1763343273.396432:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7101 00000004:00080000:0.0:1763343273.396498:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6507b80/2, rc 0, transno 21474839136 00000100:00100000:0.0:1763343273.396504:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412949120:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343273.396514:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399792000 00000100:00100000:3.0:1763343273.396520:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399792000 00000100:00100000:3.0:1763343273.396566:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10485 00000100:00100000:1.0:1763343273.396567:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.396575:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+283:57097:x1848998399792000:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343273.396593:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343273.396610:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2000/0x9104b1ba770a234c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49064 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343273.396675:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:2.0:1763343273.396769:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2000/0x9104b1ba770a234c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49064 expref: 284 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.396784:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2000/0x9104b1ba770a234c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49064 expref: 284 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.396802:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:2.0:1763343273.396805:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343273.396808:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba2000, rc 0) 00000100:00100000:2.0:1763343273.396854:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57097:x1848998399792000:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 279us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.396860:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10485 00000100:00100000:0.0:1763343273.397045:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399792256 00000100:00100000:0.0:1763343273.397050:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399792256 00010000:00010000:0.0:1763343273.397072:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2234 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49017 expref: 28 pid: 11289 timeout: 1166 lvb_type: 0 00000100:00100000:0.0:1763343273.397097:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399792128 00000100:00100000:0.0:1763343273.397100:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399792128 00010000:00010000:0.0:1763343273.397113:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98200/0x9104b1ba770a2226 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49010 expref: 14 pid: 8412 timeout: 1166 lvb_type: 0 00000100:00100000:0.0:1763343273.397135:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3398 00000100:00100000:0.0:1763343273.397142:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8599f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2408:x1848998399792256:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343273.397151:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343273.397156:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2234 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49017 expref: 28 pid: 11289 timeout: 1166 lvb_type: 0 00010000:00010000:0.0:1763343273.397167:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2234 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49017 expref: 28 pid: 11289 timeout: 1166 lvb_type: 0 00010000:00010000:0.0:1763343273.397186:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2234 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49017 expref: 28 pid: 11289 timeout: 1166 lvb_type: 0 00010000:00010000:0.0:1763343273.397199:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343273.397201:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343273.397205:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a2337 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.397214:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a2337 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.397236:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343273.397262:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8599f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2408:x1848998399792256:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 121us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343273.397280:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3398 00000100:00100000:0.0:1763343273.397305:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3399 00000100:00100000:0.0:1763343273.397313:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8599c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399792128:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343273.397321:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343273.397326:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98200/0x9104b1ba770a2226 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49010 expref: 14 pid: 8412 timeout: 1166 lvb_type: 0 00010000:00010000:0.0:1763343273.397336:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98200/0x9104b1ba770a2226 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49010 expref: 14 pid: 8412 timeout: 1166 lvb_type: 0 00010000:00010000:0.0:1763343273.397350:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98200/0x9104b1ba770a2226 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49010 expref: 14 pid: 8412 timeout: 1166 lvb_type: 0 00010000:00010000:0.0:1763343273.397359:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343273.397361:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343273.397364:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a233e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.397371:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a233e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.397389:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343273.397408:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8599c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2408:x1848998399792128:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 97us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343273.397415:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3399 00010000:00010000:0.0:1763343273.397438:0:8414:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a233e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.397446:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a233e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.397455:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a233e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.397462:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a233e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.397478:0:8414:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343273.397599:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.397619:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399792512 00000100:00100000:3.0:1763343273.397623:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399792512 00000100:00100000:3.0:1763343273.397648:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3696 00000100:00100000:3.0:1763343273.397654:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8444450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+284:57101:x1848998399792512:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343273.397672:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+9:3661:x1848998412948992:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5595us (5658us total) trans 21474839137 rc 0/0 00000100:00100000:0.0:1763343273.397679:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7103 00010000:00010000:0.0:1763343273.397696:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343273.397701:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a233e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.397707:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401f1bf1c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343273.397711:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a233e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.397719:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a233e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.397730:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a233e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.397737:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a233e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.397750:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343273.397752:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343273.397753:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343273.397778:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6505880/2, rc 0, transno 21474839137 00000100:00100000:0.0:1763343273.397783:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412948992:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343273.397792:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8444450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57101:x1848998399792512:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 138us (194us total) trans 4294973463 rc 0/0 00000100:00100000:3.0:1763343273.397799:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3696 00010000:00010000:0.0:1763343273.397800:0:28562:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a2337 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.397807:0:28562:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a2337 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.397815:0:28562:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a2337 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.397821:0:28562:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a2337 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.397837:0:28562:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343273.397960:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+37:3662:x1848998412948480:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7543us (8124us total) trans 17179871867 rc 0/0 00000100:00100000:0.0:1763343273.397967:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7100 00010000:00010000:0.0:1763343273.397982:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343273.397987:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a2337 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.397994:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121fc00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343273.397997:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a2337 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.398004:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a2337 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.398015:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a2337 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.398039:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a2337 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.398052:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343273.398054:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343273.398055:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343273.398075:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c9832d80/2, rc 0, transno 17179871867 00000100:00100000:0.0:1763343273.398080:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412948480:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343273.400136:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.400804:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399792768 00000100:00100000:1.0:1763343273.400815:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399792768 00000100:00100000:1.0:1763343273.400875:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3697 00000100:00100000:1.0:1763343273.400885:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57097:x1848998399792768:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:1.0:1763343273.401169:0:19639:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1f3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1763343273.401239:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1682, 64 off140224 00000040:00080000:1.0:1763343273.401265:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1674, 64 off139568 00000040:00080000:1.0:1763343273.401301:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1675, 64 off139632 00000040:00080000:1.0:1763343273.401313:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1683, 64 off140288 00010000:00010000:1.0:1763343273.401371:0:19639:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a2353 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19639 initiator: MDT0 00010000:00010000:1.0:1763343273.401388:0:19639:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a2353 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 19639 initiator: MDT1 00010000:00010000:1.0:1763343273.401398:0:19639:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a2353 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 19639 initiator: MDT1 00010000:00010000:1.0:1763343273.401406:0:19639:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a2353 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 19639 initiator: MDT1 00010000:00010000:1.0:1763343273.401412:0:19639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a2353 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 19639 initiator: MDT1 00010000:00010000:1.0:1763343273.401418:0:19639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a2353 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 19639 initiator: MDT1 00010000:00010000:1.0:1763343273.401437:0:19639:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343273.401609:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57097:x1848998399792768:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 724us (1480us total) trans 4294973464 rc 0/0 00000100:00100000:1.0:1763343273.401617:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3697 00010000:00010000:0.0:1763343273.401762:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343273.401769:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a2353 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343273.401776:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121e200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343273.401780:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a2353 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343273.401788:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a2353 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343273.401801:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f3:0x0].0x0 (ffff9401fc4f1200) 00010000:00010000:0.0:1763343273.401804:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343273.401808:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a2353 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343273.401814:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a2353 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1f3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343273.401823:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343273.401824:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343273.401826:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343273.401879:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.402075:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399793024 00000100:00100000:0.0:1763343273.402082:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399793024 00000100:00100000:0.0:1763343273.402122:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10486 00000100:00100000:0.0:1763343273.402130:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:55884:x1848998399793024:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343273.402143:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343273.402157:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a235a lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4906b expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.402258:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2361 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343273.402281:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2361 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.402299:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2361 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.402314:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a2368 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343273.402320:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a2368 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.402327:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a2368 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.402377:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a236f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343273.402385:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a236f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.402392:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a236f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343273.402402:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f6:0x0]: returning size 0 00010000:00010000:0.0:1763343273.402466:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2361 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.402478:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2361 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.402484:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2361 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.402489:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2361 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.402494:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401f1bf0200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.402498:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2361 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.402504:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2361 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.402513:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c52ece00) 00010000:00010000:0.0:1763343273.402516:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.402523:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2361 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.402528:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2361 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.402540:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a2368 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.402545:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a2368 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.402551:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a2368 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.402555:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c0030200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.402558:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a2368 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.402564:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a2368 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.402571:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c52ecf00) 00010000:00010000:0.0:1763343273.402574:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.402578:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a2368 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.402582:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a2368 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.402620:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a235a lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4906b expref: 289 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.402634:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a236f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4906b expref: 288 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.402641:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f6:0x0].0x0 (ffff9400c52eca00) 00010000:00010000:0.0:1763343273.402643:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343273.402645:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940202040c00, rc 0) 00000100:00100000:0.0:1763343273.402694:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:55884:x1848998399793024:12345-192.168.201.40@tcp:101:bash.0 Request processed in 564us (814us total) trans 4294973465 rc 0/0 00000100:00100000:0.0:1763343273.402701:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10486 00000100:00100000:1.0:1763343273.404538:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.404570:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.404614:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399793152 00000100:00100000:2.0:1763343273.404623:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399793152 00000100:00100000:2.0:1763343273.404673:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399793408 00000100:00100000:2.0:1763343273.404676:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399793408 00000100:00100000:2.0:1763343273.404710:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10487 00000100:00100000:2.0:1763343273.404720:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:55884:x1848998399793152:12345-192.168.201.40@tcp:101:bash.0 00000100:00100000:0.0:1763343273.404725:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10488 00000100:00100000:0.0:1763343273.404733:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57097:x1848998399793408:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343273.404742:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343273.404742:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.404760:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a2384 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49072 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.404760:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a237d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49079 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.404789:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a238b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343273.404801:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a238b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.404811:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a238b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.404848:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2392 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343273.404855:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2392 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.404867:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2392 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:0.0:1763343273.404877:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f6:0x0]: returning size 0 00010000:00010000:2.0:1763343273.404894:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a2384 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49072 expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.404910:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a238b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49072 expref: 291 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.404919:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f6:0x0].0x0 (ffff9400c52eca00) 00010000:00010000:2.0:1763343273.404922:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343273.404925:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c6b99600, rc 0) 00000100:00100000:2.0:1763343273.404967:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:55884:x1848998399793152:12345-192.168.201.40@tcp:101:bash.0 Request processed in 250us (439us total) trans 0 rc 0/0 00010000:00010000:0.0:1763343273.404967:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a237d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49079 expref: 293 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343273.404974:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10487 00010000:00010000:0.0:1763343273.404980:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2392 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49079 expref: 292 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.404986:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f6:0x0].0x0 (ffff9400c52eca00) 00010000:00010000:0.0:1763343273.404989:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1763343273.404991:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400cbad3c00, rc 0) 00000100:00100000:0.0:1763343273.405012:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57097:x1848998399793408:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 280us (442us total) trans 4294973466 rc 0/0 00000100:00100000:0.0:1763343273.405018:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10488 00000100:00100000:1.0:1763343273.407201:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.407238:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.407440:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399793664 00000100:00100000:2.0:1763343273.407440:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399793792 00000100:00100000:3.0:1763343273.407450:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399793664 00000100:00100000:2.0:1763343273.407450:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399793792 00000100:00100000:3.0:1763343273.407509:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10489 00000100:00100000:3.0:1763343273.407520:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:55884:x1848998399793664:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:3.0:1763343273.407575:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1763343273.407593:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10490 00000100:00100000:2.0:1763343273.407601:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57097:x1848998399793792:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343273.407603:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a236f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4906b expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.407611:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343273.407622:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f6:0x0].0x0 (ffff9400c52eca00) 00010000:00010000:2.0:1763343273.407626:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a23a0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49080 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.407628:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343273.407683:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a23a7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343273.407696:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a23a7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.407704:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a23a7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:2.0:1763343273.407778:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f6:0x0]: returning size 0 00000004:00200000:2.0:1763343273.407783:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343273.407809:0:6524:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a23a7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343273.407810:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a23ae lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343273.407818:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a23a7 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343273.407976:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a23ae lrc: 4/0,1 mode: --/PW res: [0x240000404:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.408000:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a23a0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49080 expref: 294 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.408008:0:9827:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a23a7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49080 expref: 293 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.408090:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a23a7 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49080 expref: 293 pid: 6524 timeout: 1166 lvb_type: 0 00000100:00100000:3.0:1763343273.408105:0:9827:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9832a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412949760:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343273.408203:0:6524:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a23a7 lrc: 6/0,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49080 expref: 293 pid: 6524 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.408241:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a23a7 lrc: 6/0,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49080 expref: 293 pid: 6524 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.408248:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4514200, rc 0) 00000100:00100000:3.0:1763343273.408581:0:9827:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc440780 going to sleep for 11 seconds 00000100:00100000:2.0:1763343273.408620:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57097:x1848998399793792:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1020us (1380us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.408628:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10490 00000100:00100000:1.0:1763343273.411543:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.411625:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.411640:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9832a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412949760:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343273.411668:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a23ae lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:2.0:1763343273.411738:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399794048 00000100:00100000:2.0:1763343273.411746:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399794048 00010000:00010000:2.0:1763343273.411782:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a23a7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49080 expref: 293 pid: 6524 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.411821:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3400 00000100:00100000:2.0:1763343273.411832:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c511d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:2408:x1848998399794048:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343273.411849:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343273.411856:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a23a7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49080 expref: 293 pid: 6524 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.411870:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a23a7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49080 expref: 293 pid: 6524 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.411893:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a23a7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49080 expref: 293 pid: 6524 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.411908:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f6:0x0].0x0 (ffff9400c52eca00) 00010000:00010000:2.0:1763343273.411913:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a23ae lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.411923:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a23ae lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.411930:0:7904:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a23ae lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.411959:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343273.411971:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399793920 00000100:00100000:0.0:1763343273.411976:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399793920 00000100:00100000:2.0:1763343273.412008:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c511d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:2408:x1848998399794048:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 177us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343273.412014:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7105 00000100:00100000:2.0:1763343273.412015:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3400 00000100:00100000:0.0:1763343273.412021:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c511ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2407:x1848998399793920:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343273.412067:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343273.412085:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a23b5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49087 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343273.412107:0:28562:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343273.412123:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343273.412125:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343273.412134:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a23b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49087 expref: 14 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343273.412147:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a23b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49087 expref: 14 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343273.412159:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a7e00, rc 0) 00000100:00100000:0.0:1763343273.412185:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c511ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399793920:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 164us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343273.412191:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7105 00010000:00010000:3.0:1763343273.412323:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a23ae lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.412331:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a23ae lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000001:00080000:3.0:1763343273.412566:0:9827:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973467 00000004:00010000:3.0:1763343273.412612:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004ce9c786 reply state 0000000030575e12 transno 4294973468 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a23ae lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.412626:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a23ae lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.412633:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f6:0x0].0x0 (ffff9400c52eca00) 00010000:00010000:3.0:1763343273.412636:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343273.412639:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343273.412712:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:55884:x1848998399793664:12345-192.168.201.40@tcp:36:bash.0 Request processed in 5194us (5519us total) trans 4294973468 rc 0/0 00000100:00100000:3.0:1763343273.412719:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10489 00000020:00080000:3.0:1763343273.412723:0:9827:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343273.412773:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.413175:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399794176 00000100:00100000:1.0:1763343273.413182:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399794176 00000100:00100000:1.0:1763343273.413217:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7106 00000100:00100000:1.0:1763343273.413226:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2407:x1848998399794176:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343273.413237:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.413253:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a23bc lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4908e expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343273.413270:0:8414:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343273.413283:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.413284:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.413299:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a23bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4908e expref: 28 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343273.413313:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a23bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4908e expref: 28 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343273.413323:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121ea00, rc 0) 00000100:00100000:1.0:1763343273.413355:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2407:x1848998399794176:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 131us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343273.413361:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7106 00000100:00100000:0.0:1763343273.415920:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.416000:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.416071:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399794560 00000100:00100000:2.0:1763343273.416071:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399794432 00000100:00100000:3.0:1763343273.416081:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399794560 00000100:00100000:2.0:1763343273.416081:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399794432 00000100:00100000:2.0:1763343273.416226:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10491 00000100:00100000:2.0:1763343273.416238:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:55884:x1848998399794432:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343273.416261:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.416264:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343273.416301:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2392 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49079 expref: 294 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.416327:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f6:0x0].0x0 (ffff9400c52eca00) 00010000:00010000:2.0:1763343273.416332:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343273.416346:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a23c3 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49095 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.416392:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a23ca lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343273.416405:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a23ca lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.416414:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a23ca lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000100:00100000:3.0:1763343273.416559:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10492 00000100:00100000:3.0:1763343273.416567:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57097:x1848998399794560:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343273.416575:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343273.416585:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a23d1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4909c expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.416611:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a23ca lrc: 2/0,1 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343273.416619:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a23d1 lrc: 4/0,0 mode: --/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4909c expref: 295 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.416636:0:9827:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a23ca lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343273.416648:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a23d1 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4909c expref: 295 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.416660:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f6:0x0].0x0 (ffff9400c52eca00) 00010000:00010000:3.0:1763343273.416663:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343273.416666:0:9827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a23d1 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4909c expref: 295 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.416672:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba2c00, rc 0) 00000100:00100000:3.0:1763343273.416731:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57097:x1848998399794560:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 165us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343273.416738:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10492 00000040:00080000:2.0:1763343273.416955:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1684, 88 off140376 00000004:00080000:2.0:1763343273.416963:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1066540938574ns, next at 1066683090291ns, rc = 0 00000040:00080000:2.0:1763343273.417355:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1676, 88 off139720 00000004:00080000:2.0:1763343273.417362:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1066541336854ns, next at 1066683237775ns, rc = 0 00000040:00080000:2.0:1763343273.417377:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1677, 88 off139808 00000004:00080000:2.0:1763343273.417381:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1066541356517ns, next at 1066683237775ns, rc = 0 00000040:00080000:2.0:1763343273.417392:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1685, 88 off140464 00000004:00080000:2.0:1763343273.417396:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1066541371682ns, next at 1066683090291ns, rc = 0 00000001:00080000:2.0:1763343273.419461:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973469 is committed 00000004:00080000:2.0:1763343273.419474:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1081 committed 00010000:00010000:0.0:1763343273.419590:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a23ae lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.419601:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a23ae lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.419608:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a23ae lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.419614:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.419618:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a23ae lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.419626:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a23ae lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.419641:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f6:0x0].0x0 (ffff9400c52eca00) 00010000:00010000:0.0:1763343273.419644:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.419649:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a23ae lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.419656:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a23ae lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000004:00080000:2.0:1763343273.419698:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1073 committed 00000004:00080000:2.0:1763343273.419715:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1072 committed 00000004:00080000:2.0:1763343273.419718:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1080 committed 00000100:00100000:2.0:1763343273.419836:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412950144:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763343273.419904:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343273.419949:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763343273.419956:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412950272:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343273.419978:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343273.420013:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412950144 00000100:00100000:2.0:1763343273.420019:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412950144 00000100:00100000:2.0:1763343273.420089:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412950272 00000100:00100000:2.0:1763343273.420092:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412950272 00000100:00100000:2.0:1763343273.420115:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7107 00000100:00100000:2.0:1763343273.420124:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+10:3659:x1848998412950144:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763343273.420147:0:8414:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:679 count 1 00010000:00010000:2.0:1763343273.420172:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c4514200/0x9104b1ba770a23d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.420190:0:8414:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c4515600/0x9104b1ba770a2296 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4902c expref: 13 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.420197:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343273.420199:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343273.420202:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c4514200/0x9104b1ba770a23d8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.420227:0:8414:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c4515600/0x9104b1ba770a2296 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4902c expref: 13 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.420241:0:8414:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c4515600/0x9104b1ba770a2296 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4902c expref: 13 pid: 8412 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.420260:0:8414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9dc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1848998412950528:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343273.420282:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7108 00000100:00100000:3.0:1763343273.420305:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+10:3659:x1848998412950272:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343273.420331:0:8414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401ed059540 going to sleep for 11 seconds 00010000:00010000:2.0:1763343273.420389:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a23ca lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49095 expref: 286 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.420399:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f6:0x0].0x0 (ffff9400c52eca00) 00010000:00010000:2.0:1763343273.420402:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343273.420406:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a23d1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4909c expref: 286 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.420416:0:6524:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a23d1 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4909c expref: 286 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.420424:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a23d1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4909c expref: 286 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.420449:0:6524:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a23d1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4909c expref: 286 pid: 9827 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343273.420462:0:6524:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9dc8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412950656:192.168.201.40@tcp:105: 00000100:00100000:3.0:1763343273.420472:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+11:3659:x1848998412950272:12345-0@lo:2:osp-syn-0-1.0 Request processed in 179us (490us total) trans 21474839138 rc 0/0 00000100:00100000:3.0:1763343273.420482:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7108 00000004:00080000:2.0:1763343273.420493:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b27100/2, rc 0, transno 21474839138 00000100:00100000:2.0:1763343273.420501:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412950272:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343273.420537:0:6524:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401ed0596c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343273.420787:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412949888:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343273.420816:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343273.421279:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412950784:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343273.421317:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343273.421344:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1763343273.421350:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c511c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412950016:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343273.421369:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343273.421384:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412950400:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343273.421401:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343273.421428:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412951040:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343273.421448:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343273.421463:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763343273.421468:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412950912:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343273.421484:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343273.421508:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412949888 00000100:00100000:0.0:1763343273.421514:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412949888 00000100:00100000:0.0:1763343273.421543:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412950784 00000100:00100000:0.0:1763343273.421546:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412950784 00000100:00100000:0.0:1763343273.421560:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412950016 00000100:00100000:0.0:1763343273.421563:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412950016 00000100:00100000:0.0:1763343273.421574:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412950400 00000100:00100000:0.0:1763343273.421577:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412950400 00000100:00100000:0.0:1763343273.421585:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412951040 00000100:00100000:0.0:1763343273.421587:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412951040 00000100:00100000:0.0:1763343273.421596:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412950912 00000100:00100000:0.0:1763343273.421598:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412950912 00000100:00100000:0.0:1763343273.421609:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7109 00000100:00100000:0.0:1763343273.421615:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+12:3662:x1848998412949888:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763343273.421634:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:678 count 1 00010000:00010000:0.0:1763343273.421653:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a23df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.421669:0:35266:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff940202041000/0x9104b1ba770a20f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fa0 expref: 13 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.421676:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343273.421678:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343273.421681:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a23df lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.421704:0:35266:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff940202041000/0x9104b1ba770a20f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fa0 expref: 13 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.421714:0:35266:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff940202041000/0x9104b1ba770a20f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fa0 expref: 13 pid: 11289 timeout: 1166 lvb_type: 0 00000100:00100000:0.0:1763343273.421724:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc73800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35266:1848998412951168:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343273.421753:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c3217540 going to sleep for 11 seconds 00000100:00100000:0.0:1763343273.421773:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7110 00000100:00100000:0.0:1763343273.421779:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+40:3662:x1848998412950784:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763343273.421792:0:8412:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:680 count 1 00010000:00010000:0.0:1763343273.421807:0:8412:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a23e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.421818:0:8412:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c4514400/0x9104b1ba770a22c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49041 expref: 27 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.421825:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343273.421826:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343273.421829:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a23e6 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.421848:0:8412:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c4514400/0x9104b1ba770a22c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49041 expref: 27 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.421857:0:8412:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c4514400/0x9104b1ba770a22c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49041 expref: 27 pid: 11289 timeout: 1166 lvb_type: 0 00000100:00100000:0.0:1763343273.421866:0:8412:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8412:1848998412951296:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343273.421889:0:8412:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c32170c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343273.421956:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7111 00000100:00100000:1.0:1763343273.421966:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+40:3662:x1848998412950016:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343273.421977:0:8626:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:679 count 1 00010000:00010000:1.0:1763343273.421993:0:8626:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a23ed lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.422004:0:8626:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a21d2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fed expref: 27 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343273.422011:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.422012:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.422014:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a23ed lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.422061:0:8626:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a21d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fed expref: 27 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343273.422070:0:8626:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a21d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fed expref: 27 pid: 8412 timeout: 1166 lvb_type: 1 00000100:00100000:1.0:1763343273.422079:0:8626:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dcb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998412951424:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343273.422112:0:8626:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1763343273.422127:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7112 00000100:00100000:1.0:1763343273.422134:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+12:3662:x1848998412950400:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1763343273.422244:0:27798:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2ab:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343273.422248:0:27798:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2ab:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343273.422250:0:27798:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2ab:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343273.422253:0:27798:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2ab:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763343273.422255:0:27798:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2ab:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343273.422309:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+13:3662:x1848998412950400:12345-0@lo:2:osp-syn-0-1.0 Request processed in 174us (906us total) trans 21474839139 rc 0/0 00000100:00100000:1.0:1763343273.422316:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7112 00000100:00100000:1.0:1763343273.422334:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7113 00000100:00100000:1.0:1763343273.422340:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+40:3660:x1848998412951040:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763343273.422409:0:27798:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2ac:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343273.422412:0:27798:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2ac:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343273.422414:0:27798:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2ac:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343273.422416:0:27798:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2ac:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763343273.422418:0:27798:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2ac:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343273.422448:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+41:3660:x1848998412951040:12345-0@lo:2:osp-syn-1-1.0 Request processed in 109us (999us total) trans 17179871868 rc 0/0 00000100:00100000:1.0:1763343273.422455:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7113 00000100:00100000:1.0:1763343273.422466:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7114 00000100:00100000:1.0:1763343273.422471:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+40:3660:x1848998412950912:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343273.422536:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+41:3660:x1848998412950912:12345-0@lo:2:osp-syn-1-1.0 Request processed in 65us (1050us total) trans 17179871869 rc 0/0 00000100:00100000:1.0:1763343273.422542:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7114 00000004:00080000:1.0:1763343273.422578:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5dcb800/2, rc 0, transno 17179871869 00000100:00100000:1.0:1763343273.422583:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412950912:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763343273.422593:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5dcbb80/2, rc 0, transno 17179871868 00000100:00100000:1.0:1763343273.422596:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412951040:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763343273.422709:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b24700/2, rc 0, transno 21474839139 00000100:00100000:0.0:1763343273.422715:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412950400:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343273.423947:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.424169:0:6524:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9dc8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412950656:192.168.201.40@tcp:105: 00010000:00010000:3.0:1763343273.424208:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a23c3 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49095 expref: 286 pid: 6524 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763343273.424228:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a23ca lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49095 expref: 285 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.424267:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c6b98000, rc 0) 00000100:00100000:3.0:1763343273.424331:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:55884:x1848998399794432:12345-192.168.201.40@tcp:101:bash.0 Request processed in 8096us (8422us total) trans 4294973469 rc 0/0 00000100:00100000:3.0:1763343273.424340:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10491 00000100:00100000:2.0:1763343273.424650:0:8414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9dc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1848998412950528:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343273.424665:0:8414:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c4514200/0x9104b1ba770a23d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343273.424688:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399794688 00000100:00100000:2.0:1763343273.424694:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399794688 00010000:00010000:2.0:1763343273.424719:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c4515600/0x9104b1ba770a2296 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4902c expref: 14 pid: 8412 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.424747:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3401 00000100:00100000:2.0:1763343273.424757:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8391450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399794688:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343273.424771:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343273.424776:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c4515600/0x9104b1ba770a2296 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4902c expref: 14 pid: 8412 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.424788:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c4515600/0x9104b1ba770a2296 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4902c expref: 14 pid: 8412 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.424809:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c4515600/0x9104b1ba770a2296 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4902c expref: 14 pid: 8412 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.424823:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.424825:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.424829:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c4514200/0x9104b1ba770a23d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.424839:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c4514200/0x9104b1ba770a23d8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.425812:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343273.425875:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8391450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2407:x1848998399794688:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1115us (1929us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.425885:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3401 00010000:00010000:1.0:1763343273.426352:0:8414:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c4514200/0x9104b1ba770a23d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.426363:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c4514200/0x9104b1ba770a23d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.426378:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c4514200/0x9104b1ba770a23d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.426386:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c4514200/0x9104b1ba770a23d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343273.427108:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:0.0:1763343273.427167:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343273.427175:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c4514200/0x9104b1ba770a23d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.427182:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343273.427186:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c4514200/0x9104b1ba770a23d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.427199:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c4514200/0x9104b1ba770a23d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.427218:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c4514200/0x9104b1ba770a23d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.427226:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343273.427228:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343273.427229:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343273.427282:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399794816 00000100:00100000:2.0:1763343273.427299:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399794816 00000100:00100000:2.0:1763343273.427346:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3698 00000100:00100000:2.0:1763343273.427355:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57097:x1848998399794816:12345-192.168.201.40@tcp:49:lfs.0 00000100:00100000:2.0:1763343273.427464:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57097:x1848998399794816:12345-192.168.201.40@tcp:49:lfs.0 Request processed in 111us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.427472:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3698 00010000:00010000:1.0:1763343273.427797:0:8414:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1763343273.427805:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c4514200/0x9104b1ba770a23d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343273.428164:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+13:3659:x1848998412950144:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8040us (8259us total) trans 21474839140 rc 0/0 00000100:00100000:1.0:1763343273.428172:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7107 00000004:00080000:2.0:1763343273.428402:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b27b80/2, rc 0, transno 21474839140 00000100:00100000:2.0:1763343273.428410:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412950144:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343273.429010:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.429057:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.429076:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399794944 00000100:00100000:3.0:1763343273.429083:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399794944 00010000:00010000:3.0:1763343273.429107:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff940202041000/0x9104b1ba770a20f2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fa0 expref: 13 pid: 11289 timeout: 1166 lvb_type: 0 00000100:00100000:3.0:1763343273.429132:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399795200 00000100:00100000:3.0:1763343273.429134:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399795200 00010000:00010000:3.0:1763343273.429148:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a21d2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fed expref: 28 pid: 8412 timeout: 1166 lvb_type: 1 00000100:00100000:3.0:1763343273.429165:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3402 00000100:00100000:3.0:1763343273.429173:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2410:x1848998399794944:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343273.429185:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343273.429190:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff940202041000/0x9104b1ba770a20f2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fa0 expref: 13 pid: 11289 timeout: 1166 lvb_type: 0 00010000:00010000:3.0:1763343273.429201:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff940202041000/0x9104b1ba770a20f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fa0 expref: 13 pid: 11289 timeout: 1166 lvb_type: 0 00010000:00010000:3.0:1763343273.429222:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343273.429224:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343273.429228:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a23df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.429248:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a23df lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.429265:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343273.429306:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2410:x1848998399794944:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 133us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343273.429313:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3402 00000100:00100000:3.0:1763343273.429328:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3403 00000100:00100000:3.0:1763343273.429334:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2410:x1848998399795200:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343273.429342:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343273.429346:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a21d2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fed expref: 28 pid: 8412 timeout: 1166 lvb_type: 1 00010000:00010000:3.0:1763343273.429355:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a21d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fed expref: 28 pid: 8412 timeout: 1166 lvb_type: 1 00010000:00010000:3.0:1763343273.429369:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343273.429371:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343273.429374:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a23ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.429380:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a23ed lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.429390:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343273.429408:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2410:x1848998399795200:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 74us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343273.429413:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3403 00000100:00100000:3.0:1763343273.429448:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.429462:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399795072 00000100:00100000:3.0:1763343273.429466:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399795072 00010000:00010000:3.0:1763343273.429477:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c4514400/0x9104b1ba770a22c0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49041 expref: 28 pid: 11289 timeout: 1166 lvb_type: 0 00000100:00100000:3.0:1763343273.429494:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3404 00000100:00100000:3.0:1763343273.429499:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2410:x1848998399795072:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343273.429506:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343273.429509:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c4514400/0x9104b1ba770a22c0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49041 expref: 28 pid: 11289 timeout: 1166 lvb_type: 0 00010000:00010000:3.0:1763343273.429522:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c4514400/0x9104b1ba770a22c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49041 expref: 28 pid: 11289 timeout: 1166 lvb_type: 0 00010000:00010000:3.0:1763343273.429533:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343273.429534:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343273.429537:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a23e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.429543:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a23e6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.429554:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343273.429571:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2410:x1848998399795072:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 72us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343273.429577:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3404 00010000:00010000:1.0:1763343273.429911:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c4514400/0x9104b1ba770a22c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49041 expref: 27 pid: 11289 timeout: 1166 lvb_type: 0 00000100:00100000:1.0:1763343273.429924:0:8412:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8412:1848998412951296:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343273.429942:0:8412:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a23e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.429951:0:8412:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a23e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.429958:0:8412:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a23e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.429972:0:8412:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a23e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.429979:0:8412:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a23e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.429996:0:8412:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343273.430208:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+41:3662:x1848998412950784:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8427us (8888us total) trans 17179871870 rc 0/0 00000100:00100000:1.0:1763343273.430216:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7110 00010000:00010000:1.0:1763343273.430235:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343273.430241:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a23e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.430249:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a7200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343273.430252:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a23e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.430261:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a23e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.430274:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a23e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.430280:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a23e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.430312:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343273.430314:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343273.430316:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343273.430341:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5dc8000/2, rc 0, transno 17179871870 00000100:00100000:1.0:1763343273.430347:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412950784:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1763343273.430436:0:8626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a21d2 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fed expref: 26 pid: 8412 timeout: 1166 lvb_type: 1 00000100:00100000:2.0:1763343273.430446:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dcb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998412951424:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343273.430459:0:8626:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a23ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.430467:0:8626:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a23ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.430474:0:8626:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a23ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.430481:0:8626:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a23ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.430489:0:8626:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a23ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.430511:0:8626:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343273.430702:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+41:3662:x1848998412950016:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8737us (9330us total) trans 17179871871 rc 0/0 00000100:00100000:2.0:1763343273.430709:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7111 00000004:00080000:2.0:1763343273.430741:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c511c380/2, rc 0, transno 17179871871 00000100:00100000:2.0:1763343273.430746:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c511c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412950016:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1763343273.431072:0:35266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff940202041000/0x9104b1ba770a20f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b48fa0 expref: 12 pid: 11289 timeout: 1166 lvb_type: 0 00000100:00100000:0.0:1763343273.431087:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc73800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35266:1848998412951168:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343273.431100:0:35266:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a23df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.431108:0:35266:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a23df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.431115:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a23df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.431123:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a23df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.431131:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a23df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.431150:0:35266:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1763343273.431306:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+13:3662:x1848998412949888:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9690us (10487us total) trans 21474839141 rc 0/0 00000100:00100000:0.0:1763343273.431312:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7109 00010000:00010000:1.0:1763343273.431430:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763343273.431436:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a23ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.431443:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121fc00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343273.431446:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a23ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.431454:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a23ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.431468:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a23ed lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.431475:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a23ed lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.431491:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343273.431494:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a23df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.431505:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a6a00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343273.431509:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a23df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.431516:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a23df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.431526:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a23df lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.431533:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a23df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.431546:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343273.431548:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343273.431549:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763343273.431619:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c9831c00/2, rc 0, transno 21474839141 00000100:00100000:2.0:1763343273.431624:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412949888:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1763343273.431638:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343273.432381:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.433649:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399795328 00000100:00100000:0.0:1763343273.433660:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399795328 00000100:00100000:0.0:1763343273.433716:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3699 00000100:00100000:0.0:1763343273.433728:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:55884:x1848998399795328:12345-192.168.201.40@tcp:49:bash.0 00000100:00100000:0.0:1763343273.434019:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:55884:x1848998399795328:12345-192.168.201.40@tcp:49:bash.0 Request processed in 292us (1639us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343273.434050:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3699 00000100:00100000:3.0:1763343273.435335:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.435481:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399795456 00000100:00100000:0.0:1763343273.435490:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399795456 00000100:00100000:0.0:1763343273.435542:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7115 00000100:00100000:0.0:1763343273.435552:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2408:x1848998399795456:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343273.435567:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343273.435589:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a23f4 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b490a3 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343273.435614:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343273.435632:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343273.435635:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343273.435646:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a23f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490a3 expref: 27 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343273.435664:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a23f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490a3 expref: 27 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343273.435677:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a6800, rc 0) 00000100:00100000:0.0:1763343273.435731:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2408:x1848998399795456:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 180us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343273.435738:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7115 00000100:00100000:0.0:1763343273.436975:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.437057:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399795584 00000100:00100000:3.0:1763343273.437065:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399795584 00000100:00100000:3.0:1763343273.437114:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7116 00000100:00100000:3.0:1763343273.437123:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:55884:x1848998399795584:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343273.437136:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343273.437151:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a23fb lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b490aa expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.437175:0:35266:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a23f4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490a3 expref: 28 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343273.437184:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343273.437186:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343273.437190:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a23fb lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490aa expref: 28 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.437221:0:35266:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a23f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490a3 expref: 28 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343273.437234:0:35266:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a23f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490a3 expref: 28 pid: 35266 timeout: 1166 lvb_type: 1 00000100:00100000:3.0:1763343273.437247:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b26d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412951552:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343273.437333:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc440a80 going to sleep for 11 seconds 00000100:00100000:1.0:1763343273.443564:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.443690:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.443753:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399795968 00000100:00100000:2.0:1763343273.443764:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399795968 00000100:00100000:0.0:1763343273.443767:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399795840 00000100:00100000:0.0:1763343273.443773:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399795840 00010000:00010000:2.0:1763343273.443811:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a23f4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490a3 expref: 29 pid: 35266 timeout: 1166 lvb_type: 1 00000100:00100000:0.0:1763343273.443830:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3700 00000100:00100000:0.0:1763343273.443845:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57097:x1848998399795840:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343273.443852:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3405 00000100:00100000:2.0:1763343273.443863:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:2407:x1848998399795968:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343273.443879:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343273.443885:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a23f4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490a3 expref: 29 pid: 35266 timeout: 1166 lvb_type: 1 00010000:00010000:2.0:1763343273.443900:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a23f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490a3 expref: 29 pid: 35266 timeout: 1166 lvb_type: 1 00010000:00010000:2.0:1763343273.443934:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.443936:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.443945:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a23fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490aa expref: 29 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.443956:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a23fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490aa expref: 29 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.443998:0:14071:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a23fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490aa expref: 29 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343273.444014:0:14071:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9dc9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:14071:1848998412951680:192.168.201.40@tcp:105: 00000100:00100000:0.0:1763343273.444090:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57097:x1848998399795840:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 250us (535us total) trans 4294973470 rc 0/0 00000100:00100000:0.0:1763343273.444097:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3700 00000100:00100000:2.0:1763343273.445151:0:14071:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401ed059240 going to sleep for 11 seconds 00010000:00010000:3.0:1763343273.445629:0:35266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a23f4 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490a3 expref: 29 pid: 35266 timeout: 1166 lvb_type: 1 00000100:00100000:3.0:1763343273.445648:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b26d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412951552:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343273.445882:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a23fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490aa expref: 28 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.445896:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3200, rc 0) 00000100:00100000:3.0:1763343273.445952:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:55884:x1848998399795584:12345-192.168.201.40@tcp:101:bash.0 Request processed in 8829us (8982us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343273.445959:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7116 00000100:00100000:2.0:1763343273.446096:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.446153:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399796224 00000100:00100000:3.0:1763343273.446161:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399796224 00000100:00100000:2.0:1763343273.446309:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10493 00000100:00100000:2.0:1763343273.446319:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57097:x1848998399796224:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343273.446337:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.446358:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2402 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b490b1 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.446806:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2409 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343273.446820:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2409 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.446832:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2409 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.446846:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2410 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343273.446853:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2410 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.446860:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2410 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.447490:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2417 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343273.447501:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2417 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.447508:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2417 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:2.0:1763343273.447519:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f6:0x0]: returning size 2 00010000:00010000:2.0:1763343273.447748:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2409 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.447755:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2409 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.447761:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2409 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.447767:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.447772:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2409 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.447777:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2409 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.447788:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53a00) 00010000:00010000:2.0:1763343273.447791:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.447795:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2409 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.447800:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2409 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.447812:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2410 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.447816:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2410 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.447821:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2410 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.447826:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.447828:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2410 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.447833:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2410 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.447839:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53500) 00010000:00010000:2.0:1763343273.447840:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.447843:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2410 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.447847:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2410 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.447889:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2402 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490b1 expref: 289 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.447905:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2417 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490b1 expref: 288 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.447911:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f6:0x0].0x0 (ffff9400c52eca00) 00010000:00010000:2.0:1763343273.447913:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343273.447916:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4514200, rc 0) 00000100:00100000:2.0:1763343273.447966:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57097:x1848998399796224:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1649us (1872us total) trans 4294973471 rc 0/0 00000100:00100000:2.0:1763343273.447975:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10493 00000100:00100000:2.0:1763343273.452197:0:14071:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9dc9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:14071:1848998412951680:192.168.201.40@tcp:105: 00010000:00010000:2.0:1763343273.452311:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343273.452486:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.453187:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2407:x1848998399795968:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 9322us (9492us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.453213:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3405 00000100:00100000:0.0:1763343273.453326:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399796352 00000100:00100000:0.0:1763343273.453334:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399796352 00000100:00100000:0.0:1763343273.453384:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7117 00000100:00100000:0.0:1763343273.453398:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401ede6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:55884:x1848998399796352:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343273.453417:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343273.453439:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff940202041000/0x9104b1ba770a2425 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b490b8 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343273.453461:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343273.453485:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343273.453488:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343273.453497:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff940202041000/0x9104b1ba770a2425 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490b8 expref: 13 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.453520:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff940202041000/0x9104b1ba770a2425 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490b8 expref: 13 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.453534:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940202041000, rc 0) 00000100:00100000:0.0:1763343273.453578:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401ede6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:55884:x1848998399796352:12345-192.168.201.40@tcp:101:bash.0 Request processed in 186us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343273.453585:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7117 00000100:00100000:3.0:1763343273.456849:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.458022:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399796608 00000100:00100000:1.0:1763343273.458082:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399796608 00000100:00100000:1.0:1763343273.458153:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3701 00000100:00100000:1.0:1763343273.458164:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8445c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57097:x1848998399796608:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343273.458445:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8445c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57097:x1848998399796608:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 280us (1605us total) trans 4294973472 rc 0/0 00000100:00100000:1.0:1763343273.458453:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3701 00000100:00100000:1.0:1763343273.465664:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.465923:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.466162:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.466418:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399796736 00000100:00100000:3.0:1763343273.466429:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399796736 00002000:00010000:3.0:1763343273.466506:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/683 (0->18446744073709551615) 00002000:00100000:3.0:1763343273.466513:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5dcad80 with x1848998399796736 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343273.466527:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5dcad80. 00000100:00100000:3.0:1763343273.466550:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399796864 00000100:00100000:3.0:1763343273.466554:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399796864 00002000:00010000:3.0:1763343273.466567:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/682 (0->18446744073709551615) 00002000:00100000:3.0:1763343273.466570:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5dc9880 with x1848998399796864 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343273.466576:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5dc9880. 00000100:00100000:3.0:1763343273.466595:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1701 00000100:00100000:3.0:1763343273.466604:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2407:x1848998399796736:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:3.0:1763343273.466785:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2ab:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343273.466789:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2ab:0x0] updating lvb mtime from disk: 0 -> 1763343272 00002000:00010000:3.0:1763343273.466791:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2ab:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343273.466793:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2ab:0x0] updating lvb ctime from disk: 0 -> 1763343272 00002000:00010000:3.0:1763343273.466795:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2ab:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343273.466854:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2407:x1848998399796736:12345-192.168.201.40@tcp:10:bash.0 Request processed in 250us (1199us total) trans 17179871872 rc 0/0 00000100:00100000:3.0:1763343273.466861:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1701 00002000:00010000:3.0:1763343273.466865:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/683 (0->18446744073709551615) 00002000:00100000:3.0:1763343273.466867:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5dcad80 with x1848998399796736 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343273.466872:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5dcad80. 00000100:00100000:3.0:1763343273.466889:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1702 00000100:00100000:3.0:1763343273.466897:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2407:x1848998399796864:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:3.0:1763343273.466980:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2aa:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343273.466983:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2aa:0x0] updating lvb mtime from disk: 0 -> 1763343272 00002000:00010000:3.0:1763343273.466985:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2aa:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343273.466987:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2aa:0x0] updating lvb ctime from disk: 0 -> 1763343272 00002000:00010000:3.0:1763343273.466989:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2aa:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343273.467009:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399796864:12345-192.168.201.40@tcp:10:bash.0 Request processed in 113us (1087us total) trans 21474839142 rc 0/0 00000100:00100000:3.0:1763343273.467015:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1702 00002000:00010000:3.0:1763343273.467017:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/682 (0->18446744073709551615) 00002000:00100000:3.0:1763343273.467019:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5dc9880 with x1848998399796864 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343273.467046:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5dc9880. 00000100:00100000:2.0:1763343273.467760:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399796992 00000100:00100000:2.0:1763343273.467769:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399796992 00000100:00100000:2.0:1763343273.467810:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3702 00000100:00100000:2.0:1763343273.467817:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57097:x1848998399796992:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:2.0:1763343273.467919:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57097:x1848998399796992:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 103us (1756us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.467925:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3702 00000100:00100000:2.0:1763343273.475708:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.476209:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399797248 00000100:00100000:0.0:1763343273.476220:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399797248 00000100:00100000:0.0:1763343273.476303:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10494 00000100:00100000:0.0:1763343273.476313:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57097:x1848998399797248:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343273.476334:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343273.476356:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a242c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b490bf expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.476471:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a2433 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343273.476488:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a2433 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.476499:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a2433 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:0.0:1763343273.476511:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f6:0x0]: returning size 2 00010000:00010000:0.0:1763343273.476614:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a242c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490bf expref: 292 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.476993:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a2433 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1f6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490bf expref: 291 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.477003:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f6:0x0].0x0 (ffff9400c52eca00) 00010000:00010000:0.0:1763343273.477006:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343273.477010:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940202040400, rc 0) 00000100:00100000:0.0:1763343273.477125:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57097:x1848998399797248:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 812us (1425us total) trans 4294973473 rc 0/0 00000100:00100000:0.0:1763343273.477135:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10494 00000100:00100000:2.0:1763343273.480667:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.481000:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399797504 00000100:00100000:1.0:1763343273.481012:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399797504 00000100:00100000:1.0:1763343273.481100:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3703 00000100:00100000:1.0:1763343273.481113:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57097:x1848998399797504:12345-192.168.201.40@tcp:35:lfs.0 00000004:00010000:1.0:1763343273.481198:0:6527:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x1f6:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a2433 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1f6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490bf expref: 291 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.481243:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2441 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343273.481258:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a238b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49072 expref: 291 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.481266:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2417 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490b1 expref: 291 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.481272:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a23ca lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49095 expref: 291 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.481279:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a23d1 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4909c expref: 291 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.481297:0:6527:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2441 lrc: 7/0,1 mode: --/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343273.481332:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a23d1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4909c expref: 291 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.481353:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a23d1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4909c expref: 291 pid: 9827 timeout: 1166 lvb_type: 0 00000100:00100000:1.0:1763343273.481367:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dcb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6527:1848998412951808:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343273.481467:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a23ca lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49095 expref: 291 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.481475:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a23ca lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49095 expref: 291 pid: 6524 timeout: 1166 lvb_type: 0 00000100:00100000:1.0:1763343273.481484:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6527:1848998412951936:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343273.481523:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2417 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490b1 expref: 291 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.481531:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2417 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490b1 expref: 291 pid: 33856 timeout: 1166 lvb_type: 0 00000100:00100000:1.0:1763343273.481540:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dc9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6527:1848998412952064:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343273.481574:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a238b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49072 expref: 291 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.481584:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a238b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49072 expref: 291 pid: 7641 timeout: 1166 lvb_type: 0 00000100:00100000:1.0:1763343273.481593:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dcaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6527:1848998412952192:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343273.481618:0:6527:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd0780 going to sleep for 11 seconds 00000100:00100000:1.0:1763343273.485518:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:2.0:1763343273.485685:0:6527:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.40@tcp) returned -22 from blocking AST (req@000000001702d539 x1848998412951808) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a23d1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4909c expref: 291 pid: 9827 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.485716:0:6527:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a23d1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4909c expref: 291 pid: 9827 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.485740:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a23d1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4909c expref: 291 pid: 9827 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.485755:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dcb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6527:1848998412951808:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343273.485769:0:6527:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.40@tcp) returned -22 from blocking AST (req@00000000d654d7a4 x1848998412951936) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a23ca lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49095 expref: 290 pid: 6524 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.485789:0:6527:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a23ca lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49095 expref: 290 pid: 6524 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.485801:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a23ca lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49095 expref: 290 pid: 6524 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.485811:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6527:1848998412951936:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343273.485823:0:6527:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.40@tcp) returned -22 from blocking AST (req@00000000d320d100 x1848998412952064) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2417 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490b1 expref: 289 pid: 33856 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.485834:0:6527:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2417 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490b1 expref: 289 pid: 33856 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.485846:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2417 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490b1 expref: 289 pid: 33856 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.485860:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dc9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6527:1848998412952064:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343273.485871:0:6527:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.40@tcp) returned -22 from blocking AST (req@0000000046d393c5 x1848998412952192) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a238b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49072 expref: 288 pid: 7641 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.485881:0:6527:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a238b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49072 expref: 288 pid: 7641 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.485890:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a238b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49072 expref: 288 pid: 7641 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.485901:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dcaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6527:1848998412952192:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343273.485927:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f6:0x0].0x0 (ffff9400c52eca00) 00010000:00010000:2.0:1763343273.485933:0:6527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2441 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343273.485943:0:6527:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2441 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343273.485949:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2441 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343273.485969:0:6527:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2441 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343273.485978:0:6527:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2441 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343273.485984:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2441 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00000004:00020000:2.0:1763343273.486232:0:6527:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0001-mdtlov: can not set all stale mirrors for [0x240000404:0x1f6:0x0]: rc = -1 00010000:00010000:2.0:1763343273.486260:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2441 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343273.486267:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2441 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343273.486273:0:6527:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2441 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343273.486279:0:6527:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121e800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.486283:0:6527:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2441 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343273.486300:0:6527:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2441 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343273.486309:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f6:0x0].0x0 (ffff9400c52eca00) 00010000:00010000:2.0:1763343273.486312:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1763343273.486316:0:6527:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2441 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343273.486321:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2441 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343273.486331:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f6:0x0].0x0 (ffff9400c52eca00) 00010000:00010000:2.0:1763343273.486333:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343273.486338:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a2433 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1f6:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490bf expref: 287 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343273.486601:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399797760 00000100:00100000:0.0:1763343273.486609:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399797760 00000100:00100000:0.0:1763343273.486653:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10495 00000100:00100000:0.0:1763343273.486663:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57102:x1848998399797760:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:0.0:1763343273.486801:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1763343273.486805:0:33856:0:(ldlm_lockd.c:1753:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9104b1ba770a23ca) 00010000:00010000:0.0:1763343273.486806:0:33856:0:(ldlm_lockd.c:1753:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9104b1ba770a23d1) 00010000:00010000:0.0:1763343273.486808:0:33856:0:(ldlm_lockd.c:1753:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9104b1ba770a2417) 00010000:00010000:0.0:1763343273.486809:0:33856:0:(ldlm_lockd.c:1753:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9104b1ba770a238b) 00010000:00010000:0.0:1763343273.486811:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343273.486835:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a2448 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343273.486844:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a2448 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.486852:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a2448 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.486865:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a244f lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343273.486871:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a244f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.486876:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a244f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.487132:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a2456 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343273.487140:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a2456 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.487145:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a2456 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00080000:0.0:1763343273.487341:0:33856:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x1f6:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1763343273.487394:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a2456 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.487401:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a2456 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.487406:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a2456 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.487411:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401f1bf1c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.487414:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a2456 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.487420:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a2456 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.487430:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f6:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:0.0:1763343273.487432:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763343273.487435:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a2456 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.487440:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a2456 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.487454:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a2448 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.487459:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a2448 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.487463:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a2448 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.487468:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff940202040c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.487470:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a2448 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.487475:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a2448 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.487480:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f66a1a00) 00010000:00010000:0.0:1763343273.487482:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.487484:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a2448 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.487488:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a2448 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:0.0:1763343273.487496:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d41ff948 reply state 00000000daf4696b transno 4294973475 ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a244f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.487506:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a244f lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.487511:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1100) 00010000:00010000:0.0:1763343273.487513:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343273.487515:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343273.487596:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57097:x1848998399797504:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 6484us (6937us total) trans 4294973474 rc -1/-1 00000100:00100000:2.0:1763343273.487606:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3703 00000100:00100000:0.0:1763343273.488364:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57102:x1848998399797760:12345-192.168.201.40@tcp:36:rm.0 Request processed in 1698us (2849us total) trans 4294973475 rc 0/0 00000100:00100000:0.0:1763343273.488372:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10495 00000100:00100000:1.0:1763343273.491202:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.491315:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399797888 00000100:00100000:0.0:1763343273.491329:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399797888 00000100:00100000:0.0:1763343273.491392:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10496 00000100:00100000:0.0:1763343273.491403:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57097:x1848998399797888:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343273.491429:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343273.491454:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a245d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b490c6 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.491515:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a245d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490c6 expref: 290 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.491532:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1e00/0x9104b1ba770a245d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490c6 expref: 290 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.491550:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f6:0x0].0x0 (ffff9401f66a1400) 00010000:00010000:0.0:1763343273.491554:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343273.491557:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401f1bf1e00, rc 0) 00000100:00100000:0.0:1763343273.491908:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57097:x1848998399797888:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 219us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343273.491920:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10496 00000100:00100000:2.0:1763343273.500676:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.501152:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399798144 00000100:00100000:1.0:1763343273.501175:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399798144 00000100:00100000:1.0:1763343273.501244:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3704 00000100:00100000:1.0:1763343273.501256:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57097:x1848998399798144:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:1.0:1763343273.501509:0:6527:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1f6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1763343273.501574:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1686, 64 off140528 00000040:00080000:1.0:1763343273.501600:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1678, 64 off139872 00000040:00080000:1.0:1763343273.501612:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1679, 64 off139936 00000040:00080000:1.0:1763343273.501628:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1687, 64 off140592 00010000:00010000:1.0:1763343273.501691:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2464 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343273.501720:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2464 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343273.501731:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2464 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343273.501739:0:6527:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2464 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343273.501746:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2464 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343273.501751:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2464 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343273.501772:0:6527:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343273.501975:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57097:x1848998399798144:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 720us (1307us total) trans 4294973476 rc 0/0 00000100:00100000:1.0:1763343273.501984:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3704 00010000:00010000:0.0:1763343273.502490:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343273.502497:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2464 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343273.502506:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121e800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343273.502510:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2464 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343273.502517:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2464 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343273.502531:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f6:0x0].0x0 (ffff9401f66a1400) 00010000:00010000:0.0:1763343273.502534:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343273.502539:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2464 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343273.502544:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2464 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343273.502555:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343273.502557:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343273.502559:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343273.505268:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.506232:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399798272 00000100:00100000:0.0:1763343273.506244:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399798272 00000100:00100000:0.0:1763343273.506319:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10497 00000100:00100000:0.0:1763343273.506329:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57103:x1848998399798272:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343273.506352:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343273.506377:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a246b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b490cd expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.506452:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2472 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343273.506465:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2472 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.506477:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2472 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.506488:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a2479 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343273.506496:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a2479 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.506502:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a2479 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.506541:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2472 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.506547:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2472 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.506553:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2472 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.506559:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401f1bf0200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.506563:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2472 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.506569:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2472 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.506585:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f66a1a00) 00010000:00010000:0.0:1763343273.506588:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.506593:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2472 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.506598:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a2472 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.506611:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a2479 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.506616:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a2479 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.506621:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a2479 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.506625:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5b3d000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.506628:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a2479 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.506634:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a2479 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.506640:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1100) 00010000:00010000:0.0:1763343273.506643:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.506646:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a2479 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.506652:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a2479 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.506680:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a246b lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490cd expref: 292 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.506691:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f66a1a00) 00010000:00010000:0.0:1763343273.506693:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.506697:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a246b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490cd expref: 292 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.506709:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401f1bf1c00, rc 0) 00000100:00100000:0.0:1763343273.506764:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57103:x1848998399798272:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 436us (1505us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343273.506771:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10497 00000100:00100000:3.0:1763343273.509502:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.509587:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399798400 00000100:00100000:2.0:1763343273.509598:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399798400 00000100:00100000:2.0:1763343273.509654:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10498 00000100:00100000:2.0:1763343273.509663:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57103:x1848998399798400:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343273.509684:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.509706:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2480 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b490d4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.509769:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2487 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343273.509789:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2487 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.509799:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2487 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.509809:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a248e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343273.509817:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a248e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.509822:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a248e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.509860:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2487 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.509867:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2487 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.509873:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2487 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.509879:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2487 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.509884:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.509888:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2487 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.509895:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2487 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.509906:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53a00) 00010000:00010000:2.0:1763343273.509909:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.509913:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2487 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.509919:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2487 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.509930:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a248e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.509936:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a248e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.509941:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a248e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.509945:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4515600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.509948:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a248e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.509957:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a248e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.509963:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1100) 00010000:00010000:2.0:1763343273.509965:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.509968:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a248e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.509973:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a248e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.510006:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2480 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490d4 expref: 292 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.510016:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53a00) 00010000:00010000:2.0:1763343273.510019:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.510061:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2480 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490d4 expref: 292 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.510077:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4514400, rc 0) 00000100:00100000:2.0:1763343273.510126:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57103:x1848998399798400:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 464us (634us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343273.510133:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10498 00000100:00100000:2.0:1763343273.512604:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.513013:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399798528 00000100:00100000:0.0:1763343273.513129:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399798528 00000100:00100000:0.0:1763343273.513255:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10499 00000100:00100000:0.0:1763343273.513265:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57103:x1848998399798528:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343273.513361:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343273.513386:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a2495 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b490db expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.513445:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a249c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343273.513459:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a249c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.513470:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a249c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:0.0:1763343273.513512:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343273.513517:0:33856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343273.513550:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a2495 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490db expref: 293 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.513568:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a249c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490db expref: 292 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.513576:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:0.0:1763343273.513580:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343273.513583:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5b3d200, rc 0) 00000100:00100000:0.0:1763343273.513647:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57103:x1848998399798528:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 383us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343273.513654:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10499 00000100:00100000:1.0:1763343273.525526:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.525698:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399798784 00000100:00100000:2.0:1763343273.525711:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399798784 00000100:00100000:2.0:1763343273.525767:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10500 00000100:00100000:2.0:1763343273.525777:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57104:x1848998399798784:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343273.525804:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.525828:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a24a3 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b490e2 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.525914:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a24aa lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343273.525930:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a24aa lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.525942:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a24aa lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.525952:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a24b1 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343273.525959:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a24b1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.525965:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a24b1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.526003:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a24aa lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.526009:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a24aa lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.526016:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a24aa lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.526066:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4515600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.526071:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a24aa lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.526082:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a24aa lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.526095:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:2.0:1763343273.526098:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.526103:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a24aa lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.526110:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a24aa lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.526122:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a24b1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.526128:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a24b1 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.526134:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a24b1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.526139:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.526141:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a24b1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.526146:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a24b1 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.526153:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1100) 00010000:00010000:2.0:1763343273.526154:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.526157:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a24b1 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.526162:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a24b1 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.526190:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a24a3 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490e2 expref: 293 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.526199:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:2.0:1763343273.526202:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343273.526206:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a24a3 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490e2 expref: 293 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.526214:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4514400, rc 0) 00000100:00100000:2.0:1763343273.526282:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57104:x1848998399798784:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 506us (766us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343273.526299:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10500 00000100:00100000:3.0:1763343273.529646:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.529734:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399798912 00000100:00100000:2.0:1763343273.529746:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399798912 00000100:00100000:2.0:1763343273.529809:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10501 00000100:00100000:2.0:1763343273.529820:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57103:x1848998399798912:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343273.529843:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.529871:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a24b8 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b490e9 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.529944:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a24bf lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343273.529960:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a24bf lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.529974:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a24bf lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.529991:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a24c6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343273.529999:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a24c6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.530005:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a24c6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.530254:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a24bf lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.530262:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a24bf lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.530268:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a24bf lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.530274:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff940202040400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.530278:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a24bf lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.530295:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a24bf lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.530308:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:2.0:1763343273.530311:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.530316:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a24bf lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.530321:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a24bf lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.530335:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a24c6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.530341:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a24c6 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.530346:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a24c6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.530351:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ec00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.530354:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a24c6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.530358:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a24c6 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.530365:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1100) 00010000:00010000:2.0:1763343273.530368:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.530370:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a24c6 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.530375:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a24c6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.530402:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a24b8 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490e9 expref: 293 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.530411:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:2.0:1763343273.530413:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.530416:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a24b8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490e9 expref: 293 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.530424:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940202040c00, rc 0) 00000100:00100000:2.0:1763343273.532340:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57103:x1848998399798912:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2510us (2694us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343273.532353:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10501 00000100:00100000:0.0:1763343273.541121:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.541233:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399799168 00000100:00100000:2.0:1763343273.541243:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399799168 00000100:00100000:2.0:1763343273.541304:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10502 00000100:00100000:2.0:1763343273.541313:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57103:x1848998399799168:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343273.541334:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.541337:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343273.541364:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a249c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490db expref: 292 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.541383:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:2.0:1763343273.541393:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343273.541408:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a24cd lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b490f0 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.541508:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a24d4 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343273.541521:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a24d4 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.541531:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a24d4 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.541542:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a24db lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343273.541549:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a24db lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.541555:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a24db lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.541950:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a24e2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343273.541959:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a24e2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.541965:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a24e2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:2.0:1763343273.541975:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f8:0x0]: returning size 0 00010000:00010000:2.0:1763343273.542002:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a24d4 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.542010:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a24d4 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.542016:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a24d4 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.542226:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.542232:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a24d4 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.542245:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a24d4 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.542255:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53a00) 00010000:00010000:2.0:1763343273.542258:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.542261:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a24d4 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.542267:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a24d4 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:2.0:1763343273.542282:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000de6a2725 reply state 000000000c1fe45d transno 4294973477 ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a24db lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.542303:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a24db lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.542309:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1100) 00010000:00010000:2.0:1763343273.542311:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343273.542314:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343273.542341:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a24cd lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490f0 expref: 294 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.542359:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a24e2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490f0 expref: 293 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.542366:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401edc53500) 00010000:00010000:2.0:1763343273.542369:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343273.542371:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940202040400, rc 0) 00000100:00100000:2.0:1763343273.542517:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57103:x1848998399799168:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1202us (1405us total) trans 4294973477 rc 0/0 00000100:00100000:2.0:1763343273.542527:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10502 00000100:00100000:1.0:1763343273.547745:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.547931:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399799424 00000100:00100000:2.0:1763343273.547944:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399799424 00000100:00100000:2.0:1763343273.548002:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10503 00000100:00100000:2.0:1763343273.548012:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57103:x1848998399799424:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343273.548066:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.548093:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a24f0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b490f7 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.548219:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a24f7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343273.548234:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a24e2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490f0 expref: 295 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.548244:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a24f7 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.548298:0:33856:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a24e2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490f0 expref: 295 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.548314:0:33856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a24e2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490f0 expref: 295 pid: 33856 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.548329:0:33856:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9832a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412952320:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343273.548425:0:33856:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401ed059180 going to sleep for 11 seconds 00000100:00100000:3.0:1763343273.558222:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.558270:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.558505:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399799808 00000100:00100000:0.0:1763343273.558516:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399799808 00000100:00100000:0.0:1763343273.558578:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10504 00000100:00100000:0.0:1763343273.558589:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57105:x1848998399799808:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343273.558617:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343273.558649:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a24fe lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b490fe expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.558782:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a2505 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343273.558800:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a2505 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.558815:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a2505 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.558828:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a250c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343273.558835:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a250c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.558839:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a250c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.558968:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a2513 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343273.558978:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a2513 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.558985:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a2513 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:0.0:1763343273.558996:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f8:0x0]: returning size 0 00010000:00010000:0.0:1763343273.559122:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a2513 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.559130:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a2513 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.559137:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a2513 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.559142:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5b3c400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.559147:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a2513 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.559154:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a2513 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.559167:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401edc53500) 00010000:00010000:0.0:1763343273.559170:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763343273.559175:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a2513 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.559181:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a2513 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.559197:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a2505 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.559203:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a2505 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.559208:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a2505 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.559214:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a2505 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.559218:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5b3d000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.559221:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a2505 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.559226:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a2505 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.559232:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f66a1a00) 00010000:00010000:0.0:1763343273.559235:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.559238:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a2505 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.559243:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a2505 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.559252:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a250c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.559258:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a250c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.559263:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a250c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.559268:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5b3d200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.559271:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a250c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.559277:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a250c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.559283:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1100) 00010000:00010000:0.0:1763343273.559300:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.559304:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a250c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.559309:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a250c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.559344:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a24fe lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490fe expref: 298 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.559355:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f66a1a00) 00010000:00010000:0.0:1763343273.559357:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343273.559360:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a24fe lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490fe expref: 298 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.559378:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5b3de00, rc 0) 00000100:00100000:0.0:1763343273.559441:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57105:x1848998399799808:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 853us (1236us total) trans 4294973478 rc 301/301 00000100:00100000:0.0:1763343273.559448:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10504 00000100:00100000:2.0:1763343273.559949:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399799552 00000100:00100000:2.0:1763343273.559956:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399799552 00010000:00010000:2.0:1763343273.559986:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a24e2 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490f0 expref: 297 pid: 33856 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.560021:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3406 00000100:00100000:2.0:1763343273.560048:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:2407:x1848998399799552:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343273.560061:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343273.560067:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a24e2 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490f0 expref: 297 pid: 33856 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.560085:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a24e2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490f0 expref: 297 pid: 33856 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.560100:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401edc53500) 00010000:00010000:2.0:1763343273.560105:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a24f7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.560114:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a24f7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.560120:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a24f7 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.560136:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343273.560161:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:2407:x1848998399799552:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 114us (1889us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.560168:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3406 00010000:00010000:2.0:1763343273.560215:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a24e2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490f0 expref: 296 pid: 33856 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.560228:0:33856:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9832a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412952320:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343273.560247:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a24f7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.560255:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a24f7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.560260:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a24f7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:2.0:1763343273.560280:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f8:0x0]: returning size 0 00000004:00080000:2.0:1763343273.560786:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2ac:0x0], index 0: 0 00000004:00080000:2.0:1763343273.560794:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2ad:0x0], index 1: 0 00000004:00080000:2.0:1763343273.560800:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2ae:0x0], index 1: 0 00000004:00080000:2.0:1763343273.560804:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2ad:0x0], index 0: 0 00010000:00010000:2.0:1763343273.560901:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a24f7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.560908:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a24f7 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.560914:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a24f7 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.560919:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.560923:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a24f7 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.560929:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a24f7 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.560939:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401edc53500) 00010000:00010000:2.0:1763343273.560942:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343273.560946:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a24f7 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.560951:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a24f7 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.560993:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a24f0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490f7 expref: 296 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.561007:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401edc53500) 00010000:00010000:2.0:1763343273.561010:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343273.561013:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a24f0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490f7 expref: 296 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.561833:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4514400, rc 0) 00000100:00100000:2.0:1763343273.561897:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57103:x1848998399799424:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 13884us (14160us total) trans 4294973479 rc 301/301 00000100:00100000:2.0:1763343273.561904:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10503 00000100:00100000:0.0:1763343273.565235:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.565277:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.565350:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399800064 00000100:00100000:3.0:1763343273.565361:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399800320 00000100:00100000:2.0:1763343273.565362:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399800064 00000100:00100000:3.0:1763343273.565370:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399800320 00000100:00100000:3.0:1763343273.565435:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3705 00000100:00100000:3.0:1763343273.565447:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8441050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57103:x1848998399800320:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343273.565527:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3706 00000100:00100000:2.0:1763343273.565536:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57105:x1848998399800064:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343273.565758:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57105:x1848998399800064:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 221us (536us total) trans 4294973481 rc 0/0 00000100:00100000:3.0:1763343273.565769:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8441050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57103:x1848998399800320:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 323us (490us total) trans 4294973480 rc 0/0 00000100:00100000:2.0:1763343273.565784:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3706 00000100:00100000:3.0:1763343273.565792:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3705 00000100:00100000:0.0:1763343273.566988:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.567503:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399800576 00000100:00100000:3.0:1763343273.567512:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399800576 00000100:00100000:1.0:1763343273.567950:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.568056:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399800832 00000100:00100000:0.0:1763343273.568061:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399800832 00000100:00100000:0.0:1763343273.568096:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10505 00000100:00100000:0.0:1763343273.568104:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57105:x1848998399800832:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343273.568127:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343273.568153:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a2528 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49105 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.568223:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a252f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343273.568235:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a252f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.568246:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a252f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.568257:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a2536 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343273.568264:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a2536 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.568300:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a2536 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.568403:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a253d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343273.568411:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a253d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.568416:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a253d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:0.0:1763343273.568427:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f8:0x0]: returning size 0 00010000:00010000:0.0:1763343273.568496:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a252f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.568504:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a252f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.568510:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a252f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.568517:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a252f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.568523:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401f1bf0200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.568527:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a252f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.568533:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a252f lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.568545:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f66a1f00) 00010000:00010000:0.0:1763343273.568547:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.568552:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a252f lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.568558:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a252f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.568572:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a2536 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.568578:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a2536 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.568583:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a2536 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.568587:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c1661000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.568589:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a2536 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.568594:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a2536 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.568600:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1100) 00010000:00010000:0.0:1763343273.568602:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.568605:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a2536 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.568611:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a2536 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.568644:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a2528 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49105 expref: 301 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.568660:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a253d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49105 expref: 300 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.568666:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:0.0:1763343273.568670:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343273.568672:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c1661c00, rc 0) 00000100:00100000:0.0:1763343273.568725:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57105:x1848998399800832:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 622us (777us total) trans 4294973482 rc 0/0 00000100:00100000:0.0:1763343273.568733:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10505 00000100:00100000:3.0:1763343273.568961:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3707 00000100:00100000:3.0:1763343273.568973:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57103:x1848998399800576:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343273.569094:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57103:x1848998399800576:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 121us (2110us total) trans 4294973483 rc 0/0 00000100:00100000:3.0:1763343273.569101:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3707 00000100:00100000:1.0:1763343273.573587:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.574271:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.574366:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399801216 00000100:00100000:3.0:1763343273.574377:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399801216 00000100:00100000:3.0:1763343273.574434:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7118 00000100:00100000:3.0:1763343273.574445:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399801216:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:2.0:1763343273.574719:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399801088 00000100:00100000:2.0:1763343273.574723:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399801088 00000100:00100000:2.0:1763343273.574758:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10506 00000100:00100000:2.0:1763343273.574765:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:55884:x1848998399801088:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343273.574787:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.574807:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a254b lrc: 2/0,0 mode: --/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4910c expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.574924:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2552 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343273.574939:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a253d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49105 expref: 301 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.574949:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2552 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.574991:0:33856:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a253d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49105 expref: 301 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.575003:0:33856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a253d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49105 expref: 301 pid: 9827 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.575016:0:33856:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9832a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412952448:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343273.575105:0:33856:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401ed059180 going to sleep for 11 seconds 00010000:00010000:3.0:1763343273.575154:0:8626:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343273.575169:0:8626:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2559 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49113 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343273.575187:0:8626:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343273.575201:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343273.575203:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343273.575211:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2559 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49113 expref: 15 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343273.575225:0:8626:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2559 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49113 expref: 15 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343273.575237:0:8626:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3a00, rc 0) 00000100:00100000:3.0:1763343273.575263:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998399801216:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 821us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343273.575271:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7118 00000100:00100000:0.0:1763343273.581903:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.581943:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.582009:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399801600 00000100:00100000:1.0:1763343273.582018:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399801600 00010000:00010000:1.0:1763343273.582077:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a253d lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49105 expref: 302 pid: 9827 timeout: 1166 lvb_type: 0 00000100:00100000:1.0:1763343273.582126:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3407 00000100:00100000:1.0:1763343273.582136:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:2408:x1848998399801600:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343273.582152:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343273.582158:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a253d lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49105 expref: 302 pid: 9827 timeout: 1166 lvb_type: 0 00010000:00010000:1.0:1763343273.582170:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a253d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49105 expref: 302 pid: 9827 timeout: 1166 lvb_type: 0 00010000:00010000:1.0:1763343273.582192:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:1.0:1763343273.582198:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2552 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.582208:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2552 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.582214:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2552 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.582234:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343273.582299:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:2408:x1848998399801600:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 154us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343273.582307:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3407 00010000:00010000:2.0:1763343273.582492:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a253d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49105 expref: 301 pid: 9827 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.582511:0:33856:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9832a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412952448:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343273.582533:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2552 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:3.0:1763343273.582538:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399801472 00010000:00010000:2.0:1763343273.582542:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2552 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:3.0:1763343273.582545:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399801472 00010000:00010000:2.0:1763343273.582550:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2552 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:2.0:1763343273.582574:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f8:0x0]: returning size 0 00010000:00010000:2.0:1763343273.582704:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a254b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4910c expref: 303 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.582720:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2552 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4910c expref: 302 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.582727:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:2.0:1763343273.582730:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1763343273.582732:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4514200, rc 0) 00000100:00100000:2.0:1763343273.582771:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:55884:x1848998399801088:12345-192.168.201.40@tcp:101:bash.0 Request processed in 8006us (9753us total) trans 4294973484 rc 0/0 00000100:00100000:2.0:1763343273.582778:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10506 00000100:00100000:3.0:1763343273.582965:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3708 00000100:00100000:3.0:1763343273.582975:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57105:x1848998399801472:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343273.583141:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57105:x1848998399801472:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 168us (1250us total) trans 4294973485 rc 0/0 00000100:00100000:3.0:1763343273.583148:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3708 00000100:00100000:1.0:1763343273.586492:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.586723:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399801728 00000100:00100000:2.0:1763343273.586735:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399801728 00000100:00100000:2.0:1763343273.586791:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10507 00000100:00100000:2.0:1763343273.586800:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:55884:x1848998399801728:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343273.586826:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.586851:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a2567 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4911a expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.586898:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a256e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343273.586911:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a256e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.586922:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a256e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.587065:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a2567 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4911a expref: 304 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.587087:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a256e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4911a expref: 303 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.587096:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:2.0:1763343273.587098:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343273.587102:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940202040400, rc 0) 00000100:00100000:2.0:1763343273.587163:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:55884:x1848998399801728:12345-192.168.201.40@tcp:101:bash.0 Request processed in 364us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.587170:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10507 00000100:00100000:1.0:1763343273.590644:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.591247:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399801984 00000100:00100000:0.0:1763343273.591257:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399801984 00000100:00100000:3.0:1763343273.591321:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.591324:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10508 00000100:00100000:0.0:1763343273.591333:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57105:x1848998399801984:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343273.591357:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1763343273.591403:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399802240 00000100:00100000:2.0:1763343273.591419:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399802240 00000100:00100000:2.0:1763343273.591820:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10509 00010000:00010000:0.0:1763343273.591820:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a2575 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49121 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343273.591831:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:55884:x1848998399802240:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:0.0:1763343273.591892:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a257c lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343273.591907:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a257c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.591918:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a257c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.591929:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2583 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343273.591941:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2583 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.591948:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2583 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.592082:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a258a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343273.592091:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a258a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.592098:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a258a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:0.0:1763343273.592108:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f8:0x0]: returning size 0 00010000:00010000:0.0:1763343273.592185:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a257c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.592191:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a257c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.592197:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a257c lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.592202:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a257c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.592208:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508b200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.592212:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a257c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.592219:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a257c lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.592233:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f66a1f00) 00010000:00010000:0.0:1763343273.592236:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.592240:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a257c lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.592244:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2598 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343273.592247:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a257c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.592253:0:6524:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a258a lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.592258:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2583 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.592260:0:6524:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2598 lrc: 4/0,1 mode: --/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.592263:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2583 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.592268:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2583 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.592272:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508be00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.592274:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2583 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.592275:0:6524:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a258a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.592280:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2583 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.592284:0:6524:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2598 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.592300:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1100) 00010000:00010000:0.0:1763343273.592302:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.592304:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2583 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.592310:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2583 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.592350:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a2575 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49121 expref: 308 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.592510:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a258a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49121 expref: 307 pid: 9827 timeout: 1166 lvb_type: 0 00010000:00010000:0.0:1763343273.592522:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a258a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49121 expref: 307 pid: 9827 timeout: 1166 lvb_type: 0 00010000:00010000:0.0:1763343273.592529:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c508a400, rc 0) 00000100:00100000:0.0:1763343273.592597:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57105:x1848998399801984:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1264us (1962us total) trans 4294973486 rc 0/0 00000100:00100000:0.0:1763343273.592605:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10508 00000100:00100000:1.0:1763343273.596308:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.596404:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399802496 00000100:00100000:2.0:1763343273.596543:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399802496 00000100:00100000:2.0:1763343273.596597:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3709 00000100:00100000:2.0:1763343273.596607:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57105:x1848998399802496:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343273.596801:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57105:x1848998399802496:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 194us (514us total) trans 4294973488 rc 0/0 00000100:00100000:2.0:1763343273.596809:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3709 00000100:00100000:3.0:1763343273.599804:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.600527:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399802752 00000100:00100000:2.0:1763343273.600538:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399802752 00000100:00100000:2.0:1763343273.600602:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3710 00000100:00100000:2.0:1763343273.600613:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57105:x1848998399802752:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:2.0:1763343273.600770:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57105:x1848998399802752:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 159us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.600778:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3710 00000100:00100000:0.0:1763343273.602406:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.603689:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399802624 00000100:00100000:2.0:1763343273.603700:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399802624 00010000:00010000:2.0:1763343273.603744:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a258a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49121 expref: 308 pid: 9827 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.603792:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3408 00000100:00100000:2.0:1763343273.603801:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8391850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:2407:x1848998399802624:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343273.603817:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343273.603824:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a258a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49121 expref: 308 pid: 9827 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.603837:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a258a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49121 expref: 308 pid: 9827 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.603865:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a258a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49121 expref: 308 pid: 9827 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.603895:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:2.0:1763343273.603901:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2598 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.603911:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2598 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.603918:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2598 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.603953:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343273.603981:0:6524:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2598 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.603991:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2598 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000100:00100000:2.0:1763343273.604016:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8391850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:2407:x1848998399802624:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 215us (1616us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.604054:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3408 00000001:00080000:0.0:1763343273.604342:0:6524:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973487 00000004:00010000:0.0:1763343273.604390:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000964e428c reply state 00000000b2c37df7 transno 4294973489 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2598 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.604404:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2598 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.604410:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:0.0:1763343273.604413:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343273.604415:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343273.604698:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:55884:x1848998399802240:12345-192.168.201.40@tcp:36:bash.0 Request processed in 12867us (13376us total) trans 4294973489 rc 0/0 00000100:00100000:0.0:1763343273.604710:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10509 00000020:00080000:0.0:1763343273.604714:0:6524:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343273.606368:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.606418:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399802880 00000100:00100000:2.0:1763343273.606428:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399802880 00000100:00100000:2.0:1763343273.606476:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10510 00000100:00100000:2.0:1763343273.606484:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:55884:x1848998399802880:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343273.606506:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.606524:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a259f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49128 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.606574:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a259f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49128 expref: 309 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.606586:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a259f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49128 expref: 309 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.606604:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:2.0:1763343273.606607:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343273.606611:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4515600, rc 0) 00000100:00100000:2.0:1763343273.606662:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:55884:x1848998399802880:12345-192.168.201.40@tcp:101:bash.0 Request processed in 177us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.606669:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10510 00000100:00100000:2.0:1763343273.616377:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.616585:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399803136 00000100:00100000:0.0:1763343273.616598:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399803136 00000100:00100000:0.0:1763343273.617935:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10511 00000100:00100000:0.0:1763343273.617955:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:55884:x1848998399803136:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343273.617976:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343273.617980:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343273.618009:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a259f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49128 expref: 309 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.618045:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:0.0:1763343273.618051:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343273.618067:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a25a6 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4912f expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.618128:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a25ad lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343273.618140:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a25ad lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.618148:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a25ad lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000040:00080000:0.0:1763343273.618391:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1680, 88 off140024 00000004:00080000:0.0:1763343273.618399:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1066742373952ns, next at 1066683237775ns, rc = 0 00000040:00080000:0.0:1763343273.618443:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1688, 88 off140680 00000004:00080000:0.0:1763343273.618450:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1066742424965ns, next at 1066683090291ns, rc = 0 00000040:00080000:0.0:1763343273.618475:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1689, 88 off140768 00000004:00080000:0.0:1763343273.618480:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1066742455430ns, next at 1066683090291ns, rc = 0 00000040:00080000:0.0:1763343273.618499:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1681, 88 off140112 00000004:00080000:0.0:1763343273.618504:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1066742479553ns, next at 1066683237775ns, rc = 0 00000100:00100000:0.0:1763343273.620644:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.622083:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399803392 00000100:00100000:2.0:1763343273.622095:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399803392 00000100:00100000:2.0:1763343273.622154:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10512 00000100:00100000:2.0:1763343273.622163:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57106:x1848998399803392:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343273.622182:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.622205:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a25b4 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49136 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.622270:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a25bb lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343273.622282:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a25bb lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.622301:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a25bb lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.622312:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a25c2 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343273.622319:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a25c2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.622328:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a25c2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.623328:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a25c9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343273.623345:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a25c9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.623355:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a25c9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:2.0:1763343273.623366:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f8:0x0]: returning size 2 00000001:00080000:3.0:1763343273.623917:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973490 is committed 00000004:00080000:3.0:1763343273.623925:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1075 committed 00010000:00010000:0.0:1763343273.623944:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a244f lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.623953:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a244f lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.623960:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a244f lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.623965:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c0030200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.623969:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a244f lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.623977:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a244f lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.623990:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1100) 00010000:00010000:0.0:1763343273.623993:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.624336:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a244f lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.624347:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a244f lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.624370:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a24db lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.624503:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a25c9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.624510:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a25c9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.624516:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a25c9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.624521:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85abe00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.624524:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a25c9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.624531:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a25c9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.624540:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:2.0:1763343273.624542:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1763343273.624545:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a25c9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.624554:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a25c9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.624572:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a25bb lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.624577:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a25bb lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.624582:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a25bb lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.624587:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a25bb lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.624591:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.624594:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a25bb lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.624599:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a25bb lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.624606:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53500) 00010000:00010000:2.0:1763343273.624608:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.624610:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a25bb lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.624615:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a25bb lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.624693:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a24db lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.624699:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a24db lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00000004:00080000:3.0:1763343273.624716:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1083 committed 00000004:00080000:3.0:1763343273.624731:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1082 committed 00000004:00080000:3.0:1763343273.624733:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1074 committed 00010000:00010000:2.0:1763343273.624958:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a25c2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.625003:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a25c2 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.625068:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a25c2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.625081:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400cbad3c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.625084:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a25c2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.625090:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a25c2 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.625098:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1100) 00010000:00010000:2.0:1763343273.625100:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.625102:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a25c2 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.625107:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a25c2 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.625158:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a25b4 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49136 expref: 311 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.625169:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53500) 00010000:00010000:2.0:1763343273.625172:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343273.625175:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a25b4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49136 expref: 311 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.625189:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d1e9ec00, rc 0) 00000100:00100000:2.0:1763343273.625266:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57106:x1848998399803392:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3103us (4632us total) trans 4294973491 rc 301/301 00000100:00100000:2.0:1763343273.625275:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10512 00000100:00100000:1.0:1763343273.625704:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c791a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412952704:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343273.625749:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343273.625778:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763343273.625783:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c791b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412952576:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343273.625801:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343273.625822:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412952832:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343273.625907:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343273.625923:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763343273.625927:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c791b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412952960:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343273.625955:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763343273.625960:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff940202040c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.625967:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a24db lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.625975:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a24db lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.625988:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1100) 00010000:00010000:0.0:1763343273.625991:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343273.625995:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412952704 00010000:00010000:0.0:1763343273.625995:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a24db lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000100:00100000:1.0:1763343273.626003:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412952704 00010000:00010000:0.0:1763343273.626004:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a24db lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.626051:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2598 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00000100:00100000:1.0:1763343273.626055:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412952576 00010000:00010000:0.0:1763343273.626060:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2598 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00000100:00100000:1.0:1763343273.626061:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412952576 00010000:00010000:0.0:1763343273.626070:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2598 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00000100:00100000:1.0:1763343273.626081:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412952832 00000100:00100000:1.0:1763343273.626086:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412952832 00010000:00010000:0.0:1763343273.626091:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c4514400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.626096:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2598 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.626103:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2598 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00000100:00100000:1.0:1763343273.626106:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412952960 00000100:00100000:1.0:1763343273.626111:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412952960 00010000:00010000:0.0:1763343273.626114:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:0.0:1763343273.626118:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.626122:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2598 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.626127:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a2598 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000100:00100000:1.0:1763343273.626134:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7119 00000100:00100000:1.0:1763343273.626144:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+16:3662:x1848998412952704:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763343273.626170:0:8626:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:683 count 1 00010000:00010000:1.0:1763343273.626192:0:8626:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401d121fc00/0x9104b1ba770a25d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.626210:0:8626:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a23b5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49087 expref: 14 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343273.626218:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.626221:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.626225:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401d121fc00/0x9104b1ba770a25d7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.626265:0:8626:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a23b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49087 expref: 14 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343273.626279:0:8626:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a23b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49087 expref: 14 pid: 28562 timeout: 1166 lvb_type: 1 00000100:00100000:1.0:1763343273.626301:0:8626:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7918000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8626:1848998412953088:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343273.626356:0:8626:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343273.626376:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7120 00000100:00100000:1.0:1763343273.626384:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+16:3662:x1848998412952576:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763343273.626397:0:8412:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:682 count 1 00010000:00010000:1.0:1763343273.626408:0:8412:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a25de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.626419:0:8412:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff940202041000/0x9104b1ba770a2425 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490b8 expref: 14 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.626425:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343273.626426:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343273.626429:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a25de lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.626447:0:8412:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff940202041000/0x9104b1ba770a2425 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490b8 expref: 14 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.626455:0:8412:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff940202041000/0x9104b1ba770a2425 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490b8 expref: 14 pid: 35266 timeout: 1166 lvb_type: 0 00000100:00100000:1.0:1763343273.626465:0:8412:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7919f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998412953216:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343273.626488:0:8412:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd0300 going to sleep for 11 seconds 00000100:00100000:1.0:1763343273.626511:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7121 00000100:00100000:1.0:1763343273.626519:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+16:3659:x1848998412952832:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1763343273.626655:0:8414:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2ac:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343273.626658:0:8414:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2ac:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343273.626660:0:8414:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2ac:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343273.626661:0:8414:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2ac:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763343273.626663:0:8414:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2ac:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343273.626710:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+17:3659:x1848998412952832:12345-0@lo:2:osp-syn-0-1.0 Request processed in 193us (803us total) trans 21474839143 rc 0/0 00000100:00100000:1.0:1763343273.626717:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7121 00000100:00100000:1.0:1763343273.626731:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7122 00000100:00100000:1.0:1763343273.626737:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+16:3659:x1848998412952960:12345-0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763343273.626781:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c7918380/2, rc 0, transno 21474839143 00000100:00100000:2.0:1763343273.626791:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412952832:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343273.626825:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+17:3659:x1848998412952960:12345-0@lo:2:osp-syn-0-1.0 Request processed in 86us (867us total) trans 21474839144 rc 0/0 00000004:00080000:2.0:1763343273.626834:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c791b100/2, rc 0, transno 21474839144 00000100:00100000:2.0:1763343273.626845:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c791b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412952960:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343273.626849:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7122 00000100:00100000:2.0:1763343273.626941:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c791b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412953344:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343273.626975:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412953728:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343273.626982:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343273.627009:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763343273.627014:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343273.627018:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c791a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412953472:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343273.627062:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763343273.627070:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c791bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412953600:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343273.627101:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412953344 00000100:00100000:1.0:1763343273.627105:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412953344 00000100:00100000:1.0:1763343273.627126:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412953728 00000100:00100000:1.0:1763343273.627129:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412953728 00000100:00100000:0.0:1763343273.627138:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7123 00000100:00100000:0.0:1763343273.627150:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+42:3661:x1848998412953344:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763343273.627165:0:27798:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:683 count 1 00010000:00010000:0.0:1763343273.627183:0:27798:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c508a400/0x9104b1ba770a25e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.627197:0:27798:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a23fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490aa expref: 27 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.627204:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1763343273.627206:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763343273.627207:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343273.627213:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c508a400/0x9104b1ba770a25e5 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.627238:0:27798:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a23fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490aa expref: 27 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343273.627241:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412953472 00000100:00100000:2.0:1763343273.627247:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412953472 00010000:00010000:0.0:1763343273.627253:0:27798:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a23fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490aa expref: 27 pid: 35266 timeout: 1166 lvb_type: 0 00000100:00100000:0.0:1763343273.627265:0:27798:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:27798:1848998412953856:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343273.627319:0:27798:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401cbf743c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343273.627406:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7124 00000100:00100000:2.0:1763343273.627414:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7125 00000100:00100000:1.0:1763343273.627417:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+43:3660:x1848998412953728:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343273.627427:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+43:3661:x1848998412953472:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763343273.627443:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:684 count 1 00010000:00010000:2.0:1763343273.627465:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a25ec lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.627478:0:8413:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a23bc lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4908e expref: 27 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343273.627484:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.627486:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.627489:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a25ec lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.627513:0:8413:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a23bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4908e expref: 27 pid: 8414 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1763343273.627517:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+44:3660:x1848998412953728:12345-0@lo:2:osp-syn-1-1.0 Request processed in 102us (502us total) trans 17179871873 rc 0/0 00000100:00100000:1.0:1763343273.627531:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7124 00010000:00010000:2.0:1763343273.627543:0:8413:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a23bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4908e expref: 27 pid: 8414 timeout: 1166 lvb_type: 1 00000100:00100000:2.0:1763343273.627554:0:8413:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dc8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8413:1848998412953984:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343273.627568:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343273.627590:0:8413:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401ed059000 going to sleep for 11 seconds 00000004:00080000:1.0:1763343273.627597:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c7919880/2, rc 0, transno 17179871873 00000100:00100000:1.0:1763343273.627603:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412953728:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343273.627610:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412953600 00000100:00100000:2.0:1763343273.627615:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412953600 00000100:00100000:2.0:1763343273.627651:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7126 00000100:00100000:2.0:1763343273.627660:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+44:3660:x1848998412953600:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343273.627754:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+45:3660:x1848998412953600:12345-0@lo:2:osp-syn-1-1.0 Request processed in 95us (187us total) trans 17179871874 rc 0/0 00000100:00100000:2.0:1763343273.627761:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7126 00000004:00080000:1.0:1763343273.627982:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c791bb80/2, rc 0, transno 17179871874 00000100:00100000:1.0:1763343273.627988:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c791bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412953600:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1763343273.628310:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a25ad lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4912f expref: 288 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.628322:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:0.0:1763343273.628325:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343273.628341:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a25a6 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4912f expref: 288 pid: 9827 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763343273.628359:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a25ad lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4912f expref: 287 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.628385:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:0.0:1763343273.628388:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343273.628390:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c1661c00, rc 0) 00000100:00100000:0.0:1763343273.628431:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:55884:x1848998399803136:12345-192.168.201.40@tcp:101:bash.0 Request processed in 10484us (12066us total) trans 4294973490 rc 0/0 00000100:00100000:0.0:1763343273.628439:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10511 00000100:00100000:0.0:1763343273.633293:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.633411:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399803520 00000100:00100000:2.0:1763343273.633422:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399803520 00000100:00100000:2.0:1763343273.633488:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10513 00000100:00100000:2.0:1763343273.633499:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57106:x1848998399803520:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343273.633520:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.633541:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba770a25f3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4913d expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.633641:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a25fa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343273.633656:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2552 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4910c expref: 288 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.633672:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a25fa lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.633707:0:9827:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2552 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4910c expref: 288 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.633719:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2552 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4910c expref: 288 pid: 33856 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.633731:0:9827:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b26680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412954112:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343273.633815:0:9827:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401ed059180 going to sleep for 11 seconds 00000100:00100000:1.0:1763343273.634082:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7918000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8626:1848998412953088:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343273.634102:0:8626:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9401d121fc00/0x9104b1ba770a25d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343273.634199:0:8412:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7919f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998412953216:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343273.634214:0:8412:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a25de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343273.634738:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.634815:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399803648 00000100:00100000:1.0:1763343273.634822:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399803648 00010000:00010000:1.0:1763343273.634849:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a23b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49087 expref: 15 pid: 28562 timeout: 1166 lvb_type: 1 00000100:00100000:1.0:1763343273.634886:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3409 00000100:00100000:1.0:1763343273.634895:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998399803648:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343273.634908:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343273.634913:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a23b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49087 expref: 15 pid: 28562 timeout: 1166 lvb_type: 1 00010000:00010000:1.0:1763343273.634923:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a23b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49087 expref: 15 pid: 28562 timeout: 1166 lvb_type: 1 00010000:00010000:1.0:1763343273.634944:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a23b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49087 expref: 15 pid: 28562 timeout: 1166 lvb_type: 1 00010000:00010000:1.0:1763343273.634958:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.634960:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.634964:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9401d121fc00/0x9104b1ba770a25d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.634972:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401d121fc00/0x9104b1ba770a25d7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.635000:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343273.635387:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399803648:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 179us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343273.635398:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3409 00010000:00010000:3.0:1763343273.635461:0:8626:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9401d121fc00/0x9104b1ba770a25d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.635470:0:8626:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401d121fc00/0x9104b1ba770a25d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.635481:0:8626:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401d121fc00/0x9104b1ba770a25d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.635489:0:8626:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401d121fc00/0x9104b1ba770a25d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.635511:0:8626:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343273.635893:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343273.635900:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9401d121fc00/0x9104b1ba770a25d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.635908:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121fc00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343273.635912:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9401d121fc00/0x9104b1ba770a25d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.635921:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9401d121fc00/0x9104b1ba770a25d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.635934:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9401d121fc00/0x9104b1ba770a25d7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.635941:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401d121fc00/0x9104b1ba770a25d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.635959:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343273.635961:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343273.635963:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343273.636712:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+17:3662:x1848998412952704:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10566us (10958us total) trans 21474839145 rc 0/0 00000100:00100000:3.0:1763343273.636721:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7119 00000100:00100000:1.0:1763343273.636950:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000004:00080000:0.0:1763343273.637021:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c791a680/2, rc 0, transno 21474839145 00000100:00100000:0.0:1763343273.637055:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c791a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412952704:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343273.637313:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.637428:0:27798:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:27798:1848998412953856:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343273.637449:0:27798:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c508a400/0x9104b1ba770a25e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343273.637793:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.637837:0:8413:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dc8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8413:1848998412953984:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343273.637850:0:8413:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a25ec lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343273.637883:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399803776 00000100:00100000:2.0:1763343273.637890:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399803776 00010000:00010000:2.0:1763343273.637922:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff940202041000/0x9104b1ba770a2425 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490b8 expref: 14 pid: 35266 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.637954:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399803904 00000100:00100000:2.0:1763343273.637958:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399803904 00010000:00010000:2.0:1763343273.637974:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a23fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490aa expref: 28 pid: 35266 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.637997:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3410 00000100:00100000:2.0:1763343273.638005:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399803776:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343273.638019:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343273.638048:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff940202041000/0x9104b1ba770a2425 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490b8 expref: 14 pid: 35266 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.638064:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff940202041000/0x9104b1ba770a2425 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490b8 expref: 14 pid: 35266 timeout: 1166 lvb_type: 0 00000100:00100000:3.0:1763343273.638172:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3411 00000100:00100000:3.0:1763343273.638182:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2408:x1848998399803904:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343273.638191:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343273.638195:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a23fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490aa expref: 28 pid: 35266 timeout: 1166 lvb_type: 0 00010000:00010000:3.0:1763343273.638204:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a23fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490aa expref: 28 pid: 35266 timeout: 1166 lvb_type: 0 00010000:00010000:3.0:1763343273.638223:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a23fb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490aa expref: 28 pid: 35266 timeout: 1166 lvb_type: 0 00010000:00010000:3.0:1763343273.638237:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343273.638239:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343273.638242:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c508a400/0x9104b1ba770a25e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.638252:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c508a400/0x9104b1ba770a25e5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.638273:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343273.638326:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2408:x1848998399803904:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 146us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343273.638333:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3411 00010000:00010000:0.0:1763343273.638425:0:27798:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c508a400/0x9104b1ba770a25e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.638434:0:27798:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c508a400/0x9104b1ba770a25e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.638444:0:27798:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c508a400/0x9104b1ba770a25e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.638451:0:27798:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c508a400/0x9104b1ba770a25e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.638473:0:27798:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343273.638708:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+45:3661:x1848998412953344:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11560us (11727us total) trans 17179871875 rc 0/0 00000100:00100000:0.0:1763343273.638716:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7123 00000100:00100000:1.0:1763343273.639037:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.639054:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399804032 00000100:00100000:1.0:1763343273.639060:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399804032 00010000:00010000:1.0:1763343273.639081:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a23bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4908e expref: 27 pid: 8414 timeout: 1166 lvb_type: 1 00000100:00100000:1.0:1763343273.639101:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399804160 00000100:00100000:1.0:1763343273.639104:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399804160 00010000:00010000:1.0:1763343273.639115:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2552 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4910c expref: 289 pid: 33856 timeout: 1166 lvb_type: 0 00000100:00100000:1.0:1763343273.639133:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3412 00000100:00100000:1.0:1763343273.639140:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2407:x1848998399804032:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343273.639148:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343273.639153:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a23bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4908e expref: 27 pid: 8414 timeout: 1166 lvb_type: 1 00010000:00010000:1.0:1763343273.639164:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a23bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4908e expref: 27 pid: 8414 timeout: 1166 lvb_type: 1 00010000:00010000:1.0:1763343273.639181:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a23bc lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4908e expref: 27 pid: 8414 timeout: 1166 lvb_type: 1 00010000:00010000:1.0:1763343273.639194:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.639196:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343273.639200:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a25ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.639208:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a25ec lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.639232:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343273.639257:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2407:x1848998399804032:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 118us (1465us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343273.639263:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3412 00000100:00100000:1.0:1763343273.639278:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3413 00000100:00100000:1.0:1763343273.639296:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:2409:x1848998399804160:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343273.639305:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343273.639310:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2552 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4910c expref: 289 pid: 33856 timeout: 1166 lvb_type: 0 00010000:00010000:1.0:1763343273.639319:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2552 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4910c expref: 289 pid: 33856 timeout: 1166 lvb_type: 0 00010000:00010000:1.0:1763343273.639333:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:1.0:1763343273.639339:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a25fa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.639348:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a25fa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.639355:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a25fa lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.639367:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343273.639387:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:2409:x1848998399804160:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 103us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343273.639393:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3413 00010000:00010000:1.0:1763343273.639421:0:8413:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a25ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.639429:0:8413:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a25ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.639437:0:8413:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a25ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.639444:0:8413:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a25ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.639458:0:8413:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1763343273.639631:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+45:3661:x1848998412953472:12345-0@lo:6:osp-syn-1-1.0 Request processed in 12207us (12565us total) trans 17179871876 rc 0/0 00000100:00100000:1.0:1763343273.639640:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7125 00010000:00010000:3.0:1763343273.639656:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763343273.639665:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c508a400/0x9104b1ba770a25e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.639666:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343273.639676:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a25ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.639677:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508a400 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343273.639684:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c508a400/0x9104b1ba770a25e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.639688:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a4200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343273.639695:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a25ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.639696:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c508a400/0x9104b1ba770a25e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.639715:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a25ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.639720:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c508a400/0x9104b1ba770a25e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.639730:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c508a400/0x9104b1ba770a25e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.639732:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a25ec lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.639745:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a25ec lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.639750:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343273.639754:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343273.639756:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343273.639765:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343273.639768:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343273.639770:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343273.639809:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:2.0:1763343273.639827:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff940202041000/0x9104b1ba770a2425 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b490b8 expref: 14 pid: 35266 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.639840:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.639843:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.639847:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a25de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.639854:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a25de lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.639876:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343273.639910:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2408:x1848998399803776:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1905us (2960us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.639917:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3410 00000004:00080000:2.0:1763343273.639970:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c791a300/2, rc 0, transno 17179871876 00000100:00100000:2.0:1763343273.639977:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c791a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412953472:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1763343273.639988:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c791b480/2, rc 0, transno 17179871875 00000100:00100000:2.0:1763343273.639992:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c791b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412953344:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1763343273.640011:0:8412:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a25de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.640019:0:8412:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a25de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.640051:0:8412:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a25de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.640058:0:8412:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a25de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.640073:0:8412:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343273.640231:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+17:3662:x1848998412952576:12345-0@lo:6:osp-syn-0-1.0 Request processed in 13846us (14426us total) trans 21474839146 rc 0/0 00000100:00100000:2.0:1763343273.640238:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7120 00000100:00100000:2.0:1763343273.640254:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399804288 00000100:00100000:2.0:1763343273.640259:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399804288 00000100:00100000:2.0:1763343273.640308:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7127 00000100:00100000:2.0:1763343273.640316:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:55884:x1848998399804288:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343273.640328:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.640341:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2601 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49144 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.640361:0:8412:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2559 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49113 expref: 14 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343273.640368:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.640370:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.640374:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2601 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49144 expref: 14 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.640408:0:8412:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2559 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49113 expref: 14 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343273.640423:0:8412:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2559 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49113 expref: 14 pid: 8626 timeout: 1166 lvb_type: 1 00000100:00100000:2.0:1763343273.640435:0:8412:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b24a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998412954240:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343273.640495:0:8412:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c546e300 going to sleep for 11 seconds 00010000:00010000:2.0:1763343273.640511:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343273.640516:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a25de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.640523:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121e200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343273.640526:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a25de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.640534:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a25de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.640547:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a25de lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.640554:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401d121e200/0x9104b1ba770a25de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.640569:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343273.640570:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343273.640572:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343273.640599:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a2552 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4910c expref: 288 pid: 33856 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.640611:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b26680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412954112:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343273.640625:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a25fa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.640632:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a25fa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.640637:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a25fa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:2.0:1763343273.640680:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f8:0x0]: returning size 2 00000004:00200000:2.0:1763343273.640686:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343273.640704:0:9827:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a25fa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.640733:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba770a25f3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4913d expref: 288 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.640747:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a25fa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4913d expref: 287 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.640756:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:2.0:1763343273.640759:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343273.640761:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400cbad3c00, rc 0) 00000100:00100000:2.0:1763343273.640800:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57106:x1848998399803520:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 7303us (7525us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.640807:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10513 00000004:00080000:1.0:1763343273.641429:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c791b800/2, rc 0, transno 21474839146 00000100:00100000:1.0:1763343273.641437:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c791b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412952576:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343273.644399:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.644655:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399804544 00000100:00100000:3.0:1763343273.644665:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399804544 00000100:00100000:3.0:1763343273.645108:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3711 00000100:00100000:3.0:1763343273.645124:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57106:x1848998399804544:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343273.645326:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57106:x1848998399804544:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 206us (939us total) trans 4294973492 rc 0/0 00000100:00100000:3.0:1763343273.645337:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3711 00000100:00100000:2.0:1763343273.648108:0:8412:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b24a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998412954240:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343273.648145:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2601 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49144 expref: 14 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.648165:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d1e9ec00, rc 0) 00000100:00100000:2.0:1763343273.648216:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:55884:x1848998399804288:12345-192.168.201.40@tcp:101:bash.0 Request processed in 7900us (8407us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.648225:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7127 00000100:00100000:2.0:1763343273.652387:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.652438:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.652674:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399804800 00000100:00100000:0.0:1763343273.652674:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399804672 00000100:00100000:3.0:1763343273.652683:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399804800 00000100:00100000:0.0:1763343273.652683:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399804672 00010000:00010000:0.0:1763343273.652735:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2559 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49113 expref: 14 pid: 8626 timeout: 1166 lvb_type: 1 00000100:00100000:3.0:1763343273.652741:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10514 00000100:00100000:3.0:1763343273.652753:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57106:x1848998399804800:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:0.0:1763343273.652769:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3414 00010000:00010000:3.0:1763343273.652773:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1763343273.652776:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399804672:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343273.652788:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343273.652793:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2559 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49113 expref: 14 pid: 8626 timeout: 1166 lvb_type: 1 00010000:00010000:3.0:1763343273.652795:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a2608 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4914b expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.652806:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2559 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49113 expref: 14 pid: 8626 timeout: 1166 lvb_type: 1 00010000:00010000:0.0:1763343273.652826:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2559 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49113 expref: 14 pid: 8626 timeout: 1166 lvb_type: 1 00010000:00010000:0.0:1763343273.652841:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343273.652843:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343273.652849:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2601 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49144 expref: 13 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.652853:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a260f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343273.652859:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2601 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49144 expref: 13 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.652865:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a260f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.652873:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a260f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.652882:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2616 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343273.652888:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2616 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.652893:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2616 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.652894:0:7904:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2601 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49144 expref: 13 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343273.652907:0:7904:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc70a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7904:1848998412954368:192.168.201.40@tcp:105: 00010000:00010000:3.0:1763343273.652966:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a261d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343273.652976:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a261d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.652982:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a261d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:0.0:1763343273.652983:0:7904:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401cbf74d80 going to sleep for 11 seconds 00000004:00200000:3.0:1763343273.653021:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f8:0x0]: returning size 2 00000004:00200000:3.0:1763343273.653046:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343273.653065:0:9827:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a261d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.653076:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a261d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.653084:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a260f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.653091:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a260f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.653097:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a260f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.653102:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a260f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.653108:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343273.653111:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a260f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.653117:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a260f lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.653126:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cb9f2c00) 00010000:00010000:3.0:1763343273.653128:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343273.653133:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a260f lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.653140:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a260f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.653148:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2616 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.653153:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2616 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.653159:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2616 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.653163:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba2c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343273.653166:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2616 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.653171:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2616 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.653177:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401cb9f2f00) 00010000:00010000:3.0:1763343273.653180:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343273.653182:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2616 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.653188:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2616 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343273.653214:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a2608 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4914b expref: 290 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.653227:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a261d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4914b expref: 289 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.653239:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:3.0:1763343273.653242:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343273.653244:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3000, rc 0) 00000100:00100000:3.0:1763343273.653306:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57106:x1848998399804800:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 555us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343273.653313:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10514 00000100:00100000:2.0:1763343273.656498:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.658140:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399804928 00000100:00100000:3.0:1763343273.658153:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399804928 00000100:00100000:3.0:1763343273.658213:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7128 00000100:00100000:3.0:1763343273.658224:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:55884:x1848998399804928:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343273.658241:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343273.658265:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a2624 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49152 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343273.658306:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343273.658328:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343273.658330:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343273.658339:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a2624 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49152 expref: 27 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.658354:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a2624 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49152 expref: 27 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.658366:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121e200, rc 0) 00000100:00100000:3.0:1763343273.658421:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:55884:x1848998399804928:12345-192.168.201.40@tcp:101:bash.0 Request processed in 199us (1941us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343273.658433:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7128 00000100:00100000:0.0:1763343273.658574:0:7904:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc70a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7904:1848998412954368:192.168.201.40@tcp:105: 00010000:00010000:0.0:1763343273.658594:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343273.658618:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2408:x1848998399804672:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 5842us (6253us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343273.658628:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3414 00000100:00100000:0.0:1763343273.658738:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.658760:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399805056 00000100:00100000:0.0:1763343273.658763:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399805056 00000100:00100000:0.0:1763343273.658791:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 451 00000100:00100000:0.0:1763343273.658797:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8390c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:2408:x1848998399805056:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343273.658806:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343273.658826:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a261d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4914b expref: 289 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.658843:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:0.0:1763343273.658846:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343273.658874:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8390c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:2408:x1848998399805056:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 76us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343273.658879:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 451 00000100:00100000:2.0:1763343273.663189:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.663247:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.663353:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399805184 00000100:00100000:1.0:1763343273.663364:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399805184 00002000:00010000:1.0:1763343273.663416:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/684 (0->18446744073709551615) 00002000:00100000:1.0:1763343273.663421:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b25f80 with x1848998399805184 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343273.663434:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5b25f80. 00000100:00100000:1.0:1763343273.663466:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399805312 00000100:00100000:1.0:1763343273.663469:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399805312 00002000:00010000:1.0:1763343273.663482:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/685 (0->18446744073709551615) 00002000:00100000:1.0:1763343273.663485:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b24a80 with x1848998399805312 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343273.663492:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5b24a80. 00000100:00100000:1.0:1763343273.663517:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1703 00000100:00100000:1.0:1763343273.663528:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2407:x1848998399805184:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:1.0:1763343273.663718:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2ac:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343273.663722:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2ac:0x0] updating lvb mtime from disk: 0 -> 1763343272 00002000:00010000:1.0:1763343273.663724:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2ac:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343273.663728:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2ac:0x0] updating lvb ctime from disk: 0 -> 1763343272 00002000:00010000:1.0:1763343273.663730:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2ac:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343273.663785:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399805184:12345-192.168.201.40@tcp:10:bash.0 Request processed in 258us (605us total) trans 21474839147 rc 0/0 00000100:00100000:1.0:1763343273.663792:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1703 00002000:00010000:1.0:1763343273.663796:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/684 (0->18446744073709551615) 00002000:00100000:1.0:1763343273.663799:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b25f80 with x1848998399805184 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343273.663803:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5b25f80. 00000100:00100000:1.0:1763343273.663820:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1704 00000100:00100000:1.0:1763343273.663826:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2408:x1848998399805312:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:1.0:1763343273.663907:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2ad:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343273.663911:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2ad:0x0] updating lvb mtime from disk: 0 -> 1763343272 00002000:00010000:1.0:1763343273.663913:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2ad:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343273.663915:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2ad:0x0] updating lvb ctime from disk: 0 -> 1763343272 00002000:00010000:1.0:1763343273.663917:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2ad:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343273.663937:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2408:x1848998399805312:12345-192.168.201.40@tcp:10:bash.0 Request processed in 111us (690us total) trans 17179871877 rc 0/0 00000100:00100000:1.0:1763343273.663942:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1704 00002000:00010000:1.0:1763343273.663945:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/685 (0->18446744073709551615) 00002000:00100000:1.0:1763343273.663947:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b24a80 with x1848998399805312 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343273.663951:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5b24a80. 00000100:00100000:1.0:1763343273.671072:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.671442:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399805568 00000100:00100000:2.0:1763343273.671627:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.671686:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399805568 00000100:00100000:3.0:1763343273.671747:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3712 00000100:00100000:3.0:1763343273.671759:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8441450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:55884:x1848998399805568:12345-192.168.201.40@tcp:35:bash.0 00000001:00080000:3.0:1763343273.672008:0:19639:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973493 00000100:00100000:3.0:1763343273.672162:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8441450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:55884:x1848998399805568:12345-192.168.201.40@tcp:35:bash.0 Request processed in 404us (1141us total) trans 4294973494 rc 0/0 00000100:00100000:3.0:1763343273.672170:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3712 00000020:00080000:3.0:1763343273.672175:0:19639:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343273.672525:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399805824 00000100:00100000:0.0:1763343273.672532:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399805824 00000100:00100000:0.0:1763343273.672576:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10515 00000100:00100000:0.0:1763343273.672585:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57107:x1848998399805824:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343273.672596:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343273.672618:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a262b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49159 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.672696:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2632 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343273.672712:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2632 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.672722:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2632 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:0.0:1763343273.672733:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f8:0x0]: returning size 5 00010000:00010000:0.0:1763343273.672802:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a262b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49159 expref: 293 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.672817:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2632 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49159 expref: 292 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.672825:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:0.0:1763343273.672828:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1763343273.672831:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c508be00, rc 0) 00000100:00100000:0.0:1763343273.672859:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57107:x1848998399805824:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 276us (1235us total) trans 4294973495 rc 0/0 00000100:00100000:0.0:1763343273.672866:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10515 00000100:00100000:2.0:1763343273.682846:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.683069:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399806080 00000100:00100000:0.0:1763343273.683079:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399806080 00000100:00100000:0.0:1763343273.683143:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10516 00000100:00100000:0.0:1763343273.683154:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57107:x1848998399806080:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343273.683183:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343273.683208:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a2640 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49160 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.683355:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a2647 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343273.683371:0:6524:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a25fa lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4913d expref: 293 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.683381:0:6524:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a2647 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.683415:0:6524:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a25fa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4913d expref: 293 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.683427:0:6524:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a25fa lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4913d expref: 293 pid: 9827 timeout: 1166 lvb_type: 0 00000100:00100000:0.0:1763343273.683441:0:6524:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc71500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412954496:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343273.683521:0:6524:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c8385f00 going to sleep for 11 seconds 00000100:00100000:1.0:1763343273.694157:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.694243:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.694354:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399806336 00000100:00100000:3.0:1763343273.694407:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399806336 00000100:00100000:3.0:1763343273.694468:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10517 00000100:00100000:3.0:1763343273.694479:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57108:x1848998399806336:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:3.0:1763343273.694497:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343273.694521:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a264e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49167 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.694615:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a2655 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343273.694628:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a2655 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.694639:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a2655 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.694651:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a265c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343273.694658:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a265c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.694665:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a265c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.694736:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a2663 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343273.694746:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a2647 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343273.694753:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a2663 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.694770:0:7641:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a2647 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343273.694778:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a2663 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:0.0:1763343273.694920:0:6524:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc71500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412954496:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343273.694940:0:6524:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a2647 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00000100:00100000:2.0:1763343273.695188:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399806208 00000100:00100000:2.0:1763343273.695194:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399806208 00010000:00010000:2.0:1763343273.695217:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a25fa lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4913d expref: 296 pid: 9827 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.695248:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3415 00000100:00100000:2.0:1763343273.695256:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:2407:x1848998399806208:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343273.695266:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343273.695271:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a25fa lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4913d expref: 296 pid: 9827 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.695294:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a25fa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4913d expref: 296 pid: 9827 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.695318:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a25fa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4913d expref: 296 pid: 9827 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.695333:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:2.0:1763343273.695337:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a2647 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.695344:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a2647 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.695351:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a2647 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.695356:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a2663 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.695362:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a2663 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.695368:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a2663 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.695395:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343273.695452:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:2407:x1848998399806208:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 195us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.695460:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3415 00010000:00010000:1.0:1763343273.695520:0:6524:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a2647 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.695531:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a2647 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00000004:00200000:1.0:1763343273.695548:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f8:0x0]: returning size 5 00010000:00010000:1.0:1763343273.695667:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a2640 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49160 expref: 296 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.695686:0:6524:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a2647 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49160 expref: 295 pid: 6524 timeout: 1166 lvb_type: 0 00010000:00010000:1.0:1763343273.695696:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a2647 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49160 expref: 295 pid: 6524 timeout: 1166 lvb_type: 0 00010000:00010000:1.0:1763343273.695702:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c508a400, rc 0) 00000100:00100000:1.0:1763343273.695738:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57107:x1848998399806080:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 12586us (12906us total) trans 4294973496 rc 0/0 00000100:00100000:1.0:1763343273.695744:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10516 00000100:00100000:1.0:1763343273.699991:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.700101:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.700131:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399806592 00000100:00100000:1.0:1763343273.700140:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399806592 00000100:00100000:1.0:1763343273.700188:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10518 00000100:00100000:1.0:1763343273.700197:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57107:x1848998399806592:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343273.700222:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.700245:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2671 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4916e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.700381:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a2678 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343273.700395:0:6524:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a2678 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.700403:0:6524:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a2678 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000100:00100000:0.0:1763343273.700541:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399806464 00000100:00100000:0.0:1763343273.700546:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399806464 00010000:00010000:0.0:1763343273.700566:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a2647 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49160 expref: 297 pid: 6524 timeout: 1166 lvb_type: 0 00000100:00100000:0.0:1763343273.700594:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3416 00000100:00100000:0.0:1763343273.700600:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7919f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:2409:x1848998399806464:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343273.700609:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343273.700614:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a2647 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49160 expref: 297 pid: 6524 timeout: 1166 lvb_type: 0 00010000:00010000:0.0:1763343273.700626:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a2647 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49160 expref: 297 pid: 6524 timeout: 1166 lvb_type: 0 00010000:00010000:0.0:1763343273.700645:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a2647 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1f8:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49160 expref: 297 pid: 6524 timeout: 1166 lvb_type: 0 00010000:00010000:0.0:1763343273.700659:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:0.0:1763343273.700663:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a2663 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.700671:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a2663 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.700678:0:7904:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a2663 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.700685:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a2678 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.700690:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a2678 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.700695:0:7904:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a2678 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.700719:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343273.700762:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7919f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:2409:x1848998399806464:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 162us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343273.700768:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3416 00010000:00010000:1.0:1763343273.702123:0:6524:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a2678 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.702137:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a2678 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:1.0:1763343273.702183:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f8:0x0]: returning size 5 00000004:00200000:1.0:1763343273.702188:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343273.702207:0:6524:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a2678 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.702243:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2671 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4916e expref: 296 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.702260:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a2678 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4916e expref: 295 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.702269:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:1.0:1763343273.702272:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343273.702275:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a6800, rc 0) 00000100:00100000:1.0:1763343273.702345:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57107:x1848998399806592:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2148us (2242us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343273.702357:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10518 00010000:00010000:2.0:1763343273.702492:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a2663 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.702501:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a2663 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343273.702525:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f8:0x0]: returning size 5 00000004:00200000:2.0:1763343273.702528:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343273.702538:0:7641:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a2663 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.702549:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a2663 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.702558:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a2655 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.702564:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a2655 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.702570:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a2655 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.702575:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a2655 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.702580:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121fc00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.702584:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a2655 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.702591:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a2655 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.702601:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cb9f2c00) 00010000:00010000:2.0:1763343273.702603:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.702607:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a2655 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.702613:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a2655 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.702625:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a265c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.702630:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a265c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.702635:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a265c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.702639:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121e800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.702641:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a265c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.702647:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a265c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.702654:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401cb9f2f00) 00010000:00010000:2.0:1763343273.702657:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.702660:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a265c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.702665:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a265c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.702692:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a264e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49167 expref: 295 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.702705:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a2663 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49167 expref: 294 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.702712:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:2.0:1763343273.702715:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343273.702718:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c6b99600, rc 0) 00000100:00100000:2.0:1763343273.702760:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57108:x1848998399806336:12345-192.168.201.40@tcp:101:rm.0 Request processed in 8283us (8517us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.702767:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10517 00000100:00100000:3.0:1763343273.707062:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.707157:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399807104 00000100:00100000:2.0:1763343273.707169:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399807104 00000100:00100000:2.0:1763343273.707241:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10519 00000100:00100000:2.0:1763343273.707252:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57108:x1848998399807104:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:2.0:1763343273.707329:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1763343273.707360:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a25ad lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4912f expref: 294 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.707385:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a2663 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49167 expref: 293 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.707399:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a2678 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4916e expref: 292 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.707413:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a256e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4911a expref: 291 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.707425:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:2.0:1763343273.707430:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343273.707460:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a267f lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343273.707474:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a267f lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.707486:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a267f lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.707501:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2686 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343273.707508:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2686 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.707514:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2686 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.707600:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a268d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343273.707611:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2632 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49159 expref: 290 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.707618:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a268d lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.707649:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2632 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49159 expref: 290 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.707662:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2632 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49159 expref: 290 pid: 9827 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.707676:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c8599c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412954624:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343273.707749:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c546e300 going to sleep for 11 seconds 00000100:00100000:3.0:1763343273.708798:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.709147:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399806848 00000100:00100000:2.0:1763343273.709155:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399806848 00000100:00100000:2.0:1763343273.709208:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3713 00000100:00100000:2.0:1763343273.709217:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57107:x1848998399806848:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343273.709489:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57107:x1848998399806848:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 272us (693us total) trans 4294973497 rc 0/0 00000100:00100000:2.0:1763343273.709497:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3713 00000100:00100000:2.0:1763343273.712413:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c8599c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412954624:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343273.712444:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a268d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343273.715138:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.715232:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.715497:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399807360 00000100:00100000:3.0:1763343273.715507:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399807360 00010000:00010000:3.0:1763343273.715544:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2632 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49159 expref: 292 pid: 9827 timeout: 1166 lvb_type: 0 00000100:00100000:3.0:1763343273.715585:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3417 00000100:00100000:3.0:1763343273.715593:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:2408:x1848998399807360:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343273.715612:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343273.715619:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2632 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49159 expref: 292 pid: 9827 timeout: 1166 lvb_type: 0 00010000:00010000:3.0:1763343273.715631:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2632 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49159 expref: 292 pid: 9827 timeout: 1166 lvb_type: 0 00010000:00010000:3.0:1763343273.715654:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2632 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49159 expref: 292 pid: 9827 timeout: 1166 lvb_type: 0 00010000:00010000:3.0:1763343273.715670:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:3.0:1763343273.715675:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a268d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.715684:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a268d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.715692:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a268d lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343273.715785:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399807616 00000100:00100000:2.0:1763343273.715791:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399807616 00000100:00100000:2.0:1763343273.715822:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10520 00000100:00100000:2.0:1763343273.715829:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57107:x1848998399807616:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343273.715847:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.715861:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2694 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49175 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.716076:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a269b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343273.716086:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a269b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.716093:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a269b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:2.0:1763343273.716106:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f8:0x0]: returning size 5 00010000:00010000:2.0:1763343273.716207:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2694 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49175 expref: 295 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.716228:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a269b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49175 expref: 294 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.716235:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:2.0:1763343273.716239:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343273.716241:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c85abe00, rc 0) 00000100:00100000:2.0:1763343273.716309:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57107:x1848998399807616:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 480us (1182us total) trans 4294973498 rc 0/0 00000100:00100000:2.0:1763343273.716316:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10520 00010000:00010000:1.0:1763343273.717241:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a268d lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.717251:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a268d lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.717325:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:1.0:1763343273.717502:0:7641:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x1f8:0x0] is inserted into orphan list, open count = 2 00000100:00100000:0.0:1763343273.717514:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:2408:x1848998399807360:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1918us (2280us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343273.717526:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3417 00010000:00010000:1.0:1763343273.717579:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a268d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.717587:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a268d lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.717592:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a268d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.717598:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85aa600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.717602:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a268d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.717608:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a268d lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.717620:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:1.0:1763343273.717623:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343273.717627:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a268d lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.717633:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a268d lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.717647:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a267f lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.717653:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a267f lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.717658:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a267f lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.717664:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a267f lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.717668:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.717671:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a267f lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.717677:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a267f lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.717685:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53500) 00010000:00010000:1.0:1763343273.717687:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.717691:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a267f lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.717697:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a267f lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00010000:1.0:1763343273.718489:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000682d2513 reply state 000000001c90d054 transno 4294973499 ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2686 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.718509:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2686 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.718518:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53a00) 00010000:00010000:1.0:1763343273.718521:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343273.718524:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343273.718587:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57108:x1848998399807104:12345-192.168.201.40@tcp:36:rm.0 Request processed in 11336us (11536us total) trans 4294973499 rc 0/0 00000100:00100000:1.0:1763343273.718594:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10519 00000100:00100000:3.0:1763343273.718780:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.718860:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399807744 00000100:00100000:1.0:1763343273.718868:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399807744 00000100:00100000:1.0:1763343273.719215:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10521 00000100:00100000:1.0:1763343273.719224:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57107:x1848998399807744:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343273.719241:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.719256:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a26a9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4917c expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.719315:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a26a9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4917c expref: 295 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.719329:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a26a9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4917c expref: 295 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.719344:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:1.0:1763343273.719347:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343273.719350:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a7e00, rc 0) 00000100:00100000:1.0:1763343273.719604:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57107:x1848998399807744:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 380us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343273.719610:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10521 00000100:00100000:3.0:1763343273.720963:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.721057:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399807872 00000100:00100000:2.0:1763343273.721066:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399807872 00000100:00100000:2.0:1763343273.721107:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7129 00000100:00100000:2.0:1763343273.721116:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2410:x1848998399807872:12345-192.168.201.40@tcp:1:lfs.0 00010000:00010000:2.0:1763343273.721157:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a26b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.721175:0:8413:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2601 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49144 expref: 14 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.721182:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343273.721185:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343273.721189:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a26b0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.721226:0:8413:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2601 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49144 expref: 14 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.721244:0:8413:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2601 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49144 expref: 14 pid: 8412 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.721259:0:8413:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c8599c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412954752:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343273.721337:0:8413:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c546e840 going to sleep for 11 seconds 00010000:00010000:3.0:1763343273.723995:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343273.725619:0:8413:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c8599c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412954752:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343273.725650:0:8413:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a26b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343273.726955:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.727085:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399808000 00000100:00100000:2.0:1763343273.727095:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399808000 00002000:00100000:2.0:1763343273.727142:0:8419:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2ac:0x0] (0->4) req@ffff9400c5179c00 x1848998399808000/t0(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:14/0 lens 496/0 e 0 to 0 dl 1763343284 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763343273.727151:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5179c00 with x1848998399808000 ext(0->4) 00010000:00010000:2.0:1763343273.727375:0:8419:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2601 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49144 expref: 15 pid: 8412 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.727394:0:8419:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2601 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49144 expref: 15 pid: 8412 timeout: 1166 lvb_type: 0 00002000:00010000:2.0:1763343273.727401:0:8419:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9400c5179c00 00000100:00100000:2.0:1763343273.727443:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 117 00000100:00100000:2.0:1763343273.727454:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998399808000:12345-192.168.201.40@tcp:4:bash.0 00000100:00100000:2.0:1763343273.728599:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998399808000:12345-192.168.201.40@tcp:4:bash.0 Request processed in 1140us (1643us total) trans 21474839148 rc 0/0 00000100:00100000:2.0:1763343273.728611:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 117 00002000:00100000:2.0:1763343273.728621:0:8419:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2ac:0x0] (0->4) req@ffff9400c5179c00 x1848998399808000/t21474839148(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:14/0 lens 496/448 e 0 to 0 dl 1763343284 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763343273.728631:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5179c00 with x1848998399808000 ext(0->4) 00010000:00010000:2.0:1763343273.728638:0:8419:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2601 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49144 expref: 17 pid: 8412 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.728651:0:8419:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2601 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49144 expref: 17 pid: 8412 timeout: 1166 lvb_type: 0 00002000:00010000:2.0:1763343273.728658:0:8419:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9400c5179c00 00000100:00100000:3.0:1763343273.732374:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.732437:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399808128 00000100:00100000:1.0:1763343273.732448:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399808128 00000100:00100000:1.0:1763343273.732507:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10522 00000100:00100000:1.0:1763343273.732518:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57109:x1848998399808128:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343273.732542:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.732568:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a26b7 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49183 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.732644:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a26be lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343273.732659:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a26be lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.732669:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a26be lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.732679:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a26c5 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343273.732687:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a26c5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.732693:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a26c5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.732742:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a26be lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.732749:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a26be lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.732754:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a26be lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.732760:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a26be lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.732765:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a7200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.732770:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a26be lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.732777:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a26be lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.732789:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:1.0:1763343273.732792:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.732797:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a26be lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.732802:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a26be lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.732815:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a26c5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.732821:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a26c5 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.732826:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a26c5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.732831:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a6a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.732834:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a26c5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.732839:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a26c5 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.732846:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53a00) 00010000:00010000:1.0:1763343273.732848:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.732851:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a26c5 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.732856:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a26c5 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.732883:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a26b7 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49183 expref: 296 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.732892:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:1.0:1763343273.732895:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.732898:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a26b7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49183 expref: 296 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.732911:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a6800, rc 0) 00000100:00100000:1.0:1763343273.732978:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57109:x1848998399808128:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 462us (613us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343273.732985:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10522 00000100:00100000:0.0:1763343273.735331:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.736877:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.737343:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399808256 00000100:00100000:2.0:1763343273.737354:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399808256 00010000:00010000:2.0:1763343273.737413:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2601 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49144 expref: 17 pid: 8412 timeout: 1166 lvb_type: 0 00000100:00100000:2.0:1763343273.737448:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3418 00000100:00100000:2.0:1763343273.737458:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998399808256:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343273.737475:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1763343273.737494:0:35278:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2ac:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:2.0:1763343273.737497:0:35278:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2ac:0x0] updating lvb mtime from disk: 1763343272 -> 1763343273 00002000:00010000:2.0:1763343273.737499:0:35278:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2ac:0x0] updating lvb ctime from disk: 1763343272 -> 1763343273 00000100:00100000:1.0:1763343273.737499:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399808384 00002000:00010000:2.0:1763343273.737502:0:35278:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2ac:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1763343273.737504:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399808384 00010000:00010000:2.0:1763343273.737507:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2601 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49144 expref: 17 pid: 8412 timeout: 1166 lvb_type: 0 00010000:00010000:2.0:1763343273.737527:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2601 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49144 expref: 17 pid: 8412 timeout: 1166 lvb_type: 0 00000100:00100000:1.0:1763343273.737533:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10523 00000100:00100000:1.0:1763343273.737539:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57109:x1848998399808384:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343273.737550:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2601 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49144 expref: 17 pid: 8412 timeout: 1166 lvb_type: 0 00010000:00010000:1.0:1763343273.737555:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.737566:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.737568:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.737573:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a26b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.737575:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a26cc lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4918a expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.737582:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a26b0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.737609:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343273.737635:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba770a26d3 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343273.737648:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba770a26d3 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.737656:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba770a26d3 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343273.737660:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998399808256:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 204us (2338us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.737668:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3418 00010000:00010000:1.0:1763343273.737670:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a26da lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343273.737676:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a26da lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.737682:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a26da lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.737694:0:8413:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a26b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.737701:0:8413:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a26b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.737719:0:8413:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a26b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.737720:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba770a26d3 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.737727:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba770a26d3 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.737734:0:8413:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a26b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.737734:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba770a26d3 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.737740:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba770a26d3 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.737741:0:8413:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a26b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.737746:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a4000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.737747:0:8413:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121ea00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343273.737751:0:8413:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a26b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.737751:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba770a26d3 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.737758:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba770a26d3 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.737759:0:8413:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a26b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.737768:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5000) 00010000:00010000:2.0:1763343273.737769:0:8413:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a26b0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.737771:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.737776:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401d121ea00/0x9104b1ba770a26b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.737787:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba770a26d3 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.737792:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba770a26d3 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.737801:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a26da lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.737807:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a26da lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.737812:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a26da lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343273.737814:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2410:x1848998399807872:12345-192.168.201.40@tcp:1:lfs.0 Request processed in 16700us (16856us total) trans 0 rc 0/0 00010000:00010000:1.0:1763343273.737817:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a4200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.737819:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a26da lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343273.737821:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7129 00010000:00010000:1.0:1763343273.737825:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a26da lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.737831:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53a00) 00010000:00010000:1.0:1763343273.737834:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.737837:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a26da lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.737842:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a26da lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.737865:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a26cc lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4918a expref: 296 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.737873:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5000) 00010000:00010000:1.0:1763343273.737875:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.737878:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a26cc lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4918a expref: 296 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.737910:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d1e9ea00, rc 0) 00000100:00100000:1.0:1763343273.737932:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57109:x1848998399808384:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 394us (1063us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343273.737939:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10523 00000100:00100000:0.0:1763343273.745101:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.745152:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.745155:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399808512 00000100:00100000:2.0:1763343273.745167:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399808512 00000100:00100000:1.0:1763343273.745205:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399808768 00000100:00100000:1.0:1763343273.745211:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399808768 00000100:00100000:2.0:1763343273.745242:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10524 00000100:00100000:2.0:1763343273.745254:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57109:x1848998399808512:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:1.0:1763343273.745264:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10525 00000100:00100000:1.0:1763343273.745275:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57107:x1848998399808768:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:2.0:1763343273.745277:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.745310:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a26e1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49191 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.745329:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343273.745355:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a26a9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4917c expref: 297 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.745372:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:1.0:1763343273.745378:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343273.745383:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a26e8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343273.745396:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a26e8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.745401:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a26ef lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343273.745406:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a26e8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.745415:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a26ef lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.745425:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a26ef lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343273.745449:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763343273.745453:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763343273.745481:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a26e1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49191 expref: 297 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.745493:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a26e8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49191 expref: 296 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.745500:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53200) 00010000:00010000:2.0:1763343273.745503:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763343273.745506:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121fc00, rc 0) 00000100:00100000:2.0:1763343273.745551:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57109:x1848998399808512:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 300us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.745558:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10524 00000040:00080000:1.0:1763343273.745627:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1682, 88 off140200 00000004:00080000:1.0:1763343273.745635:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1066869610591ns, next at 1066683237775ns, rc = 0 00000040:00080000:1.0:1763343273.745674:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1690, 88 off140856 00000004:00080000:1.0:1763343273.745679:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1066869654541ns, next at 1066683090291ns, rc = 0 00000040:00080000:1.0:1763343273.745709:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1691, 88 off140944 00000004:00080000:1.0:1763343273.745715:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1066869690364ns, next at 1066683090291ns, rc = 0 00000040:00080000:1.0:1763343273.745726:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1683, 88 off140288 00000004:00080000:1.0:1763343273.745729:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1066869704863ns, next at 1066683237775ns, rc = 0 00000001:00080000:0.0:1763343273.750684:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973500 is committed 00000004:00080000:0.0:1763343273.750697:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1077 committed 00000004:00080000:0.0:1763343273.750710:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1085 committed 00000004:00080000:0.0:1763343273.750720:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1084 committed 00000004:00080000:0.0:1763343273.750723:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1076 committed 00010000:00010000:3.0:1763343273.750816:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2686 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.750828:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2686 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.750836:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2686 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.750841:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400cbad3c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343273.750845:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2686 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.750852:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2686 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.750869:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53a00) 00010000:00010000:3.0:1763343273.750872:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343273.750876:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2686 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.751002:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2686 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000100:00100000:0.0:1763343273.751239:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c511ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412955008:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343273.751310:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343273.751348:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763343273.751354:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c8599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412954880:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343273.751374:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343273.751409:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412955008 00000100:00100000:0.0:1763343273.751417:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412955008 00000100:00100000:0.0:1763343273.751467:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412954880 00000100:00100000:0.0:1763343273.751471:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412954880 00000100:00100000:0.0:1763343273.751493:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7130 00000100:00100000:0.0:1763343273.751500:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+18:3662:x1848998412955008:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343273.751527:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6280380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412955136:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343273.751552:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343273.751572:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763343273.751577:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412955264:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343273.751594:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343273.751620:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412955136 00000100:00100000:1.0:1763343273.751623:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412955136 00000100:00100000:1.0:1763343273.751644:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412955264 00000100:00100000:1.0:1763343273.751646:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412955264 00000100:00100000:1.0:1763343273.751661:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7131 00000100:00100000:0.0:1763343273.751665:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+19:3662:x1848998412955008:12345-0@lo:2:osp-syn-0-1.0 Request processed in 165us (354us total) trans 21474839149 rc 0/0 00000100:00100000:1.0:1763343273.751666:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+19:3662:x1848998412954880:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343273.751673:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7130 00000100:00100000:0.0:1763343273.751689:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7132 00000100:00100000:0.0:1763343273.751694:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6282a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+46:3659:x1848998412955136:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343273.751738:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+19:3662:x1848998412954880:12345-0@lo:2:osp-syn-0-1.0 Request processed in 71us (363us total) trans 21474839150 rc 0/0 00000100:00100000:1.0:1763343273.751745:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7131 00000100:00100000:1.0:1763343273.751757:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7133 00002000:00010000:0.0:1763343273.751757:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2ad:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343273.751761:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2ad:0x0] updating lvb mtime from disk: 1763343272 -> 1763343272 00000100:00100000:1.0:1763343273.751762:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+47:3659:x1848998412955264:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1763343273.751763:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2ad:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343273.751766:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2ad:0x0] updating lvb ctime from disk: 1763343272 -> 1763343272 00002000:00010000:0.0:1763343273.751769:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2ad:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343273.751797:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6282a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+48:3659:x1848998412955136:12345-0@lo:2:osp-syn-1-1.0 Request processed in 102us (243us total) trans 17179871878 rc 0/0 00000100:00100000:0.0:1763343273.751803:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7132 00000100:00100000:1.0:1763343273.751824:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+47:3659:x1848998412955264:12345-0@lo:2:osp-syn-1-1.0 Request processed in 61us (228us total) trans 17179871879 rc 0/0 00000100:00100000:1.0:1763343273.751829:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7133 00000004:00080000:0.0:1763343273.751848:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6282300/2, rc 0, transno 17179871879 00000100:00100000:0.0:1763343273.751853:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412955264:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763343273.751862:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6280380/2, rc 0, transno 17179871878 00000100:00100000:0.0:1763343273.751865:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6280380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412955136:0@lo:2:osp-syn-1-1.0 00000004:00010000:1.0:1763343273.751870:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002ea55777 reply state 0000000021b1bd83 transno 4294973500 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a26ef lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00080000:0.0:1763343273.751880:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c8599c00/2, rc 0, transno 21474839150 00000100:00100000:0.0:1763343273.751883:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c8599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412954880:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763343273.751890:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c511ed80/2, rc 0, transno 21474839149 00000100:00100000:0.0:1763343273.751893:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c511ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412955008:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1763343273.751898:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a26ef lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.751910:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:1.0:1763343273.751913:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1763343273.751916:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1763343273.751997:0:7641:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763343273.752013:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57107:x1848998399808768:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 6740us (6858us total) trans 4294973500 rc 0/0 00000100:00100000:1.0:1763343273.752021:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10525 00010000:00010000:0.0:1763343273.752085:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a26ef lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.752093:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a26ef lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.752099:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a26ef lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.752104:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a4200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.752108:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a26ef lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.752114:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a26ef lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.752126:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:0.0:1763343273.752128:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343273.752131:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a26ef lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.752137:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a26ef lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000100:00100000:0.0:1763343273.753944:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.754083:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399808896 00000100:00100000:1.0:1763343273.754092:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399808896 00000100:00100000:1.0:1763343273.754145:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10526 00000100:00100000:1.0:1763343273.754154:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57109:x1848998399808896:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343273.754173:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.754192:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba770a26f6 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49198 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.754261:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a26fd lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343273.754275:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a26fd lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.754298:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a26fd lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.754313:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2704 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343273.754319:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2704 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.754324:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2704 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.754365:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a26fd lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.754372:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a26fd lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.754378:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a26fd lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.754384:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a26fd lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.754390:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ec00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.754394:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a26fd lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.754401:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a26fd lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.754411:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53200) 00010000:00010000:1.0:1763343273.754414:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.754417:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a26fd lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.754423:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a26fd lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.754435:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2704 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.754441:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2704 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.754446:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2704 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.754451:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.754453:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2704 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.754458:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2704 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.754463:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c497eb00) 00010000:00010000:1.0:1763343273.754465:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.754467:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2704 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.754471:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2704 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.754497:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba770a26f6 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49198 expref: 286 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.754506:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53200) 00010000:00010000:1.0:1763343273.754508:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.754511:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba770a26f6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49198 expref: 286 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.754519:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a4000, rc 0) 00000100:00100000:1.0:1763343273.754577:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57109:x1848998399808896:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 423us (640us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343273.754584:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10526 00000100:00100000:0.0:1763343273.755691:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.755744:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399809024 00000100:00100000:3.0:1763343273.755755:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399809024 00000100:00100000:3.0:1763343273.755804:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10527 00000100:00100000:3.0:1763343273.755813:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:57107:x1848998399809024:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343273.755831:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343273.755846:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a270b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4919f expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.756253:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a270b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4919f expref: 286 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.756268:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a270b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4919f expref: 286 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.756296:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:3.0:1763343273.756300:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343273.756303:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c7bb2400, rc 0) 00000100:00100000:3.0:1763343273.756853:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57107:x1848998399809024:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1038us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343273.756862:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10527 00000100:00100000:2.0:1763343273.759547:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.759635:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399809280 00000100:00100000:3.0:1763343273.759647:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399809280 00000100:00100000:0.0:1763343273.759909:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10528 00000100:00100000:0.0:1763343273.759921:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c511d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57109:x1848998399809280:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343273.759945:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343273.759948:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343273.759977:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a26e8 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49191 expref: 286 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.759997:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53200) 00010000:00010000:0.0:1763343273.760008:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343273.760045:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2712 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b491a6 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.760143:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a2719 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343273.760155:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a2719 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.760164:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a2719 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.760178:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a2720 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343273.760185:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a2720 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.760190:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a2720 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.760646:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a2727 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343273.760655:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a2727 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.760663:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a2727 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:0.0:1763343273.760672:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f9:0x0]: returning size 0 00010000:00010000:0.0:1763343273.760708:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a2719 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.760716:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a2719 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.760722:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a2719 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.760728:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508a400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.760732:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a2719 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.760739:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a2719 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.760748:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f66a1100) 00010000:00010000:0.0:1763343273.760751:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.760755:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a2719 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.760760:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a2719 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:0.0:1763343273.760772:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000404d27a7 reply state 0000000043014862 transno 4294973501 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a2720 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.760782:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a2720 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.760788:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1f00) 00010000:00010000:0.0:1763343273.760790:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343273.760793:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343273.760822:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2712 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491a6 expref: 288 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.760840:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a2727 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491a6 expref: 287 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.760847:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f9:0x0].0x0 (ffff9401f66a1a00) 00010000:00010000:0.0:1763343273.760849:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343273.760851:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a4200, rc 0) 00000100:00100000:0.0:1763343273.760921:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c511d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57109:x1848998399809280:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1001us (1384us total) trans 4294973501 rc 0/0 00000100:00100000:0.0:1763343273.760929:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10528 00000100:00100000:3.0:1763343273.761595:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.763319:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399809408 00000100:00100000:0.0:1763343273.763332:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399809408 00000100:00100000:0.0:1763343273.763398:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10529 00000100:00100000:0.0:1763343273.763993:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57107:x1848998399809408:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343273.764019:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343273.764068:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba770a2735 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b491ad expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.764153:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a273c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343273.764169:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a273c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.764181:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a273c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:0.0:1763343273.764226:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f8:0x0]: returning size 5 00000004:00200000:0.0:1763343273.764231:0:33856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343273.764248:0:33856:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a273c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.764276:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4000/0x9104b1ba770a2735 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491ad expref: 290 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.764308:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a273c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491ad expref: 289 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.764316:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:0.0:1763343273.764319:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1763343273.764323:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3000, rc 0) 00000100:00100000:0.0:1763343273.764401:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57107:x1848998399809408:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 994us (2808us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343273.764410:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10529 00000100:00100000:3.0:1763343273.764675:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.764908:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399809664 00000100:00100000:0.0:1763343273.764915:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399809664 00000100:00100000:0.0:1763343273.764954:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10530 00000100:00100000:0.0:1763343273.764962:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c372b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57109:x1848998399809664:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343273.764975:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343273.764987:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a2743 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b491b4 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.765081:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a274a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343273.765091:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a2727 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491a6 expref: 290 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.765099:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a274a lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.765128:0:33856:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a2727 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491a6 expref: 290 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.765141:0:33856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a2727 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491a6 expref: 290 pid: 33856 timeout: 1166 lvb_type: 0 00000100:00100000:0.0:1763343273.765153:0:33856:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dc8700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412955392:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343273.765209:0:33856:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c3be3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1763343273.769138:0:33856:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dc8700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412955392:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343273.769174:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a274a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:2.0:1763343273.769594:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.769793:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399809792 00000100:00100000:0.0:1763343273.769801:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399809792 00010000:00010000:0.0:1763343273.769836:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a2727 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491a6 expref: 291 pid: 33856 timeout: 1166 lvb_type: 0 00000100:00100000:0.0:1763343273.769872:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3419 00000100:00100000:0.0:1763343273.769881:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:2407:x1848998399809792:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343273.769896:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343273.769903:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a2727 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491a6 expref: 291 pid: 33856 timeout: 1166 lvb_type: 0 00010000:00010000:0.0:1763343273.769915:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a2727 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491a6 expref: 291 pid: 33856 timeout: 1166 lvb_type: 0 00010000:00010000:0.0:1763343273.769938:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a2727 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491a6 expref: 291 pid: 33856 timeout: 1166 lvb_type: 0 00010000:00010000:0.0:1763343273.769954:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f9:0x0].0x0 (ffff9401f66a1a00) 00010000:00010000:0.0:1763343273.769959:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a274a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.769969:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a274a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.769975:0:7904:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a274a lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.770003:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343273.770078:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:2407:x1848998399809792:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 196us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343273.770086:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3419 00000100:00100000:3.0:1763343273.770306:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:1.0:1763343273.770431:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a274a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.770443:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a274a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:1.0:1763343273.770464:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f9:0x0]: returning size 0 00000004:00080000:1.0:1763343273.770635:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2af:0x0], index 1: 0 00000004:00080000:1.0:1763343273.770642:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2ae:0x0], index 0: 0 00000004:00080000:1.0:1763343273.770647:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2af:0x0], index 0: 0 00000004:00080000:1.0:1763343273.770650:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2b0:0x0], index 1: 0 00010000:00010000:1.0:1763343273.770758:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a274a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.770766:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a274a lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.770771:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a274a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.770776:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba2c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.770780:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a274a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.770787:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a274a lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.770797:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f9:0x0].0x0 (ffff9401f66a1a00) 00010000:00010000:1.0:1763343273.770799:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343273.770803:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a274a lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.770808:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a274a lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.770856:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a2743 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1f9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491b4 expref: 290 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.770864:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f9:0x0].0x0 (ffff9401f66a1a00) 00010000:00010000:1.0:1763343273.770867:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343273.770870:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a2743 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491b4 expref: 290 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.770884:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3200, rc 0) 00000100:00100000:1.0:1763343273.770930:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c372b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57109:x1848998399809664:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 5969us (6256us total) trans 4294973502 rc 301/301 00000100:00100000:1.0:1763343273.770938:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10530 00000100:00100000:2.0:1763343273.771208:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399809920 00000100:00100000:2.0:1763343273.771217:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399809920 00000100:00100000:2.0:1763343273.771255:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7134 00000100:00100000:2.0:1763343273.771263:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998399809920:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343273.771275:0:8413:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.771304:0:8413:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401d121fc00/0x9104b1ba770a2758 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b491bb expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343273.771325:0:8413:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2ac:0x0] initial LVB size: 5, mtime: 0x691a7ba9, atime: 0x0, ctime: 0x691a7ba9, blocks: 0x8 00010000:00010000:2.0:1763343273.771342:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.771344:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.771353:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401d121fc00/0x9104b1ba770a2758 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491bb expref: 16 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343273.771366:0:8413:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9401d121fc00/0x9104b1ba770a2758 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491bb expref: 16 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343273.771376:0:8413:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121fc00, rc 0) 00000100:00100000:2.0:1763343273.771406:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998399809920:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 145us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.771412:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7134 00000100:00100000:3.0:1763343273.774553:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.774648:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399810176 00000100:00100000:2.0:1763343273.774660:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399810176 00000100:00100000:2.0:1763343273.774710:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3714 00000100:00100000:2.0:1763343273.774718:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57109:x1848998399810176:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343273.775010:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57109:x1848998399810176:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 291us (467us total) trans 4294973503 rc 0/0 00000100:00100000:2.0:1763343273.775018:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3714 00000100:00100000:0.0:1763343273.791427:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.791729:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399810432 00000100:00100000:3.0:1763343273.791741:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399810432 00000100:00100000:3.0:1763343273.792803:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3715 00000100:00100000:3.0:1763343273.792821:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57109:x1848998399810432:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343273.793081:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57109:x1848998399810432:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 265us (1664us total) trans 4294973504 rc 0/0 00000100:00100000:3.0:1763343273.793088:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3715 00000100:00100000:0.0:1763343273.800093:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.800220:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399810688 00000100:00100000:1.0:1763343273.800229:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399810688 00000100:00100000:1.0:1763343273.800293:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10531 00000100:00100000:1.0:1763343273.800303:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:55884:x1848998399810688:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343273.800330:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.800356:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a275f lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b491c2 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.800605:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2766 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343273.800620:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2766 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.800630:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2766 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.800644:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a276d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343273.800650:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a276d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.800657:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a276d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.800716:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a2774 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343273.800723:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a2774 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.800729:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a2774 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:1.0:1763343273.800739:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f9:0x0]: returning size 0 00010000:00010000:1.0:1763343273.800814:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2766 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.800821:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2766 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.800828:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2766 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.800834:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.800838:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2766 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.800844:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2766 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.800856:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497eb00) 00010000:00010000:1.0:1763343273.800859:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.800863:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2766 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.800868:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2766 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.800880:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a276d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.800886:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a276d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.800891:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a276d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.800896:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a7e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.800899:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a276d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.800904:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a276d lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.800910:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1f00) 00010000:00010000:1.0:1763343273.800913:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.800916:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a276d lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.800921:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a276d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.800958:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a275f lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491c2 expref: 294 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.800977:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a2774 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491c2 expref: 293 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.800983:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f9:0x0].0x0 (ffff9400c497ed00) 00010000:00010000:1.0:1763343273.800986:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343273.800989:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a6800, rc 0) 00000100:00100000:0.0:1763343273.802333:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:55884:x1848998399810688:12345-192.168.201.40@tcp:101:bash.0 Request processed in 2021us (2239us total) trans 4294973505 rc 0/0 00000100:00100000:0.0:1763343273.802345:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10531 00000100:00100000:0.0:1763343273.806162:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.806229:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399810816 00000100:00100000:2.0:1763343273.806239:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399810816 00000100:00100000:2.0:1763343273.806321:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10532 00000100:00100000:2.0:1763343273.806332:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:55884:x1848998399810816:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343273.806359:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.806384:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2782 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b491c9 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.806424:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a2789 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343273.806440:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a2789 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.806452:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a2789 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.806575:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a2782 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491c9 expref: 295 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.806594:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a2789 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491c9 expref: 294 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.806602:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f9:0x0].0x0 (ffff9400c497ed00) 00010000:00010000:2.0:1763343273.806605:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343273.806608:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121ea00, rc 0) 00000100:00100000:2.0:1763343273.806675:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:55884:x1848998399810816:12345-192.168.201.40@tcp:101:bash.0 Request processed in 344us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.806683:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10532 00000100:00100000:2.0:1763343273.810578:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.811420:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399811072 00000100:00100000:3.0:1763343273.811432:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399811072 00000100:00100000:2.0:1763343273.811583:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10533 00000100:00100000:2.0:1763343273.811594:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:55884:x1848998399811072:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:2.0:1763343273.811648:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343273.811674:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a2774 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491c2 expref: 294 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.811696:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f9:0x0].0x0 (ffff9400c497ed00) 00010000:00010000:2.0:1763343273.811702:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343273.813383:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2790 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343273.813405:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2790 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.813417:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2790 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000001:00080000:2.0:1763343273.813477:0:7641:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973506 00000004:00010000:2.0:1763343273.813509:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d486f2c0 reply state 000000007702599b transno 4294973507 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2790 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.813520:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2790 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.813528:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f9:0x0].0x0 (ffff9400c497ed00) 00010000:00010000:2.0:1763343273.813530:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343273.813533:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343273.813640:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:55884:x1848998399811072:12345-192.168.201.40@tcp:36:bash.0 Request processed in 2043us (3070us total) trans 4294973507 rc 0/0 00000100:00100000:2.0:1763343273.813649:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10533 00000020:00080000:2.0:1763343273.813654:0:7641:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343273.816805:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.817119:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399811200 00000100:00100000:2.0:1763343273.817130:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399811200 00000100:00100000:2.0:1763343273.817189:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10534 00000100:00100000:2.0:1763343273.817200:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:55884:x1848998399811200:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343273.817227:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.817246:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2797 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b491d0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.817316:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2797 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491d0 expref: 297 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.817329:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2797 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491d0 expref: 297 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.817349:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f9:0x0].0x0 (ffff9400c497ed00) 00010000:00010000:2.0:1763343273.817352:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343273.817355:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c85ab400, rc 0) 00000100:00100000:2.0:1763343273.817414:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:55884:x1848998399811200:12345-192.168.201.40@tcp:101:bash.0 Request processed in 216us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.817422:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10534 00000100:00100000:0.0:1763343273.824176:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.824379:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399811456 00000100:00100000:2.0:1763343273.824392:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399811456 00000100:00100000:2.0:1763343273.824728:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10535 00000100:00100000:2.0:1763343273.824738:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:55884:x1848998399811456:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343273.824757:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.824760:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343273.824785:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2797 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491d0 expref: 297 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.824809:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f9:0x0].0x0 (ffff9400c497ed00) 00010000:00010000:2.0:1763343273.824814:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343273.824829:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a279e lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b491d7 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.824878:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a27a5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343273.824890:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a27a5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.824899:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a27a5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000040:00080000:0.0:1763343273.825237:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1692, 88 off141032 00000004:00080000:0.0:1763343273.825247:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1066949221862ns, next at 1066683090291ns, rc = 0 00000040:00080000:0.0:1763343273.825308:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1684, 88 off140376 00000004:00080000:0.0:1763343273.825313:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1066949288552ns, next at 1066683237775ns, rc = 0 00000040:00080000:0.0:1763343273.825343:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1685, 88 off140464 00000004:00080000:0.0:1763343273.825348:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1066949323732ns, next at 1066683237775ns, rc = 0 00000040:00080000:0.0:1763343273.825359:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1693, 88 off141120 00000004:00080000:0.0:1763343273.825363:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1066949338127ns, next at 1066683090291ns, rc = 0 00000001:00080000:0.0:1763343273.828782:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973508 is committed 00000004:00080000:0.0:1763343273.828796:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1087 committed 00000004:00080000:0.0:1763343273.828812:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1079 committed 00010000:00010000:2.0:1763343273.828816:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a2720 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00000004:00080000:0.0:1763343273.828823:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1078 committed 00000004:00080000:0.0:1763343273.828827:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1086 committed 00010000:00010000:2.0:1763343273.828831:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a2720 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.828839:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a2720 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.828846:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508aa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.828852:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a2720 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.828860:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a2720 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.828879:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f66a1f00) 00010000:00010000:2.0:1763343273.828883:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.828888:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a2720 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.828893:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a2720 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.828907:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a27a5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491d7 expref: 291 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.828918:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f9:0x0].0x0 (ffff9400c497ed00) 00010000:00010000:0.0:1763343273.828921:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:1.0:1763343273.828924:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6281c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412955648:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343273.828990:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343273.829046:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763343273.829054:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412955520:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343273.829080:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343273.829117:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412955648 00000100:00100000:1.0:1763343273.829124:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412955648 00000100:00100000:1.0:1763343273.829167:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412955520 00000100:00100000:1.0:1763343273.829171:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412955520 00000100:00100000:1.0:1763343273.829201:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7135 00000100:00100000:3.0:1763343273.829209:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412955776:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343273.829213:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+48:3662:x1848998412955648:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343273.829242:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343273.829264:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343273.829270:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412955904:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343273.829305:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763343273.829323:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2790 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.829332:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2790 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343273.829337:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412955776 00010000:00010000:2.0:1763343273.829338:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2790 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343273.829344:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412955776 00010000:00010000:2.0:1763343273.829347:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85aa600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.829352:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2790 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.829359:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2790 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.829369:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f9:0x0].0x0 (ffff9400c497ed00) 00010000:00010000:2.0:1763343273.829372:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343273.829374:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412955904 00010000:00010000:2.0:1763343273.829375:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2790 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343273.829379:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412955904 00010000:00010000:2.0:1763343273.829386:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2790 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343273.829404:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7136 00000100:00100000:3.0:1763343273.829413:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+48:3662:x1848998412955520:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343273.829419:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7137 00000100:00100000:2.0:1763343273.829430:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+20:3659:x1848998412955776:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343273.829614:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+49:3662:x1848998412955520:12345-0@lo:2:osp-syn-1-1.0 Request processed in 200us (532us total) trans 17179871880 rc 0/0 00000100:00100000:2.0:1763343273.829620:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+21:3659:x1848998412955776:12345-0@lo:2:osp-syn-0-1.0 Request processed in 190us (375us total) trans 21474839151 rc 0/0 00000100:00100000:3.0:1763343273.829627:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7136 00000100:00100000:2.0:1763343273.829634:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7137 00000100:00100000:3.0:1763343273.829653:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7138 00000100:00100000:3.0:1763343273.829662:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+20:3659:x1848998412955904:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343273.829734:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+21:3659:x1848998412955904:12345-0@lo:2:osp-syn-0-1.0 Request processed in 73us (428us total) trans 21474839152 rc 0/0 00000100:00100000:1.0:1763343273.830095:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+49:3662:x1848998412955648:12345-0@lo:2:osp-syn-1-1.0 Request processed in 885us (1104us total) trans 17179871881 rc 0/0 00010000:00010000:0.0:1763343273.830144:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a279e lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491d7 expref: 289 pid: 33856 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763343273.830165:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a27a5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491d7 expref: 288 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.830196:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f9:0x0].0x0 (ffff9400c497ed00) 00010000:00010000:0.0:1763343273.830200:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343273.830203:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e91e00, rc 0) 00000100:00100000:0.0:1763343273.830250:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:55884:x1848998399811456:12345-192.168.201.40@tcp:101:bash.0 Request processed in 5514us (6086us total) trans 4294973508 rc 0/0 00000100:00100000:0.0:1763343273.830256:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10535 00000100:00100000:0.0:1763343273.830384:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.830895:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7138 00000100:00100000:2.0:1763343273.830900:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399811584 00000100:00100000:1.0:1763343273.830907:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7135 00000100:00100000:2.0:1763343273.830910:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399811584 00000100:00100000:2.0:1763343273.830957:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7139 00000100:00100000:2.0:1763343273.830965:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998399811584:12345-192.168.201.40@tcp:23:lfs.0 00000004:00080000:3.0:1763343273.831068:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6280a80/2, rc 0, transno 17179871880 00000100:00100000:3.0:1763343273.831075:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412955520:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763343273.831138:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6281c00/2, rc 0, transno 17179871881 00000100:00100000:3.0:1763343273.831143:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6281c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412955648:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343273.831163:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998399811584:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 195us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.831171:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7139 00000004:00080000:2.0:1763343273.831213:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5957100/2, rc 0, transno 21474839152 00000100:00100000:2.0:1763343273.831219:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412955904:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763343273.832515:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c372ad80/2, rc 0, transno 21474839151 00000100:00100000:2.0:1763343273.832526:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412955776:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343273.835200:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.835304:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399811712 00000100:00100000:3.0:1763343273.835317:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399811712 00000100:00100000:3.0:1763343273.835396:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7140 00000100:00100000:3.0:1763343273.835409:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:55884:x1848998399811712:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343273.835431:0:27798:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343273.835455:0:27798:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a27ac lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b491de expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343273.835484:0:27798:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343273.835504:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343273.835506:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343273.835515:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a27ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491de expref: 29 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.835531:0:27798:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a27ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491de expref: 29 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.835544:0:27798:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c508b200, rc 0) 00000100:00100000:3.0:1763343273.835604:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:55884:x1848998399811712:12345-192.168.201.40@tcp:101:bash.0 Request processed in 200us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343273.835611:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7140 00000100:00100000:0.0:1763343273.837950:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.838014:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399811840 00000100:00100000:2.0:1763343273.838049:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399811840 00000100:00100000:2.0:1763343273.838102:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7141 00000100:00100000:2.0:1763343273.838111:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399811840:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:2.0:1763343273.838221:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399811840:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 110us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.838229:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7141 00000100:00100000:0.0:1763343273.844592:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.845347:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.845560:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399812096 00000100:00100000:3.0:1763343273.845571:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399812096 00000100:00100000:3.0:1763343273.845641:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1705 00000100:00100000:3.0:1763343273.845650:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399812096:12345-192.168.201.40@tcp:3:lfs.0 00010000:00010000:3.0:1763343273.845685:0:8419:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9400c508aa00/0x9104b1ba770a27b3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.845700:0:8419:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343273.845702:0:8419:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343273.845708:0:8419:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c508aa00/0x9104b1ba770a27b3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.845721:0:8419:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c508aa00/0x9104b1ba770a27b3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.845821:0:8419:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9400c508aa00/0x9104b1ba770a27b3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.845829:0:8419:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c508aa00/0x9104b1ba770a27b3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.845836:0:8419:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c508aa00/0x9104b1ba770a27b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.845842:0:8419:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508aa00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343273.845846:0:8419:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c508aa00/0x9104b1ba770a27b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.845853:0:8419:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c508aa00/0x9104b1ba770a27b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.845867:0:8419:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c508aa00/0x9104b1ba770a27b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.845873:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c508aa00/0x9104b1ba770a27b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343273.845938:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399812096:12345-192.168.201.40@tcp:3:lfs.0 Request processed in 289us (593us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1763343273.845946:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1705 00000100:00100000:2.0:1763343273.846565:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399811968 00000100:00100000:2.0:1763343273.846572:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399811968 00000100:00100000:2.0:1763343273.846602:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7142 00000100:00100000:2.0:1763343273.846609:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:55884:x1848998399811968:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343273.846619:0:8413:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.846634:0:8413:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90600/0x9104b1ba770a27ba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b491e5 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343273.846651:0:8413:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343273.846665:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.846667:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.846673:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90600/0x9104b1ba770a27ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491e5 expref: 17 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.846684:0:8413:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90600/0x9104b1ba770a27ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491e5 expref: 17 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.846694:0:8413:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e90600, rc 0) 00000100:00100000:2.0:1763343273.846733:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:55884:x1848998399811968:12345-192.168.201.40@tcp:101:bash.0 Request processed in 124us (2151us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.846739:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7142 00000100:00100000:0.0:1763343273.849658:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.849691:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.850212:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399812480 00000100:00100000:3.0:1763343273.850224:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399812480 00002000:00010000:3.0:1763343273.850264:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/686 (0->18446744073709551615) 00002000:00100000:3.0:1763343273.850270:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c7ef6680 with x1848998399812480 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343273.850290:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9401c7ef6680. 00000100:00100000:3.0:1763343273.850323:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399812352 00000100:00100000:3.0:1763343273.850327:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399812352 00002000:00010000:3.0:1763343273.850341:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/687 (0->18446744073709551615) 00002000:00100000:3.0:1763343273.850343:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c7ef6a00 with x1848998399812352 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343273.850352:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401c7ef6a00. 00000100:00100000:3.0:1763343273.850374:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1706 00000100:00100000:3.0:1763343273.850383:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2409:x1848998399812480:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:3.0:1763343273.850554:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2ae:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343273.850557:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2ae:0x0] updating lvb mtime from disk: 0 -> 1763343273 00002000:00010000:3.0:1763343273.850560:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2ae:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343273.850562:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2ae:0x0] updating lvb ctime from disk: 0 -> 1763343273 00002000:00010000:3.0:1763343273.850564:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2ae:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343273.850611:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2409:x1848998399812480:12345-192.168.201.40@tcp:10:bash.0 Request processed in 229us (963us total) trans 21474839153 rc 0/0 00000100:00100000:3.0:1763343273.850617:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1706 00002000:00010000:3.0:1763343273.850621:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/686 (0->18446744073709551615) 00002000:00100000:3.0:1763343273.850623:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c7ef6680 with x1848998399812480 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343273.850627:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9401c7ef6680. 00000100:00100000:3.0:1763343273.850645:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1707 00000100:00100000:3.0:1763343273.850651:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:2409:x1848998399812352:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:3.0:1763343273.850732:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2af:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343273.850735:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2af:0x0] updating lvb mtime from disk: 0 -> 1763343273 00002000:00010000:3.0:1763343273.850737:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2af:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343273.850739:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2af:0x0] updating lvb ctime from disk: 0 -> 1763343273 00002000:00010000:3.0:1763343273.850741:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2af:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343273.850762:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+30:2409:x1848998399812352:12345-192.168.201.40@tcp:10:bash.0 Request processed in 112us (1070us total) trans 17179871882 rc 0/0 00000100:00100000:3.0:1763343273.850768:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1707 00002000:00010000:3.0:1763343273.850771:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/687 (0->18446744073709551615) 00002000:00100000:3.0:1763343273.850773:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c7ef6a00 with x1848998399812352 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343273.850776:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401c7ef6a00. 00000100:00100000:0.0:1763343273.850922:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.851680:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399812224 00000100:00100000:3.0:1763343273.851686:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399812224 00000100:00100000:3.0:1763343273.851728:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10536 00000100:00100000:3.0:1763343273.851734:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57107:x1848998399812224:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343273.851751:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343273.851769:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a27c1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b491ec expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.851801:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a27c8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343273.851816:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a27c8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.851828:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a27c8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.851930:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a27c1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491ec expref: 290 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.851946:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508a400/0x9104b1ba770a27c8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491ec expref: 289 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.851956:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:3.0:1763343273.851959:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343273.851962:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c508a400, rc 0) 00000100:00100000:3.0:1763343273.852007:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57107:x1848998399812224:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 272us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343273.852014:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10536 00000100:00100000:1.0:1763343273.855648:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.855719:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.855823:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399812736 00000100:00100000:2.0:1763343273.855834:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399812736 00000100:00100000:2.0:1763343273.855890:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3716 00000100:00100000:2.0:1763343273.855901:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:55884:x1848998399812736:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:2.0:1763343273.856226:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:55884:x1848998399812736:12345-192.168.201.40@tcp:35:bash.0 Request processed in 326us (586us total) trans 4294973509 rc 0/0 00000100:00100000:2.0:1763343273.856234:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3716 00000100:00100000:3.0:1763343273.856427:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399812864 00000100:00100000:3.0:1763343273.856433:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399812864 00000100:00100000:3.0:1763343273.856468:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1708 00000100:00100000:3.0:1763343273.856475:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+30:2408:x1848998399812864:12345-192.168.201.40@tcp:4:lfs.0 00002000:00010000:3.0:1763343273.856515:0:28399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343273.856523:0:28399:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a27cf lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.856536:0:28399:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343273.856539:0:28399:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343273.856543:0:28399:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a27cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.856558:0:28399:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a27cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1763343273.858952:0:25994:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871883 is committed 00000001:00080000:0.0:1763343273.858973:0:25994:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871881 is committed 00002000:00010000:3.0:1763343273.859259:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2ae:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:3.0:1763343273.859264:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2ae:0x0] updating lvb mtime from disk: 0 -> 1763343273 00002000:00010000:3.0:1763343273.859267:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2ae:0x0] updating lvb ctime from disk: 0 -> 1763343273 00002000:00010000:3.0:1763343273.859269:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2ae:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1763343273.859292:0:28399:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a27cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.859303:0:28399:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a27cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.859311:0:28399:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a27cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.859318:0:28399:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508aa00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343273.859322:0:28399:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a27cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.859332:0:28399:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a27cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.859351:0:28399:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a27cf lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.859358:0:28399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a27cf lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343273.859435:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2408:x1848998399812864:12345-192.168.201.40@tcp:4:lfs.0 Request processed in 2955us (3711us total) trans 17179871883 rc 0/0 00000100:00100000:3.0:1763343273.859445:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1708 00000100:00100000:2.0:1763343273.865905:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.866484:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399812992 00000100:00100000:1.0:1763343273.866542:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399812992 00000100:00100000:1.0:1763343273.867109:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10537 00000100:00100000:1.0:1763343273.867120:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57110:x1848998399812992:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:1.0:1763343273.867144:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.867168:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a27d6 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b491f3 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.867233:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a27dd lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343273.867247:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a27dd lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.867258:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a27dd lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.867279:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a27e4 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343273.867294:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a27e4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.867459:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a27e4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.867530:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a27eb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343273.867540:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a27eb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.867546:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a27eb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343273.867585:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1f9:0x0]: returning size 5 00000004:00200000:1.0:1763343273.867589:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343273.867606:0:7641:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a27eb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.867616:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a27eb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.867624:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a27dd lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.867630:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a27dd lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.867636:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a27dd lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.867641:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a27dd lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.867647:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a6a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.867651:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a27dd lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.867657:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a27dd lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.867668:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497eb00) 00010000:00010000:1.0:1763343273.867671:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.867676:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a27dd lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.867683:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a27dd lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.867696:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a27e4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.867701:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a27e4 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.867706:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a27e4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.867710:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a7e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.867713:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a27e4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.867717:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a27e4 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.867723:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c497e300) 00010000:00010000:1.0:1763343273.867725:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.867727:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a27e4 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.867732:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a27e4 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.867757:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a27d6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491f3 expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.867769:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a27eb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491f3 expref: 291 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.867775:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f9:0x0].0x0 (ffff9400c497ed00) 00010000:00010000:1.0:1763343273.867777:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343273.867779:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a6800, rc 0) 00000100:00100000:1.0:1763343273.867886:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57110:x1848998399812992:12345-192.168.201.40@tcp:101:rm.0 Request processed in 769us (1990us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343273.867893:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10537 00000100:00100000:1.0:1763343273.872515:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.873081:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399813248 00000100:00100000:2.0:1763343273.873092:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399813248 00000100:00100000:2.0:1763343273.873715:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10538 00000100:00100000:2.0:1763343273.873728:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57107:x1848998399813248:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:2.0:1763343273.873785:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343273.873813:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a273c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f8:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491ad expref: 291 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.873832:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:2.0:1763343273.873838:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343273.873905:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a27f2 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343273.873920:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a27f2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.873931:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a27f2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00010000:2.0:1763343273.874100:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006ba6d53f reply state 00000000e432544c transno 4294973510 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a27f2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.874113:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a27f2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.874120:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:2.0:1763343273.874123:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343273.874125:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343273.874214:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57107:x1848998399813248:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 488us (1709us total) trans 4294973510 rc 0/0 00000100:00100000:2.0:1763343273.874222:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10538 00000100:00100000:0.0:1763343273.875383:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.875536:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399813504 00000100:00100000:3.0:1763343273.875545:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399813504 00000100:00100000:3.0:1763343273.875602:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10539 00000100:00100000:3.0:1763343273.875611:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57110:x1848998399813504:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:3.0:1763343273.875655:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763343273.875677:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a27a5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491d7 expref: 292 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.875696:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a27eb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491f3 expref: 291 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.875711:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a2789 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1f9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491c9 expref: 290 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.875723:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f9:0x0].0x0 (ffff9400c497ed00) 00010000:00010000:3.0:1763343273.875732:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343273.875758:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a27f9 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343273.875769:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a27f9 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.875777:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a27f9 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.875788:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2800 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343273.875795:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2800 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.875800:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2800 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.875869:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2807 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343273.875881:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2807 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.875887:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2807 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000040:00080000:3.0:1763343273.876140:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1694, 64 off141184 00000004:00080000:3.0:1763343273.876148:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1067000123418ns, next at 1068000121327ns, rc = 0 00000040:00080000:3.0:1763343273.876172:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1686, 64 off140528 00000004:00080000:3.0:1763343273.876177:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1067000152040ns, next at 1068000150895ns, rc = 0 00000040:00080000:3.0:1763343273.876186:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1687, 64 off140592 00000040:00080000:3.0:1763343273.876196:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1695, 64 off141248 00010000:00010000:3.0:1763343273.876242:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a280e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343273.876252:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a280e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.876260:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a280e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.876267:0:33856:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a280e lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.876273:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a280e lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.876279:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a280e lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.876314:0:33856:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343273.876331:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2807 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.876338:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343273.876342:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2807 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.876346:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a280e lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.876350:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2807 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.876359:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb3e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343273.876364:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a280e lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.876366:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb3800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343273.876373:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2807 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.876376:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a280e lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.876384:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2807 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.876391:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f9:0x0].0x0 (ffff9401f669e500) 00010000:00010000:1.0:1763343273.876395:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763343273.876399:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a280e lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.876405:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f9:0x0].0x0 (ffff9401f669e500) 00010000:00010000:1.0:1763343273.876405:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a280e lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.876413:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763343273.876417:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2807 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.876421:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343273.876424:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2807 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.876425:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343273.876428:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343273.876536:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a27f9 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.876543:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a27f9 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.876548:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a27f9 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.876552:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508aa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343273.876555:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a27f9 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.876565:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a27f9 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.876572:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f669e900) 00010000:00010000:3.0:1763343273.876575:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343273.876577:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a27f9 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.876582:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a27f9 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:3.0:1763343273.876593:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000197ebf5b reply state 00000000db9365b1 transno 4294973511 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2800 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.876603:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2800 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343273.876608:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f669e000) 00010000:00010000:3.0:1763343273.876610:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343273.876612:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343273.876686:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57110:x1848998399813504:12345-192.168.201.40@tcp:36:rm.0 Request processed in 1074us (1308us total) trans 4294973511 rc 0/0 00000100:00100000:3.0:1763343273.876695:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10539 00000100:00100000:0.0:1763343273.881174:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.882190:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399813632 00000100:00100000:3.0:1763343273.882203:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399813632 00000100:00100000:3.0:1763343273.882331:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7143 00000100:00100000:3.0:1763343273.882344:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:57107:x1848998399813632:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343273.882587:0:27798:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343273.882616:0:27798:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2815 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b491fa expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343273.882647:0:27798:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2ae:0x0] initial LVB size: 4096, mtime: 0x691a7ba9, atime: 0x0, ctime: 0x691a7ba9, blocks: 0x8 00010000:00010000:3.0:1763343273.882670:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343273.882673:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343273.882680:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2815 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491fa expref: 14 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.882698:0:27798:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2815 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491fa expref: 14 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.882712:0:27798:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400cbad3c00, rc 0) 00000100:00100000:3.0:1763343273.882779:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:57107:x1848998399813632:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 438us (1616us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343273.882787:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7143 00000100:00100000:1.0:1763343273.885150:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.886277:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399813760 00000100:00100000:3.0:1763343273.886301:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399813760 00000100:00100000:3.0:1763343273.886366:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7144 00000100:00100000:3.0:1763343273.886376:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:57107:x1848998399813760:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343273.886392:0:27798:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343273.886416:0:27798:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a281c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49201 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343273.886438:0:27798:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343273.886458:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343273.886460:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343273.886467:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a281c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49201 expref: 19 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.886488:0:27798:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a281c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49201 expref: 19 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.886501:0:27798:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c6b99600, rc 0) 00000100:00100000:3.0:1763343273.886551:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:57107:x1848998399813760:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 177us (1410us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343273.886558:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7144 00000100:00100000:0.0:1763343273.891581:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.891624:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.891649:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399813888 00000100:00100000:3.0:1763343273.891661:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399813888 00002000:00010000:3.0:1763343273.891701:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/686 (5->18446744073709551615) 00002000:00100000:3.0:1763343273.891706:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c514df80 with x1848998399813888 ext(5->18446744073709551615) 00000100:00100000:0.0:1763343273.891706:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00002000:00010000:3.0:1763343273.891718:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c514df80. 00000100:00100000:3.0:1763343273.891741:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399814016 00000100:00100000:3.0:1763343273.891744:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399814016 00002000:00010000:3.0:1763343273.891756:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/685 (0->18446744073709551615) 00002000:00100000:3.0:1763343273.891759:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400cc5dfb80 with x1848998399814016 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343273.891765:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400cc5dfb80. 00000100:00100000:3.0:1763343273.891789:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1709 00000100:00100000:3.0:1763343273.891798:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399813888:12345-192.168.201.40@tcp:10:lfs.0 00000100:00100000:1.0:1763343273.891907:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399814144 00000100:00100000:1.0:1763343273.891913:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399814144 00000100:00100000:1.0:1763343273.891953:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10540 00000100:00100000:1.0:1763343273.891963:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57111:x1848998399814144:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343273.891980:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.892004:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2823 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49208 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.892110:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a282a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343273.892125:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a282a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.892138:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a282a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.892150:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2831 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343273.892157:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2831 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.892163:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2831 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00002000:00010000:3.0:1763343273.892176:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2ae:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:3.0:1763343273.892181:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2ae:0x0] updating lvb mtime from disk: 1763343273 -> 1763343273 00002000:00010000:3.0:1763343273.892183:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2ae:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343273.892185:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2ae:0x0] updating lvb ctime from disk: 1763343273 -> 1763343273 00002000:00010000:3.0:1763343273.892188:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2ae:0x0] updating lvb blocks from disk: 8 -> 8 00010000:00010000:1.0:1763343273.892196:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a282a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.892204:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a282a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.892210:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a282a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.892216:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a282a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.892221:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ec00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.892225:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a282a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.892235:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a282a lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.892248:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497eb00) 00010000:00010000:1.0:1763343273.892251:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343273.892255:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1710 00010000:00010000:1.0:1763343273.892259:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a282a lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.892267:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a282a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000100:00100000:0.0:1763343273.892268:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2407:x1848998399814016:12345-192.168.201.40@tcp:10:lfs.0 00010000:00010000:1.0:1763343273.892302:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2831 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.892309:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2831 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.892319:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2831 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.892324:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb3800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.892327:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2831 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.892333:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2831 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.892341:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f669e000) 00010000:00010000:1.0:1763343273.892344:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.892347:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2831 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.892352:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2831 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343273.892381:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2823 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49208 expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.892391:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497eb00) 00010000:00010000:1.0:1763343273.892393:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.892396:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2823 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49208 expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.892408:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d1e9ea00, rc 0) 00000100:00100000:1.0:1763343273.892481:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57111:x1848998399814144:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 521us (773us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343273.892488:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10540 00002000:00010000:0.0:1763343273.892681:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2ad:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343273.892684:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2ad:0x0] updating lvb mtime from disk: 0 -> 1763343273 00002000:00010000:0.0:1763343273.892686:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2ad:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343273.892689:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2ad:0x0] updating lvb ctime from disk: 0 -> 1763343273 00002000:00010000:0.0:1763343273.892691:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2ad:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343273.892712:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399814016:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 448us (1087us total) trans 21474839154 rc 0/0 00000100:00100000:0.0:1763343273.892718:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1710 00002000:00010000:0.0:1763343273.892722:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/685 (0->18446744073709551615) 00002000:00100000:0.0:1763343273.892724:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400cc5dfb80 with x1848998399814016 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343273.892729:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400cc5dfb80. 00000100:00100000:2.0:1763343273.894445:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998399813888:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 2641us (2867us total) trans 17179871884 rc 0/0 00000100:00100000:2.0:1763343273.894456:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1709 00002000:00010000:2.0:1763343273.894463:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/686 (5->18446744073709551615) 00002000:00100000:2.0:1763343273.894467:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c514df80 with x1848998399813888 ext(5->18446744073709551615) 00002000:00010000:2.0:1763343273.894476:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c514df80. 00000100:00100000:0.0:1763343273.895554:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.896312:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399814272 00000100:00100000:1.0:1763343273.896325:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399814272 00000100:00100000:1.0:1763343273.896377:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10541 00000100:00100000:1.0:1763343273.896386:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57111:x1848998399814272:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343273.896406:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.896428:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2838 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4920f expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.896499:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a283f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00000100:00100000:2.0:1763343273.896514:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:1.0:1763343273.896514:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a283f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.896531:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a283f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:2.0:1763343273.896542:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399814528 00000100:00100000:2.0:1763343273.896547:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399814528 00010000:00010000:1.0:1763343273.896547:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2846 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343273.896559:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2846 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.896567:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2846 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:2.0:1763343273.896580:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10542 00000100:00100000:2.0:1763343273.896589:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57107:x1848998399814528:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:1.0:1763343273.896603:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a283f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.896613:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a283f lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.896620:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a283f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.896626:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a6800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.896630:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a283f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.896638:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a283f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.896642:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a284d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343273.896650:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497e300) 00010000:00010000:2.0:1763343273.896654:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a284d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.896655:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.896662:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a283f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343273.896667:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a284d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.896670:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a283f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.896694:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2846 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.896713:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2846 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.896719:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2846 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.896723:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a7200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.896726:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2846 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.896731:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2846 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.896739:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f669e000) 00010000:00010000:1.0:1763343273.896742:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.896745:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2846 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.896752:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2846 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343273.896782:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2838 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4920f expref: 294 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.896792:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497e300) 00010000:00010000:1.0:1763343273.896795:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.896800:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2838 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4920f expref: 294 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.896814:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c7bb3e00, rc 0) 00000100:00100000:1.0:1763343273.896882:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57111:x1848998399814272:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 496us (1332us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343273.896890:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10541 00000004:00010000:2.0:1763343273.897478:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004b506608 reply state 00000000b1a6a8f6 transno 4294973512 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a284d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.897494:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a284d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.897501:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:2.0:1763343273.897504:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343273.897507:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343273.897580:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57107:x1848998399814528:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 991us (1066us total) trans 4294973512 rc 0/0 00000100:00100000:2.0:1763343273.897588:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10542 00000100:00100000:0.0:1763343273.902372:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.902437:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.903806:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399814656 00000100:00100000:2.0:1763343273.903819:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399814656 00000100:00100000:2.0:1763343273.903896:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10543 00000100:00100000:2.0:1763343273.903909:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57111:x1848998399814656:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343273.903931:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.903958:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a2854 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49216 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.904020:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a285b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343273.904060:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a285b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.904072:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a285b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:2.0:1763343273.904116:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763343273.904121:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763343273.904156:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a2854 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49216 expref: 295 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.904178:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a285b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49216 expref: 294 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.904188:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53400) 00010000:00010000:2.0:1763343273.904192:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763343273.904195:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8692c00, rc 0) 00000100:00100000:2.0:1763343273.904263:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57111:x1848998399814656:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 358us (1901us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.904271:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10543 00000100:00100000:3.0:1763343273.904298:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399814784 00000100:00100000:3.0:1763343273.904304:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399814784 00000100:00100000:3.0:1763343273.908004:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.908232:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399814912 00000100:00100000:1.0:1763343273.908241:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399814912 00000100:00100000:1.0:1763343273.908311:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10544 00000100:00100000:1.0:1763343273.908321:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57111:x1848998399814912:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343273.908346:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.908370:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2862 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49224 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.908467:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2869 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343273.908482:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2869 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.908494:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2869 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.908522:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2870 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343273.908530:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2870 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.908537:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2870 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.908580:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2869 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.908587:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2869 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.908593:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2869 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.908599:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2869 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.908604:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a7e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.908608:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2869 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.908616:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2869 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.908628:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53400) 00010000:00010000:1.0:1763343273.908631:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.908635:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2869 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.908641:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2869 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.908652:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2870 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.908657:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2870 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.908663:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2870 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.908667:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c7ec0600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.908670:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2870 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.908679:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2870 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.908685:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f669e000) 00010000:00010000:1.0:1763343273.908688:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.908690:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2870 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.908696:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2870 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.908722:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2862 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49224 expref: 295 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.908733:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53400) 00010000:00010000:1.0:1763343273.908735:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.908738:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2862 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49224 expref: 295 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.908750:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a6a00, rc 0) 00000100:00100000:1.0:1763343273.908991:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57111:x1848998399814912:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 670us (997us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343273.908999:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10544 00000100:00100000:2.0:1763343273.909452:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7145 00000100:00100000:2.0:1763343273.909463:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:57107:x1848998399814784:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343273.909476:0:27798:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.909490:0:27798:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a2877 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4921d expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.909513:0:27798:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9401d121fc00/0x9104b1ba770a2758 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491bb expref: 21 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343273.909521:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.909523:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.909527:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a2877 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4921d expref: 21 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.909560:0:27798:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9401d121fc00/0x9104b1ba770a2758 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491bb expref: 21 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343273.909574:0:27798:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9401d121fc00/0x9104b1ba770a2758 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491bb expref: 21 pid: 8413 timeout: 1167 lvb_type: 1 00000100:00100000:2.0:1763343273.909586:0:27798:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6489c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27798:1848998412956032:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343273.909666:0:27798:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c546e300 going to sleep for 11 seconds 00000100:00100000:3.0:1763343273.912565:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.912758:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399815168 00000100:00100000:1.0:1763343273.912769:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399815168 00000100:00100000:0.0:1763343273.913683:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.913974:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10545 00000100:00100000:2.0:1763343273.914019:0:27798:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6489c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27798:1848998412956032:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343273.914066:0:27798:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a2877 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4921d expref: 21 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.914085:0:27798:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8693e00, rc 0) 00000100:00100000:2.0:1763343273.914150:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:57107:x1848998399814784:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 4688us (11712us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.914159:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7145 00000100:00100000:2.0:1763343273.914190:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399815296 00000100:00100000:2.0:1763343273.914195:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399815296 00010000:00010000:2.0:1763343273.914218:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9401d121fc00/0x9104b1ba770a2758 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491bb expref: 21 pid: 8413 timeout: 1167 lvb_type: 1 00000100:00100000:2.0:1763343273.914250:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3420 00000100:00100000:2.0:1763343273.914257:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399815296:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343273.914287:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343273.914309:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9401d121fc00/0x9104b1ba770a2758 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491bb expref: 21 pid: 8413 timeout: 1167 lvb_type: 1 00010000:00010000:2.0:1763343273.914321:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9401d121fc00/0x9104b1ba770a2758 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491bb expref: 21 pid: 8413 timeout: 1167 lvb_type: 1 00010000:00010000:2.0:1763343273.914347:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401d121fc00/0x9104b1ba770a2758 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491bb expref: 21 pid: 8413 timeout: 1167 lvb_type: 1 00010000:00010000:2.0:1763343273.914359:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.914361:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.914368:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a2877 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4921d expref: 20 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.914377:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a2877 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4921d expref: 20 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.914419:0:35278:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a2877 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4921d expref: 20 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343273.914434:0:35278:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6489c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35278:1848998412956160:192.168.201.40@tcp:105: 00000100:00100000:2.0:1763343273.914489:0:35278:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c546e300 going to sleep for 11 seconds 00000100:00100000:2.0:1763343273.914504:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57111:x1848998399815168:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343273.914523:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.914525:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343273.914540:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a285b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49216 expref: 294 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.914552:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53400) 00010000:00010000:2.0:1763343273.914563:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343273.914578:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a287e lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4922b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.914675:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2885 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343273.914687:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2885 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.914697:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2885 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.914706:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a288c lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343273.914717:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a288c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.914724:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a288c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.915169:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2893 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343273.915178:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2893 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.915186:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2893 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:2.0:1763343273.915196:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1fb:0x0]: returning size 0 00010000:00010000:2.0:1763343273.915222:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2885 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.915229:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2885 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.915235:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2885 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.915241:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2885 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.915247:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fca00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.915251:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2885 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.915259:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2885 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.915272:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53600) 00010000:00010000:2.0:1763343273.915275:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.915279:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2885 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.915298:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2885 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000004:00010000:2.0:1763343273.915308:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000dae8f701 reply state 00000000ef8e68c5 transno 4294973513 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a288c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.915319:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a288c lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.915325:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f669e000) 00010000:00010000:2.0:1763343273.915327:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343273.915330:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343273.915359:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a287e lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4922b expref: 296 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.915376:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2893 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4922b expref: 295 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.915383:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fb:0x0].0x0 (ffff9401edc53900) 00010000:00010000:2.0:1763343273.915386:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343273.915388:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fdc00, rc 0) 00000100:00100000:2.0:1763343273.915446:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57111:x1848998399815168:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1462us (3439us total) trans 4294973513 rc 0/0 00000100:00100000:2.0:1763343273.915454:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10545 00000100:00100000:0.0:1763343273.918608:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.918643:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.918787:0:35278:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6489c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:35278:1848998412956160:192.168.201.40@tcp:105: 00010000:00010000:2.0:1763343273.918813:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343273.918873:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399815296:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 4614us (5191us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.918886:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3420 00000100:00100000:0.0:1763343273.918927:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399815424 00000100:00100000:0.0:1763343273.918935:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399815424 00000100:00100000:0.0:1763343273.918984:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7146 00000100:00100000:0.0:1763343273.918994:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2408:x1848998399815424:12345-192.168.201.40@tcp:2:lfs.0 00002000:00010000:0.0:1763343273.919169:0:27798:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2ac:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763343273.919172:0:27798:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2ac:0x0] updating lvb mtime from disk: 1763343273 -> 1763343273 00002000:00010000:0.0:1763343273.919174:0:27798:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2ac:0x0] updating lvb atime from disk: 0 -> 1763343272 00002000:00010000:0.0:1763343273.919176:0:27798:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2ac:0x0] updating lvb ctime from disk: 1763343273 -> 1763343273 00002000:00010000:0.0:1763343273.919179:0:27798:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2ac:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763343273.919204:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399815424:12345-192.168.201.40@tcp:2:lfs.0 Request processed in 212us (561us total) trans 21474839155 rc 0/0 00000100:00100000:0.0:1763343273.919211:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7146 00000100:00100000:1.0:1763343273.919304:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399815680 00000100:00100000:1.0:1763343273.919310:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399815680 00000100:00100000:1.0:1763343273.919354:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10546 00000100:00100000:1.0:1763343273.919368:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57111:x1848998399815680:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343273.919386:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.919405:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a28a1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1fb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49232 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.919502:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a28a8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343273.919517:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2893 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4922b expref: 297 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.919527:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a28a8 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.919562:0:9827:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2893 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4922b expref: 297 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.919576:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2893 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4922b expref: 297 pid: 6524 timeout: 1167 lvb_type: 0 00000100:00100000:1.0:1763343273.919591:0:9827:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc19500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412956288:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343273.919663:0:9827:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343273.922203:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.922244:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.922334:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc19500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412956288:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343273.922341:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399815808 00000100:00100000:2.0:1763343273.922349:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399815808 00010000:00010000:2.0:1763343273.922382:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2893 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4922b expref: 298 pid: 6524 timeout: 1167 lvb_type: 0 00000100:00100000:2.0:1763343273.922420:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3421 00000100:00100000:2.0:1763343273.922429:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8392850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:2408:x1848998399815808:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343273.922442:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343273.922448:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2893 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4922b expref: 298 pid: 6524 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343273.922461:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2893 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4922b expref: 298 pid: 6524 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343273.922485:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2893 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4922b expref: 298 pid: 6524 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343273.922500:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fb:0x0].0x0 (ffff9401edc53900) 00010000:00010000:2.0:1763343273.922505:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a28a8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.922513:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a28a8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.922520:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a28a8 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.922537:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343273.922551:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a28a8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.922560:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a28a8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.922564:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a28a8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:2.0:1763343273.922579:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8392850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:2408:x1848998399815808:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 152us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.922586:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3421 00000004:00200000:1.0:1763343273.922592:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1fb:0x0]: returning size 0 00000004:00080000:1.0:1763343273.922788:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2b0:0x0], index 0: 0 00000004:00080000:1.0:1763343273.922796:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2b1:0x0], index 1: 0 00000004:00080000:1.0:1763343273.922800:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2b2:0x0], index 1: 0 00000004:00080000:1.0:1763343273.922804:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2b1:0x0], index 0: 0 00000100:00100000:0.0:1763343273.922824:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399816064 00000100:00100000:0.0:1763343273.922828:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399816064 00000100:00100000:0.0:1763343273.922864:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3717 00000100:00100000:0.0:1763343273.922871:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8441850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57107:x1848998399816064:12345-192.168.201.40@tcp:35:lfs.0 00010000:00010000:1.0:1763343273.922906:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a28a8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.922914:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a28a8 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00000004:00010000:0.0:1763343273.922918:0:19639:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x1f8:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a269b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49175 expref: 298 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.922921:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a28a8 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.922927:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c7ec0c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.922931:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a28a8 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.922937:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a28a8 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.922944:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fb:0x0].0x0 (ffff9401edc53900) 00010000:00010000:1.0:1763343273.922946:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343273.922947:0:19639:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a28b6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19639 initiator: MDT0 00010000:00010000:1.0:1763343273.922950:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a28a8 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.922956:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a28a8 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.922958:0:19639:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a270b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4919f expref: 298 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.922966:0:19639:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a28b6 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343273.922991:0:19639:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a270b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4919f expref: 298 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.922997:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a28a1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49232 expref: 298 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.923002:0:19639:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a270b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4919f expref: 298 pid: 33856 timeout: 1167 lvb_type: 0 00010000:00010000:1.0:1763343273.923010:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fb:0x0].0x0 (ffff9401edc53900) 00010000:00010000:1.0:1763343273.923012:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:0.0:1763343273.923015:0:19639:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c8bc0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998412956416:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343273.923016:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a28a1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49232 expref: 298 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.923060:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c7ec0600, rc 0) 00000100:00100000:1.0:1763343273.923087:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57111:x1848998399815680:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3726us (4489us total) trans 4294973514 rc 301/301 00000100:00100000:0.0:1763343273.923090:0:19639:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c3be3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1763343273.923093:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10546 00000100:00100000:2.0:1763343273.923261:0:9931:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6489c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9931:1848998412956544:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1763343273.923433:0:9931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343273.923459:0:9931:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c546e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343273.923520:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412956544 00000100:00100000:0.0:1763343273.923526:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412956544 00000100:00100000:0.0:1763343273.923567:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7147 00000100:00100000:0.0:1763343273.923574:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9931:x1848998412956544:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1763343273.923605:0:8413:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 706 00000100:00100000:0.0:1763343273.925195:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9931:x1848998412956544:12345-0@lo:5:osp-pre-1-1.0 Request processed in 1616us (1830us total) trans 17179871885 rc 0/0 00000100:00100000:0.0:1763343273.925207:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7147 00000100:00100000:1.0:1763343273.925326:0:9931:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179871881 gen 2 00000004:00080000:1.0:1763343273.925333:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bfd880, transno 17179871825 00000004:00080000:1.0:1763343273.925348:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6e8fb80, transno 17179871826 00000004:00080000:1.0:1763343273.925351:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6e8d180, transno 17179871827 00000004:00080000:1.0:1763343273.925353:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6e8e680, transno 17179871828 00000004:00080000:1.0:1763343273.925355:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bfc700, transno 17179871829 00000004:00080000:1.0:1763343273.925358:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bfea00, transno 17179871830 00000004:00080000:1.0:1763343273.925371:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bfd500, transno 17179871831 00000004:00080000:1.0:1763343273.925373:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bfe680, transno 17179871832 00000004:00080000:1.0:1763343273.925376:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c390ce00, transno 17179871834 00000004:00080000:1.0:1763343273.925378:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bfc000, transno 17179871835 00000004:00080000:1.0:1763343273.925380:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bfce00, transno 17179871836 00000004:00080000:1.0:1763343273.925382:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c390fb80, transno 17179871837 00000004:00080000:1.0:1763343273.925384:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5955880, transno 17179871840 00000004:00080000:1.0:1763343273.925386:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5955500, transno 17179871841 00000004:00080000:1.0:1763343273.925389:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b9f480, transno 17179871842 00000004:00080000:1.0:1763343273.925391:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b9ce00, transno 17179871843 00000004:00080000:1.0:1763343273.925394:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400cc5de300, transno 17179871847 00000004:00080000:1.0:1763343273.925397:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400cc5de680, transno 17179871848 00000004:00080000:1.0:1763343273.925400:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400cc5dea00, transno 17179871849 00000004:00080000:1.0:1763343273.925402:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400cc5ded80, transno 17179871850 00000004:00080000:1.0:1763343273.925404:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b1a680, transno 17179871851 00000004:00080000:1.0:1763343273.925406:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b19180, transno 17179871852 00000004:00080000:1.0:1763343273.925408:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b19c00, transno 17179871853 00000004:00080000:1.0:1763343273.925411:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b1b480, transno 17179871854 00000004:00080000:1.0:1763343273.925413:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c7ef5880, transno 17179871857 00000004:00080000:1.0:1763343273.925416:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c7ef7b80, transno 17179871858 00000004:00080000:1.0:1763343273.925418:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6401180, transno 17179871859 00000004:00080000:1.0:1763343273.925421:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6401880, transno 17179871860 00000004:00080000:1.0:1763343273.925424:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9832300, transno 17179871864 00000004:00080000:1.0:1763343273.925426:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c7ef4e00, transno 17179871865 00000004:00080000:1.0:1763343273.925428:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9833b80, transno 17179871866 00000004:00080000:1.0:1763343273.925431:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9832d80, transno 17179871867 00000004:00080000:1.0:1763343273.925433:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5dcbb80, transno 17179871868 00000004:00080000:1.0:1763343273.925435:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5dcb800, transno 17179871869 00000004:00080000:1.0:1763343273.925438:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5dc8000, transno 17179871870 00000004:00080000:1.0:1763343273.925440:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c511c380, transno 17179871871 00000004:00080000:1.0:1763343273.925443:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c7919880, transno 17179871873 00000004:00080000:1.0:1763343273.925445:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c791bb80, transno 17179871874 00000004:00080000:1.0:1763343273.925448:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c791b480, transno 17179871875 00000004:00080000:1.0:1763343273.925450:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c791a300, transno 17179871876 00000004:00080000:1.0:1763343273.925452:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6280380, transno 17179871878 00000004:00080000:1.0:1763343273.925455:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6282300, transno 17179871879 00000004:00080000:1.0:1763343273.925457:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6280a80, transno 17179871880 00000004:00080000:1.0:1763343273.925460:0:9931:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6281c00, transno 17179871881 00000100:00100000:1.0:1763343273.925467:0:9931:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9401f6489c00 x1848998412956544/t17179871885(17179871885) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1763343289 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1763343273.925483:0:9931:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6489c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9931:1848998412956544:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1763343273.925950:0:9930:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 2 changes, 0 in progress, 0 in flight, 44 done 00000004:00080000:1.0:1763343273.926189:0:9931:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x2b2:0x0]-[0x2c0000400:0x2e1:0x0] 00000100:00100000:0.0:1763343273.926255:0:19639:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c8bc0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998412956416:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343273.926272:0:19639:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a28b6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00000100:00100000:1.0:1763343273.927464:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.928141:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.928844:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399816448 00000100:00100000:2.0:1763343273.928858:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399816448 00000100:00100000:2.0:1763343273.928910:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3718 00000100:00100000:2.0:1763343273.928920:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57111:x1848998399816448:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343273.929243:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57111:x1848998399816448:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 323us (1102us total) trans 4294973515 rc 0/0 00000100:00100000:2.0:1763343273.929250:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3718 00000100:00100000:3.0:1763343273.929958:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399816192 00000100:00100000:3.0:1763343273.929966:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399816192 00010000:00010000:0.0:1763343273.930079:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a270b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4919f expref: 298 pid: 33856 timeout: 1167 lvb_type: 0 00000100:00100000:0.0:1763343273.930112:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3422 00000100:00100000:0.0:1763343273.930119:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:2407:x1848998399816192:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343273.930131:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343273.930137:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a270b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4919f expref: 298 pid: 33856 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343273.930148:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a270b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4919f expref: 298 pid: 33856 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343273.930169:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a270b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4919f expref: 298 pid: 33856 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343273.930183:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:0.0:1763343273.930188:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a28b6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343273.930197:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a28b6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343273.930203:0:7904:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a28b6 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343273.930229:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343273.930266:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:2407:x1848998399816192:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 147us (2809us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343273.930277:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3422 00010000:00010000:1.0:1763343273.930512:0:19639:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a28b6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00010000:00010000:1.0:1763343273.930520:0:19639:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a28b6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00000040:00080000:1.0:1763343273.930740:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1688, 88 off140680 00000004:00080000:1.0:1763343273.930748:0:19639:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1067054722848ns, next at 1068000150895ns, rc = 0 00000040:00080000:1.0:1763343273.931451:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1696, 88 off141336 00000004:00080000:1.0:1763343273.931461:0:19639:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1067055436415ns, next at 1068000121327ns, rc = 0 00000040:00080000:1.0:1763343273.931498:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1697, 88 off141424 00000004:00080000:1.0:1763343273.931503:0:19639:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1067055478599ns, next at 1068000121327ns, rc = 0 00000040:00080000:1.0:1763343273.931515:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1689, 88 off140768 00000004:00080000:1.0:1763343273.931519:0:19639:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1067055494909ns, next at 1068000150895ns, rc = 0 00000100:00100000:1.0:1763343273.932110:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.932220:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399816704 00000100:00100000:0.0:1763343273.932230:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399816704 00000100:00100000:0.0:1763343273.932278:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3719 00000100:00100000:0.0:1763343273.932297:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57111:x1848998399816704:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343273.932750:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57111:x1848998399816704:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 452us (641us total) trans 4294973517 rc 0/0 00000100:00100000:0.0:1763343273.932757:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3719 00000001:00080000:3.0:1763343273.933441:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973516 is committed 00000004:00080000:3.0:1763343273.933448:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1082 committed 00000004:00080000:3.0:1763343273.933464:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1090 committed 00000004:00080000:3.0:1763343273.933474:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1089 committed 00000004:00080000:3.0:1763343273.933476:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1081 committed 00000004:00080000:3.0:1763343273.933488:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1080 committed 00000004:00080000:3.0:1763343273.933491:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1088 committed 00000004:00010000:3.0:1763343273.933768:0:19639:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e188676e reply state 00000000e6e20325 transno 4294973516 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a28b6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343273.933793:0:19639:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a28b6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343273.933802:0:19639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:3.0:1763343273.933805:0:19639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1763343273.933809:0:19639:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343273.933813:0:19639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:3.0:1763343273.933816:0:19639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763343273.933823:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a269b lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49175 expref: 290 pid: 6524 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343273.933879:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412956672:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343273.933937:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343273.933970:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763343273.933976:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412956800:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343273.933995:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343273.934044:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412956928:0@lo:2:osp-syn-1-1.0 00010000:00080000:3.0:1763343273.934072:0:19639:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763343273.934085:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8441850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57107:x1848998399816064:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 11214us (11839us total) trans 4294973516 rc 0/0 00000100:00100000:3.0:1763343273.934094:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3717 00010000:00010000:3.0:1763343273.934146:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a28b6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343273.934155:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a28b6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343273.934162:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a28b6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343273.934168:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343273.934173:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a28b6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343273.934185:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a28b6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343273.934197:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:3.0:1763343273.934200:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343273.934203:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a28b6 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343273.934209:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a28b6 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343273.934225:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a27f2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.934232:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a27f2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.934237:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a27f2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.934241:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85ab400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.934244:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a27f2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.934252:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a27f2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.934261:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:0.0:1763343273.934263:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.934266:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a27f2 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.934272:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a27f2 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.934292:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2800 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.934298:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2800 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.934351:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2800 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.934357:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508be00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.934359:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2800 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.934365:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2800 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.934373:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f669e000) 00010000:00010000:0.0:1763343273.934375:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.934378:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2800 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.934382:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a2800 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343273.934393:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a284d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.934398:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a284d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.934402:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a284d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.934406:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85aa600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.934408:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a284d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.934413:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a284d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.934419:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:0.0:1763343273.934421:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.934423:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a284d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.934428:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a284d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1f8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343273.934436:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a288c lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.934440:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a288c lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.934445:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a288c lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.934454:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fd800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.934457:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a288c lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.934462:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a288c lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.934469:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f669e000) 00010000:00010000:0.0:1763343273.934471:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.934474:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a288c lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.934479:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a288c lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000100:00100000:2.0:1763343273.934836:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343273.934870:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412957440:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343273.934896:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343273.934924:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1763343273.934930:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412957056:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343273.934951:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343273.934970:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412957568:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343273.934975:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412956672 00000100:00100000:3.0:1763343273.934983:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412956672 00000100:00100000:2.0:1763343273.934990:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343273.935015:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412956800 00000100:00100000:2.0:1763343273.935016:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412957312:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343273.935018:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412956800 00000100:00100000:3.0:1763343273.935056:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412956928 00000100:00100000:2.0:1763343273.935058:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343273.935059:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412956928 00000100:00100000:3.0:1763343273.935072:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412957440 00000100:00100000:3.0:1763343273.935074:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412957440 00000100:00100000:2.0:1763343273.935075:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763343273.935080:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412957184:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343273.935084:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412957056 00000100:00100000:3.0:1763343273.935086:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412957056 00000100:00100000:3.0:1763343273.935094:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412957568 00000100:00100000:3.0:1763343273.935096:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412957568 00000100:00100000:2.0:1763343273.935100:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343273.935103:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412957312 00000100:00100000:3.0:1763343273.935105:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412957312 00000100:00100000:3.0:1763343273.935113:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412957184 00000100:00100000:3.0:1763343273.935115:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412957184 00000100:00100000:2.0:1763343273.935118:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7148 00000100:00100000:3.0:1763343273.935126:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7149 00000100:00100000:2.0:1763343273.935127:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+9:3661:x1848998412956672:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343273.935131:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3661:x1848998412956800:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763343273.935150:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:688 count 1 00002000:00080000:2.0:1763343273.935150:0:35281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:687 count 1 00010000:00010000:2.0:1763343273.935171:0:35281:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a28bd lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2af:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343273.935176:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343273.935180:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a28c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.935187:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343273.935189:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.935189:0:35281:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a27ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491de expref: 14 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.935194:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a28c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.935195:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343273.935197:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343273.935200:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a28bd lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.935206:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a28c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.935213:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a28c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.935219:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a28c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.935224:0:35281:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a27ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491de expref: 14 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.935235:0:35266:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343273.935237:0:35281:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a27ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491de expref: 14 pid: 27798 timeout: 1167 lvb_type: 0 00000100:00100000:2.0:1763343273.935247:0:35281:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9832300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35281:1848998412957696:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343273.935298:0:35281:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c546e480 going to sleep for 11 seconds 00000100:00100000:2.0:1763343273.935322:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7150 00000100:00100000:2.0:1763343273.935328:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+9:3659:x1848998412956928:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343273.935346:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7151 00000100:00100000:2.0:1763343273.935352:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+24:3659:x1848998412957440:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1763343273.935451:0:27798:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2ac:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763343273.935455:0:27798:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2ac:0x0] updating lvb mtime from disk: 1763343273 -> 1763343273 00002000:00010000:2.0:1763343273.935458:0:27798:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2ac:0x0] updating lvb atime from disk: 1763343272 -> 1763343272 00002000:00010000:2.0:1763343273.935460:0:27798:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2ac:0x0] updating lvb ctime from disk: 1763343273 -> 1763343273 00002000:00010000:2.0:1763343273.935463:0:27798:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2ac:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763343273.935497:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+25:3659:x1848998412957440:12345-0@lo:2:osp-syn-0-1.0 Request processed in 144us (598us total) trans 21474839156 rc 0/0 00000100:00100000:2.0:1763343273.935504:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7151 00000100:00100000:2.0:1763343273.935518:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7152 00000100:00100000:2.0:1763343273.935524:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+10:3659:x1848998412957056:12345-0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1763343273.935553:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401edc1a300/2, rc 0, transno 21474839156 00000100:00100000:2.0:1763343273.935559:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412957440:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343273.935575:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7153 00000100:00100000:2.0:1763343273.935581:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401ede68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+24:3659:x1848998412957568:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1763343273.935633:0:8413:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2ad:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343273.935636:0:8413:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2ad:0x0] updating lvb mtime from disk: 1763343273 -> 1763343273 00002000:00010000:2.0:1763343273.935640:0:8413:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2ad:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343273.935642:0:8413:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2ad:0x0] updating lvb ctime from disk: 1763343273 -> 1763343273 00002000:00010000:2.0:1763343273.935644:0:8413:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2ad:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343273.935670:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401ede68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+25:3659:x1848998412957568:12345-0@lo:2:osp-syn-0-1.0 Request processed in 89us (679us total) trans 21474839157 rc 0/0 00000100:00100000:2.0:1763343273.935676:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7153 00000100:00100000:2.0:1763343273.935688:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7154 00000100:00100000:2.0:1763343273.935694:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+24:3662:x1848998412957312:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763343273.935703:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:687 count 1 00002000:00010000:2.0:1763343273.935717:0:8413:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343273.935723:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fca00/0x9104b1ba770a28cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.935732:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.935733:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343273.935737:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fca00/0x9104b1ba770a28cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.935746:0:8413:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fca00/0x9104b1ba770a28cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.935754:0:8413:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fca00/0x9104b1ba770a28cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.935761:0:8413:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fca00/0x9104b1ba770a28cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.935774:0:8413:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1763343273.935903:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+25:3662:x1848998412957312:12345-0@lo:6:osp-syn-0-1.0 Request processed in 209us (844us total) trans 21474839158 rc 0/0 00000100:00100000:2.0:1763343273.935909:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7154 00000100:00100000:2.0:1763343273.935921:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7155 00000100:00100000:2.0:1763343273.935927:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+24:3662:x1848998412957184:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763343273.935938:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:686 count 1 00010000:00010000:2.0:1763343273.935948:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fd600/0x9104b1ba770a28d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.935959:0:8413:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90600/0x9104b1ba770a27ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491e5 expref: 20 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.935965:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343273.935968:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343273.935970:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fd600/0x9104b1ba770a28d2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.935990:0:8413:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90600/0x9104b1ba770a27ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491e5 expref: 20 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.935999:0:8413:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90600/0x9104b1ba770a27ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491e5 expref: 20 pid: 8413 timeout: 1167 lvb_type: 0 00000100:00100000:2.0:1763343273.936008:0:8413:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9833b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412957824:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343273.936059:0:8413:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c546ef00 going to sleep for 11 seconds 00000004:00080000:2.0:1763343273.936081:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401edc18e00/2, rc 0, transno 21474839158 00000100:00100000:2.0:1763343273.936086:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412957312:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1763343273.936102:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401edc1bb80/2, rc 0, transno 21474839157 00000100:00100000:2.0:1763343273.936106:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412957568:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343273.936583:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+10:3661:x1848998412956800:12345-0@lo:6:osp-syn-1-1.0 Request processed in 1448us (2583us total) trans 17179871886 rc 0/0 00000100:00100000:3.0:1763343273.936592:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7149 00010000:00010000:3.0:1763343273.936626:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763343273.936635:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a28c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.936644:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b98200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343273.936650:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a28c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.936658:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a28c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.936675:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a28c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.936682:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a28c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.936697:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343273.936701:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fca00/0x9104b1ba770a28cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.936707:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fca00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343273.936710:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fca00/0x9104b1ba770a28cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.936722:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fca00/0x9104b1ba770a28cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.936733:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fca00/0x9104b1ba770a28cb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.936740:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fca00/0x9104b1ba770a28cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.936752:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343273.936754:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343273.936755:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343273.936780:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343273.936811:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b9ce00/2, rc 0, transno 17179871886 00000100:00100000:3.0:1763343273.936818:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412956800:0@lo:6:osp-syn-1-1.0 00002000:00010000:2.0:1763343273.938897:0:8414:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2ad:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343273.938897:0:27798:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2ae:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763343273.938905:0:8414:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2ad:0x0] updating lvb mtime from disk: 1763343272 -> 1763343272 00002000:00010000:0.0:1763343273.938905:0:27798:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2ae:0x0] updating lvb mtime from disk: 1763343273 -> 1763343273 00002000:00010000:2.0:1763343273.938908:0:8414:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2ad:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343273.938908:0:27798:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2ae:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343273.938911:0:8414:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2ad:0x0] updating lvb ctime from disk: 1763343272 -> 1763343272 00002000:00010000:0.0:1763343273.938911:0:27798:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2ae:0x0] updating lvb ctime from disk: 1763343273 -> 1763343273 00002000:00010000:2.0:1763343273.938914:0:8414:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2ad:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1763343273.938914:0:27798:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2ae:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763343273.938982:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+11:3659:x1848998412956928:12345-0@lo:2:osp-syn-1-1.0 Request processed in 3651us (4143us total) trans 17179871888 rc 0/0 00000100:00100000:0.0:1763343273.938982:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+11:3659:x1848998412957056:12345-0@lo:2:osp-syn-1-1.0 Request processed in 3455us (4026us total) trans 17179871887 rc 0/0 00000100:00100000:2.0:1763343273.938991:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7150 00000100:00100000:0.0:1763343273.938994:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7152 00000004:00080000:3.0:1763343273.939232:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400cc5de680/2, rc 0, transno 17179871887 00000100:00100000:3.0:1763343273.939241:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412957056:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763343273.939250:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400cc5de300/2, rc 0, transno 17179871888 00000100:00100000:3.0:1763343273.939253:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412956928:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343273.940276:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.940449:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399816960 00000100:00100000:2.0:1763343273.940457:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399816960 00000100:00100000:2.0:1763343273.940513:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10547 00000100:00100000:2.0:1763343273.940523:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+285:55884:x1848998399816960:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343273.940542:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.940568:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fc000/0x9104b1ba770a28d9 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49239 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343273.940684:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:2.0:1763343273.940701:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a28e0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343273.940716:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a28e0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.940728:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a28e0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:2.0:1763343273.940763:0:35281:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9832300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35281:1848998412957696:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343273.940787:0:35281:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a28bd lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343273.940813:0:8413:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9833b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412957824:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343273.940826:0:8413:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fd600/0x9104b1ba770a28d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.940846:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a28e7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343273.940854:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a28e7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.940861:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a28e7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.940920:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a28ee lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343273.940928:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a28ee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.940935:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a28ee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:2.0:1763343273.940946:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1fb:0x0]: returning size 0 00000100:00100000:1.0:1763343273.940968:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399817088 00000100:00100000:1.0:1763343273.940973:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399817088 00000100:00100000:1.0:1763343273.941007:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10548 00000100:00100000:1.0:1763343273.941014:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57107:x1848998399817088:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343273.941039:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.941040:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a28e0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.941048:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a28e0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.941049:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a28fc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49240 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.941054:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a28e0 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.941060:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a28e0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.941065:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8693c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.941069:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a28e0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.941075:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a28fc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49240 expref: 289 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.941076:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a28e0 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.941086:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6800/0x9104b1ba770a28fc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49240 expref: 289 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.941088:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53f00) 00010000:00010000:2.0:1763343273.941091:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.941095:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a28e0 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.941100:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a28e0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343273.941100:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:1.0:1763343273.941102:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343273.941105:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a6800, rc 0) 00010000:00010000:2.0:1763343273.941112:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a28e7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.941117:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a28e7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.941121:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a28e7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.941126:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8692c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343273.941128:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a28e7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.941133:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a28e7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.941143:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53300) 00010000:00010000:2.0:1763343273.941145:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343273.941145:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57107:x1848998399817088:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 132us (462us total) trans 0 rc 0/0 00010000:00010000:2.0:1763343273.941148:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a28e7 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000100:00100000:1.0:1763343273.941152:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10548 00010000:00010000:2.0:1763343273.941154:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a28e7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343273.941191:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fc000/0x9104b1ba770a28d9 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49239 expref: 289 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.941205:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a28ee lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49239 expref: 288 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.941211:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fb:0x0].0x0 (ffff9401edc53d00) 00010000:00010000:2.0:1763343273.941214:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343273.941216:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5bd9a00, rc 0) 00000100:00100000:2.0:1763343273.941247:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:55884:x1848998399816960:12345-192.168.201.40@tcp:101:bash.0 Request processed in 726us (976us total) trans 4294973518 rc 0/0 00000100:00100000:2.0:1763343273.941253:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10547 00000100:00100000:0.0:1763343273.941614:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.941715:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.941733:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399817216 00000100:00100000:0.0:1763343273.941737:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399817216 00010000:00010000:0.0:1763343273.941758:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a27ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491de expref: 15 pid: 27798 timeout: 1167 lvb_type: 0 00000100:00100000:0.0:1763343273.941783:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399817344 00000100:00100000:0.0:1763343273.941785:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399817344 00010000:00010000:0.0:1763343273.941796:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90600/0x9104b1ba770a27ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491e5 expref: 21 pid: 8413 timeout: 1167 lvb_type: 0 00000100:00100000:0.0:1763343273.941812:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3423 00000100:00100000:0.0:1763343273.941819:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998399817216:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343273.941832:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343273.941838:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a27ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491de expref: 15 pid: 27798 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343273.941850:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a27ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491de expref: 15 pid: 27798 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343273.941871:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a27ac lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491de expref: 15 pid: 27798 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343273.941885:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343273.941887:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343273.941892:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a28bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.941901:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a28bd lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.941921:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343273.941948:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399817216:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 129us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343273.941954:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3423 00000100:00100000:0.0:1763343273.941971:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3424 00000100:00100000:0.0:1763343273.941978:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399817344:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343273.941988:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343273.941993:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90600/0x9104b1ba770a27ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491e5 expref: 21 pid: 8413 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343273.942003:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90600/0x9104b1ba770a27ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491e5 expref: 21 pid: 8413 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343273.942017:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e90600/0x9104b1ba770a27ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491e5 expref: 21 pid: 8413 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343273.942056:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343273.942058:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343273.942061:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fd600/0x9104b1ba770a28d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.942069:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fd600/0x9104b1ba770a28d2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.942083:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343273.942100:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399817344:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 122us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343273.942106:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3424 00010000:00010000:2.0:1763343273.942880:0:35281:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a28bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.942891:0:35281:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a28bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.942901:0:35281:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a28bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.942914:0:35281:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a28bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.942944:0:35281:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343273.943271:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+10:3661:x1848998412956672:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8142us (9330us total) trans 17179871889 rc 0/0 00000100:00100000:2.0:1763343273.943291:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7148 00010000:00010000:2.0:1763343273.943427:0:8413:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fd600/0x9104b1ba770a28d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.943437:0:8413:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fd600/0x9104b1ba770a28d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.943446:0:8413:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fd600/0x9104b1ba770a28d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.943452:0:8413:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fd600/0x9104b1ba770a28d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.943473:0:8413:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1763343273.943615:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+25:3662:x1848998412957184:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7675us (8500us total) trans 21474839159 rc 0/0 00000100:00100000:2.0:1763343273.943623:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7155 00000004:00080000:2.0:1763343273.943665:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401edc19180/2, rc 0, transno 21474839159 00000100:00100000:2.0:1763343273.943672:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412957184:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763343273.944308:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763343273.944317:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a28bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.944330:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fdc00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343273.944334:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a28bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.944343:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a28bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.944363:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a28bd lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.944371:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a28bd lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.944387:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343273.944390:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fd600/0x9104b1ba770a28d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.944396:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fd600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343273.944399:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fd600/0x9104b1ba770a28d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.944405:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fd600/0x9104b1ba770a28d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.944413:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fd600/0x9104b1ba770a28d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.944419:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fd600/0x9104b1ba770a28d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.944430:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343273.944432:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343273.944435:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343273.944503:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b9f480/2, rc 0, transno 17179871889 00000100:00100000:3.0:1763343273.944511:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412956672:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1763343273.944600:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343273.945062:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.945359:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399817472 00000100:00100000:3.0:1763343273.945367:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399817472 00000100:00100000:3.0:1763343273.945414:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10549 00000100:00100000:3.0:1763343273.945425:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:55884:x1848998399817472:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343273.945448:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343273.945468:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a2903 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49247 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.945521:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a290a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343273.945535:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a290a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.945545:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a290a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.945659:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a2903 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49247 expref: 290 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.945676:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a290a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49247 expref: 289 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.945684:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fb:0x0].0x0 (ffff9401edc53d00) 00010000:00010000:3.0:1763343273.945687:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343273.945691:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c6b98000, rc 0) 00000100:00100000:3.0:1763343273.945752:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:55884:x1848998399817472:12345-192.168.201.40@tcp:101:bash.0 Request processed in 329us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343273.945759:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10549 00000100:00100000:1.0:1763343273.945989:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.946676:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399817728 00000100:00100000:3.0:1763343273.946684:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399817728 00000100:00100000:3.0:1763343273.946731:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3720 00000100:00100000:3.0:1763343273.946740:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57107:x1848998399817728:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:2.0:1763343273.947140:0:19639:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1f8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1763343273.947214:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1690, 64 off140832 00000040:00080000:2.0:1763343273.947243:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1698, 64 off141488 00000040:00080000:2.0:1763343273.947255:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1699, 64 off141552 00000040:00080000:2.0:1763343273.947265:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1691, 64 off140896 00010000:00010000:2.0:1763343273.947343:0:19639:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2911 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19639 initiator: MDT0 00010000:00010000:2.0:1763343273.947357:0:19639:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2911 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343273.947367:0:19639:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2911 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343273.947375:0:19639:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2911 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343273.947380:0:19639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2911 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343273.947386:0:19639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2911 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343273.947412:0:19639:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343273.947603:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57107:x1848998399817728:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 862us (1612us total) trans 4294973519 rc 0/0 00000100:00100000:2.0:1763343273.947611:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3720 00010000:00010000:3.0:1763343273.948314:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343273.948323:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2911 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343273.948330:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd9000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343273.948334:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2911 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343273.948341:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2911 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343273.948356:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1f8:0x0].0x0 (ffff9401f66a1300) 00010000:00010000:3.0:1763343273.948358:0:7451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343273.948364:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2911 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343273.948369:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2911 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343273.948379:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343273.948381:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343273.948382:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343273.952082:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.952122:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.952316:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399817984 00000100:00100000:0.0:1763343273.952316:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399818240 00000100:00100000:0.0:1763343273.952327:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399818240 00000100:00100000:3.0:1763343273.952328:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399817984 00000100:00100000:0.0:1763343273.952593:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10550 00000100:00100000:0.0:1763343273.952605:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57107:x1848998399818240:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343273.952628:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343273.952653:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a2918 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4924e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343273.952688:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10551 00000100:00100000:3.0:1763343273.952699:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:55884:x1848998399817984:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:3.0:1763343273.952743:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343273.952772:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a28ee lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49239 expref: 292 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.952792:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fb:0x0].0x0 (ffff9401edc53d00) 00010000:00010000:3.0:1763343273.952798:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343273.952819:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a291f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343273.952832:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a291f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.952842:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a291f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.952853:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2926 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343273.952859:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2926 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.952869:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2926 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.952959:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a292d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343273.952968:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2934 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1fb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343273.952968:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a292d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.952985:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a292d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343273.952989:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a292d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:0.0:1763343273.952997:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1fb:0x0]: returning size 0 00010000:00010000:3.0:1763343273.952998:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2934 lrc: 4/0,1 mode: --/PW res: [0x240000404:0x1fb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.953018:0:7641:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a292d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343273.953059:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2934 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1fb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.953141:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a291f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.953149:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a291f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.953155:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a291f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.953161:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a291f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.953166:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.953170:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a291f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.953177:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a291f lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.953186:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5900) 00010000:00010000:0.0:1763343273.953189:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.953193:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a291f lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.953199:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a291f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.953208:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2926 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.953214:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2926 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.953219:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2926 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.953224:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba2c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343273.953228:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2926 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.953233:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2926 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.953241:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401cc2f5f00) 00010000:00010000:0.0:1763343273.953248:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343273.953251:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2926 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.953257:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2926 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.953305:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a2918 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4924e expref: 294 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.953324:0:6524:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a292d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4924e expref: 293 pid: 6524 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343273.953333:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a292d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4924e expref: 293 pid: 6524 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343273.953340:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3c00, rc 0) 00000100:00100000:0.0:1763343273.953626:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57107:x1848998399818240:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1022us (1501us total) trans 4294973521 rc 0/0 00000100:00100000:0.0:1763343273.953634:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10550 00000100:00100000:1.0:1763343273.963287:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.963329:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343273.963381:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399818368 00000100:00100000:0.0:1763343273.963392:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399818368 00000100:00100000:0.0:1763343273.963454:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10552 00000100:00100000:0.0:1763343273.963464:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c511c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57107:x1848998399818368:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343273.963485:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343273.963520:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a2942 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49255 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.963594:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2949 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343273.963608:0:6524:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2934 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1fb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.963617:0:6524:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2949 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.963635:0:6524:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2934 lrc: 4/0,1 mode: --/PW res: [0x240000404:0x1fb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343273.963646:0:6524:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2949 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000100:00100000:2.0:1763343273.963717:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399818496 00000100:00100000:2.0:1763343273.963723:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399818496 00010000:00010000:2.0:1763343273.963746:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a292d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4924e expref: 295 pid: 6524 timeout: 1167 lvb_type: 0 00000100:00100000:2.0:1763343273.963811:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3425 00000100:00100000:2.0:1763343273.963819:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6282a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:2408:x1848998399818496:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343273.963830:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343273.963836:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a292d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4924e expref: 295 pid: 6524 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343273.963849:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a292d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4924e expref: 295 pid: 6524 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343273.963866:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a292d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4924e expref: 295 pid: 6524 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343273.963881:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fb:0x0].0x0 (ffff9401edc53d00) 00010000:00010000:2.0:1763343273.963885:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2949 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.963892:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2934 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1fb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.963898:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2934 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1fb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.963904:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2934 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1fb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.963910:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2949 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.963916:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2949 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.965181:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343273.965250:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6282a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:2408:x1848998399818496:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1429us (1916us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.965264:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3425 00010000:00010000:3.0:1763343273.966171:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2934 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1fb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.966185:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2934 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1fb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00000001:00080000:2.0:1763343273.967114:0:7641:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973520 00000004:00010000:2.0:1763343273.967163:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ea0abd8c reply state 00000000c7e17b96 transno 4294973522 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2934 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1fb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.967181:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2934 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1fb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343273.967190:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fb:0x0].0x0 (ffff9401edc53d00) 00010000:00010000:2.0:1763343273.967193:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343273.967197:0:7641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2949 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.967205:0:7641:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2949 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343273.967211:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2949 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT1 00000100:00100000:2.0:1763343273.967243:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343273.967404:0:6524:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2949 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.967413:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2949 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:0.0:1763343273.967437:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1fb:0x0]: returning size 0 00000004:00200000:0.0:1763343273.967449:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343273.967704:0:6524:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2949 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.967717:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2949 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343273.967748:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a2942 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49255 expref: 295 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.967771:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2949 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49255 expref: 294 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343273.967778:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fb:0x0].0x0 (ffff9401edc53d00) 00010000:00010000:0.0:1763343273.967781:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343273.967783:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba2c00, rc 0) 00000100:00100000:0.0:1763343273.968190:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c511c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57107:x1848998399818368:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 4725us (4919us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343273.968199:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10552 00000100:00100000:2.0:1763343273.968345:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:55884:x1848998399817984:12345-192.168.201.40@tcp:36:bash.0 Request processed in 15647us (16278us total) trans 4294973522 rc 0/0 00000100:00100000:2.0:1763343273.968351:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10551 00000020:00080000:2.0:1763343273.968355:0:7641:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343273.973709:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.974185:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399818624 00000100:00100000:2.0:1763343273.974195:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399818624 00000100:00100000:2.0:1763343273.974262:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10553 00000100:00100000:2.0:1763343273.974273:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:55884:x1848998399818624:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343273.974316:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343273.974342:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2950 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1fb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4925c expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.974406:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2950 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1fb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4925c expref: 295 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.974421:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2950 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1fb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4925c expref: 295 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.974440:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fb:0x0].0x0 (ffff9401edc53d00) 00010000:00010000:2.0:1763343273.974443:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343273.974447:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5bd8e00, rc 0) 00000100:00100000:1.0:1763343273.975139:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.975209:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399818752 00000100:00100000:3.0:1763343273.975216:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399818752 00000100:00100000:3.0:1763343273.975257:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7156 00000100:00100000:3.0:1763343273.975266:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399818752:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343273.975293:0:8413:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343273.975311:0:8413:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c85ab400/0x9104b1ba770a2957 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49263 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343273.975332:0:8413:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343273.975346:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343273.975349:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343273.975358:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c85ab400/0x9104b1ba770a2957 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49263 expref: 21 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343273.975372:0:8413:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c85ab400/0x9104b1ba770a2957 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49263 expref: 21 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343273.975387:0:8413:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c85ab400, rc 0) 00000100:00100000:3.0:1763343273.975859:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399818752:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 592us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343273.975866:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7156 00000100:00100000:2.0:1763343273.976107:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:55884:x1848998399818624:12345-192.168.201.40@tcp:101:bash.0 Request processed in 1834us (2417us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343273.976115:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10553 00000100:00100000:1.0:1763343273.984655:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.984861:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399819008 00000100:00100000:2.0:1763343273.984872:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399819008 00000100:00100000:2.0:1763343273.984937:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3721 00000100:00100000:2.0:1763343273.984947:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57107:x1848998399819008:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343273.985124:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343273.985590:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399819264 00000100:00100000:3.0:1763343273.985595:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399819264 00000100:00100000:3.0:1763343273.985632:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10554 00000100:00100000:3.0:1763343273.985640:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:55884:x1848998399819264:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343273.985651:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343273.985654:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1763343273.985677:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2950 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1fb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4925c expref: 297 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.985696:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2949 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49255 expref: 296 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.985707:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fb:0x0].0x0 (ffff9401edc53d00) 00010000:00010000:3.0:1763343273.985711:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343273.985723:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a295e lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4926a expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343273.985764:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a2965 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343273.985776:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a2965 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.985784:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a2965 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000040:00080000:3.0:1763343273.985969:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1692, 88 off140984 00000004:00080000:3.0:1763343273.985976:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1067109951428ns, next at 1068000150895ns, rc = 0 00000040:00080000:3.0:1763343273.986006:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1700, 88 off141640 00000004:00080000:3.0:1763343273.986011:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1067109986079ns, next at 1068000121327ns, rc = 0 00000040:00080000:3.0:1763343273.986061:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1701, 88 off141728 00000004:00080000:3.0:1763343273.986066:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1067110041449ns, next at 1068000121327ns, rc = 0 00000040:00080000:3.0:1763343273.986081:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1693, 88 off141072 00000004:00080000:3.0:1763343273.986085:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1067110060246ns, next at 1068000150895ns, rc = 0 00000100:00100000:2.0:1763343273.986131:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57107:x1848998399819008:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1182us (1482us total) trans 4294973523 rc 0/0 00000100:00100000:2.0:1763343273.986142:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3721 00000100:00100000:3.0:1763343273.991115:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343273.991197:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399819520 00000100:00100000:1.0:1763343273.991209:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399819520 00000100:00100000:1.0:1763343273.991289:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10555 00000100:00100000:1.0:1763343273.991300:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57107:x1848998399819520:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343273.991330:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343273.991356:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a296c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49271 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.991441:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2973 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343273.991455:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2973 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.991466:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2973 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.991478:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a297a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343273.991484:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a297a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.991490:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a297a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.991611:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2981 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343273.991620:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2981 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.991628:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2981 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:1.0:1763343273.991638:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1fb:0x0]: returning size 2 00010000:00010000:1.0:1763343273.991721:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2981 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.991734:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2981 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.991740:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2981 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.991746:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb2400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.991750:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2981 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.991757:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2981 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.991768:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fb:0x0].0x0 (ffff9401edc53d00) 00010000:00010000:1.0:1763343273.991771:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1763343273.991777:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2981 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.991782:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2981 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.991798:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2973 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.991804:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2973 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.991810:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2973 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.991815:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2973 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.991820:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a7200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.991823:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2973 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.991829:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2973 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.991836:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497e300) 00010000:00010000:1.0:1763343273.991838:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.991841:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2973 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.991847:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2973 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.991855:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a297a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.991860:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a297a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.991865:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a297a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.991869:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a6a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343273.991871:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a297a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.991876:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a297a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.991881:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c497eb00) 00010000:00010000:1.0:1763343273.991884:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343273.991887:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a297a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.991896:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a297a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343273.991937:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a296c lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49271 expref: 299 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.991947:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497e300) 00010000:00010000:1.0:1763343273.991950:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343273.991954:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a296c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49271 expref: 299 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.991965:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a7e00, rc 0) 00000100:00100000:1.0:1763343273.992047:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57107:x1848998399819520:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 724us (920us total) trans 4294973525 rc 301/301 00000100:00100000:1.0:1763343273.992055:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10555 00000001:00080000:2.0:1763343273.993510:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973524 is committed 00000004:00080000:2.0:1763343273.993520:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1084 committed 00000004:00080000:2.0:1763343273.993531:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1092 committed 00000100:00100000:1.0:1763343273.993795:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6280380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412957952:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1763343273.993832:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2934 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1fb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.993844:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2934 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1fb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.993852:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2934 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1fb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00000100:00100000:1.0:1763343273.993860:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343273.993864:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85aa600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343273.993870:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2934 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1fb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.993884:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2934 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1fb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00000100:00100000:1.0:1763343273.993900:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1763343273.993901:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fb:0x0].0x0 (ffff9401edc53d00) 00010000:00010000:3.0:1763343273.993906:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343273.993909:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412958080:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1763343273.993912:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2934 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1fb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343273.993921:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2934 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1fb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000100:00100000:1.0:1763343273.993935:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343273.993967:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412958208:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343273.993986:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1763343273.994234:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1091 committed 00000004:00080000:2.0:1763343273.994732:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1083 committed 00010000:00010000:2.0:1763343273.994842:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a2965 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1fb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4926a expref: 289 pid: 7641 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343273.994842:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c8bc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412958592:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1763343273.994864:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fb:0x0].0x0 (ffff9401edc53d00) 00010000:00010000:2.0:1763343273.994868:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343273.994884:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a295e lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4926a expref: 289 pid: 7641 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1763343273.994900:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c8bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412958464:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1763343273.994904:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a2965 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1fb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4926a expref: 288 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.994935:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fb:0x0].0x0 (ffff9401edc53d00) 00010000:00010000:2.0:1763343273.994938:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343273.994941:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c6b98200, rc 0) 00000100:00100000:2.0:1763343273.995012:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:55884:x1848998399819264:12345-192.168.201.40@tcp:101:bash.0 Request processed in 9372us (10312us total) trans 4294973524 rc 0/0 00000100:00100000:2.0:1763343273.995021:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10554 00000100:00100000:1.0:1763343273.995431:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412958720:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343273.995692:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412957952 00000100:00100000:2.0:1763343273.995701:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412957952 00000100:00100000:2.0:1763343273.995745:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412958080 00000100:00100000:2.0:1763343273.995748:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412958080 00000100:00100000:2.0:1763343273.995763:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412958208 00000100:00100000:2.0:1763343273.995766:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412958208 00000100:00100000:2.0:1763343273.995948:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7157 00000100:00100000:2.0:1763343273.995959:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+27:3661:x1848998412957952:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763343273.995985:0:27798:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:684 count 1 00010000:00010000:2.0:1763343273.996009:0:27798:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a298f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.996046:0:27798:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a2877 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4921d expref: 20 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.996056:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343273.996059:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343273.996064:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a298f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343273.996090:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7158 00010000:00010000:2.0:1763343273.996096:0:27798:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a2877 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4921d expref: 20 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.996112:0:27798:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a2877 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4921d expref: 20 pid: 27798 timeout: 1167 lvb_type: 0 00000100:00100000:2.0:1763343273.996126:0:27798:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9831500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27798:1848998412958976:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343273.996134:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7159 00000100:00100000:3.0:1763343273.996144:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+27:3659:x1848998412958208:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343273.996180:0:27798:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c546ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1763343273.996196:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+27:3661:x1848998412958080:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763343273.996207:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:685 count 1 00010000:00010000:2.0:1763343273.996219:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2996 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.996230:0:8413:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a281c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49201 expref: 20 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.996239:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1763343273.996240:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763343273.996242:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343273.996246:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2996 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.996271:0:8413:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a281c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49201 expref: 20 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343273.996289:0:8413:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a281c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49201 expref: 20 pid: 27798 timeout: 1167 lvb_type: 0 00000100:00100000:1.0:1763343273.996296:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1763343273.996301:0:8413:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9831880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412959104:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343273.996308:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6281c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412958336:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343273.996330:0:8413:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c546e480 going to sleep for 11 seconds 00000100:00100000:1.0:1763343273.996343:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1763343273.996402:0:8414:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2b0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343273.996406:0:8414:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2b0:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343273.996408:0:8414:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2b0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343273.996410:0:8414:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2b0:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343273.996413:0:8414:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2b0:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343273.996447:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+28:3659:x1848998412958208:12345-0@lo:2:osp-syn-0-1.0 Request processed in 306us (2459us total) trans 21474839160 rc 0/0 00000100:00100000:3.0:1763343273.996455:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7159 00000100:00100000:1.0:1763343273.997388:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412958848:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343273.997417:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343273.997759:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412958720 00000100:00100000:3.0:1763343273.997768:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412958720 00000100:00100000:3.0:1763343273.997802:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412958336 00000100:00100000:3.0:1763343273.997805:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412958336 00000100:00100000:2.0:1763343273.997993:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7160 00000100:00100000:2.0:1763343273.998005:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+10:3659:x1848998412958720:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343273.998190:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+11:3659:x1848998412958720:12345-0@lo:2:osp-syn-1-1.0 Request processed in 185us (1950us total) trans 17179871890 rc 0/0 00000100:00100000:0.0:1763343273.998190:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343273.998201:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7160 00000100:00100000:0.0:1763343273.998229:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399819776 00000100:00100000:0.0:1763343273.998234:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399819776 00000100:00100000:0.0:1763343273.998274:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3722 00000100:00100000:0.0:1763343273.998294:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57107:x1848998399819776:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:1.0:1763343273.998407:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401efc71180/2, rc 0, transno 17179871890 00000100:00100000:1.0:1763343273.998415:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412958720:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763343273.998434:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6280a80/2, rc 0, transno 21474839160 00000100:00100000:1.0:1763343273.998438:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412958208:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343273.998450:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57107:x1848998399819776:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 167us (263us total) trans 4294973526 rc 0/0 00000100:00100000:0.0:1763343273.998464:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3722 00000100:00100000:1.0:1763343273.998478:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412958848 00000100:00100000:1.0:1763343273.998483:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412958848 00000100:00100000:0.0:1763343273.998493:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343273.998515:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412958592 00000100:00100000:1.0:1763343273.998519:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412958592 00000100:00100000:0.0:1763343273.998534:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7161 00000100:00100000:1.0:1763343273.998542:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7162 00000100:00100000:0.0:1763343273.998547:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+12:3659:x1848998412958848:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343273.998555:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+12:3662:x1848998412958592:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343273.998573:0:28561:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:686 count 1 00010000:00010000:1.0:1763343273.998592:0:28561:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a299d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.998610:0:28561:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2815 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491fa expref: 13 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.998618:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343273.998621:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343273.998626:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a299d lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343273.998646:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+13:3659:x1848998412958848:12345-0@lo:2:osp-syn-1-1.0 Request processed in 103us (1226us total) trans 17179871891 rc 0/0 00000100:00100000:0.0:1763343273.998654:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7161 00010000:00010000:1.0:1763343273.998660:0:28561:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2815 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491fa expref: 13 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.998678:0:28561:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2815 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491fa expref: 13 pid: 27798 timeout: 1167 lvb_type: 0 00000100:00100000:1.0:1763343273.998690:0:28561:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c791b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998412959232:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343273.998743:0:28561:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd0300 going to sleep for 11 seconds 00000100:00100000:1.0:1763343273.998766:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343273.998800:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412958464 00000100:00100000:1.0:1763343273.998804:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412958464 00000100:00100000:1.0:1763343273.998824:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7163 00000100:00100000:1.0:1763343273.998830:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+13:3661:x1848998412958464:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343273.998843:0:35281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:685 count 1 00010000:00010000:1.0:1763343273.998854:0:35281:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a29a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.998866:0:35281:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a2624 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49152 expref: 13 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.998872:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343273.998874:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343273.998876:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a29a4 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.998894:0:35281:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a2624 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49152 expref: 13 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343273.998903:0:35281:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a2624 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49152 expref: 13 pid: 8412 timeout: 1167 lvb_type: 0 00000100:00100000:1.0:1763343273.998913:0:35281:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7918000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35281:1848998412959360:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343273.998949:0:35281:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd00c0 going to sleep for 11 seconds 00000004:00080000:1.0:1763343273.998976:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401efc71500/2, rc 0, transno 17179871891 00000100:00100000:1.0:1763343273.998981:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412958848:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343273.999526:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7164 00000100:00100000:3.0:1763343273.999538:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+28:3659:x1848998412958336:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343273.999680:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+29:3659:x1848998412958336:12345-0@lo:2:osp-syn-0-1.0 Request processed in 145us (3336us total) trans 21474839161 rc 0/0 00000100:00100000:3.0:1763343273.999689:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7164 00000004:00080000:2.0:1763343273.999703:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6281c00/2, rc 0, transno 21474839161 00000100:00100000:2.0:1763343273.999711:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6281c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412958336:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343274.008622:0:27798:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9831500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27798:1848998412958976:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343274.008658:0:27798:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a298f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343274.008771:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.008793:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.008818:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399820160 00000100:00100000:0.0:1763343274.008824:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399820160 00010000:00010000:0.0:1763343274.008861:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2815 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491fa expref: 14 pid: 27798 timeout: 1167 lvb_type: 0 00000100:00100000:0.0:1763343274.008904:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3426 00000100:00100000:0.0:1763343274.008913:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399820160:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343274.008927:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343274.008932:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2815 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491fa expref: 14 pid: 27798 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.008950:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2815 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491fa expref: 14 pid: 27798 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.008974:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.008976:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.008982:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a299d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.008991:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a299d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.009009:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343274.009075:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399820160:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 162us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343274.009082:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3426 00000100:00100000:0.0:1763343274.009119:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.009134:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399820288 00000100:00100000:0.0:1763343274.009137:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399820288 00010000:00010000:0.0:1763343274.009150:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a2624 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49152 expref: 14 pid: 8412 timeout: 1167 lvb_type: 0 00000100:00100000:0.0:1763343274.009165:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3427 00000100:00100000:0.0:1763343274.009170:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399820288:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343274.009177:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343274.009181:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a2624 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49152 expref: 14 pid: 8412 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.009195:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a2624 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49152 expref: 14 pid: 8412 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.009206:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.009207:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.009211:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a29a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.009218:0:6511:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a29a4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.009228:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343274.009243:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399820288:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 72us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343274.009249:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3427 00000100:00100000:0.0:1763343274.009318:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.009336:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399820416 00000100:00100000:0.0:1763343274.009340:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399820416 00000100:00100000:0.0:1763343274.009366:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7165 00000100:00100000:0.0:1763343274.009372:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:55884:x1848998399820416:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343274.009384:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343274.009397:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a29ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49278 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.009417:0:28562:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c85ab400/0x9104b1ba770a2957 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49263 expref: 22 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343274.009428:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.009430:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.009434:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a29ab lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49278 expref: 22 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.009456:0:28562:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c85ab400/0x9104b1ba770a2957 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49263 expref: 22 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343274.009467:0:28562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c85ab400/0x9104b1ba770a2957 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49263 expref: 22 pid: 8413 timeout: 1167 lvb_type: 1 00000100:00100000:0.0:1763343274.009479:0:28562:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28562:1848998412959488:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343274.009521:0:28562:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343274.009552:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.009564:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399819904 00000100:00100000:0.0:1763343274.009567:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399819904 00010000:00010000:0.0:1763343274.009578:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a2877 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4921d expref: 23 pid: 27798 timeout: 1167 lvb_type: 0 00000100:00100000:0.0:1763343274.009594:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3428 00000100:00100000:0.0:1763343274.009599:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8390050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2410:x1848998399819904:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343274.009605:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343274.009609:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a2877 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4921d expref: 23 pid: 27798 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.009619:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a2877 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4921d expref: 23 pid: 27798 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.009633:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a2877 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4921d expref: 23 pid: 27798 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.009643:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.009644:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.009647:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a298f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.009655:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a298f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.009669:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343274.009682:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8390050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2410:x1848998399819904:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 83us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343274.009688:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3428 00010000:00010000:0.0:1763343274.009728:0:27798:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a298f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.009736:0:27798:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a298f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.009746:0:27798:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a298f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.009754:0:27798:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a298f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.009773:0:27798:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343274.009963:0:28561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2815 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b491fa expref: 13 pid: 27798 timeout: 1167 lvb_type: 0 00000100:00100000:1.0:1763343274.009978:0:28561:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c791b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998412959232:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343274.009998:0:28561:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a299d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.010008:0:28561:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a299d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.010016:0:28561:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a299d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.010054:0:28561:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a299d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.010063:0:28561:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a299d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343274.010076:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+29:3661:x1848998412957952:12345-0@lo:6:osp-syn-0-1.0 Request processed in 14118us (16218us total) trans 21474839162 rc 0/0 00010000:00010000:1.0:1763343274.010081:0:28561:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1763343274.010086:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7157 00010000:00010000:0.0:1763343274.010105:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763343274.010111:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a298f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.010119:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd9a00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343274.010124:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a298f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.010133:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a298f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.010147:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a298f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.010154:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a298f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.010170:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343274.010173:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a299d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.010180:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb3800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343274.010184:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a299d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.010192:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a299d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.010202:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a299d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.010208:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a299d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.010224:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343274.010227:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343274.010230:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343274.010301:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.010321:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399820544 00000100:00100000:0.0:1763343274.010326:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399820544 00000100:00100000:1.0:1763343274.010328:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+14:3662:x1848998412958592:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11773us (11831us total) trans 17179871892 rc 0/0 00000100:00100000:1.0:1763343274.010338:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7162 00010000:00010000:0.0:1763343274.010343:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a281c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49201 expref: 22 pid: 27798 timeout: 1167 lvb_type: 0 00010000:00010000:1.0:1763343274.010364:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343274.010367:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3429 00000100:00100000:0.0:1763343274.010375:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2410:x1848998399820544:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343274.010384:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343274.010388:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a281c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49201 expref: 22 pid: 27798 timeout: 1167 lvb_type: 0 00000004:00080000:1.0:1763343274.010390:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c8bc3b80/2, rc 0, transno 17179871892 00000100:00100000:1.0:1763343274.010400:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c8bc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412958592:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1763343274.010404:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a281c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49201 expref: 22 pid: 27798 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.010419:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.010421:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.010425:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2996 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763343274.010429:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6280380/2, rc 0, transno 21474839162 00000100:00100000:1.0:1763343274.010438:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6280380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412957952:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763343274.010438:0:6511:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2996 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.010457:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343274.010472:0:35281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a2624 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49152 expref: 12 pid: 8412 timeout: 1167 lvb_type: 0 00000100:00100000:0.0:1763343274.010479:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2410:x1848998399820544:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 102us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343274.010489:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3429 00000100:00100000:1.0:1763343274.010492:0:35281:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7918000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35281:1848998412959360:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343274.010508:0:35281:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a29a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.010517:0:35281:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a29a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.010525:0:35281:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a29a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.010533:0:35281:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a29a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.010540:0:35281:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a29a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.010563:0:35281:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343274.010673:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+14:3661:x1848998412958464:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11841us (11906us total) trans 17179871893 rc 0/0 00000100:00100000:1.0:1763343274.010680:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7163 00010000:00010000:3.0:1763343274.010805:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a281c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49201 expref: 21 pid: 27798 timeout: 1167 lvb_type: 0 00000100:00100000:3.0:1763343274.010818:0:8413:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9831880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412959104:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343274.010829:0:8413:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2996 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.010842:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343274.010845:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a29a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.010851:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb3e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343274.010853:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a29a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.010858:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a29a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.010866:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a29a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.010870:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a29a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.010879:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343274.010933:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343274.010935:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343274.010942:0:8413:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2996 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.010950:0:8413:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2996 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.010958:0:8413:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2996 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.011102:0:8413:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2996 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.011125:0:8413:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343274.011144:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343274.011150:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2996 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.011159:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd9000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343274.011162:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2996 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.011171:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2996 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.011183:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2996 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.011189:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2996 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.011207:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343274.011209:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343274.011210:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343274.011486:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+29:3661:x1848998412958080:12345-0@lo:6:osp-syn-0-1.0 Request processed in 15385us (17549us total) trans 21474839163 rc 0/0 00000100:00100000:3.0:1763343274.011495:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7158 00000100:00100000:2.0:1763343274.011534:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399820032 00000100:00100000:2.0:1763343274.011541:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399820032 00000100:00100000:2.0:1763343274.011584:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3723 00000100:00100000:2.0:1763343274.011592:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8440c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57107:x1848998399820032:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:2.0:1763343274.011726:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8440c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57107:x1848998399820032:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 136us (2956us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.011733:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3723 00000004:00080000:0.0:1763343274.011842:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c8bc0000/2, rc 0, transno 17179871893 00000100:00100000:0.0:1763343274.011849:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c8bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412958464:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1763343274.011859:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6282300/2, rc 0, transno 21474839163 00000100:00100000:0.0:1763343274.011863:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412958080:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343274.014075:0:28562:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28562:1848998412959488:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343274.014113:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a29ab lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49278 expref: 20 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.014133:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba2c00, rc 0) 00000100:00100000:1.0:1763343274.014193:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:55884:x1848998399820416:12345-192.168.201.40@tcp:101:bash.0 Request processed in 4819us (4873us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.014201:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7165 00000100:00100000:1.0:1763343274.015390:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.015443:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399820672 00000100:00100000:0.0:1763343274.015452:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399820672 00010000:00010000:0.0:1763343274.015489:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c85ab400/0x9104b1ba770a2957 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49263 expref: 20 pid: 8413 timeout: 1167 lvb_type: 1 00000100:00100000:2.0:1763343274.016475:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3430 00000100:00100000:2.0:1763343274.016493:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399820672:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343274.016511:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343274.016519:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c85ab400/0x9104b1ba770a2957 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49263 expref: 20 pid: 8413 timeout: 1167 lvb_type: 1 00010000:00010000:2.0:1763343274.016534:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c85ab400/0x9104b1ba770a2957 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49263 expref: 20 pid: 8413 timeout: 1167 lvb_type: 1 00010000:00010000:2.0:1763343274.016559:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c85ab400/0x9104b1ba770a2957 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49263 expref: 20 pid: 8413 timeout: 1167 lvb_type: 1 00010000:00010000:2.0:1763343274.016574:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.016576:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.016583:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a29ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49278 expref: 19 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.016593:0:6511:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a29ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49278 expref: 19 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.016630:0:6511:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a29ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49278 expref: 19 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343274.016649:0:6511:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9831500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6511:1848998412959616:192.168.201.40@tcp:105: 00000100:00100000:2.0:1763343274.016736:0:6511:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c546ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1763343274.022286:0:6511:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9831500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6511:1848998412959616:192.168.201.40@tcp:105: 00010000:00010000:2.0:1763343274.022317:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343274.022421:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2407:x1848998399820672:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 5933us (7034us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.022433:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3430 00000100:00100000:1.0:1763343274.024234:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.024854:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399820800 00000100:00100000:0.0:1763343274.024865:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399820800 00000100:00100000:0.0:1763343274.024938:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7166 00000100:00100000:0.0:1763343274.024949:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:55884:x1848998399820800:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343274.024966:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343274.024988:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a29b2 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4927f expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343274.025011:0:28562:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343274.025054:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.025057:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.025066:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a29b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4927f expref: 13 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.025081:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a29b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4927f expref: 13 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.025094:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3200, rc 0) 00000100:00100000:0.0:1763343274.025146:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:55884:x1848998399820800:12345-192.168.201.40@tcp:101:bash.0 Request processed in 200us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343274.025153:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7166 00000100:00100000:3.0:1763343274.029073:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.029115:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.029148:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.029220:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399821184 00000100:00100000:0.0:1763343274.029234:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399821184 00002000:00010000:0.0:1763343274.029293:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/688 (0->18446744073709551615) 00002000:00100000:0.0:1763343274.029299:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5954700 with x1848998399821184 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343274.029311:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5954700. 00000100:00100000:0.0:1763343274.029335:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399821312 00000100:00100000:0.0:1763343274.029338:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399821312 00000100:00100000:3.0:1763343274.029344:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1711 00002000:00010000:0.0:1763343274.029351:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/689 (0->18446744073709551615) 00002000:00100000:0.0:1763343274.029354:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5954e00 with x1848998399821312 ext(0->18446744073709551615) 00000100:00100000:3.0:1763343274.029355:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2407:x1848998399821184:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:0.0:1763343274.029359:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5954e00. 00000100:00100000:0.0:1763343274.029374:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1712 00000100:00100000:0.0:1763343274.029379:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2407:x1848998399821312:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:3.0:1763343274.029519:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2b0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343274.029519:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2b1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343274.029523:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2b0:0x0] updating lvb mtime from disk: 0 -> 1763343273 00002000:00010000:0.0:1763343274.029523:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2b1:0x0] updating lvb mtime from disk: 0 -> 1763343273 00002000:00010000:3.0:1763343274.029526:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2b0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343274.029526:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2b1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343274.029529:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2b0:0x0] updating lvb ctime from disk: 0 -> 1763343273 00002000:00010000:0.0:1763343274.029529:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2b1:0x0] updating lvb ctime from disk: 0 -> 1763343273 00002000:00010000:3.0:1763343274.029532:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2b0:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1763343274.029532:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2b1:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343274.029612:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399821056 00000100:00100000:2.0:1763343274.029616:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399821056 00000100:00100000:3.0:1763343274.029651:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399821184:12345-192.168.201.40@tcp:10:bash.0 Request processed in 297us (534us total) trans 21474839164 rc 0/0 00000100:00100000:2.0:1763343274.029659:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10556 00000100:00100000:3.0:1763343274.029660:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1711 00002000:00010000:3.0:1763343274.029663:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/688 (0->18446744073709551615) 00000100:00100000:2.0:1763343274.029665:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57112:x1848998399821056:12345-192.168.201.40@tcp:101:lfs.0 00002000:00100000:3.0:1763343274.029666:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5954700 with x1848998399821184 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343274.029670:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5954700. 00010000:00010000:2.0:1763343274.029677:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.029711:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a29b9 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49286 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.029806:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a29c0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.029820:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a29c0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.029832:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a29c0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.029844:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a29c7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.029851:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a29c7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.029864:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a29c7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.029968:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a29ce lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.029978:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a29ce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.029984:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a29ce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343274.029993:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1fb:0x0]: returning size 2 00010000:00010000:2.0:1763343274.030082:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a29c0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.030090:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a29c0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.030095:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a29c0 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.030101:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a29c0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.030107:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd9000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.030110:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a29c0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.030117:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a29c0 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.030129:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8600) 00010000:00010000:2.0:1763343274.030133:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.030138:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a29c0 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.030143:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a29c0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.030156:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a29c7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.030162:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a29c7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.030167:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a29c7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.030172:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd8e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.030175:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a29c7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.030180:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a29c7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.030186:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8700) 00010000:00010000:2.0:1763343274.030188:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.030191:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a29c7 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.030196:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a29c7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.030237:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a29b9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49286 expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.030252:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a29ce lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49286 expref: 291 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.030259:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fb:0x0].0x0 (ffff9401edc53d00) 00010000:00010000:2.0:1763343274.030261:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343274.030264:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c85ab400, rc 0) 00000100:00100000:0.0:1763343274.030888:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399821312:12345-192.168.201.40@tcp:10:bash.0 Request processed in 1505us (1736us total) trans 17179871894 rc 0/0 00000100:00100000:0.0:1763343274.030898:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1712 00002000:00010000:0.0:1763343274.030902:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/689 (0->18446744073709551615) 00002000:00100000:0.0:1763343274.030904:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5954e00 with x1848998399821312 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343274.030911:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5954e00. 00000100:00100000:2.0:1763343274.031748:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57112:x1848998399821056:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2077us (2728us total) trans 4294973527 rc 0/0 00000100:00100000:2.0:1763343274.031757:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10556 00000100:00100000:1.0:1763343274.035778:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.035867:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399821568 00000100:00100000:2.0:1763343274.035877:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399821568 00000100:00100000:2.0:1763343274.035971:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3724 00000100:00100000:2.0:1763343274.035982:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:55884:x1848998399821568:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:2.0:1763343274.036309:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:55884:x1848998399821568:12345-192.168.201.40@tcp:35:bash.0 Request processed in 328us (540us total) trans 4294973528 rc 0/0 00000100:00100000:2.0:1763343274.036316:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3724 00000100:00100000:0.0:1763343274.039505:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.039582:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399821824 00000100:00100000:2.0:1763343274.039592:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399821824 00000100:00100000:2.0:1763343274.039650:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3725 00000100:00100000:2.0:1763343274.039659:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57112:x1848998399821824:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343274.041193:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57112:x1848998399821824:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1524us (1688us total) trans 4294973529 rc 0/0 00000100:00100000:2.0:1763343274.041206:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3725 00000100:00100000:1.0:1763343274.044433:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.044831:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399822080 00000100:00100000:2.0:1763343274.044843:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399822080 00000100:00100000:2.0:1763343274.044908:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10557 00000100:00100000:2.0:1763343274.044920:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57112:x1848998399822080:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.044949:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.044972:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a29dc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1fb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4928d expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343274.045612:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.045697:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399822336 00000100:00100000:1.0:1763343274.045703:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399822336 00000100:00100000:1.0:1763343274.045745:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10558 00000100:00100000:1.0:1763343274.045755:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57113:x1848998399822336:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:1.0:1763343274.045790:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763343274.045817:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a2965 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1fb:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4926a expref: 295 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.045840:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a29ce lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49286 expref: 294 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.045852:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a290a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1fb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49247 expref: 293 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.045862:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fb:0x0].0x0 (ffff9401edc53d00) 00010000:00010000:1.0:1763343274.045868:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343274.045901:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a29e3 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343274.045918:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a29e3 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.045928:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a29e3 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.045941:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a29ea lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343274.045948:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a29ea lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.045954:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a29ea lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.046093:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a29f1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343274.046101:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a29f1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.046109:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a29f1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000040:00080000:1.0:1763343274.046405:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1694, 64 off141136 00000040:00080000:1.0:1763343274.046436:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1702, 64 off141792 00000040:00080000:1.0:1763343274.046447:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1703, 64 off141856 00000040:00080000:1.0:1763343274.046456:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1695, 64 off141200 00010000:00010000:1.0:1763343274.046513:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a29f8 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1fb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343274.046523:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a29f8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1fb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.046534:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a29f8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1fb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.046541:0:33856:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a29f8 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1fb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.046547:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a29f8 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1fb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.046553:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a29f8 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1fb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.046572:0:33856:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343274.046592:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343274.046598:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a29f8 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1fb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.046604:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a7200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343274.046608:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a29f8 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1fb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.046616:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a29f8 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1fb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.046624:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fb:0x0].0x0 (ffff9401edc53d00) 00010000:00010000:1.0:1763343274.046627:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763343274.046631:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a29f8 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1fb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.046637:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a29f8 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1fb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.046647:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343274.046649:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343274.046651:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343274.046666:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a29f1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.046672:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a29f1 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.046678:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a29f1 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.046683:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a6a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.046686:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a29f1 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.046692:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a29f1 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.046699:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fb:0x0].0x0 (ffff9401edc53d00) 00010000:00010000:1.0:1763343274.046702:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343274.046704:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a29f1 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.046710:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a29f1 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1fb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.046836:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a29e3 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.046843:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a29e3 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.046848:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a29e3 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.046856:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400cbad3c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.046860:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a29e3 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.046865:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a29e3 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.046873:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497e300) 00010000:00010000:1.0:1763343274.046875:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.046878:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a29e3 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.046883:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a29e3 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:1.0:1763343274.046894:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000715dc9b8 reply state 00000000bc315220 transno 4294973530 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a29ea lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.046905:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a29ea lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.046911:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c497eb00) 00010000:00010000:1.0:1763343274.046913:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343274.046916:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343274.046992:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57113:x1848998399822336:12345-192.168.201.40@tcp:36:rm.0 Request processed in 1237us (1380us total) trans 4294973530 rc 0/0 00000100:00100000:1.0:1763343274.047000:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10558 00010000:00010000:2.0:1763343274.047317:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a29dc lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4928d expref: 293 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.047329:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fb:0x0].0x0 (ffff9401edc53d00) 00010000:00010000:2.0:1763343274.047332:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343274.047336:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a29dc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1fb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4928d expref: 293 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.047355:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c85aa600, rc 0) 00000100:00100000:2.0:1763343274.047397:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57112:x1848998399822080:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2480us (2980us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343274.047404:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10557 00000100:00100000:0.0:1763343274.052672:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.052776:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399822592 00000100:00100000:1.0:1763343274.052789:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399822592 00000100:00100000:1.0:1763343274.052853:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10559 00000100:00100000:1.0:1763343274.052863:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57112:x1848998399822592:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343274.052888:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.052912:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a29ff lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49294 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.052990:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2a06 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343274.053003:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2a06 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.053015:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2a06 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.053058:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2a0d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343274.053067:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2a0d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.053074:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2a0d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.053118:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2a06 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.053125:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2a06 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.053131:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2a06 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.053137:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2a06 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.053143:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb3800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.053147:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2a06 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.053154:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2a06 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.053165:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497e300) 00010000:00010000:1.0:1763343274.053168:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.053172:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2a06 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.053178:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2a06 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.053191:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2a0d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.053196:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2a0d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.053201:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2a0d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.053205:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb2400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.053207:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2a0d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.053212:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2a0d lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.053218:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c497eb00) 00010000:00010000:1.0:1763343274.053220:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.053223:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2a0d lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.053231:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2a0d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.053258:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a29ff lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49294 expref: 293 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.053286:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497e300) 00010000:00010000:1.0:1763343274.053289:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343274.053293:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a29ff lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49294 expref: 293 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.053306:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c7bb3e00, rc 0) 00000100:00100000:1.0:1763343274.053375:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57112:x1848998399822592:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 513us (712us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343274.053383:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10559 00000100:00100000:1.0:1763343274.063245:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.063391:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399822720 00000100:00100000:2.0:1763343274.063402:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399822720 00000100:00100000:2.0:1763343274.063470:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10560 00000100:00100000:2.0:1763343274.063480:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57114:x1848998399822720:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.063501:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.063527:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2a14 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4929b expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.063591:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2a1b lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.063606:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2a1b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.063617:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2a1b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.063630:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2a22 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.063637:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2a22 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.063643:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2a22 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.063683:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2a1b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.063691:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2a1b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.063697:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2a1b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.063704:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2a1b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.063709:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85abe00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.063713:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2a1b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.063721:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2a1b lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.063732:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8600) 00010000:00010000:2.0:1763343274.063736:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.063741:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2a1b lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.063747:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2a1b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.063758:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2a22 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.063763:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2a22 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.063768:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2a22 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.063773:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85ab400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.063776:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2a22 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.063781:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2a22 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.063788:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c497eb00) 00010000:00010000:2.0:1763343274.063791:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.063793:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2a22 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.063799:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2a22 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.063823:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2a14 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4929b expref: 293 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.063833:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8600) 00010000:00010000:2.0:1763343274.063836:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.063840:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2a14 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4929b expref: 293 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.063852:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c85aa600, rc 0) 00000100:00100000:2.0:1763343274.064005:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57114:x1848998399822720:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 524us (770us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343274.064013:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10560 00000100:00100000:3.0:1763343274.067526:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.068792:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399822848 00000100:00100000:2.0:1763343274.068806:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399822848 00000100:00100000:0.0:1763343274.069529:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10561 00000100:00100000:0.0:1763343274.069543:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57114:x1848998399822848:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343274.069567:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343274.069597:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a2a29 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b492a2 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.069674:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2a30 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343274.069689:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2a30 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.069700:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2a30 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.069713:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a2a37 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343274.069720:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a2a37 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.069726:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a2a37 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.069768:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2a30 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.069775:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2a30 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.069781:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2a30 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.069788:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2a30 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.069794:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343274.069798:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2a30 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.069805:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2a30 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.069819:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5b00) 00010000:00010000:0.0:1763343274.069823:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343274.069828:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2a30 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.069833:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2a30 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.069848:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a2a37 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.069854:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a2a37 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.069859:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a2a37 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.069863:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343274.069866:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a2a37 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.069871:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a2a37 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.069877:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c497eb00) 00010000:00010000:0.0:1763343274.069880:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343274.069882:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a2a37 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.069888:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a2a37 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.069914:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a2a29 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492a2 expref: 293 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.069924:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5b00) 00010000:00010000:0.0:1763343274.069927:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343274.069930:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a2a29 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492a2 expref: 293 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.069948:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3000, rc 0) 00000100:00100000:0.0:1763343274.070537:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57114:x1848998399822848:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 994us (3017us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343274.070545:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10561 00000100:00100000:3.0:1763343274.073538:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.073911:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399822976 00000100:00100000:2.0:1763343274.073922:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399822976 00000100:00100000:2.0:1763343274.074239:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10562 00000100:00100000:2.0:1763343274.074250:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57114:x1848998399822976:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:0.0:1763343274.074310:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.074490:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399823232 00000100:00100000:1.0:1763343274.074496:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399823232 00000100:00100000:1.0:1763343274.074541:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10563 00000100:00100000:1.0:1763343274.074551:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7f54850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57115:x1848998399823232:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343274.074562:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.074584:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2a3e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b492b0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.074762:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.074773:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2a4c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b492a9 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.074803:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2a53 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.074815:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2a53 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.074828:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2a53 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343274.074877:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763343274.074883:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763343274.074916:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2a4c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492a9 expref: 296 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.074937:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2a53 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492a9 expref: 295 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.074945:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497e300) 00010000:00010000:2.0:1763343274.074948:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763343274.074951:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5bd9000, rc 0) 00000100:00100000:2.0:1763343274.075015:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57114:x1848998399822976:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 766us (1486us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.075050:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10562 00010000:00010000:1.0:1763343274.076081:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2a45 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343274.076099:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2a45 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.076111:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2a45 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.076127:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2a5a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343274.076134:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2a5a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.076139:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2a5a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.076171:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2a45 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.076177:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2a45 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.076183:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2a45 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.076190:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2a45 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.076196:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb2400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.076200:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2a45 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.076206:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2a45 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.076215:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497e300) 00010000:00010000:1.0:1763343274.076218:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.076221:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2a45 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.076228:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2a45 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.076238:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2a5a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.076244:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2a5a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.076249:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2a5a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.076253:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb3800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.076256:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2a5a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.076261:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2a5a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.076266:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c497eb00) 00010000:00010000:1.0:1763343274.076399:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.076403:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2a5a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.076409:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2a5a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.076442:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2a3e lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492b0 expref: 294 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.076452:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497e300) 00010000:00010000:1.0:1763343274.076455:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343274.076458:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2a3e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492b0 expref: 294 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.076466:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c7bb3e00, rc 0) 00000100:00100000:1.0:1763343274.076516:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7f54850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57115:x1848998399823232:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1967us (2207us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343274.076523:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10563 00000100:00100000:0.0:1763343274.080446:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.080656:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399823488 00000100:00100000:1.0:1763343274.080667:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399823488 00000100:00100000:1.0:1763343274.080725:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10564 00000100:00100000:1.0:1763343274.080736:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57114:x1848998399823488:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343274.080756:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.080760:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343274.080783:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2a53 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492a9 expref: 293 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.080800:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497e300) 00010000:00010000:1.0:1763343274.080809:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343274.080825:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2a61 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b492b7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.080920:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2a68 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343274.080932:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2a68 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.080940:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2a68 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.080952:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2a6f lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343274.080958:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2a6f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.080963:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2a6f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.082700:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2a76 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343274.082719:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2a76 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.082729:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2a76 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:1.0:1763343274.082740:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1fd:0x0]: returning size 0 00010000:00010000:1.0:1763343274.082767:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2a68 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.082774:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2a68 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.082780:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2a68 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.082786:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2a68 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.082792:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a6a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.082796:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2a68 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.082808:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2a68 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.082818:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497e100) 00010000:00010000:1.0:1763343274.082821:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.082825:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2a68 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.082831:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2a68 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000004:00010000:1.0:1763343274.082843:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000040b8e9fc reply state 000000002a805e80 transno 4294973531 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2a6f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.082853:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2a6f lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.082858:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c497eb00) 00010000:00010000:1.0:1763343274.082860:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343274.082863:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343274.082897:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2a61 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492b7 expref: 295 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.082915:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2a76 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492b7 expref: 294 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.082922:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e000) 00010000:00010000:1.0:1763343274.082924:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343274.082926:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3bcc200, rc 0) 00000100:00100000:1.0:1763343274.082993:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57114:x1848998399823488:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2259us (2556us total) trans 4294973531 rc 0/0 00000100:00100000:1.0:1763343274.083005:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10564 00000100:00100000:1.0:1763343274.088200:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.088296:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399823744 00000100:00100000:0.0:1763343274.088309:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399823744 00000100:00100000:0.0:1763343274.088378:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10565 00000100:00100000:0.0:1763343274.088388:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57114:x1848998399823744:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343274.088411:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343274.088430:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fc000/0x9104b1ba770a2a84 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b492be expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.088539:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2a8b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343274.088554:0:6524:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2a76 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492b7 expref: 296 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.088563:0:6524:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2a8b lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.088597:0:6524:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2a76 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492b7 expref: 296 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.088610:0:6524:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2a76 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492b7 expref: 296 pid: 6524 timeout: 1167 lvb_type: 0 00000100:00100000:0.0:1763343274.088630:0:6524:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412959744:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343274.088722:0:6524:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9480 going to sleep for 11 seconds 00000100:00100000:3.0:1763343274.089598:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.092021:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399824000 00000100:00100000:2.0:1763343274.092044:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399824000 00000100:00100000:2.0:1763343274.092109:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10566 00000100:00100000:2.0:1763343274.092119:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57116:x1848998399824000:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.092137:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.092158:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2a92 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b492c5 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343274.092184:0:6524:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412959744:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343274.092205:0:6524:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2a8b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.092258:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2a99 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.092780:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2a99 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.092794:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2a99 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343274.092807:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1fd:0x0]: returning size 0 00010000:00010000:2.0:1763343274.092902:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2a99 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.092910:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2a99 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.092917:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2a99 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.092923:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd9a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.092927:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2a99 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.092934:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2a99 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.092945:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e000) 00010000:00010000:2.0:1763343274.092949:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1763343274.092953:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2a99 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.092959:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2a99 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.093002:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2a92 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492c5 expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.093011:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e000) 00010000:00010000:2.0:1763343274.093014:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343274.093016:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2a92 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492c5 expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.093044:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5bd8e00, rc 0) 00000100:00100000:2.0:1763343274.093111:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57116:x1848998399824000:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 992us (3516us total) trans 4294973532 rc 301/301 00000100:00100000:2.0:1763343274.093119:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10566 00000100:00100000:3.0:1763343274.093434:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.093633:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399824128 00000100:00100000:2.0:1763343274.093640:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399824128 00010000:00010000:2.0:1763343274.093662:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2a76 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492b7 expref: 298 pid: 6524 timeout: 1167 lvb_type: 0 00000100:00100000:2.0:1763343274.093694:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3431 00000100:00100000:2.0:1763343274.093702:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5954a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:2407:x1848998399824128:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343274.093714:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343274.093720:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2a76 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492b7 expref: 298 pid: 6524 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343274.093731:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2a76 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492b7 expref: 298 pid: 6524 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343274.093746:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2a76 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492b7 expref: 298 pid: 6524 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343274.093758:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e000) 00010000:00010000:2.0:1763343274.093763:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2a8b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.093770:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2a8b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.093777:0:6511:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2a8b lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.093808:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343274.093837:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5954a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:2407:x1848998399824128:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 136us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.093845:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3431 00010000:00010000:3.0:1763343274.093907:0:6524:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2a8b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.093914:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2a8b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:3.0:1763343274.093931:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1fd:0x0]: returning size 0 00000100:00100000:2.0:1763343274.094240:0:8617:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9831500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8617:1848998412959872:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1763343274.094808:0:6524:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2b3:0x0], index 1: 0 00000004:00080000:3.0:1763343274.094816:0:6524:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2b2:0x0], index 0: 0 00000004:00080000:3.0:1763343274.094821:0:6524:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2b3:0x0], index 0: 0 00000004:00080000:3.0:1763343274.094825:0:6524:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2b4:0x0], index 1: 0 00000100:00100000:2.0:1763343274.094953:0:8617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343274.094994:0:8617:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c546e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343274.095012:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412959872 00000100:00100000:0.0:1763343274.095020:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412959872 00000100:00100000:0.0:1763343274.095084:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7167 00000100:00100000:0.0:1763343274.095093:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+29:8617:x1848998412959872:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1763343274.095129:0:8413:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 706 00010000:00010000:2.0:1763343274.095433:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2a8b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.095442:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2a8b lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.095448:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2a8b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.095453:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fca00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.095457:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2a8b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.095464:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2a8b lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.095476:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e000) 00010000:00010000:2.0:1763343274.095479:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343274.095483:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2a8b lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.095488:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2a8b lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.095535:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fc000/0x9104b1ba770a2a84 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492be expref: 297 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.095551:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e000) 00010000:00010000:2.0:1763343274.095553:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343274.095557:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fc000/0x9104b1ba770a2a84 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492be expref: 297 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.095572:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fc000, rc 0) 00000100:00100000:2.0:1763343274.095620:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57114:x1848998399823744:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 7233us (7433us total) trans 4294973533 rc 301/301 00000100:00100000:2.0:1763343274.095627:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10565 00000100:00100000:0.0:1763343274.096625:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+30:8617:x1848998412959872:12345-0@lo:5:osp-pre-0-1.0 Request processed in 1529us (1669us total) trans 21474839165 rc 0/0 00000100:00100000:0.0:1763343274.096635:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7167 00000100:00100000:2.0:1763343274.097114:0:8617:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9831500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8617:1848998412959872:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1763343274.097127:0:8617:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x2b3:0x0]-[0x280000400:0x2e1:0x0] 00000100:00100000:0.0:1763343274.099454:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.099585:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.099770:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399824512 00000100:00100000:1.0:1763343274.099781:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399824512 00000100:00100000:2.0:1763343274.099837:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399824384 00000100:00100000:2.0:1763343274.099842:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399824384 00000100:00100000:1.0:1763343274.099847:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10567 00000100:00100000:1.0:1763343274.099861:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57116:x1848998399824512:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:2.0:1763343274.099879:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3726 00010000:00010000:1.0:1763343274.099887:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1763343274.099890:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57114:x1848998399824384:12345-192.168.201.40@tcp:35:lfs.0 00010000:00010000:1.0:1763343274.099914:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2aae lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b492cc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.099993:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcca00/0x9104b1ba770a2ab5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343274.100007:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcca00/0x9104b1ba770a2ab5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.100019:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcca00/0x9104b1ba770a2ab5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:1.0:1763343274.100069:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1fd:0x0]: returning size 0 00000004:00200000:1.0:1763343274.100086:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343274.100104:0:6524:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcca00/0x9104b1ba770a2ab5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.100132:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2aae lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492cc expref: 300 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.100149:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcca00/0x9104b1ba770a2ab5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492cc expref: 299 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.100163:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:1.0:1763343274.100166:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343274.100170:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3bcca00, rc 0) 00000100:00100000:2.0:1763343274.100181:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57114:x1848998399824384:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 293us (735us total) trans 4294973534 rc 0/0 00000100:00100000:2.0:1763343274.100189:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3726 00000100:00100000:1.0:1763343274.100203:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57116:x1848998399824512:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 345us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.100210:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10567 00000100:00100000:0.0:1763343274.103968:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.104009:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.104047:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399824768 00000100:00100000:3.0:1763343274.104058:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399824768 00000100:00100000:0.0:1763343274.104074:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.104111:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3727 00000100:00100000:3.0:1763343274.104121:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57114:x1848998399824768:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343274.104364:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399824896 00000100:00100000:2.0:1763343274.104370:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399824896 00000100:00100000:2.0:1763343274.104409:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399825024 00000100:00100000:2.0:1763343274.104413:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399825024 00000100:00100000:3.0:1763343274.104418:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57114:x1848998399824768:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 295us (458us total) trans 4294973535 rc 0/0 00000100:00100000:1.0:1763343274.104421:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7168 00000100:00100000:3.0:1763343274.104427:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3727 00000100:00100000:1.0:1763343274.104432:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2408:x1848998399824896:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:2.0:1763343274.104445:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7169 00000100:00100000:2.0:1763343274.104467:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399825024:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.104480:0:8413:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.104505:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.104510:0:8413:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2abc lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b492da expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.104521:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2ac3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b492d3 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343274.104534:0:8413:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1763343274.104540:0:28562:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343274.104553:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.104554:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.104557:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.104558:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.104570:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2abc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492da expref: 15 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343274.104570:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2ac3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492d3 expref: 21 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343274.104600:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2ac3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492d3 expref: 21 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343274.104601:0:8413:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2abc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492da expref: 15 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343274.104616:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a6a00, rc 0) 00010000:00010000:2.0:1763343274.104620:0:8413:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5bd8e00, rc 0) 00000100:00100000:1.0:1763343274.104657:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399824896:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 228us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.104664:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7168 00000100:00100000:2.0:1763343274.104741:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998399825024:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 286us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.104749:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7169 00000100:00100000:3.0:1763343274.115345:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.115442:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.115748:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399825280 00000100:00100000:2.0:1763343274.115758:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399825280 00000100:00100000:2.0:1763343274.115811:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3728 00000100:00100000:2.0:1763343274.115821:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57116:x1848998399825280:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343274.116072:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57116:x1848998399825280:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 251us (735us total) trans 4294973536 rc 0/0 00000100:00100000:2.0:1763343274.116081:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3728 00000100:00100000:1.0:1763343274.116369:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399825536 00000100:00100000:1.0:1763343274.116374:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399825536 00000100:00100000:1.0:1763343274.116415:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10568 00000100:00100000:1.0:1763343274.116423:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:55884:x1848998399825536:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343274.116434:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.116459:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2aca lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b492e1 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.116577:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2ad1 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343274.116592:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2ad1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.116603:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2ad1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.116613:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2ad8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343274.116621:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2ad8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.116628:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2ad8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.116666:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2adf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343274.116674:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2adf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.116681:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2adf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343274.116696:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1fd:0x0]: returning size 0 00010000:00010000:1.0:1763343274.116743:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2ad1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.116751:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2ad1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.116757:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2ad1 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.116764:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2ad1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.116770:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb3e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.116775:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2ad1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.116782:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2ad1 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.116795:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497e900) 00010000:00010000:1.0:1763343274.116798:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.116802:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2ad1 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.116809:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2ad1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.116820:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2ad8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.116827:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2ad8 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.116836:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2ad8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.116841:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb3800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.116843:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2ad8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.116849:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2ad8 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.116855:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c497eb00) 00010000:00010000:1.0:1763343274.116857:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.116859:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2ad8 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.116864:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2ad8 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.116893:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2aca lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492e1 expref: 303 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.116912:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2adf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492e1 expref: 302 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.116921:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:1.0:1763343274.116923:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343274.116926:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c7bb2400, rc 0) 00000100:00100000:1.0:1763343274.116967:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:55884:x1848998399825536:12345-192.168.201.40@tcp:101:bash.0 Request processed in 545us (1524us total) trans 4294973537 rc 0/0 00000100:00100000:1.0:1763343274.116974:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10568 00000100:00100000:0.0:1763343274.120758:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.120806:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.121020:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399825792 00000100:00100000:2.0:1763343274.121071:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399825792 00000100:00100000:2.0:1763343274.121136:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10569 00000100:00100000:2.0:1763343274.121145:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:55884:x1848998399825792:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343274.121178:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.121201:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2aed lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b492e8 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.121243:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2af4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.121260:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2af4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.121287:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2af4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.121411:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2aed lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492e8 expref: 304 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.121429:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2af4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492e8 expref: 303 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.121438:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:2.0:1763343274.121441:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343274.121445:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5bd9000, rc 0) 00000100:00100000:2.0:1763343274.121522:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:55884:x1848998399825792:12345-192.168.201.40@tcp:101:bash.0 Request processed in 376us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.121529:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10569 00000100:00100000:1.0:1763343274.121677:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399825664 00000100:00100000:1.0:1763343274.121683:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399825664 00000100:00100000:1.0:1763343274.121732:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 452 00000100:00100000:1.0:1763343274.121741:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:2407:x1848998399825664:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343274.121750:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1763343274.121762:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:1.0:1763343274.121767:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2adf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492e1 expref: 303 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.121780:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:1.0:1763343274.121783:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343274.121810:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:2407:x1848998399825664:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 72us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.121818:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 452 00000100:00100000:3.0:1763343274.121876:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399826048 00000100:00100000:3.0:1763343274.121882:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399826048 00000100:00100000:3.0:1763343274.121916:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10570 00000100:00100000:3.0:1763343274.121927:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57116:x1848998399826048:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343274.121938:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.122778:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2afb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b492ef expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.122872:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2b02 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.122882:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2b02 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.122893:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2b02 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343274.122903:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1fd:0x0]: returning size 0 00010000:00010000:2.0:1763343274.123007:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2afb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492ef expref: 305 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.124223:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2b02 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492ef expref: 304 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.124241:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:2.0:1763343274.124244:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1763343274.124247:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c85ab400, rc 0) 00000100:00100000:2.0:1763343274.124325:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57116:x1848998399826048:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2399us (2562us total) trans 4294973538 rc 0/0 00000100:00100000:2.0:1763343274.124334:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10570 00000100:00100000:0.0:1763343274.127500:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.127624:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399826304 00000100:00100000:2.0:1763343274.127639:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399826304 00000100:00100000:0.0:1763343274.128101:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10571 00000100:00100000:0.0:1763343274.128114:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:55884:x1848998399826304:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:0.0:1763343274.128172:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343274.128202:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcca00/0x9104b1ba770a2ab5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492cc expref: 304 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.128220:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:0.0:1763343274.128225:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343274.128945:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.129009:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399826432 00000100:00100000:3.0:1763343274.129016:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399826432 00000100:00100000:3.0:1763343274.129937:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10572 00000100:00100000:3.0:1763343274.129949:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57116:x1848998399826432:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343274.129967:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343274.129984:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a2b10 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b492f6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.130135:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2b17 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343274.130151:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2b17 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.130163:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2b17 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000001:00080000:0.0:1763343274.130206:0:7641:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973539 00000004:00010000:0.0:1763343274.130238:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000715dc9b8 reply state 0000000056281813 transno 4294973540 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2b17 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.130251:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2b17 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.130259:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:0.0:1763343274.130263:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343274.130266:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343274.130382:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:55884:x1848998399826304:12345-192.168.201.40@tcp:36:bash.0 Request processed in 2269us (3405us total) trans 4294973540 rc 0/0 00000100:00100000:0.0:1763343274.130390:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10571 00000020:00080000:0.0:1763343274.130395:0:7641:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1763343274.130612:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a2b1e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343274.130626:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a2b1e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.130635:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a2b1e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:3.0:1763343274.130658:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1fd:0x0]: returning size 0 00000004:00200000:3.0:1763343274.130662:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343274.130676:0:6524:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a2b1e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.130707:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a2b10 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492f6 expref: 308 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.130724:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a2b1e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492f6 expref: 307 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.130731:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:3.0:1763343274.130734:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343274.130736:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c6b98000, rc 0) 00000100:00100000:3.0:1763343274.130778:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57116:x1848998399826432:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 832us (1837us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343274.130785:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10572 00000100:00100000:3.0:1763343274.135932:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.136162:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.136492:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399826688 00000100:00100000:0.0:1763343274.136503:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399826688 00000100:00100000:0.0:1763343274.136565:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10573 00000100:00100000:0.0:1763343274.136575:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57116:x1848998399826688:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343274.136598:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343274.136622:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fc000/0x9104b1ba770a2b25 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b492fd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.136699:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2b2c lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343274.136713:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2b2c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.136725:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2b2c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.136735:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2b33 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343274.136743:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2b33 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.136749:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2b33 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.136867:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a2b3a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343274.136877:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a2b3a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.136885:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a2b3a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:0.0:1763343274.136895:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1fd:0x0]: returning size 0 00010000:00010000:0.0:1763343274.136979:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2b2c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.136990:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2b2c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.136997:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2b2c lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.137003:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2b2c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.137008:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fca00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343274.137012:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2b2c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.137019:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2b2c lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.137056:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5b00) 00010000:00010000:0.0:1763343274.137060:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343274.137065:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2b2c lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.137071:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2b2c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.137084:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2b33 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.137089:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2b33 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.137094:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2b33 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.137099:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fdc00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343274.137102:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2b33 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.137108:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2b33 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.137114:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c497eb00) 00010000:00010000:0.0:1763343274.137117:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343274.137120:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2b33 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.137125:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2b33 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.137160:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fc000/0x9104b1ba770a2b25 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492fd expref: 310 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.137178:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a2b3a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492fd expref: 309 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.137185:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:0.0:1763343274.137187:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343274.137190:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fd600, rc 0) 00000100:00100000:0.0:1763343274.137252:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57116:x1848998399826688:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 678us (1331us total) trans 4294973541 rc 0/0 00000100:00100000:0.0:1763343274.137260:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10573 00000100:00100000:1.0:1763343274.138056:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399826944 00000100:00100000:1.0:1763343274.138066:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399826944 00000100:00100000:1.0:1763343274.138108:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3729 00000100:00100000:1.0:1763343274.138117:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8442850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:55884:x1848998399826944:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:1.0:1763343274.138313:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8442850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:55884:x1848998399826944:12345-192.168.201.40@tcp:35:bash.0 Request processed in 195us (2149us total) trans 4294973542 rc 0/0 00000100:00100000:1.0:1763343274.138321:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3729 00000100:00100000:0.0:1763343274.140528:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.140621:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399827200 00000100:00100000:2.0:1763343274.140631:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399827200 00000100:00100000:2.0:1763343274.140688:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3730 00000100:00100000:2.0:1763343274.140698:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57116:x1848998399827200:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343274.140890:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57116:x1848998399827200:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 192us (369us total) trans 4294973543 rc 0/0 00000100:00100000:2.0:1763343274.140898:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3730 00000100:00100000:2.0:1763343274.143533:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.143857:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399827456 00000100:00100000:3.0:1763343274.143869:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399827456 00000100:00100000:0.0:1763343274.144056:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.144225:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399827584 00000100:00100000:2.0:1763343274.144230:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399827584 00000100:00100000:2.0:1763343274.144287:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3731 00000100:00100000:2.0:1763343274.144297:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57116:x1848998399827584:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:2.0:1763343274.144461:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57116:x1848998399827584:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 166us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.144468:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3731 00000100:00100000:3.0:1763343274.144689:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10574 00000100:00100000:3.0:1763343274.144699:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:55884:x1848998399827456:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343274.144710:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343274.144713:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1763343274.144738:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2b02 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492ef expref: 311 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.144761:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a2b1e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492f6 expref: 310 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.144772:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:3.0:1763343274.144777:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343274.144789:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a2b48 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49304 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.144827:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a2b4f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343274.144839:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a2b3a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492fd expref: 310 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.144847:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a2b4f lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.144877:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a2b3a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492fd expref: 310 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.144889:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a2b3a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492fd expref: 310 pid: 6524 timeout: 1167 lvb_type: 0 00000100:00100000:3.0:1763343274.144901:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5956a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412960000:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343274.144960:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c3be8300 going to sleep for 11 seconds 00000100:00100000:0.0:1763343274.153897:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5956a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412960000:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343274.153922:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:0.0:1763343274.153934:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a2b4f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343274.154128:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399827712 00000100:00100000:2.0:1763343274.154137:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399827712 00010000:00010000:2.0:1763343274.154172:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a2b3a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492fd expref: 311 pid: 6524 timeout: 1167 lvb_type: 0 00000100:00100000:2.0:1763343274.154216:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3432 00000100:00100000:2.0:1763343274.154226:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:2407:x1848998399827712:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343274.154242:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343274.154250:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a2b3a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492fd expref: 311 pid: 6524 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343274.154263:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a2b3a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492fd expref: 311 pid: 6524 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343274.154308:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a2b3a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492fd expref: 311 pid: 6524 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343274.154325:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:2.0:1763343274.154330:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a2b4f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.154340:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a2b4f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.154348:0:6511:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a2b4f lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.155343:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a2b4f lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.155355:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a2b4f lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000040:00080000:0.0:1763343274.155581:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1704, 88 off141944 00000004:00080000:0.0:1763343274.155588:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1067279563446ns, next at 1068000121327ns, rc = 0 00000040:00080000:0.0:1763343274.155616:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1696, 88 off141288 00000004:00080000:0.0:1763343274.155620:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1067279595584ns, next at 1068000150895ns, rc = 0 00000040:00080000:0.0:1763343274.155650:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1697, 88 off141376 00000004:00080000:0.0:1763343274.155655:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1067279630574ns, next at 1068000150895ns, rc = 0 00000040:00080000:0.0:1763343274.155665:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1705, 88 off142032 00000004:00080000:0.0:1763343274.155668:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1067279643594ns, next at 1068000121327ns, rc = 0 00010000:00010000:2.0:1763343274.156522:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343274.157371:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:2407:x1848998399827712:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 3137us (3439us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.157383:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3432 00000001:00080000:2.0:1763343274.157967:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973544 is committed 00000004:00080000:2.0:1763343274.157973:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1094 committed 00010000:00010000:3.0:1763343274.158230:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a29ea lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.158241:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a29ea lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.158249:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a29ea lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.158255:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a7e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343274.158260:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a29ea lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.158269:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a29ea lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.158297:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c497eb00) 00010000:00010000:3.0:1763343274.158301:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343274.158305:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a29ea lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.158312:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a29ea lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.158331:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2a6f lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.158336:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2a6f lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.158342:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2a6f lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.158347:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a7200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343274.158350:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2a6f lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.158356:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2a6f lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.158362:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c497eb00) 00010000:00010000:3.0:1763343274.158364:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343274.158367:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2a6f lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.158373:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2a6f lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.158390:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2b17 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.158396:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2b17 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.158402:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2b17 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.158407:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fd800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343274.158411:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2b17 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.158417:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2b17 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.158424:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:3.0:1763343274.158426:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343274.158429:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2b17 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.158435:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2b17 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00080000:2.0:1763343274.158492:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1086 committed 00000004:00080000:2.0:1763343274.158504:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1085 committed 00000004:00080000:2.0:1763343274.158507:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1093 committed 00000100:00100000:1.0:1763343274.158796:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c2f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412960128:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343274.158850:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343274.158883:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763343274.158888:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c2f86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412960256:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343274.158907:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343274.158932:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c2f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412960384:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343274.158951:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343274.158964:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763343274.158969:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c2f85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412960512:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343274.158984:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343274.159009:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412960128 00000100:00100000:1.0:1763343274.159015:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412960128 00000100:00100000:1.0:1763343274.159073:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412960256 00000100:00100000:1.0:1763343274.159077:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412960256 00000100:00100000:1.0:1763343274.159090:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412960384 00000100:00100000:1.0:1763343274.159093:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412960384 00000100:00100000:1.0:1763343274.159104:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412960512 00000100:00100000:1.0:1763343274.159106:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412960512 00000100:00100000:1.0:1763343274.159123:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7170 00000100:00100000:1.0:1763343274.159130:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+17:3661:x1848998412960128:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343274.159153:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:689 count 1 00010000:00010000:1.0:1763343274.159175:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2b56 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2b1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.159193:0:35266:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a29b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4927f expref: 14 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.159200:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343274.159203:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343274.159206:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2b56 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.159229:0:35266:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a29b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4927f expref: 14 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.159243:0:35266:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a29b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4927f expref: 14 pid: 28562 timeout: 1167 lvb_type: 0 00000100:00100000:1.0:1763343274.159254:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c2f85f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412960640:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343274.159319:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd0780 going to sleep for 11 seconds 00000100:00100000:1.0:1763343274.159336:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7171 00000100:00100000:1.0:1763343274.159343:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+17:3661:x1848998412960256:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343274.159356:0:35281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:690 count 1 00002000:00010000:1.0:1763343274.159377:0:35281:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343274.159382:0:35281:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2b5d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.159390:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.159392:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.159396:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2b5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.159407:0:35281:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2b5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.159415:0:35281:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2b5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.159422:0:35281:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2b5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.159435:0:35281:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343274.159623:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+18:3661:x1848998412960256:12345-0@lo:6:osp-syn-1-1.0 Request processed in 280us (714us total) trans 17179871895 rc 0/0 00000100:00100000:1.0:1763343274.159633:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7171 00000100:00100000:1.0:1763343274.159650:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7172 00000100:00100000:1.0:1763343274.159656:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+17:3659:x1848998412960384:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343274.159755:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+18:3659:x1848998412960384:12345-0@lo:2:osp-syn-1-1.0 Request processed in 99us (802us total) trans 17179871896 rc 0/0 00000100:00100000:1.0:1763343274.159761:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7172 00000100:00100000:1.0:1763343274.159772:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7173 00000100:00100000:1.0:1763343274.159778:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+17:3659:x1848998412960512:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763343274.159823:0:35281:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2b4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343274.159826:0:35281:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2b4:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343274.159829:0:35281:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343274.159831:0:35281:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2b4:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763343274.159833:0:35281:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2b4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343274.159856:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+18:3659:x1848998412960512:12345-0@lo:2:osp-syn-1-1.0 Request processed in 78us (870us total) trans 17179871897 rc 0/0 00000100:00100000:1.0:1763343274.159861:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7173 00000004:00080000:1.0:1763343274.159912:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c2f85180/2, rc 0, transno 17179871897 00000100:00100000:1.0:1763343274.159918:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c2f85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412960512:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763343274.159927:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c2f84700/2, rc 0, transno 17179871896 00000100:00100000:1.0:1763343274.159930:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c2f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412960384:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763343274.159947:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c2f86d80/2, rc 0, transno 17179871895 00000100:00100000:1.0:1763343274.159951:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c2f86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412960256:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763343274.160053:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343274.160060:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2b5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.160069:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb3800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343274.160074:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2b5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.160089:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2b5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.160107:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2b5d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.160114:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2b5d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.160130:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343274.160132:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343274.160134:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343274.160213:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412961152:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343274.160245:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343274.160265:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343274.160271:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412961024:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343274.160306:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343274.160328:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412961152 00000100:00100000:3.0:1763343274.160333:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412961152 00000100:00100000:3.0:1763343274.160358:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412961024 00000100:00100000:3.0:1763343274.160360:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412961024 00000100:00100000:3.0:1763343274.160376:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7174 00000100:00100000:3.0:1763343274.160382:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+31:3660:x1848998412961152:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763343274.160451:0:8414:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2b3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343274.160454:0:8414:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2b3:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343274.160456:0:8414:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2b3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343274.160459:0:8414:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2b3:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343274.160461:0:8414:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2b3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343274.160489:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+32:3660:x1848998412961152:12345-0@lo:2:osp-syn-0-1.0 Request processed in 108us (243us total) trans 21474839166 rc 0/0 00000100:00100000:3.0:1763343274.160496:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7174 00000100:00100000:3.0:1763343274.160508:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7175 00000100:00100000:3.0:1763343274.160514:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+31:3660:x1848998412961024:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343274.160572:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+32:3660:x1848998412961024:12345-0@lo:2:osp-syn-0-1.0 Request processed in 58us (265us total) trans 21474839167 rc 0/0 00000100:00100000:3.0:1763343274.160578:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7175 00000100:00100000:3.0:1763343274.160598:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412960896:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343274.160620:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343274.160634:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343274.160639:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412960768:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343274.160655:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343274.160672:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412960896 00000100:00100000:3.0:1763343274.160675:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412960896 00000100:00100000:3.0:1763343274.160690:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412960768 00000100:00100000:3.0:1763343274.160692:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412960768 00000100:00100000:3.0:1763343274.160705:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7176 00000100:00100000:3.0:1763343274.160710:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5178000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+33:3662:x1848998412960896:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343274.160721:0:27798:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:689 count 1 00002000:00010000:3.0:1763343274.160739:0:27798:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343274.160744:0:27798:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba770a2b64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.160754:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343274.160756:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343274.160759:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba770a2b64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.160770:0:27798:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba770a2b64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.160777:0:27798:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba770a2b64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.160784:0:27798:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba770a2b64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.160798:0:27798:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343274.160908:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5178000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+34:3662:x1848998412960896:12345-0@lo:6:osp-syn-0-1.0 Request processed in 196us (286us total) trans 21474839168 rc 0/0 00000100:00100000:3.0:1763343274.160914:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7176 00000100:00100000:3.0:1763343274.160926:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7177 00000100:00100000:3.0:1763343274.160931:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+33:3662:x1848998412960768:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343274.160941:0:27798:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:688 count 1 00010000:00010000:3.0:1763343274.160951:0:27798:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2b6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.160962:0:27798:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a29ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49278 expref: 20 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.160969:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343274.160970:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343274.160973:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2b6b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.160993:0:27798:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a29ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49278 expref: 20 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.161004:0:27798:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a29ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49278 expref: 20 pid: 28562 timeout: 1167 lvb_type: 0 00000100:00100000:3.0:1763343274.161014:0:27798:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5179180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27798:1848998412961280:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343274.161077:0:27798:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c3be8300 going to sleep for 11 seconds 00010000:00010000:3.0:1763343274.161089:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343274.161093:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba770a2b64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.161100:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b98000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343274.161104:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba770a2b64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.161112:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba770a2b64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.161124:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba770a2b64 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.161131:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c6b98000/0x9104b1ba770a2b64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.161148:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343274.161151:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343274.161152:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343274.161180:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5957800/2, rc 0, transno 21474839168 00000100:00100000:3.0:1763343274.161185:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412960896:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1763343274.161199:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5954380/2, rc 0, transno 21474839167 00000100:00100000:3.0:1763343274.161203:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412961024:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763343274.161210:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5956300/2, rc 0, transno 21474839166 00000100:00100000:3.0:1763343274.161213:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412961152:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343274.161324:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.162477:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399827968 00000100:00100000:1.0:1763343274.162488:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399827968 00000100:00100000:2.0:1763343274.163105:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10575 00000100:00100000:2.0:1763343274.163119:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57117:x1848998399827968:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.163139:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.163163:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a2b72 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4930b expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.163245:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2b79 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343274.163260:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2b79 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.163273:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2b79 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.163299:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a2b80 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343274.163307:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a2b80 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.163314:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a2b80 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.163429:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2b87 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343274.163439:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2b87 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.163447:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2b87 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:2.0:1763343274.163457:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1fd:0x0]: returning size 2 00010000:00010000:2.0:1763343274.163545:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2b87 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.163553:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2b87 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.163563:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2b87 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.163569:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85ab400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.163574:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2b87 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.163581:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2b87 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.163593:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:2.0:1763343274.163595:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1763343274.163600:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2b87 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.163607:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2b87 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.163619:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2b79 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.163624:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2b79 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.163629:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2b79 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.163634:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8692c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.163636:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2b79 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.163641:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2b79 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.163652:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8800) 00010000:00010000:2.0:1763343274.163654:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.163657:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2b79 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.163662:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2b79 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.163671:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a2b80 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.163677:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a2b80 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.163682:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a2b80 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.163686:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8693e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.163689:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a2b80 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.163695:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a2b80 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.163701:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8500) 00010000:00010000:2.0:1763343274.163703:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.163706:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a2b80 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.163711:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a2b80 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.163745:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a2b72 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4930b expref: 290 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.163754:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8800) 00010000:00010000:2.0:1763343274.163757:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343274.163760:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a2b72 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4930b expref: 290 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.163770:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8693c00, rc 0) 00000100:00100000:2.0:1763343274.163840:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57117:x1848998399827968:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 726us (2515us total) trans 4294973545 rc 301/301 00000100:00100000:2.0:1763343274.163848:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10575 00010000:00010000:3.0:1763343274.164135:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a2b4f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49304 expref: 289 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.164144:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:3.0:1763343274.164147:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763343274.164156:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a2b48 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49304 expref: 289 pid: 7641 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763343274.164169:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a2b4f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49304 expref: 288 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.164188:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:3.0:1763343274.164191:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763343274.164193:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c6b99600, rc 0) 00000100:00100000:3.0:1763343274.164222:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:55884:x1848998399827456:12345-192.168.201.40@tcp:101:bash.0 Request processed in 19526us (20699us total) trans 4294973544 rc 0/0 00000100:00100000:3.0:1763343274.164229:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10574 00000100:00100000:1.0:1763343274.167296:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c2f85f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412960640:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343274.167328:0:35266:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2b56 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343274.167483:0:27798:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5179180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27798:1848998412961280:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343274.167501:0:27798:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2b6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343274.169714:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.170290:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.170421:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399828352 00000100:00100000:1.0:1763343274.170430:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399828352 00000100:00100000:1.0:1763343274.170489:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10576 00000100:00100000:1.0:1763343274.170500:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57117:x1848998399828352:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343274.170520:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.170540:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2b95 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49312 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.170648:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2b9c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343274.170663:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2b9c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.170674:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2b9c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:1.0:1763343274.170704:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1fd:0x0]: returning size 2 00000004:00200000:1.0:1763343274.170708:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343274.170724:0:6524:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2b9c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.170750:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2b95 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49312 expref: 290 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.170766:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2b9c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49312 expref: 289 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.170780:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:1.0:1763343274.170784:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343274.170788:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c7bb3800, rc 0) 00000100:00100000:1.0:1763343274.170844:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57117:x1848998399828352:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 346us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.170851:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10576 00000100:00100000:0.0:1763343274.171014:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.171834:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.171927:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399828480 00000100:00100000:3.0:1763343274.171935:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399828480 00000100:00100000:3.0:1763343274.171975:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7178 00000100:00100000:3.0:1763343274.171984:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:55884:x1848998399828480:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343274.171995:0:8413:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343274.172012:0:8413:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2ba3 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49319 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343274.172050:0:8413:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343274.172068:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343274.172070:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343274.172078:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2ba3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49319 expref: 16 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.172092:0:8413:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2ba3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49319 expref: 16 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.172102:0:8413:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d1e9ec00, rc 0) 00000100:00100000:3.0:1763343274.172136:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:55884:x1848998399828480:12345-192.168.201.40@tcp:101:bash.0 Request processed in 153us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343274.172143:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7178 00000100:00100000:2.0:1763343274.172631:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399828224 00000100:00100000:2.0:1763343274.172637:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399828224 00010000:00010000:2.0:1763343274.172662:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a29b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4927f expref: 16 pid: 28562 timeout: 1167 lvb_type: 0 00000100:00100000:2.0:1763343274.172685:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399828096 00000100:00100000:2.0:1763343274.172689:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399828096 00010000:00010000:2.0:1763343274.172701:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a29ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49278 expref: 21 pid: 28562 timeout: 1167 lvb_type: 0 00000100:00100000:2.0:1763343274.172724:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3433 00000100:00100000:2.0:1763343274.172731:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399828224:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343274.172743:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343274.172748:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a29b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4927f expref: 16 pid: 28562 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343274.172763:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a29b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4927f expref: 16 pid: 28562 timeout: 1167 lvb_type: 0 00000100:00100000:1.0:1763343274.172769:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3434 00000100:00100000:1.0:1763343274.172784:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8393c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399828096:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343274.172790:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a29b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4927f expref: 16 pid: 28562 timeout: 1167 lvb_type: 0 00010000:00010000:1.0:1763343274.172797:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343274.172804:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.172806:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a29ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49278 expref: 21 pid: 28562 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343274.172808:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.172814:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2b56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.172824:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a29ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49278 expref: 21 pid: 28562 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343274.172826:0:6511:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2b56 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.172852:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a29ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49278 expref: 21 pid: 28562 timeout: 1167 lvb_type: 0 00010000:00010000:1.0:1763343274.172864:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.172867:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343274.172867:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.172873:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2b6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.172881:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2b6b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343274.172902:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998399828224:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 170us (2623us total) trans 0 rc 0/0 00010000:00010000:1.0:1763343274.172908:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343274.172912:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3433 00000100:00100000:1.0:1763343274.172932:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8393c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399828096:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 151us (1918us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.172939:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3434 00010000:00010000:1.0:1763343274.172988:0:35266:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2b56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.172996:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2b56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.173005:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2b56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.173012:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2b56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.173041:0:35266:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343274.173075:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343274.173082:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2b56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.173091:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb2400 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343274.173095:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2b56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.173105:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2b56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.173118:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2b56 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.173126:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2b56 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.173145:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343274.173148:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343274.173150:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343274.173262:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+18:3661:x1848998412960128:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14131us (14411us total) trans 17179871898 rc 0/0 00000100:00100000:1.0:1763343274.173270:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7170 00010000:00010000:1.0:1763343274.173305:0:27798:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2b6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.173313:0:27798:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2b6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.173325:0:27798:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2b6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.173332:0:27798:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2b6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.173347:0:27798:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343274.173480:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+34:3662:x1848998412960768:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12548us (12823us total) trans 21474839169 rc 0/0 00000100:00100000:1.0:1763343274.173488:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7177 00010000:00010000:1.0:1763343274.173509:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343274.173516:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2b6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.173523:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400cbad3c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343274.173526:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2b6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.173533:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2b6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.173544:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2b6b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.173551:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2b6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.173573:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343274.173575:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343274.173577:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343274.173622:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5955c00/2, rc 0, transno 21474839169 00000004:00080000:2.0:1763343274.173630:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c2f84380/2, rc 0, transno 17179871898 00000100:00100000:1.0:1763343274.173630:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412960768:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763343274.173639:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c2f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412960128:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343274.174272:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.174516:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399828608 00000100:00100000:1.0:1763343274.174523:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399828608 00000100:00100000:1.0:1763343274.174565:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7179 00000100:00100000:1.0:1763343274.174575:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:55884:x1848998399828608:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343274.174591:0:27798:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.174609:0:27798:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a2baa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49320 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343274.174630:0:27798:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343274.174647:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.174649:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.174657:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a2baa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49320 expref: 21 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.174669:0:27798:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a2baa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49320 expref: 21 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.174680:0:27798:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3bcca00, rc 0) 00000100:00100000:1.0:1763343274.174727:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:55884:x1848998399828608:12345-192.168.201.40@tcp:101:bash.0 Request processed in 155us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.174734:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7179 00000100:00100000:1.0:1763343274.178331:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.178383:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399828864 00000100:00100000:0.0:1763343274.178394:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399828864 00000100:00100000:2.0:1763343274.179096:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3732 00000100:00100000:2.0:1763343274.179112:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57117:x1848998399828864:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343274.179356:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57117:x1848998399828864:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 248us (1034us total) trans 4294973546 rc 0/0 00000100:00100000:2.0:1763343274.179364:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3732 00000100:00100000:3.0:1763343274.180377:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.180603:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399829120 00000100:00100000:2.0:1763343274.180615:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399829120 00002000:00010000:2.0:1763343274.180648:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/690 (0->18446744073709551615) 00002000:00100000:2.0:1763343274.180652:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5179180 with x1848998399829120 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343274.180664:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5179180. 00000100:00100000:2.0:1763343274.180691:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1713 00000100:00100000:2.0:1763343274.180789:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399829120:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:2.0:1763343274.180943:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2b2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343274.180946:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2b2:0x0] updating lvb mtime from disk: 0 -> 1763343273 00002000:00010000:2.0:1763343274.180949:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2b2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343274.180952:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2b2:0x0] updating lvb ctime from disk: 0 -> 1763343273 00002000:00010000:2.0:1763343274.180956:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2b2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343274.181008:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2408:x1848998399829120:12345-192.168.201.40@tcp:10:bash.0 Request processed in 309us (634us total) trans 21474839170 rc 0/0 00000100:00100000:2.0:1763343274.181016:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1713 00002000:00010000:2.0:1763343274.181019:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/690 (0->18446744073709551615) 00002000:00100000:2.0:1763343274.181038:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5179180 with x1848998399829120 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343274.181043:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5179180. 00000100:00100000:3.0:1763343274.181087:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.181323:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399828992 00000100:00100000:0.0:1763343274.181328:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399828992 00002000:00010000:0.0:1763343274.181350:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/691 (0->18446744073709551615) 00002000:00100000:0.0:1763343274.181354:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c517b100 with x1848998399828992 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343274.181361:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c517b100. 00000100:00100000:0.0:1763343274.181379:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1714 00000100:00100000:0.0:1763343274.181386:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998399828992:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:0.0:1763343274.181478:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2b3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343274.181481:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2b3:0x0] updating lvb mtime from disk: 0 -> 1763343273 00002000:00010000:0.0:1763343274.181483:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2b3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343274.181485:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2b3:0x0] updating lvb ctime from disk: 0 -> 1763343273 00002000:00010000:0.0:1763343274.181488:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2b3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343274.181509:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399828992:12345-192.168.201.40@tcp:10:bash.0 Request processed in 124us (728us total) trans 17179871899 rc 0/0 00000100:00100000:0.0:1763343274.181515:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1714 00002000:00010000:0.0:1763343274.181518:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/691 (0->18446744073709551615) 00002000:00100000:0.0:1763343274.181520:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c517b100 with x1848998399828992 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343274.181524:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c517b100. 00000100:00100000:1.0:1763343274.183870:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.184333:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399829248 00000100:00100000:3.0:1763343274.184346:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399829248 00000100:00100000:3.0:1763343274.184408:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10577 00000100:00100000:3.0:1763343274.184417:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57117:x1848998399829248:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343274.184441:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343274.184468:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a2bb1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49327 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.184536:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2bb8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343274.184617:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2bb8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.184631:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2bb8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.184646:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2bbf lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343274.184654:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2bbf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.184664:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2bbf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.184739:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2bc6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343274.184749:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2bc6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.184756:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2bc6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:3.0:1763343274.184800:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1fd:0x0]: returning size 2 00000004:00200000:3.0:1763343274.184804:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343274.184822:0:7641:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2bc6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.184832:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2bc6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.184841:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2bb8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.184846:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2bb8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.184851:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2bb8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.184858:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2bb8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.184863:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343274.184868:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2bb8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.184874:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2bb8 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.184886:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6696500) 00010000:00010000:3.0:1763343274.184889:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343274.184893:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2bb8 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.184899:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a2bb8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.184914:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2bbf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.184919:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2bbf lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.184924:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2bbf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.184929:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a7200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343274.184931:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2bbf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.184937:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2bbf lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.184943:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c488b500) 00010000:00010000:3.0:1763343274.184946:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343274.184949:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2bbf lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.184954:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2bbf lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.184981:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a2bb1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49327 expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.184996:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2bc6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49327 expref: 291 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.185002:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:3.0:1763343274.185005:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343274.185007:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a7e00, rc 0) 00000100:00100000:3.0:1763343274.185087:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57117:x1848998399829248:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 670us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343274.185093:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10577 00000100:00100000:2.0:1763343274.190782:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.190881:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.190913:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.190975:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399829888 00000100:00100000:0.0:1763343274.190975:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399829504 00000100:00100000:3.0:1763343274.190985:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399829888 00000100:00100000:0.0:1763343274.190985:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399829504 00000100:00100000:3.0:1763343274.191065:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10578 00000100:00100000:0.0:1763343274.191067:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 453 00000100:00100000:3.0:1763343274.191076:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57117:x1848998399829888:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:0.0:1763343274.191076:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9833480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:2407:x1848998399829504:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343274.191096:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343274.191098:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343274.191116:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a2bcd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4932e expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.191122:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2bc6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49327 expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.191140:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:0.0:1763343274.191145:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343274.191197:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9833480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:2407:x1848998399829504:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 124us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343274.191205:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 453 00010000:00010000:3.0:1763343274.191224:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2bd4 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00000100:00100000:0.0:1763343274.191229:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399829632 00000100:00100000:0.0:1763343274.191232:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399829632 00010000:00010000:3.0:1763343274.191237:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2b9c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49312 expref: 292 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.191247:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2bd4 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x1fd:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00000100:00100000:0.0:1763343274.191254:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3733 00000100:00100000:0.0:1763343274.191259:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:55884:x1848998399829632:12345-192.168.201.40@tcp:35:bash.0 00010000:00010000:3.0:1763343274.191292:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2b9c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49312 expref: 292 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.191307:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2b9c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49312 expref: 292 pid: 6524 timeout: 1167 lvb_type: 0 00000100:00100000:3.0:1763343274.191321:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c517bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412961408:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343274.191374:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c3be8300 going to sleep for 11 seconds 00000100:00100000:0.0:1763343274.191488:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:55884:x1848998399829632:12345-192.168.201.40@tcp:35:bash.0 Request processed in 226us (716us total) trans 4294973547 rc 0/0 00000100:00100000:0.0:1763343274.191495:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3733 00000100:00100000:2.0:1763343274.200513:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.200829:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c517bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412961408:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343274.200863:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2bd4 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1fd:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:0.0:1763343274.200943:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399830016 00000100:00100000:0.0:1763343274.200951:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399830016 00010000:00010000:0.0:1763343274.200988:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2b9c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49312 expref: 293 pid: 6524 timeout: 1167 lvb_type: 0 00000100:00100000:0.0:1763343274.201056:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3435 00000100:00100000:0.0:1763343274.201066:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:2407:x1848998399830016:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343274.201085:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343274.201094:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2b9c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49312 expref: 293 pid: 6524 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.201113:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2b9c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49312 expref: 293 pid: 6524 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.201136:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2b9c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49312 expref: 293 pid: 6524 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.201150:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:0.0:1763343274.201155:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2bd4 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1fd:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.201165:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2bd4 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1fd:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.201177:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2bd4 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x1fd:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.201254:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343274.201307:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2bd4 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1fd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.201315:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2bd4 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1fd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:1.0:1763343274.201337:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:2407:x1848998399830016:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 270us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.201347:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3435 00000004:00200000:3.0:1763343274.201694:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1fd:0x0]: returning size 2 00010000:00010000:2.0:1763343274.201894:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a2bcd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4932e expref: 293 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.201911:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2bd4 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1fd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4932e expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.201918:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:2.0:1763343274.201921:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1763343274.201924:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c7ec0600, rc 0) 00000100:00100000:2.0:1763343274.201968:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57117:x1848998399829888:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 10894us (11087us total) trans 4294973548 rc 0/0 00000100:00100000:2.0:1763343274.201977:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10578 00000100:00100000:2.0:1763343274.205751:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.205834:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399830144 00000100:00100000:3.0:1763343274.205846:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399830144 00000100:00100000:3.0:1763343274.205912:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10579 00000100:00100000:3.0:1763343274.205922:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57118:x1848998399830144:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:3.0:1763343274.205951:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343274.205976:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2be2 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49335 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343274.206552:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.206866:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399830272 00000100:00100000:3.0:1763343274.206873:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399830272 00000100:00100000:3.0:1763343274.207010:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10580 00000100:00100000:3.0:1763343274.207018:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57117:x1848998399830272:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.207234:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2be9 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.207248:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2be9 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.207260:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2be9 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.207282:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2bf0 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.207289:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2bf0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.207295:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2bf0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.207350:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343274.207360:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2bf7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4933c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.207364:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2bfe lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.207375:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2bd4 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x1fd:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4932e expref: 295 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.207382:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2bfe lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.207416:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2bd4 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1fd:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4932e expref: 295 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.207430:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2bd4 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1fd:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4932e expref: 295 pid: 7641 timeout: 1167 lvb_type: 0 00000100:00100000:2.0:1763343274.207444:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc73800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412961536:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343274.207525:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c546ef00 going to sleep for 11 seconds 00010000:00010000:2.0:1763343274.207678:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2c05 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343274.207692:0:6524:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2c05 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.207698:0:6524:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2c05 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000100:00100000:0.0:1763343274.216989:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc73800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412961536:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343274.217066:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2bfe lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:1.0:1763343274.217323:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.217398:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399830400 00000100:00100000:2.0:1763343274.217405:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399830400 00010000:00010000:2.0:1763343274.217440:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2bd4 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1fd:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4932e expref: 296 pid: 7641 timeout: 1167 lvb_type: 0 00000100:00100000:2.0:1763343274.217682:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3436 00000100:00100000:2.0:1763343274.217693:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:2408:x1848998399830400:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343274.217708:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343274.217715:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2bd4 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1fd:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4932e expref: 296 pid: 7641 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343274.217728:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2bd4 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1fd:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4932e expref: 296 pid: 7641 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343274.217750:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2bd4 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1fd:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4932e expref: 296 pid: 7641 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343274.217767:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:2.0:1763343274.217771:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2bfe lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.217782:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2bfe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.217795:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2bfe lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.217802:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2c05 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.217807:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2c05 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.217812:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2c05 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.218530:0:6524:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2c05 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.218540:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2c05 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:1.0:1763343274.218592:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1fd:0x0]: returning size 5 00000004:00200000:1.0:1763343274.218596:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343274.218613:0:6524:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2c05 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.218647:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2bf7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4933c expref: 296 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.218663:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2c05 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4933c expref: 295 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.218671:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:1.0:1763343274.218674:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343274.218677:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c7bb3e00, rc 0) 00000100:00100000:1.0:1763343274.218740:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57117:x1848998399830272:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 11722us (12190us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.218751:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10580 00010000:00010000:2.0:1763343274.218836:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343274.218873:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:2408:x1848998399830400:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1181us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.218880:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3436 00010000:00010000:0.0:1763343274.219495:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2bfe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.219505:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2bfe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343274.219536:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1fd:0x0]: returning size 5 00000004:00200000:0.0:1763343274.219540:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343274.219554:0:7641:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2bfe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.219567:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2bfe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.219577:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2be9 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.219584:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2be9 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.219590:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2be9 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.219596:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2be9 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.219601:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85aa600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343274.219606:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2be9 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.219612:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2be9 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.219624:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b500) 00010000:00010000:0.0:1763343274.219627:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343274.219631:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2be9 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.219637:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2be9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.219652:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2bf0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.219658:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2bf0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.219663:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2bf0 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.219667:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85abe00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343274.219670:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2bf0 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.219676:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2bf0 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.219683:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8800) 00010000:00010000:0.0:1763343274.219685:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343274.219689:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2bf0 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.219698:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2bf0 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.219732:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2be2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49335 expref: 294 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.219747:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2bfe lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49335 expref: 293 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.219754:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:0.0:1763343274.219757:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343274.219759:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c85ab400, rc 0) 00000100:00100000:0.0:1763343274.219790:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57118:x1848998399830144:12345-192.168.201.40@tcp:101:rm.0 Request processed in 13870us (14049us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343274.219798:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10579 00000100:00100000:1.0:1763343274.221608:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.221914:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399830656 00000100:00100000:0.0:1763343274.221926:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399830656 00000100:00100000:0.0:1763343274.221985:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10581 00000100:00100000:0.0:1763343274.221996:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57117:x1848998399830656:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343274.222018:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343274.222090:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a2c0c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49343 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.222193:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2c13 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343274.222208:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2c13 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.222224:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2c13 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343274.222238:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1fd:0x0]: returning size 5 00010000:00010000:0.0:1763343274.222354:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a2c0c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49343 expref: 296 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.222372:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2c13 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49343 expref: 295 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.222381:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:0.0:1763343274.222384:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343274.222388:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba2c00, rc 0) 00000100:00100000:0.0:1763343274.222455:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57117:x1848998399830656:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 460us (853us total) trans 4294973549 rc 0/0 00000100:00100000:0.0:1763343274.222463:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10581 00000100:00100000:3.0:1763343274.222752:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.222956:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399831040 00000100:00100000:1.0:1763343274.222964:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399831040 00000100:00100000:1.0:1763343274.223004:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10582 00000100:00100000:1.0:1763343274.223012:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57118:x1848998399831040:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:1.0:1763343274.223065:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763343274.223086:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a2b4f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49304 expref: 295 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.223103:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2c05 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4933c expref: 294 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.223114:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2af4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492e8 expref: 293 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.223123:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:1.0:1763343274.223126:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343274.223150:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2c21 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343274.223159:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2c21 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.223168:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2c21 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.223180:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2c28 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343274.223191:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2c28 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.223197:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2c28 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.223291:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a2c2f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343274.223301:0:6524:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2bfe lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49335 expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.223309:0:6524:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a2c2f lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.223340:0:6524:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2bfe lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49335 expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.223356:0:6524:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2bfe lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49335 expref: 292 pid: 7641 timeout: 1167 lvb_type: 0 00000100:00100000:1.0:1763343274.223370:0:6524:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b9ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412961664:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343274.223431:0:6524:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd0300 going to sleep for 11 seconds 00000100:00100000:3.0:1763343274.224745:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.224990:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399830784 00000100:00100000:0.0:1763343274.224998:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399830784 00010000:00010000:0.0:1763343274.225065:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2bfe lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49335 expref: 293 pid: 7641 timeout: 1167 lvb_type: 0 00000100:00100000:0.0:1763343274.225099:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3437 00000100:00100000:0.0:1763343274.225109:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:2408:x1848998399830784:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343274.225122:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343274.225129:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2bfe lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49335 expref: 293 pid: 7641 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.225148:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2bfe lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49335 expref: 293 pid: 7641 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.225171:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:0.0:1763343274.225176:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a2c2f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.225185:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a2c2f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.225192:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a2c2f lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.225208:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343274.225244:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:2408:x1848998399830784:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 137us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343274.225251:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3437 00000100:00100000:3.0:1763343274.225470:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.225601:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399831168 00000100:00100000:1.0:1763343274.225606:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399831168 00000100:00100000:1.0:1763343274.225644:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10583 00000100:00100000:1.0:1763343274.225651:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57117:x1848998399831168:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343274.225669:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.225682:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a2c36 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4934a expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.225732:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a2c36 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4934a expref: 294 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.225744:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a2c36 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4934a expref: 294 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.225760:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:1.0:1763343274.225763:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343274.225766:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401ed154e00, rc 0) 00000100:00100000:1.0:1763343274.225794:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57117:x1848998399831168:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 144us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.225801:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10583 00010000:00010000:1.0:1763343274.227542:0:6524:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.40@tcp) returned -22 from blocking AST (req@000000001b1ca1ab x1848998412961664) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2bfe lrc: 1/0,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49335 expref: 293 pid: 7641 timeout: 1167 lvb_type: 0 00010000:00010000:1.0:1763343274.227563:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2bfe lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49335 expref: 293 pid: 7641 timeout: 1167 lvb_type: 0 00000100:00100000:1.0:1763343274.227578:0:6524:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b9ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412961664:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343274.227598:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:1.0:1763343274.227605:0:6524:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a2c2f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.227613:0:6524:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a2c2f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.227619:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a2c2f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000100:00100000:3.0:1763343274.228413:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.228478:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399831296 00000100:00100000:2.0:1763343274.228487:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399831296 00000100:00100000:2.0:1763343274.228543:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7180 00000100:00100000:2.0:1763343274.228553:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2410:x1848998399831296:12345-192.168.201.40@tcp:1:lfs.0 00010000:00010000:2.0:1763343274.228597:0:27798:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2c3d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.228614:0:27798:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2ba3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49319 expref: 16 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.228622:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343274.228624:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343274.228627:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2c3d lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.228665:0:27798:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2ba3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49319 expref: 16 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.228680:0:27798:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2ba3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49319 expref: 16 pid: 8413 timeout: 1167 lvb_type: 0 00000100:00100000:2.0:1763343274.228695:0:27798:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:27798:1848998412961792:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343274.228771:0:27798:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c546e9c0 going to sleep for 11 seconds 00000004:00080000:1.0:1763343274.229199:0:6524:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x1fd:0x0] is inserted into orphan list, open count = 2 00010000:00010000:1.0:1763343274.229311:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a2c2f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.229320:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a2c2f lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.229326:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a2c2f lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.229331:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401ed154800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.229335:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a2c2f lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.229343:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a2c2f lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.229357:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:1.0:1763343274.229360:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343274.229365:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a2c2f lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.229370:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a2c2f lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.229387:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2c21 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.229393:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2c21 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.229398:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2c21 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.229407:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2c21 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.229412:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3bcc200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.229415:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2c21 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.229420:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2c21 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.229427:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497eb00) 00010000:00010000:1.0:1763343274.229430:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.229433:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2c21 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.229438:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2c21 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000004:00010000:1.0:1763343274.229454:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d678e025 reply state 0000000016e3a99f transno 4294973550 ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2c28 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.229464:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2c28 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.229472:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c497ef00) 00010000:00010000:1.0:1763343274.229474:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343274.229477:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343274.229539:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57118:x1848998399831040:12345-192.168.201.40@tcp:36:rm.0 Request processed in 6527us (6786us total) trans 4294973550 rc 0/0 00000100:00100000:1.0:1763343274.229552:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10582 00000100:00100000:3.0:1763343274.230540:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.230602:0:27798:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:27798:1848998412961792:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343274.230628:0:27798:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2c3d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343274.230683:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399831424 00000100:00100000:2.0:1763343274.230691:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399831424 00002000:00100000:2.0:1763343274.230732:0:28386:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000400:0x2b3:0x0] (0->4) req@ffff9400c3728380 x1848998399831424/t0(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:15/0 lens 496/0 e 0 to 0 dl 1763343285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763343274.230742:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c3728380 with x1848998399831424 ext(0->4) 00010000:00010000:2.0:1763343274.230750:0:28386:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2ba3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49319 expref: 17 pid: 8413 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343274.230765:0:28386:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2ba3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49319 expref: 17 pid: 8413 timeout: 1167 lvb_type: 0 00002000:00010000:2.0:1763343274.230773:0:28386:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9400c3728380 00000100:00100000:2.0:1763343274.230804:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 118 00000100:00100000:2.0:1763343274.230814:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998399831424:12345-192.168.201.40@tcp:4:bash.0 00000100:00100000:2.0:1763343274.237109:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2407:x1848998399831424:12345-192.168.201.40@tcp:4:bash.0 Request processed in 6283us (6559us total) trans 17179871900 rc 0/0 00000100:00100000:2.0:1763343274.237131:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 118 00002000:00100000:2.0:1763343274.237150:0:28386:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000400:0x2b3:0x0] (0->4) req@ffff9400c3728380 x1848998399831424/t17179871900(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:15/0 lens 496/448 e 0 to 0 dl 1763343285 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763343274.237162:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c3728380 with x1848998399831424 ext(0->4) 00010000:00010000:2.0:1763343274.237173:0:28386:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2ba3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49319 expref: 19 pid: 8413 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343274.237196:0:28386:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2ba3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49319 expref: 19 pid: 8413 timeout: 1167 lvb_type: 0 00002000:00010000:2.0:1763343274.237205:0:28386:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9400c3728380 00000100:00100000:2.0:1763343274.239946:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.240776:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399831552 00000100:00100000:0.0:1763343274.240788:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399831552 00010000:00010000:0.0:1763343274.240834:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2ba3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49319 expref: 19 pid: 8413 timeout: 1167 lvb_type: 0 00000100:00100000:0.0:1763343274.244309:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3438 00000100:00100000:0.0:1763343274.244334:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2409:x1848998399831552:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343274.244362:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1763343274.244385:0:7904:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2b3:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:0.0:1763343274.244389:0:7904:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2b3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1763343274.244397:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2ba3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49319 expref: 19 pid: 8413 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.244415:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2ba3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49319 expref: 19 pid: 8413 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.244443:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a2ba3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49319 expref: 19 pid: 8413 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.244463:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.244465:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.244471:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2c3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.244481:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2c3d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.244521:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343274.244559:0:27798:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2c3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.244571:0:27798:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2c3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343274.244591:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2409:x1848998399831552:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 268us (4654us total) trans 0 rc 0/0 00010000:00010000:1.0:1763343274.244592:0:27798:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2c3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343274.244608:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3438 00010000:00010000:1.0:1763343274.244609:0:27798:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2c3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.244620:0:27798:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2c3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.244627:0:27798:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb2400 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343274.244632:0:27798:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2c3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.244639:0:27798:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2c3d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.244652:0:27798:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2c3d lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.244664:0:27798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2c3d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343274.244721:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2410:x1848998399831296:12345-192.168.201.40@tcp:1:lfs.0 Request processed in 16170us (16310us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.244728:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7180 00000100:00100000:1.0:1763343274.250451:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.250531:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399831808 00000100:00100000:3.0:1763343274.250543:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399831808 00000100:00100000:1.0:1763343274.250560:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.250654:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399831936 00000100:00100000:0.0:1763343274.250659:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399831936 00000100:00100000:0.0:1763343274.250721:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10584 00000100:00100000:0.0:1763343274.250732:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57119:x1848998399831936:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343274.250755:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343274.250780:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a2c44 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49351 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.250871:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a2c4b lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343274.250888:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a2c4b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.250900:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a2c4b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.250912:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a2c52 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343274.250921:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a2c52 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.250927:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a2c52 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.250987:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a2c4b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.250995:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a2c4b lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.251001:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a2c4b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.251006:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343274.251010:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a2c4b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.251017:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a2c4b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.251063:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c52ece00) 00010000:00010000:0.0:1763343274.251066:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343274.251071:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a2c4b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.251077:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a2c4b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.251089:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a2c52 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.251095:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a2c52 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.251101:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a2c52 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.251110:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343274.251113:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a2c52 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.251118:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a2c52 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.251125:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c497ef00) 00010000:00010000:0.0:1763343274.251127:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343274.251130:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a2c52 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.251135:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a2c52 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.251163:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a2c44 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49351 expref: 295 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.251173:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c52ece00) 00010000:00010000:0.0:1763343274.251175:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343274.251179:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a2c44 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49351 expref: 295 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.251192:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3c00, rc 0) 00000100:00100000:0.0:1763343274.251244:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57119:x1848998399831936:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 514us (683us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343274.251252:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10584 00000100:00100000:3.0:1763343274.251737:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10585 00000100:00100000:3.0:1763343274.251746:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57117:x1848998399831808:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:3.0:1763343274.251775:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343274.251790:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a2c36 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4934a expref: 294 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.251803:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:3.0:1763343274.251807:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343274.251829:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2c59 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343274.251837:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2c59 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.251844:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2c59 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000040:00080000:3.0:1763343274.252065:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1706, 88 off142120 00000004:00080000:3.0:1763343274.252073:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1067376047879ns, next at 1068000121327ns, rc = 0 00000040:00080000:3.0:1763343274.252107:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1698, 88 off141464 00000004:00080000:3.0:1763343274.252111:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1067376086155ns, next at 1068000150895ns, rc = 0 00000040:00080000:3.0:1763343274.252139:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1699, 88 off141552 00000004:00080000:3.0:1763343274.252143:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1067376118724ns, next at 1068000150895ns, rc = 0 00000040:00080000:3.0:1763343274.252152:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1707, 88 off142208 00000004:00080000:3.0:1763343274.252156:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1067376131389ns, next at 1068000121327ns, rc = 0 00000001:00080000:2.0:1763343274.255664:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973551 is committed 00000004:00080000:2.0:1763343274.255678:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1096 committed 00000004:00080000:2.0:1763343274.255694:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1088 committed 00000004:00080000:2.0:1763343274.255705:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1087 committed 00000004:00080000:2.0:1763343274.255709:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1095 committed 00000100:00100000:1.0:1763343274.255801:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412962048:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343274.255876:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343274.255928:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763343274.255933:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412961920:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343274.255954:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343274.255987:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412962048 00000100:00100000:1.0:1763343274.255996:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412962048 00000100:00100000:1.0:1763343274.256063:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412961920 00000100:00100000:1.0:1763343274.256067:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412961920 00000100:00100000:1.0:1763343274.256084:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7181 00000100:00100000:1.0:1763343274.256091:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+19:3662:x1848998412962048:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763343274.256243:0:35266:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2b4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343274.256247:0:35266:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2b4:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343274.256250:0:35266:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343274.256252:0:35266:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2b4:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763343274.256254:0:35266:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2b4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343274.256303:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+20:3662:x1848998412962048:12345-0@lo:2:osp-syn-1-1.0 Request processed in 211us (426us total) trans 17179871901 rc 0/0 00000100:00100000:1.0:1763343274.256314:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7181 00000100:00100000:1.0:1763343274.256332:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7182 00000100:00100000:1.0:1763343274.256339:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+19:3662:x1848998412961920:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343274.256408:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+20:3662:x1848998412961920:12345-0@lo:2:osp-syn-1-1.0 Request processed in 69us (452us total) trans 17179871902 rc 0/0 00000100:00100000:1.0:1763343274.256413:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7182 00000004:00080000:1.0:1763343274.256452:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5a3d500/2, rc 0, transno 17179871902 00000100:00100000:1.0:1763343274.256457:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412961920:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763343274.256464:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5a3e300/2, rc 0, transno 17179871901 00000100:00100000:1.0:1763343274.256467:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412962048:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1763343274.258217:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2c28 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.258231:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2c28 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.258239:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2c28 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.258246:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400cbad3c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343274.258251:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2c28 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.258259:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2c28 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.258290:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c497ef00) 00010000:00010000:3.0:1763343274.258294:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343274.258299:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2c28 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.258304:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a2c28 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000004:00010000:3.0:1763343274.258481:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001b1ca1ab reply state 00000000545b580b transno 4294973551 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2c59 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.258495:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2c59 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.258502:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:3.0:1763343274.258506:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1763343274.258511:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1763343274.258629:0:6524:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763343274.258648:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57117:x1848998399831808:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 6899us (8204us total) trans 4294973551 rc 0/0 00000100:00100000:3.0:1763343274.258659:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10585 00010000:00010000:3.0:1763343274.258686:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2c59 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.258693:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2c59 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.258698:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2c59 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.258703:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a7e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343274.258705:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2c59 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.258711:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2c59 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.258719:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:3.0:1763343274.258722:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343274.258725:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2c59 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.258729:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2c59 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000100:00100000:3.0:1763343274.258799:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.258800:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412962176:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343274.258847:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343274.258882:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763343274.258888:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412962304:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343274.258913:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343274.258940:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412962176 00000100:00100000:3.0:1763343274.258949:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412962176 00000100:00100000:3.0:1763343274.258991:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412962304 00000100:00100000:3.0:1763343274.258995:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412962304 00000100:00100000:2.0:1763343274.259055:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7183 00000100:00100000:3.0:1763343274.259065:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7184 00000100:00100000:2.0:1763343274.259071:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+35:3659:x1848998412962176:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343274.259078:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+35:3659:x1848998412962304:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343274.259629:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399832064 00000100:00100000:0.0:1763343274.259636:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399832064 00000100:00100000:0.0:1763343274.259687:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10586 00000100:00100000:0.0:1763343274.259696:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57119:x1848998399832064:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343274.259709:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343274.259740:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2c60 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49358 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.259811:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2c67 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343274.259821:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2c67 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.259831:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2c67 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.259842:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2c6e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343274.259847:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2c6e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.259852:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2c6e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.259887:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2c67 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.259893:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2c67 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.259903:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2c67 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.259908:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85ab400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343274.259912:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2c67 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.259919:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2c67 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.259928:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c52ec700) 00010000:00010000:0.0:1763343274.259932:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343274.259935:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2c67 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.259941:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a2c67 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.259953:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2c6e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.259959:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2c6e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.259964:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2c6e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.259969:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85abe00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343274.259972:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2c6e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.259977:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2c6e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.259983:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c52ec500) 00010000:00010000:0.0:1763343274.259986:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343274.259988:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2c6e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.259992:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a2c6e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.260055:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2c60 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49358 expref: 287 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.260067:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c52ec700) 00010000:00010000:0.0:1763343274.260070:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343274.260074:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a2c60 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49358 expref: 287 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.260087:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3a00, rc 0) 00000100:00100000:0.0:1763343274.260141:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+286:57119:x1848998399832064:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 446us (1346us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343274.260149:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10586 00002000:00010000:3.0:1763343274.264091:0:8413:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2b3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343274.264096:0:35266:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2b2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343274.264105:0:35266:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2b2:0x0] updating lvb mtime from disk: 1763343273 -> 1763343273 00002000:00010000:3.0:1763343274.264106:0:8413:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2b3:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763343274.264110:0:35266:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2b2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343274.264112:0:8413:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2b3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343274.264114:0:35266:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2b2:0x0] updating lvb ctime from disk: 1763343273 -> 1763343273 00002000:00010000:3.0:1763343274.264117:0:8413:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2b3:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763343274.264119:0:35266:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2b2:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1763343274.264124:0:8413:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2b3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343274.264246:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.264260:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+37:3659:x1848998412962176:12345-0@lo:2:osp-syn-0-1.0 Request processed in 5191us (5407us total) trans 21474839171 rc 0/0 00000100:00100000:3.0:1763343274.264261:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+37:3659:x1848998412962304:12345-0@lo:2:osp-syn-0-1.0 Request processed in 5180us (5340us total) trans 21474839172 rc 0/0 00000100:00100000:3.0:1763343274.264290:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7184 00000100:00100000:2.0:1763343274.264297:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7183 00000100:00100000:0.0:1763343274.264309:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.264342:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399832192 00000100:00100000:0.0:1763343274.264350:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399832192 00000004:00080000:1.0:1763343274.264400:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bfdf80/2, rc 0, transno 21474839172 00000100:00100000:1.0:1763343274.264408:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412962304:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343274.264409:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399832320 00000100:00100000:0.0:1763343274.264415:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399832320 00000004:00080000:1.0:1763343274.264420:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bfc380/2, rc 0, transno 21474839171 00000100:00100000:1.0:1763343274.264425:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412962176:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343274.264456:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10587 00000100:00100000:1.0:1763343274.264464:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10588 00000100:00100000:0.0:1763343274.264471:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57119:x1848998399832192:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:1.0:1763343274.264479:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:57117:x1848998399832320:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343274.264498:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343274.264498:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.264519:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a2c75 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49366 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.264521:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2c7c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4935f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.264592:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2c83 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343274.264609:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2c83 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.264623:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2c83 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:0.0:1763343274.264681:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343274.264687:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343274.264725:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a2c7c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4935f expref: 290 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.264743:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2c83 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4935f expref: 289 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.264753:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c52ec800) 00010000:00010000:0.0:1763343274.264756:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343274.264760:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fd800, rc 0) 00000100:00100000:0.0:1763343274.264804:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57119:x1848998399832192:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 340us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343274.264810:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10587 00010000:00010000:1.0:1763343274.264946:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a2c75 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49366 expref: 288 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.264959:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a2c75 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49366 expref: 288 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.264974:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:1.0:1763343274.264977:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343274.264980:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401ed154800, rc 0) 00000100:00100000:1.0:1763343274.265000:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57117:x1848998399832320:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 526us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.265006:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10588 00000100:00100000:0.0:1763343274.269760:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.269809:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.269875:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399832576 00000100:00100000:1.0:1763343274.269875:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399832448 00000100:00100000:2.0:1763343274.269887:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399832576 00000100:00100000:1.0:1763343274.269891:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399832448 00000100:00100000:1.0:1763343274.269941:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10589 00000100:00100000:1.0:1763343274.269950:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57117:x1848998399832448:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343274.269968:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.269988:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a2c8a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4936d expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343274.270009:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10590 00000100:00100000:2.0:1763343274.270019:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57119:x1848998399832576:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.270045:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.270055:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2c91 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49374 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.270079:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a2c98 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.270091:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2c9f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343274.270095:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a2c98 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.270102:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2c9f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.270109:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a2c98 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.270110:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2c9f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.270130:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2ca6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343274.270136:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2ca6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.270140:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2ca6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:1.0:1763343274.270167:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1fd:0x0]: returning size 5 00010000:00010000:2.0:1763343274.270168:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2c9f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00000004:00200000:1.0:1763343274.270174:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1763343274.270175:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2c9f lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.270186:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2c9f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.270190:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb2400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.270193:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2c9f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00000004:00010000:1.0:1763343274.270195:0:7641:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a2c98 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.270199:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2c9f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.270213:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c52ec800) 00010000:00010000:2.0:1763343274.270215:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.270218:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2c9f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.270223:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2c9f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.270226:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155c00/0x9104b1ba770a2c8a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4936d expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.270232:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2ca6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.270238:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2ca6 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.270244:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a2c98 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4936d expref: 291 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.270246:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2ca6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.270261:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb3e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.270262:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:2.0:1763343274.270264:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2ca6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.270268:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1763343274.270272:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2ca6 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.270285:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401ed154e00, rc 0) 00010000:00010000:2.0:1763343274.270300:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53400) 00010000:00010000:2.0:1763343274.270302:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.270304:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2ca6 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.270308:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2ca6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.270328:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2c91 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49374 expref: 291 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.270336:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c52ec800) 00010000:00010000:2.0:1763343274.270338:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.270340:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2c91 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49374 expref: 291 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.270346:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c7bb3800, rc 0) 00000100:00100000:2.0:1763343274.270391:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57119:x1848998399832576:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 376us (593us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343274.270398:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10590 00000100:00100000:1.0:1763343274.271421:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57117:x1848998399832448:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1466us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.271430:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10589 00000100:00100000:0.0:1763343274.272938:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.273452:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399832832 00000100:00100000:1.0:1763343274.273462:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399832832 00000100:00100000:1.0:1763343274.273525:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10591 00000100:00100000:1.0:1763343274.273535:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57119:x1848998399832832:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343274.273556:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.273560:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343274.273588:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2c83 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4935f expref: 289 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.273607:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c52ec800) 00010000:00010000:1.0:1763343274.273619:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343274.273637:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a2cad lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4937b expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.273753:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a2cb4 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343274.273766:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a2cb4 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.273775:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a2cb4 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.273789:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2cbb lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343274.273795:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2cbb lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.273801:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2cbb lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.274265:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2cc2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343274.274289:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2cc2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.274299:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2cc2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343274.274310:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ff:0x0]: returning size 0 00010000:00010000:1.0:1763343274.274339:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a2cb4 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.274348:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a2cb4 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.274355:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a2cb4 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.274362:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a2cb4 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.274368:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401ed155000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.274373:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a2cb4 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.274380:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a2cb4 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.274388:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497eb00) 00010000:00010000:1.0:1763343274.274391:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.274395:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a2cb4 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.274400:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155000/0x9104b1ba770a2cb4 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00010000:1.0:1763343274.274410:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000392eddda reply state 0000000073fb0672 transno 4294973552 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2cbb lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.274419:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2cbb lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.274424:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c497e000) 00010000:00010000:1.0:1763343274.274427:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343274.274429:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343274.274457:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed155600/0x9104b1ba770a2cad lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4937b expref: 291 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.274479:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2cc2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4937b expref: 290 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.274485:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ff:0x0].0x0 (ffff9400c497ed00) 00010000:00010000:1.0:1763343274.274487:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343274.274490:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177c00, rc 0) 00000100:00100000:1.0:1763343274.281307:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57119:x1848998399832832:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 7758us (8361us total) trans 4294973552 rc 0/0 00000100:00100000:1.0:1763343274.281323:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10591 00000100:00100000:2.0:1763343274.281901:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.282762:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399832960 00000100:00100000:1.0:1763343274.282772:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399832960 00000100:00100000:1.0:1763343274.282830:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7185 00000100:00100000:1.0:1763343274.282840:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998399832960:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343274.282858:0:8413:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.282882:0:8413:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a2cd0 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49382 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343274.282907:0:8413:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2b3:0x0] initial LVB size: 5, mtime: 0x691a7ba9, atime: 0x0, ctime: 0x691a7ba9, blocks: 0x8 00010000:00010000:1.0:1763343274.282929:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.282931:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.282942:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a2cd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49382 expref: 18 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343274.282959:0:8413:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a2cd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49382 expref: 18 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343274.282982:0:8413:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176600, rc 0) 00000100:00100000:1.0:1763343274.283732:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2407:x1848998399832960:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 889us (1828us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.283740:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7185 00000100:00100000:3.0:1763343274.284838:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.284889:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399833216 00000100:00100000:1.0:1763343274.284900:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399833216 00000100:00100000:1.0:1763343274.284957:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10592 00000100:00100000:1.0:1763343274.284966:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57119:x1848998399833216:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343274.284992:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.285009:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2cd7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49389 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.285161:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2cde lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343274.285181:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2cc2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4937b expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.285190:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2cde lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.285225:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2cc2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4937b expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.285243:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2cc2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4937b expref: 292 pid: 7641 timeout: 1167 lvb_type: 0 00000100:00100000:1.0:1763343274.285256:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412962432:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343274.285349:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c32170c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343274.288917:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.289055:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399833344 00000100:00100000:0.0:1763343274.289067:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399833344 00010000:00010000:0.0:1763343274.289125:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2cc2 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4937b expref: 293 pid: 7641 timeout: 1167 lvb_type: 0 00000100:00100000:0.0:1763343274.289182:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3439 00000100:00100000:0.0:1763343274.289194:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3729180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:2410:x1848998399833344:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343274.289211:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343274.289222:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2cc2 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4937b expref: 293 pid: 7641 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.289237:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2cc2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4937b expref: 293 pid: 7641 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.289263:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ff:0x0].0x0 (ffff9400c497ed00) 00010000:00010000:0.0:1763343274.289269:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2cde lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.289289:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2cde lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.289297:0:7904:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2cde lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.289306:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2cc2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4937b expref: 293 pid: 7641 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.289318:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343274.289326:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412962432:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343274.289353:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2cde lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.289364:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2cde lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.289370:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2cde lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:0.0:1763343274.289378:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3729180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:2410:x1848998399833344:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 183us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343274.289391:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3439 00000004:00200000:1.0:1763343274.289400:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ff:0x0]: returning size 0 00000004:00080000:1.0:1763343274.289610:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2b4:0x0], index 0: 0 00000004:00080000:1.0:1763343274.289618:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2b5:0x0], index 1: 0 00000004:00080000:1.0:1763343274.289623:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2b6:0x0], index 1: 0 00000004:00080000:1.0:1763343274.289626:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2b5:0x0], index 0: 0 00010000:00010000:1.0:1763343274.289742:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2cde lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.289749:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2cde lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.289756:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2cde lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.289762:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.289766:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2cde lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.289776:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2cde lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.289785:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ff:0x0].0x0 (ffff9400c497ed00) 00010000:00010000:1.0:1763343274.289788:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343274.289791:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2cde lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.289797:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2cde lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.289843:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2cd7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1ff:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49389 expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.289852:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ff:0x0].0x0 (ffff9400c497ed00) 00010000:00010000:1.0:1763343274.289855:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343274.289859:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2cd7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ff:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49389 expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.289872:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176e00, rc 0) 00000100:00100000:1.0:1763343274.289919:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57119:x1848998399833216:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 4953us (5083us total) trans 4294973553 rc 301/301 00000100:00100000:1.0:1763343274.289926:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10592 00000100:00100000:3.0:1763343274.296069:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.296114:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399833600 00000100:00100000:0.0:1763343274.296125:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399833600 00000100:00100000:0.0:1763343274.296180:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3734 00000100:00100000:0.0:1763343274.296190:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c372bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57119:x1848998399833600:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343274.296495:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c372bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57119:x1848998399833600:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 305us (437us total) trans 4294973554 rc 0/0 00000100:00100000:0.0:1763343274.296503:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3734 00000100:00100000:2.0:1763343274.301020:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.301141:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399833856 00000100:00100000:1.0:1763343274.301151:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399833856 00000100:00100000:1.0:1763343274.301262:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3735 00000100:00100000:1.0:1763343274.301282:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8440050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57119:x1848998399833856:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343274.301843:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8440050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57119:x1848998399833856:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 569us (829us total) trans 4294973555 rc 0/0 00000100:00100000:1.0:1763343274.301854:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3735 00000100:00100000:3.0:1763343274.307683:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.307858:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399834112 00000100:00100000:1.0:1763343274.307871:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399834112 00000100:00100000:1.0:1763343274.308689:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10593 00000100:00100000:1.0:1763343274.308704:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:55884:x1848998399834112:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343274.308730:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.308759:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2cec lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49390 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.308897:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2cf3 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343274.308911:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2cf3 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.308922:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2cf3 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.308931:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2cfa lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343274.308937:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2cfa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.308943:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2cfa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.309009:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177600/0x9104b1ba770a2d01 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343274.309017:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177600/0x9104b1ba770a2d01 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.309044:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177600/0x9104b1ba770a2d01 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343274.309056:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ff:0x0]: returning size 0 00010000:00010000:1.0:1763343274.309149:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2cf3 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.309156:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2cf3 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.309161:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2cf3 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.309168:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2cf3 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.309173:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.309178:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2cf3 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.309185:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2cf3 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.309197:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6696900) 00010000:00010000:1.0:1763343274.309200:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.309204:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2cf3 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.309210:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2cf3 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.309224:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2cfa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.309246:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2cfa lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.309251:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2cfa lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.309256:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.309258:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2cfa lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.309264:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2cfa lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.309271:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c497e000) 00010000:00010000:1.0:1763343274.309304:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.309307:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2cfa lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.309312:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2cfa lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.309351:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2cec lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49390 expref: 296 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.309373:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177600/0x9104b1ba770a2d01 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49390 expref: 295 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.309380:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ff:0x0].0x0 (ffff9401f6696500) 00010000:00010000:1.0:1763343274.309382:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343274.309384:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177600, rc 0) 00000100:00100000:1.0:1763343274.309453:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:55884:x1848998399834112:12345-192.168.201.40@tcp:101:bash.0 Request processed in 754us (1783us total) trans 4294973556 rc 0/0 00000100:00100000:1.0:1763343274.309461:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10593 00000100:00100000:2.0:1763343274.312660:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.314943:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399834240 00000100:00100000:1.0:1763343274.314961:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399834240 00000100:00100000:1.0:1763343274.315070:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10594 00000100:00100000:1.0:1763343274.315082:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:55884:x1848998399834240:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343274.315107:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.315131:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a2d0f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49397 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.315178:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a2d16 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343274.315192:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a2d16 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.315205:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a2d16 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.315353:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a2d0f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49397 expref: 297 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.315375:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a2d16 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49397 expref: 296 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.315390:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ff:0x0].0x0 (ffff9401f6696500) 00010000:00010000:1.0:1763343274.315393:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343274.315402:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177e00, rc 0) 00000100:00100000:1.0:1763343274.315481:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:55884:x1848998399834240:12345-192.168.201.40@tcp:101:bash.0 Request processed in 401us (2831us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.315493:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10594 00000100:00100000:2.0:1763343274.318691:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.318996:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399834496 00000100:00100000:0.0:1763343274.319007:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399834496 00000100:00100000:0.0:1763343274.319078:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10595 00000100:00100000:0.0:1763343274.319088:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:55884:x1848998399834496:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:0.0:1763343274.319140:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343274.319283:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177600/0x9104b1ba770a2d01 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49390 expref: 296 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.319304:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ff:0x0].0x0 (ffff9401f6696500) 00010000:00010000:0.0:1763343274.319309:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343274.319520:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2d1d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343274.319546:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2d1d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.319557:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2d1d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000001:00080000:0.0:1763343274.319604:0:33856:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973557 00000004:00010000:0.0:1763343274.319629:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002ea55777 reply state 000000007df93ea1 transno 4294973558 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2d1d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.319641:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2d1d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.319647:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ff:0x0].0x0 (ffff9401f6696500) 00010000:00010000:0.0:1763343274.319650:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343274.319652:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343274.319755:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:55884:x1848998399834496:12345-192.168.201.40@tcp:36:bash.0 Request processed in 667us (1073us total) trans 4294973558 rc 0/0 00000100:00100000:0.0:1763343274.319762:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10595 00000020:00080000:0.0:1763343274.319772:0:33856:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343274.322267:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.322492:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399834624 00000100:00100000:0.0:1763343274.322503:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399834624 00000100:00100000:0.0:1763343274.322565:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10596 00000100:00100000:0.0:1763343274.322576:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:55884:x1848998399834624:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343274.322602:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343274.322628:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2d24 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4939e expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.322693:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2d24 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4939e expref: 299 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.322709:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2d24 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4939e expref: 299 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.322727:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ff:0x0].0x0 (ffff9401f6696500) 00010000:00010000:0.0:1763343274.322730:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343274.322734:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fca00, rc 0) 00000100:00100000:0.0:1763343274.322806:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:55884:x1848998399834624:12345-192.168.201.40@tcp:101:bash.0 Request processed in 231us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343274.322814:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10596 00000100:00100000:2.0:1763343274.331139:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.331288:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399834880 00000100:00100000:1.0:1763343274.331300:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399834880 00000100:00100000:1.0:1763343274.331365:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10597 00000100:00100000:1.0:1763343274.331378:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:55884:x1848998399834880:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343274.331399:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.331403:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343274.331436:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2d24 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4939e expref: 299 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.331457:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ff:0x0].0x0 (ffff9401f6696500) 00010000:00010000:1.0:1763343274.331463:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343274.331477:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a2d2b lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b493a5 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.331526:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2d32 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343274.331601:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2d32 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.331613:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2d32 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000040:00080000:1.0:1763343274.331972:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1700, 88 off141640 00000004:00080000:1.0:1763343274.331980:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1067455955353ns, next at 1068000150895ns, rc = 0 00000040:00080000:1.0:1763343274.332064:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1708, 88 off142296 00000004:00080000:1.0:1763343274.332070:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1067456045060ns, next at 1068000121327ns, rc = 0 00000040:00080000:1.0:1763343274.332100:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1709, 88 off142384 00000004:00080000:1.0:1763343274.332105:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1067456080393ns, next at 1068000121327ns, rc = 0 00000040:00080000:1.0:1763343274.332116:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1701, 88 off141728 00000004:00080000:1.0:1763343274.332120:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1067456095245ns, next at 1068000150895ns, rc = 0 00000100:00100000:3.0:1763343274.335078:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.336045:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399835008 00000100:00100000:1.0:1763343274.336056:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399835008 00000100:00100000:1.0:1763343274.336116:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7186 00000100:00100000:1.0:1763343274.336127:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2407:x1848998399835008:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:1.0:1763343274.336248:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2407:x1848998399835008:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 123us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.336256:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7186 00000001:00080000:2.0:1763343274.337113:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973559 is committed 00000004:00080000:2.0:1763343274.337122:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1090 committed 00010000:00010000:3.0:1763343274.337765:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2cbb lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.337780:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2cbb lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.337788:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2cbb lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.337793:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3bcc200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343274.337798:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2cbb lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.337806:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2cbb lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.337825:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c497e000) 00010000:00010000:3.0:1763343274.337828:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343274.337833:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2cbb lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.337839:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a2cbb lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.337867:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2d1d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.337873:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2d1d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.337879:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2d1d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.337883:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fdc00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343274.337886:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2d1d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.337891:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2d1d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.337899:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ff:0x0].0x0 (ffff9401f6696500) 00010000:00010000:3.0:1763343274.337901:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343274.337903:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2d1d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.337909:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2d1d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000100:00100000:1.0:1763343274.338091:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412962560:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343274.338160:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343274.338202:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763343274.338206:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412962560 00000100:00100000:1.0:1763343274.338209:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412962688:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343274.338213:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412962560 00000100:00100000:1.0:1763343274.338231:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343274.338260:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412962688 00000100:00100000:0.0:1763343274.338264:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412962688 00000100:00100000:0.0:1763343274.338296:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7187 00000100:00100000:1.0:1763343274.338305:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7188 00000100:00100000:0.0:1763343274.338308:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+37:3661:x1848998412962560:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343274.338311:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401ede6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+37:3661:x1848998412962688:12345-0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763343274.338442:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1098 committed 00000004:00080000:2.0:1763343274.338450:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1097 committed 00000004:00080000:2.0:1763343274.338452:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1089 committed 00000100:00100000:1.0:1763343274.338465:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401ede6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+39:3661:x1848998412962688:12345-0@lo:2:osp-syn-0-1.0 Request processed in 153us (231us total) trans 21474839173 rc 0/0 00000100:00100000:1.0:1763343274.338472:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7188 00000004:00080000:1.0:1763343274.338517:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401edc1a680/2, rc 0, transno 21474839173 00000100:00100000:1.0:1763343274.338522:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412962688:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343274.338553:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+38:3661:x1848998412962560:12345-0@lo:2:osp-syn-0-1.0 Request processed in 246us (393us total) trans 21474839174 rc 0/0 00000100:00100000:0.0:1763343274.338560:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7187 00010000:00010000:1.0:1763343274.338726:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2d32 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ff:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493a5 expref: 291 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.338737:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ff:0x0].0x0 (ffff9401f6696500) 00010000:00010000:1.0:1763343274.338740:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343274.338753:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a2d2b lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493a5 expref: 291 pid: 7641 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343274.338767:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2d32 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ff:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493a5 expref: 290 pid: 7641 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343274.338788:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c372b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412962816:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1763343274.338794:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ff:0x0].0x0 (ffff9401f6696500) 00010000:00010000:1.0:1763343274.338797:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343274.338799:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176e00, rc 0) 00000100:00100000:1.0:1763343274.338839:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:55884:x1848998399834880:12345-192.168.201.40@tcp:101:bash.0 Request processed in 7465us (7710us total) trans 4294973559 rc 0/0 00000100:00100000:1.0:1763343274.338846:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10597 00000004:00080000:2.0:1763343274.338857:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401edc18700/2, rc 0, transno 21474839174 00000100:00100000:2.0:1763343274.338862:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412962560:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343274.338966:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343274.338993:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343274.338998:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c3728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412962944:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343274.339020:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343274.339557:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412962816 00000100:00100000:2.0:1763343274.339563:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412962816 00000100:00100000:2.0:1763343274.339596:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412962944 00000100:00100000:2.0:1763343274.339600:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412962944 00000100:00100000:2.0:1763343274.339625:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7189 00000100:00100000:2.0:1763343274.339633:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+21:3659:x1848998412962816:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343274.339756:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+22:3659:x1848998412962816:12345-0@lo:2:osp-syn-1-1.0 Request processed in 123us (788us total) trans 17179871903 rc 0/0 00000100:00100000:2.0:1763343274.339763:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7189 00000100:00100000:2.0:1763343274.339776:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7190 00000100:00100000:2.0:1763343274.339782:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+21:3659:x1848998412962944:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343274.339846:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+22:3659:x1848998412962944:12345-0@lo:2:osp-syn-1-1.0 Request processed in 63us (824us total) trans 17179871904 rc 0/0 00000100:00100000:2.0:1763343274.339852:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7190 00000004:00080000:3.0:1763343274.340387:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c3728a80/2, rc 0, transno 17179871904 00000100:00100000:3.0:1763343274.340394:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c3728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412962944:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763343274.340405:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c372b800/2, rc 0, transno 17179871903 00000100:00100000:3.0:1763343274.340409:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c372b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412962816:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343274.341809:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.342725:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399835136 00000100:00100000:0.0:1763343274.342736:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399835136 00000100:00100000:0.0:1763343274.342796:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7191 00000100:00100000:0.0:1763343274.342807:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998399835136:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:0.0:1763343274.342929:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998399835136:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 124us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343274.342936:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7191 00000100:00100000:1.0:1763343274.342968:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.343784:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399835264 00000100:00100000:0.0:1763343274.343792:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399835264 00000100:00100000:0.0:1763343274.344282:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7192 00000100:00100000:0.0:1763343274.344293:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:55884:x1848998399835264:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343274.344308:0:8413:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343274.344333:0:8413:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2d39 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b493ac expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343274.344362:0:8413:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343274.344384:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.344386:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.344396:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2d39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493ac expref: 23 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.344411:0:8413:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2d39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493ac expref: 23 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.344424:0:8413:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fdc00, rc 0) 00000100:00100000:0.0:1763343274.344481:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:55884:x1848998399835264:12345-192.168.201.40@tcp:101:bash.0 Request processed in 190us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343274.344487:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7192 00000100:00100000:1.0:1763343274.345587:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.346064:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399835392 00000100:00100000:2.0:1763343274.346074:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399835392 00000100:00100000:2.0:1763343274.346133:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1715 00000100:00100000:2.0:1763343274.346142:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2407:x1848998399835392:12345-192.168.201.40@tcp:3:lfs.0 00010000:00010000:2.0:1763343274.346177:0:28386:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2d40 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.346190:0:28386:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.346193:0:28386:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.346197:0:28386:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2d40 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.346209:0:28386:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2d40 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.346323:0:28386:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2d40 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.346332:0:28386:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2d40 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.346340:0:28386:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2d40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.346346:0:28386:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c7ec0c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343274.346349:0:28386:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2d40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.346357:0:28386:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2d40 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.346373:0:28386:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2d40 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.346381:0:28386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2d40 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343274.346443:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2407:x1848998399835392:12345-192.168.201.40@tcp:3:lfs.0 Request processed in 302us (861us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763343274.346454:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1715 00000100:00100000:2.0:1763343274.347391:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.347437:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399835520 00000100:00100000:0.0:1763343274.347445:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399835520 00000100:00100000:0.0:1763343274.347490:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7193 00000100:00100000:0.0:1763343274.347500:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:55884:x1848998399835520:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343274.347513:0:8413:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343274.347531:0:8413:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2d47 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b493b3 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343274.347549:0:8413:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343274.347566:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.347568:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.347575:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2d47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493b3 expref: 19 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.347593:0:8413:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2d47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493b3 expref: 19 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.347603:0:8413:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fca00, rc 0) 00000100:00100000:0.0:1763343274.347652:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:55884:x1848998399835520:12345-192.168.201.40@tcp:101:bash.0 Request processed in 153us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343274.347658:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7193 00000100:00100000:3.0:1763343274.351292:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.351629:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.351803:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.351983:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399835648 00000100:00100000:0.0:1763343274.351994:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399835648 00002000:00010000:0.0:1763343274.352055:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/692 (0->18446744073709551615) 00002000:00100000:0.0:1763343274.352060:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c372bb80 with x1848998399835648 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343274.352072:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c372bb80. 00000100:00100000:2.0:1763343274.352232:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399835776 00000100:00100000:2.0:1763343274.352236:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399835776 00002000:00010000:2.0:1763343274.352256:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/693 (0->18446744073709551615) 00002000:00100000:2.0:1763343274.352260:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401edc2df80 with x1848998399835776 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343274.352266:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401edc2df80. 00000100:00100000:2.0:1763343274.352300:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1716 00000100:00100000:2.0:1763343274.352310:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c372bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2408:x1848998399835648:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:2.0:1763343274.352485:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2b4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343274.352489:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2b4:0x0] updating lvb mtime from disk: 0 -> 1763343273 00002000:00010000:2.0:1763343274.352492:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343274.352494:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2b4:0x0] updating lvb ctime from disk: 0 -> 1763343273 00002000:00010000:2.0:1763343274.352496:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2b4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343274.352557:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c372bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2408:x1848998399835648:12345-192.168.201.40@tcp:10:bash.0 Request processed in 248us (1287us total) trans 21474839175 rc 0/0 00000100:00100000:2.0:1763343274.352565:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1716 00002000:00010000:2.0:1763343274.352570:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/692 (0->18446744073709551615) 00002000:00100000:2.0:1763343274.352572:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c372bb80 with x1848998399835648 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343274.352576:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c372bb80. 00000100:00100000:2.0:1763343274.352596:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1717 00000100:00100000:2.0:1763343274.352602:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2407:x1848998399835776:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:2.0:1763343274.352680:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2b5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343274.352683:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2b5:0x0] updating lvb mtime from disk: 0 -> 1763343273 00002000:00010000:2.0:1763343274.352686:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2b5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343274.352687:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2b5:0x0] updating lvb ctime from disk: 0 -> 1763343273 00002000:00010000:2.0:1763343274.352689:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2b5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343274.352711:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399835776:12345-192.168.201.40@tcp:10:bash.0 Request processed in 109us (1082us total) trans 17179871905 rc 0/0 00000100:00100000:2.0:1763343274.352718:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1717 00002000:00010000:2.0:1763343274.352721:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/693 (0->18446744073709551615) 00002000:00100000:2.0:1763343274.352723:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401edc2df80 with x1848998399835776 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343274.352735:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401edc2df80. 00000100:00100000:1.0:1763343274.353109:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399835904 00000100:00100000:1.0:1763343274.353115:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399835904 00000100:00100000:1.0:1763343274.353152:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10598 00000100:00100000:1.0:1763343274.353161:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57117:x1848998399835904:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343274.353176:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.353196:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a2d4e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b493ba expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.353231:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177400/0x9104b1ba770a2d55 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343274.353245:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177400/0x9104b1ba770a2d55 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.353256:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177400/0x9104b1ba770a2d55 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.353373:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a2d4e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493ba expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.353390:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177400/0x9104b1ba770a2d55 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493ba expref: 291 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.353398:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:1.0:1763343274.353401:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343274.353404:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177400, rc 0) 00000100:00100000:1.0:1763343274.353450:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57117:x1848998399835904:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 291us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.353456:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10598 00000100:00100000:3.0:1763343274.356977:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.358212:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399836160 00000100:00100000:1.0:1763343274.358225:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399836160 00000100:00100000:1.0:1763343274.358288:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3736 00000100:00100000:1.0:1763343274.358296:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:55884:x1848998399836160:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:0.0:1763343274.358736:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.359283:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399836288 00000100:00100000:2.0:1763343274.359289:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399836288 00000100:00100000:2.0:1763343274.359333:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1718 00000100:00100000:2.0:1763343274.359341:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2408:x1848998399836288:12345-192.168.201.40@tcp:4:lfs.0 00010000:00010000:2.0:1763343274.359370:0:28386:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2d5c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.359389:0:28386:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2ac3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492d3 expref: 24 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343274.359398:0:28386:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.359400:0:28386:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.359404:0:28386:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2d5c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.359438:0:28386:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2ac3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492d3 expref: 24 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343274.359451:0:28386:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2ac3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492d3 expref: 24 pid: 28562 timeout: 1167 lvb_type: 1 00000100:00100000:2.0:1763343274.359465:0:28386:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc73800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:28386:1848998412963072:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343274.359909:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:55884:x1848998399836160:12345-192.168.201.40@tcp:35:bash.0 Request processed in 1611us (2940us total) trans 4294973560 rc 0/0 00000100:00100000:1.0:1763343274.359919:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3736 00000100:00100000:2.0:1763343274.360430:0:28386:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c546e480 going to sleep for 11 seconds 00000100:00100000:2.0:1763343274.362612:0:28386:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc73800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:28386:1848998412963072:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343274.362643:0:28386:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2d5c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343274.362924:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.363159:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399836416 00000100:00100000:2.0:1763343274.363166:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399836416 00010000:00010000:2.0:1763343274.363199:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2ac3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492d3 expref: 25 pid: 28562 timeout: 1167 lvb_type: 1 00000100:00100000:2.0:1763343274.363240:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3440 00000100:00100000:2.0:1763343274.363249:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8393850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2408:x1848998399836416:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343274.363263:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343274.363294:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2ac3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492d3 expref: 25 pid: 28562 timeout: 1167 lvb_type: 1 00010000:00010000:2.0:1763343274.363308:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2ac3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492d3 expref: 25 pid: 28562 timeout: 1167 lvb_type: 1 00010000:00010000:2.0:1763343274.363332:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2ac3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492d3 expref: 25 pid: 28562 timeout: 1167 lvb_type: 1 00010000:00010000:2.0:1763343274.363351:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.363355:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.363360:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2d5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.363369:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2d5c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.363395:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343274.363452:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8393850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2408:x1848998399836416:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 203us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.363460:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3440 00010000:00010000:2.0:1763343274.363515:0:28386:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2d5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.363524:0:28386:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2d5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343274.366225:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.368100:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399836544 00000100:00100000:1.0:1763343274.368113:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399836544 00000100:00100000:1.0:1763343274.368175:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10599 00000100:00100000:1.0:1763343274.368186:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57120:x1848998399836544:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:1.0:1763343274.368213:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.368237:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a2d63 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b493c1 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.368317:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a2d6a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343274.368331:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a2d6a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.368342:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a2d6a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.368353:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a2d71 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343274.368359:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a2d71 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.368365:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a2d71 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.368432:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a2d78 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343274.368441:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a2d78 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.368447:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a2d78 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:1.0:1763343274.368486:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ff:0x0]: returning size 5 00000004:00200000:1.0:1763343274.368491:0:33856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343274.368509:0:33856:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a2d78 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.368519:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a2d78 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.368526:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a2d6a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.368532:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a2d6a lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.368537:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a2d6a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.368544:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.368547:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a2d6a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.368554:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a2d6a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.368565:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6696900) 00010000:00010000:1.0:1763343274.368569:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.368574:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a2d6a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.368581:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a2d6a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.368591:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a2d71 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.368596:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a2d71 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.368601:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a2d71 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.368606:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.368609:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a2d71 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.368615:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a2d71 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.368621:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6696f00) 00010000:00010000:1.0:1763343274.368624:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.368626:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a2d71 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.368631:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a2d71 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.368660:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a2d63 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493c1 expref: 294 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.368675:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a2d78 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493c1 expref: 293 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.368682:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ff:0x0].0x0 (ffff9401f6696500) 00010000:00010000:1.0:1763343274.368684:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343274.368687:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177200, rc 0) 00000100:00100000:1.0:1763343274.368748:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57120:x1848998399836544:12345-192.168.201.40@tcp:101:rm.0 Request processed in 564us (2531us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.368756:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10599 00000001:00080000:0.0:1763343274.371968:0:24675:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839176 is committed 00000001:00080000:0.0:1763343274.371990:0:24675:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839173 is committed 00000001:00080000:0.0:1763343274.371994:0:24675:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839174 is committed 00002000:00010000:2.0:1763343274.372204:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2b3:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:2.0:1763343274.372210:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2b3:0x0] updating lvb mtime from disk: 0 -> 1763343273 00002000:00010000:2.0:1763343274.372213:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2b3:0x0] updating lvb ctime from disk: 0 -> 1763343273 00002000:00010000:2.0:1763343274.372215:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2b3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1763343274.372228:0:28386:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2d5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.372240:0:28386:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2d5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.372248:0:28386:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2d5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.372260:0:28386:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c7ec0c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343274.372265:0:28386:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2d5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.372282:0:28386:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2d5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.372304:0:28386:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2d5c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.372312:0:28386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2d5c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343274.372408:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:2408:x1848998399836288:12345-192.168.201.40@tcp:4:lfs.0 Request processed in 13063us (13667us total) trans 21474839176 rc 0/0 00000100:00100000:2.0:1763343274.372418:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1718 00000100:00100000:0.0:1763343274.372653:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.372858:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399836800 00000100:00100000:2.0:1763343274.372866:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399836800 00000100:00100000:2.0:1763343274.372918:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10600 00000100:00100000:2.0:1763343274.372927:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57120:x1848998399836800:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:2.0:1763343274.372976:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763343274.372997:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2d32 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ff:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493a5 expref: 293 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.373017:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a2d78 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493c1 expref: 292 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.373201:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a2d16 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ff:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49397 expref: 291 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.373211:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ff:0x0].0x0 (ffff9401f6696500) 00010000:00010000:2.0:1763343274.373222:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343274.373250:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2d7f lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.373262:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2d7f lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.373284:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2d7f lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.373298:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2d86 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.373304:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2d86 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.373311:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2d86 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.373393:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2d8d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.373406:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2d8d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.373413:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2d8d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000040:00080000:2.0:1763343274.373655:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1702, 64 off141792 00000040:00080000:2.0:1763343274.373682:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1710, 64 off142448 00000040:00080000:2.0:1763343274.373693:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1711, 64 off142512 00000040:00080000:2.0:1763343274.373703:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1703, 64 off141856 00010000:00010000:2.0:1763343274.373753:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2d94 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.373762:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2d94 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.373770:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2d94 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.373777:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2d94 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.373782:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2d94 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.373787:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2d94 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.373810:0:7641:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343274.373829:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2d8d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.373835:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2d8d lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.373840:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2d8d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.373845:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb3800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.373848:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2d8d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.373854:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2d8d lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.373863:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ff:0x0].0x0 (ffff9400c48a8800) 00010000:00010000:2.0:1763343274.373866:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763343274.373870:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2d8d lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.373874:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2d8d lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.373981:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2d7f lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.373987:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2d7f lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.373991:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2d7f lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.373995:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2d7f lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.374000:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c7ec1c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.374002:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2d7f lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.374008:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2d7f lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.374015:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8200) 00010000:00010000:2.0:1763343274.374017:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.374020:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2d7f lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.374364:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343274.374417:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2d94 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.374424:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb3e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343274.374428:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2d94 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.374434:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2d94 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.374444:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ff:0x0].0x0 (ffff9400c48a8800) 00010000:00010000:3.0:1763343274.374447:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343274.374450:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2d94 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.374460:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2d94 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.374475:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343274.374477:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343274.374479:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343274.377799:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2d7f lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00010000:2.0:1763343274.377835:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009376fb4e reply state 00000000ee176858 transno 4294973561 ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2d86 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.377852:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2d86 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.377861:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8000) 00010000:00010000:2.0:1763343274.377863:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343274.377868:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343274.377989:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57120:x1848998399836800:12345-192.168.201.40@tcp:36:rm.0 Request processed in 5059us (5333us total) trans 4294973561 rc 0/0 00000100:00100000:2.0:1763343274.377998:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10600 00000100:00100000:3.0:1763343274.394136:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.394384:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399837056 00000100:00100000:2.0:1763343274.394395:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399837056 00000100:00100000:2.0:1763343274.394455:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10601 00000100:00100000:2.0:1763343274.394467:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57117:x1848998399837056:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:2.0:1763343274.394531:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343274.394560:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154e00/0x9104b1ba770a2c98 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1fd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4936d expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.394583:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:2.0:1763343274.394588:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343274.394749:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2d9b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.394763:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2d9b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.394773:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2d9b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00010000:2.0:1763343274.394892:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000221a220d reply state 000000006414a99a transno 4294973562 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2d9b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.394905:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2d9b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.394912:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:2.0:1763343274.394915:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343274.394918:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343274.395019:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57117:x1848998399837056:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 553us (892us total) trans 4294973562 rc 0/0 00000100:00100000:2.0:1763343274.395487:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10601 00000100:00100000:0.0:1763343274.397588:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.399197:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399837312 00000100:00100000:1.0:1763343274.399211:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399837312 00000100:00100000:1.0:1763343274.399782:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7194 00000100:00100000:1.0:1763343274.399793:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:57117:x1848998399837312:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343274.399814:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.399837:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a2da2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b493cf expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343274.399864:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2b3:0x0] initial LVB size: 4096, mtime: 0x691a7ba9, atime: 0x0, ctime: 0x691a7ba9, blocks: 0x8 00010000:00010000:1.0:1763343274.399893:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.399896:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.399904:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a2da2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493cf expref: 13 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.399919:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a2da2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493cf expref: 13 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.399931:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176200, rc 0) 00000100:00100000:1.0:1763343274.399998:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:57117:x1848998399837312:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 207us (2417us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.400010:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7194 00000100:00100000:3.0:1763343274.400450:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.400527:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399837184 00000100:00100000:1.0:1763343274.400533:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399837184 00000100:00100000:1.0:1763343274.400574:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10602 00000100:00100000:1.0:1763343274.400582:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57121:x1848998399837184:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343274.400594:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.400612:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a2da9 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b493c8 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.400672:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a2db0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343274.400687:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a2db0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.400698:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a2db0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.400708:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2db7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343274.400714:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2db7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.400720:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2db7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.400761:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a2db0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.400768:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a2db0 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.400774:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a2db0 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.400780:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.400784:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a2db0 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.400791:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a2db0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.400801:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497eb00) 00010000:00010000:1.0:1763343274.400804:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.400809:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a2db0 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.400814:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a2db0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.400824:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2db7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.400830:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2db7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.400835:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2db7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.400839:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.400841:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2db7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.400846:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2db7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.400851:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8000) 00010000:00010000:1.0:1763343274.400853:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.400855:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2db7 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.400860:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2db7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.400883:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a2da9 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493c8 expref: 294 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.400891:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497eb00) 00010000:00010000:1.0:1763343274.400894:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.400897:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a2da9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493c8 expref: 294 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.400907:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177800, rc 0) 00000100:00100000:1.0:1763343274.400945:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57121:x1848998399837184:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 364us (498us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343274.400951:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10602 00000100:00100000:0.0:1763343274.402896:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.402953:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399837440 00000100:00100000:1.0:1763343274.402963:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399837440 00000100:00100000:0.0:1763343274.402970:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.403019:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7195 00000100:00100000:1.0:1763343274.403129:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:57117:x1848998399837440:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343274.403145:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.403162:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a2dbe lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b493d6 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.403189:0:35266:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2abc lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492da expref: 21 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343274.403196:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.403198:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.403202:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a2dbe lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493d6 expref: 21 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.403232:0:35266:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2abc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492da expref: 21 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343274.403244:0:35266:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2abc lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492da expref: 21 pid: 8413 timeout: 1167 lvb_type: 1 00000100:00100000:1.0:1763343274.403258:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412963200:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343274.403429:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c32170c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343274.403558:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399837568 00000100:00100000:2.0:1763343274.403563:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399837568 00000100:00100000:2.0:1763343274.403597:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10603 00000100:00100000:2.0:1763343274.403604:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57121:x1848998399837568:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.403615:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.403628:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2dc5 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b493dd expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.403679:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2dcc lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.403689:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2dcc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.403699:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2dcc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.403708:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2dd3 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.403716:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2dd3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.403722:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2dd3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.403758:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2dcc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.403764:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2dcc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.403769:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2dcc lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.403775:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2dcc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.403781:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb3e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.403785:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2dcc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.403791:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2dcc lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.403801:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8200) 00010000:00010000:2.0:1763343274.403804:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.403807:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2dcc lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.403813:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2dcc lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.403823:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2dd3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.403829:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2dd3 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.403835:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2dd3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.403839:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c7ec1c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.403841:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2dd3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.403847:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2dd3 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.403852:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8000) 00010000:00010000:2.0:1763343274.403854:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.403856:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2dd3 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.403861:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2dd3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.403882:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2dc5 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493dd expref: 294 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.403890:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8200) 00010000:00010000:2.0:1763343274.403892:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.403895:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2dc5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493dd expref: 294 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.403906:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c7bb2400, rc 0) 00000100:00100000:2.0:1763343274.403932:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57121:x1848998399837568:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 329us (962us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343274.403940:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10603 00000100:00100000:0.0:1763343274.406950:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.406976:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412963200:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343274.407010:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a2dbe lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493d6 expref: 21 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.407055:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177a00, rc 0) 00000100:00100000:0.0:1763343274.407055:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.407116:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:57117:x1848998399837440:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3990us (4227us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.407127:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7195 00000100:00100000:2.0:1763343274.407136:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399837696 00000100:00100000:2.0:1763343274.407143:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399837696 00010000:00010000:2.0:1763343274.407172:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2abc lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492da expref: 21 pid: 8413 timeout: 1167 lvb_type: 1 00000100:00100000:2.0:1763343274.407205:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3441 00000100:00100000:2.0:1763343274.407215:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399837696:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343274.407228:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343274.407250:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2abc lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492da expref: 21 pid: 8413 timeout: 1167 lvb_type: 1 00010000:00010000:2.0:1763343274.407263:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2abc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492da expref: 21 pid: 8413 timeout: 1167 lvb_type: 1 00010000:00010000:2.0:1763343274.407481:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2abc lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b492da expref: 21 pid: 8413 timeout: 1167 lvb_type: 1 00010000:00010000:2.0:1763343274.407493:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.407496:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.407501:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a2dbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493d6 expref: 20 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.407511:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a2dbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493d6 expref: 20 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.407551:0:35278:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a2dbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493d6 expref: 20 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343274.407565:0:35278:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc73100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:35278:1848998412963328:192.168.201.40@tcp:105: 00000100:00100000:3.0:1763343274.407609:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399837824 00000100:00100000:3.0:1763343274.407615:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399837824 00000100:00100000:2.0:1763343274.407632:0:35278:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c546ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1763343274.407666:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10604 00000100:00100000:2.0:1763343274.408417:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57121:x1848998399837824:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.408437:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.408469:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2dda lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b493e4 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.408533:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a2de1 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343274.408547:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a2de1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.408559:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a2de1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:2.0:1763343274.408608:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763343274.408613:0:33856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763343274.408646:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a2dda lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493e4 expref: 295 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.408663:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a2de1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493e4 expref: 294 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.408671:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8500) 00010000:00010000:2.0:1763343274.408675:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763343274.408678:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8693c00, rc 0) 00000100:00100000:2.0:1763343274.408725:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57121:x1848998399837824:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1051us (1669us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.408731:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10604 00000100:00100000:2.0:1763343274.409923:0:35278:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc73100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:35278:1848998412963328:192.168.201.40@tcp:105: 00010000:00010000:2.0:1763343274.409942:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343274.409995:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399837696:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 2780us (3053us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.410004:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3441 00000100:00100000:3.0:1763343274.410410:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.410505:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.410562:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399837952 00000100:00100000:2.0:1763343274.410569:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399837952 00002000:00010000:2.0:1763343274.410599:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/691 (5->18446744073709551615) 00002000:00100000:2.0:1763343274.410605:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401edc2d880 with x1848998399837952 ext(5->18446744073709551615) 00002000:00010000:2.0:1763343274.410614:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9401edc2d880. 00000100:00100000:0.0:1763343274.410649:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399838080 00000100:00100000:0.0:1763343274.410654:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399838080 00002000:00010000:0.0:1763343274.410673:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/692 (0->18446744073709551615) 00002000:00100000:0.0:1763343274.410677:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401edc2f480 with x1848998399838080 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343274.410683:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401edc2f480. 00000100:00100000:0.0:1763343274.410715:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1719 00000100:00100000:0.0:1763343274.410723:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2408:x1848998399838080:12345-192.168.201.40@tcp:10:lfs.0 00002000:00010000:0.0:1763343274.410889:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2b4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343274.410892:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2b4:0x0] updating lvb mtime from disk: 0 -> 1763343273 00002000:00010000:0.0:1763343274.410894:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343274.410896:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2b4:0x0] updating lvb ctime from disk: 0 -> 1763343273 00002000:00010000:0.0:1763343274.410898:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2b4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343274.410942:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399838080:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 218us (437us total) trans 17179871906 rc 0/0 00000100:00100000:0.0:1763343274.410949:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1719 00002000:00010000:0.0:1763343274.410952:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/692 (0->18446744073709551615) 00002000:00100000:0.0:1763343274.410955:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401edc2f480 with x1848998399838080 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343274.410959:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401edc2f480. 00000100:00100000:2.0:1763343274.411042:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1720 00000100:00100000:2.0:1763343274.411052:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2408:x1848998399837952:12345-192.168.201.40@tcp:10:lfs.0 00002000:00010000:2.0:1763343274.411654:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2b3:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:2.0:1763343274.411659:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2b3:0x0] updating lvb mtime from disk: 1763343273 -> 1763343273 00002000:00010000:2.0:1763343274.411662:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2b3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343274.411664:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2b3:0x0] updating lvb ctime from disk: 1763343273 -> 1763343273 00002000:00010000:2.0:1763343274.411666:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2b3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763343274.411937:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399837952:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 883us (1525us total) trans 21474839177 rc 0/0 00000100:00100000:2.0:1763343274.411946:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1720 00002000:00010000:2.0:1763343274.411950:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/691 (5->18446744073709551615) 00002000:00100000:2.0:1763343274.411953:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401edc2d880 with x1848998399837952 ext(5->18446744073709551615) 00002000:00010000:2.0:1763343274.411959:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9401edc2d880. 00000100:00100000:3.0:1763343274.413550:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.413792:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399838208 00000100:00100000:2.0:1763343274.413802:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399838208 00000100:00100000:2.0:1763343274.413902:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10605 00000100:00100000:2.0:1763343274.413911:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57121:x1848998399838208:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.413927:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.413945:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a2de8 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b493eb expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.414003:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2def lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343274.414015:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2def lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.414133:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2def lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.414145:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2df6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343274.414152:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2df6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.414158:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2df6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.414191:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2def lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.414196:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2def lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.414203:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2def lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.414208:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8692c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.414212:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2def lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.414218:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2def lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.414228:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8500) 00010000:00010000:2.0:1763343274.414231:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.414328:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2def lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.414336:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2def lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.414349:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2df6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.414355:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2df6 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.414365:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2df6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.414370:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c7ec1c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.414373:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2df6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.414379:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2df6 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.414391:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8000) 00010000:00010000:2.0:1763343274.414393:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.414396:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2df6 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.414402:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a2df6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.414428:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a2de8 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493eb expref: 295 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.414437:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8500) 00010000:00010000:2.0:1763343274.414439:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.414443:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a2de8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493eb expref: 295 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.414451:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8693e00, rc 0) 00000100:00100000:2.0:1763343274.414537:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57121:x1848998399838208:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 627us (993us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343274.414545:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10605 00000100:00100000:1.0:1763343274.415895:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.415966:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399838464 00000100:00100000:2.0:1763343274.415973:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399838464 00000100:00100000:2.0:1763343274.416019:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10606 00000100:00100000:2.0:1763343274.416059:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57117:x1848998399838464:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:2.0:1763343274.416127:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2dfd lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343274.416141:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2dfd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.416151:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2dfd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:3.0:1763343274.416261:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000004:00010000:2.0:1763343274.416264:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a9b63ac1 reply state 00000000e432544c transno 4294973563 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2dfd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.416295:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2dfd lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.416302:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:2.0:1763343274.416305:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343274.416308:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343274.416385:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57117:x1848998399838464:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 332us (495us total) trans 4294973563 rc 0/0 00000100:00100000:2.0:1763343274.416392:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10606 00000100:00100000:2.0:1763343274.416405:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399838720 00000100:00100000:2.0:1763343274.416408:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399838720 00000100:00100000:2.0:1763343274.416437:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10607 00000100:00100000:2.0:1763343274.416444:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57121:x1848998399838720:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.416454:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.416456:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343274.416471:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a2de1 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493e4 expref: 296 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.416485:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8500) 00010000:00010000:2.0:1763343274.416492:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343274.416502:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2e04 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b493f2 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.416572:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2e0b lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343274.416580:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2e0b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.416588:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2e0b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.416597:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2e12 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343274.416604:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2e12 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.416610:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2e12 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.416908:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2e19 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x201:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343274.416917:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2e19 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.416924:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2e19 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:2.0:1763343274.416933:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x201:0x0]: returning size 0 00010000:00010000:2.0:1763343274.416954:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2e0b lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.416961:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2e0b lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.416971:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2e0b lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.416977:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2e0b lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.416982:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd8e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.416986:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2e0b lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.416992:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2e0b lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.417000:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8200) 00010000:00010000:2.0:1763343274.417002:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.417006:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2e0b lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.417011:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2e0b lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000004:00010000:2.0:1763343274.417020:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000823b047e reply state 000000000d4f2893 transno 4294973564 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2e12 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.417056:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2e12 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.417062:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8000) 00010000:00010000:2.0:1763343274.417064:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343274.417066:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343274.417088:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2e04 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493f2 expref: 298 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.417109:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2e19 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493f2 expref: 297 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.417115:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x201:0x0].0x0 (ffff9400c48a8800) 00010000:00010000:2.0:1763343274.417118:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343274.417120:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5bd9a00, rc 0) 00000100:00100000:2.0:1763343274.417159:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57121:x1848998399838720:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 714us (897us total) trans 4294973564 rc 0/0 00000100:00100000:2.0:1763343274.417165:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10607 00000100:00100000:3.0:1763343274.418473:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.419428:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399838848 00000100:00100000:1.0:1763343274.419441:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399838848 00000100:00100000:1.0:1763343274.419638:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7196 00000100:00100000:1.0:1763343274.419647:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399838848:12345-192.168.201.40@tcp:2:lfs.0 00002000:00010000:1.0:1763343274.419774:0:35266:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2b3:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763343274.419777:0:35266:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2b3:0x0] updating lvb mtime from disk: 1763343273 -> 1763343273 00002000:00010000:1.0:1763343274.419779:0:35266:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2b3:0x0] updating lvb atime from disk: 0 -> 1763343273 00002000:00010000:1.0:1763343274.419781:0:35266:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2b3:0x0] updating lvb ctime from disk: 1763343273 -> 1763343273 00002000:00010000:1.0:1763343274.419783:0:35266:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2b3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763343274.420159:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399838848:12345-192.168.201.40@tcp:2:lfs.0 Request processed in 511us (1690us total) trans 17179871907 rc 0/0 00000100:00100000:1.0:1763343274.420167:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7196 00000100:00100000:0.0:1763343274.420495:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.420611:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399839104 00000100:00100000:1.0:1763343274.420618:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399839104 00000100:00100000:1.0:1763343274.420661:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10608 00000100:00100000:1.0:1763343274.420669:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57121:x1848998399839104:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343274.420687:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.420707:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a2e27 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x201:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b493f9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.420803:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2e2e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x201:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343274.420818:0:6524:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2e19 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493f2 expref: 299 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.420827:0:6524:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2e2e lrc: 4/0,1 mode: --/EX res: [0x240000404:0x201:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.420860:0:6524:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2e19 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493f2 expref: 299 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.420873:0:6524:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2e19 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493f2 expref: 299 pid: 9827 timeout: 1167 lvb_type: 0 00000100:00100000:1.0:1763343274.420886:0:6524:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412963456:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343274.420964:0:6524:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c32170c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343274.422715:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.422896:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399839232 00000100:00100000:2.0:1763343274.422905:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399839232 00010000:00010000:2.0:1763343274.422941:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2e19 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493f2 expref: 300 pid: 9827 timeout: 1167 lvb_type: 0 00000100:00100000:2.0:1763343274.422981:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3442 00000100:00100000:2.0:1763343274.422995:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:2408:x1848998399839232:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343274.423009:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343274.423015:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2e19 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493f2 expref: 300 pid: 9827 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343274.423061:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2e19 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493f2 expref: 300 pid: 9827 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343274.423086:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x201:0x0].0x0 (ffff9400c48a8800) 00010000:00010000:2.0:1763343274.423091:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2e2e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x201:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.423105:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2e2e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x201:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.423111:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2e2e lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x201:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.423129:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343274.423152:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2e19 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493f2 expref: 300 pid: 9827 timeout: 1167 lvb_type: 0 00000100:00100000:0.0:1763343274.423168:0:6524:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412963456:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343274.423174:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:2408:x1848998399839232:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 186us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.423181:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3442 00010000:00010000:0.0:1763343274.423186:0:6524:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2e2e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x201:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.423194:0:6524:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2e2e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x201:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.423200:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2e2e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x201:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:0.0:1763343274.423222:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x201:0x0]: returning size 0 00000100:00100000:3.0:1763343274.423354:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000004:00080000:0.0:1763343274.423441:0:6524:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2b7:0x0], index 1: 0 00000004:00080000:0.0:1763343274.423448:0:6524:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2b6:0x0], index 0: 0 00000004:00080000:0.0:1763343274.423454:0:6524:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2b7:0x0], index 0: 0 00000004:00080000:0.0:1763343274.423458:0:6524:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2b8:0x0], index 1: 0 00000100:00100000:1.0:1763343274.423567:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399839488 00000100:00100000:1.0:1763343274.423572:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399839488 00010000:00010000:0.0:1763343274.423576:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2e2e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x201:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.423584:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2e2e lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x201:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.423591:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2e2e lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x201:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.423597:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343274.423600:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2e2e lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x201:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.423607:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2e2e lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x201:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.423616:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x201:0x0].0x0 (ffff9400c48a8800) 00010000:00010000:0.0:1763343274.423619:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343274.423623:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2e2e lrc: 2/0,0 mode: --/EX res: [0x240000404:0x201:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.423629:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2e2e lrc: 0/0,0 mode: --/EX res: [0x240000404:0x201:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.423673:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a2e27 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x201:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493f9 expref: 300 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.423687:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x201:0x0].0x0 (ffff9400c48a8800) 00010000:00010000:0.0:1763343274.423689:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343274.423693:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a2e27 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x201:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493f9 expref: 300 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.423708:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176400, rc 0) 00000100:00100000:0.0:1763343274.423742:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57121:x1848998399839104:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3074us (3248us total) trans 4294973565 rc 301/301 00000100:00100000:0.0:1763343274.423748:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10608 00000100:00100000:1.0:1763343274.423754:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3737 00000100:00100000:1.0:1763343274.423762:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57117:x1848998399839488:12345-192.168.201.40@tcp:35:lfs.0 00000004:00010000:1.0:1763343274.423805:0:6528:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x1fd:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2c13 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49343 expref: 298 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.423833:0:6528:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a2e3c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 00010000:00010000:1.0:1763343274.423844:0:6528:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a2c75 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49366 expref: 298 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.423852:0:6528:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a2e3c lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT1 00010000:00010000:1.0:1763343274.423877:0:6528:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a2c75 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49366 expref: 298 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.423890:0:6528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a2c75 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49366 expref: 298 pid: 7641 timeout: 1167 lvb_type: 0 00000100:00100000:1.0:1763343274.423903:0:6528:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6528:1848998412963584:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343274.423972:0:6528:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c32170c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343274.425871:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.426389:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399839744 00000100:00100000:3.0:1763343274.426399:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399839744 00000100:00100000:2.0:1763343274.426585:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3738 00000100:00100000:2.0:1763343274.426598:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57121:x1848998399839744:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343274.426714:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.426830:0:6528:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6528:1848998412963584:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343274.426858:0:6528:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a2e3c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT1 00000100:00100000:2.0:1763343274.427086:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57121:x1848998399839744:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 489us (1222us total) trans 4294973566 rc 0/0 00000100:00100000:2.0:1763343274.427094:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3738 00000100:00100000:2.0:1763343274.427120:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399839872 00000100:00100000:2.0:1763343274.427124:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399839872 00010000:00010000:2.0:1763343274.427141:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a2c75 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49366 expref: 300 pid: 7641 timeout: 1167 lvb_type: 0 00000100:00100000:2.0:1763343274.427173:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3443 00000100:00100000:2.0:1763343274.427181:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:2407:x1848998399839872:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343274.427190:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343274.427197:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a2c75 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49366 expref: 300 pid: 7641 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343274.427209:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a2c75 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49366 expref: 300 pid: 7641 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343274.427231:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401ed154800/0x9104b1ba770a2c75 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49366 expref: 300 pid: 7641 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343274.427244:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:2.0:1763343274.427249:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a2e3c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343274.427260:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a2e3c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343274.427287:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a2e3c lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343274.427312:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343274.427336:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:2407:x1848998399839872:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 156us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.427344:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3443 00010000:00010000:3.0:1763343274.427555:0:6528:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a2e3c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343274.427563:0:6528:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a2e3c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT1 00000040:00080000:3.0:1763343274.428096:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1712, 88 off142600 00000004:00080000:3.0:1763343274.428106:0:6528:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1067552080180ns, next at 1068000121327ns, rc = 0 00000040:00080000:2.0:1763343274.428501:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1704, 88 off141944 00000004:00080000:2.0:1763343274.428509:0:6528:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1067552483770ns, next at 1068000150895ns, rc = 0 00000040:00080000:2.0:1763343274.428536:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1705, 88 off142032 00000004:00080000:2.0:1763343274.428540:0:6528:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1067552515930ns, next at 1068000150895ns, rc = 0 00000040:00080000:2.0:1763343274.428557:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1713, 88 off142688 00000004:00080000:2.0:1763343274.428561:0:6528:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1067552536476ns, next at 1068000121327ns, rc = 0 00000100:00100000:0.0:1763343274.429576:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.429731:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399840128 00000100:00100000:2.0:1763343274.429740:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399840128 00000100:00100000:2.0:1763343274.429794:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3739 00000100:00100000:2.0:1763343274.429805:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57121:x1848998399840128:12345-192.168.201.40@tcp:35:lfs.0 00000001:00080000:1.0:1763343274.430333:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973567 is committed 00000004:00080000:1.0:1763343274.430340:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1100 committed 00000004:00080000:1.0:1763343274.430351:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1092 committed 00000004:00080000:1.0:1763343274.430358:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1091 committed 00000004:00080000:1.0:1763343274.430360:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1099 committed 00000100:00100000:2.0:1763343274.430453:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57121:x1848998399840128:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 649us (881us total) trans 4294973568 rc 0/0 00000100:00100000:2.0:1763343274.430464:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3739 00000100:00100000:2.0:1763343274.430494:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412963712:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343274.430494:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412963840:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763343274.430593:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2d86 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.430604:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2d86 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.430611:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2d86 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.430616:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c7ec0600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343274.430621:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2d86 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.430634:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2d86 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.430649:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8000) 00010000:00010000:3.0:1763343274.430652:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343274.430657:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2d86 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343274.430658:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343274.430663:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a2d86 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.430680:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2d9b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.430686:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2d9b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343274.430687:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412964224:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1763343274.430692:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2d9b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.430696:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb3800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343274.430700:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2d9b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.430706:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2d9b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343274.430707:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343274.430713:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:3.0:1763343274.430716:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343274.430718:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2d9b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.430723:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2d9b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.430732:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2dfd lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00000100:00100000:2.0:1763343274.430737:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412963712 00000100:00100000:2.0:1763343274.430742:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412963712 00010000:00010000:3.0:1763343274.430753:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2dfd lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.430758:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2dfd lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.430763:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb2400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343274.430766:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2dfd lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00000100:00100000:2.0:1763343274.430766:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412964224 00000100:00100000:2.0:1763343274.430769:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412964224 00010000:00010000:3.0:1763343274.430772:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2dfd lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.430780:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:3.0:1763343274.430783:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343274.430785:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2dfd lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000100:00100000:2.0:1763343274.430785:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7197 00000100:00100000:2.0:1763343274.430791:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+22:3661:x1848998412963712:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763343274.430795:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2dfd lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.430805:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2e12 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343274.430810:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2e12 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00002000:00080000:2.0:1763343274.430810:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:693 count 1 00010000:00010000:3.0:1763343274.430815:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2e12 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343274.430820:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd9000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343274.430822:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2e12 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343274.430827:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2e12 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343274.430833:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8000) 00010000:00010000:2.0:1763343274.430834:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2e43 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.430836:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343274.430838:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2e12 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343274.430843:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2e12 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.430850:0:8413:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2d47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493b3 expref: 21 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.430857:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343274.430859:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343274.430863:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2e43 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.430890:0:8413:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2d47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493b3 expref: 21 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.430904:0:8413:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2d47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493b3 expref: 21 pid: 8413 timeout: 1167 lvb_type: 0 00000100:00100000:2.0:1763343274.430916:0:8413:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b9d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8413:1848998412964736:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343274.432097:0:8413:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401d862c600 going to sleep for 11 seconds 00000100:00100000:3.0:1763343274.432101:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7198 00000100:00100000:3.0:1763343274.432116:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3661:x1848998412964224:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343274.432146:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:692 count 1 00010000:00010000:3.0:1763343274.432167:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2e4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.432183:0:35266:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2d39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493ac expref: 13 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.432190:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343274.432191:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343274.432194:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2e4a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.432220:0:35266:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2d39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493ac expref: 13 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343274.432487:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343274.432523:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412964352:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343274.432556:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343274.432599:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412963968:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343274.432602:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412963840 00000100:00100000:0.0:1763343274.432609:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412963840 00000100:00100000:1.0:1763343274.432623:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343274.432642:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412964480:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343274.432645:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412964352 00000100:00100000:0.0:1763343274.432647:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412964352 00000100:00100000:1.0:1763343274.432661:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343274.432677:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1763343274.432683:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412964096:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343274.432702:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343274.432969:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412963968 00000100:00100000:0.0:1763343274.432974:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412963968 00000100:00100000:1.0:1763343274.432986:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412964608:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343274.432997:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412964480 00000100:00100000:0.0:1763343274.432999:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412964480 00000100:00100000:1.0:1763343274.433008:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343274.433009:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412964096 00000100:00100000:0.0:1763343274.433011:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412964096 00000100:00100000:0.0:1763343274.433019:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412964608 00000100:00100000:0.0:1763343274.433021:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412964608 00000100:00100000:0.0:1763343274.433056:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7199 00000100:00100000:1.0:1763343274.433061:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7200 00000100:00100000:0.0:1763343274.433064:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+25:3662:x1848998412963840:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343274.433067:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+8:3662:x1848998412964352:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763343274.433081:0:8412:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:693 count 1 00002000:00080000:0.0:1763343274.433081:0:27798:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:694 count 1 00002000:00010000:1.0:1763343274.433108:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1763343274.433108:0:27798:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343274.433114:0:8412:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177800/0x9104b1ba770a2e51 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.433115:0:27798:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2e58 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.433125:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.433125:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.433127:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.433127:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.433133:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177800/0x9104b1ba770a2e51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.433133:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2e58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.433147:0:8412:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5177800/0x9104b1ba770a2e51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.433147:0:27798:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2e58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.433158:0:8412:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177800/0x9104b1ba770a2e51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.433158:0:27798:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2e58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.433168:0:8412:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177800/0x9104b1ba770a2e51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.433168:0:27798:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2e58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.433185:0:27798:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1763343274.433188:0:8412:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1763343274.433379:0:35266:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2d39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493ac expref: 13 pid: 8413 timeout: 1167 lvb_type: 0 00000100:00100000:3.0:1763343274.433392:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c39b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35266:1848998412964864:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343274.433409:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+26:3662:x1848998412963840:12345-0@lo:6:osp-syn-1-1.0 Request processed in 346us (922us total) trans 17179871908 rc 0/0 00000100:00100000:0.0:1763343274.433415:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7199 00000100:00100000:3.0:1763343274.433433:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c3be8000 going to sleep for 11 seconds 00000100:00100000:0.0:1763343274.433433:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7201 00000100:00100000:0.0:1763343274.433439:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+25:3659:x1848998412963968:12345-0@lo:2:osp-syn-1-1.0 00000004:00010000:3.0:1763343274.433482:0:6528:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e77a812c reply state 00000000cc8de548 transno 4294973567 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a2e3c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343274.433496:0:6528:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a2e3c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343274.433505:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:3.0:1763343274.433507:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00002000:00010000:0.0:1763343274.433509:0:27798:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2b3:0x0] updating lvb size from disk: 5 -> 5 00000100:00100000:3.0:1763343274.433510:0:6528:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00002000:00010000:0.0:1763343274.433511:0:27798:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2b3:0x0] updating lvb mtime from disk: 1763343273 -> 1763343273 00002000:00010000:0.0:1763343274.433513:0:27798:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2b3:0x0] updating lvb atime from disk: 1763343273 -> 1763343273 00010000:00010000:3.0:1763343274.433515:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00002000:00010000:0.0:1763343274.433516:0:27798:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2b3:0x0] updating lvb ctime from disk: 1763343273 -> 1763343273 00010000:00010000:3.0:1763343274.433517:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00002000:00010000:0.0:1763343274.433518:0:27798:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2b3:0x0] updating lvb blocks from disk: 8 -> 8 00010000:00010000:3.0:1763343274.433522:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a2c13 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49343 expref: 288 pid: 7641 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343274.433547:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+26:3659:x1848998412963968:12345-0@lo:2:osp-syn-1-1.0 Request processed in 108us (922us total) trans 17179871909 rc 0/0 00000100:00100000:0.0:1763343274.433554:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7201 00000100:00100000:0.0:1763343274.433565:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7202 00000100:00100000:0.0:1763343274.433571:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+9:3659:x1848998412964480:12345-0@lo:2:osp-syn-0-1.0 00010000:00080000:3.0:1763343274.433585:0:6528:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763343274.433598:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+288:57117:x1848998399839488:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 9836us (10244us total) trans 4294973567 rc 0/0 00000100:00100000:3.0:1763343274.433605:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3737 00002000:00010000:0.0:1763343274.433619:0:27798:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2b2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343274.433621:0:27798:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2b2:0x0] updating lvb mtime from disk: 1763343273 -> 1763343273 00002000:00010000:0.0:1763343274.433624:0:27798:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2b2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343274.433626:0:27798:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2b2:0x0] updating lvb ctime from disk: 1763343273 -> 1763343273 00010000:00010000:3.0:1763343274.433628:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a2e3c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT1 00002000:00010000:0.0:1763343274.433628:0:27798:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2b2:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:3.0:1763343274.433634:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a2e3c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343274.433640:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a2e3c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343274.433645:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343274.433649:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a2e3c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT1 00000100:00100000:0.0:1763343274.433650:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+10:3659:x1848998412964480:12345-0@lo:2:osp-syn-0-1.0 Request processed in 80us (989us total) trans 21474839179 rc 0/0 00000100:00100000:0.0:1763343274.433656:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7202 00010000:00010000:3.0:1763343274.433657:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a2e3c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343274.433666:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00000100:00100000:0.0:1763343274.433668:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7203 00010000:00010000:3.0:1763343274.433669:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343274.433673:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a2e3c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT1 00000100:00100000:0.0:1763343274.433674:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+25:3659:x1848998412964096:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1763343274.433679:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a2e3c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT1 00002000:00010000:0.0:1763343274.433719:0:27798:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2b4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343274.433722:0:27798:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2b4:0x0] updating lvb mtime from disk: 1763343273 -> 1763343273 00002000:00010000:0.0:1763343274.433724:0:27798:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343274.433726:0:27798:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2b4:0x0] updating lvb ctime from disk: 1763343273 -> 1763343273 00002000:00010000:0.0:1763343274.433728:0:27798:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2b4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343274.433756:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+26:3659:x1848998412964096:12345-0@lo:2:osp-syn-1-1.0 Request processed in 82us (1053us total) trans 17179871910 rc 0/0 00000100:00100000:0.0:1763343274.433762:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7203 00000100:00100000:0.0:1763343274.433774:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7204 00000100:00100000:0.0:1763343274.433779:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+9:3659:x1848998412964608:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763343274.433822:0:27798:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2b3:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763343274.433825:0:27798:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2b3:0x0] updating lvb mtime from disk: 1763343273 -> 1763343273 00002000:00010000:0.0:1763343274.433828:0:27798:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2b3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343274.433830:0:27798:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2b3:0x0] updating lvb ctime from disk: 1763343273 -> 1763343273 00002000:00010000:0.0:1763343274.433832:0:27798:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2b3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763343274.433856:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+10:3659:x1848998412964608:12345-0@lo:2:osp-syn-0-1.0 Request processed in 77us (846us total) trans 21474839180 rc 0/0 00000100:00100000:0.0:1763343274.433861:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7204 00000004:00080000:0.0:1763343274.433911:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5a3c700/2, rc 0, transno 17179871908 00000100:00100000:0.0:1763343274.433917:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412963840:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1763343274.433936:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5a3ed80/2, rc 0, transno 17179871910 00000100:00100000:0.0:1763343274.433940:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412964096:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343274.433949:0:3659:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474839174 gen 2 00000004:00080000:0.0:1763343274.433954:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6504a80, transno 21474839134 00000004:00080000:0.0:1763343274.433972:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6507800, transno 21474839135 00000004:00080000:0.0:1763343274.433975:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6507b80, transno 21474839136 00000004:00080000:0.0:1763343274.433977:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6505880, transno 21474839137 00000004:00080000:0.0:1763343274.433980:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b27100, transno 21474839138 00000004:00080000:0.0:1763343274.433982:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b24700, transno 21474839139 00000004:00080000:0.0:1763343274.433984:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b27b80, transno 21474839140 00000004:00080000:0.0:1763343274.433987:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9831c00, transno 21474839141 00000004:00080000:0.0:1763343274.433989:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c7918380, transno 21474839143 00000004:00080000:0.0:1763343274.433992:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c791b100, transno 21474839144 00000004:00080000:0.0:1763343274.433995:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c791a680, transno 21474839145 00000004:00080000:0.0:1763343274.433997:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c791b800, transno 21474839146 00000004:00080000:0.0:1763343274.434000:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c511ed80, transno 21474839149 00000004:00080000:0.0:1763343274.434003:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c8599c00, transno 21474839150 00000004:00080000:0.0:1763343274.434005:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c372ad80, transno 21474839151 00000004:00080000:0.0:1763343274.434008:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5957100, transno 21474839152 00000004:00080000:0.0:1763343274.434011:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc1a300, transno 21474839156 00000004:00080000:0.0:1763343274.434013:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc1bb80, transno 21474839157 00000004:00080000:0.0:1763343274.434015:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc18e00, transno 21474839158 00000004:00080000:0.0:1763343274.434017:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc19180, transno 21474839159 00000004:00080000:0.0:1763343274.434020:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6280a80, transno 21474839160 00000004:00080000:0.0:1763343274.434022:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6281c00, transno 21474839161 00000004:00080000:0.0:1763343274.434056:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6280380, transno 21474839162 00000004:00080000:0.0:1763343274.434059:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6282300, transno 21474839163 00000004:00080000:0.0:1763343274.434070:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5956300, transno 21474839166 00000004:00080000:0.0:1763343274.434072:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5954380, transno 21474839167 00000004:00080000:0.0:1763343274.434075:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5957800, transno 21474839168 00000004:00080000:0.0:1763343274.434077:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5955c00, transno 21474839169 00000004:00080000:0.0:1763343274.434080:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bfc380, transno 21474839171 00000004:00080000:0.0:1763343274.434082:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bfdf80, transno 21474839172 00000004:00080000:0.0:1763343274.434084:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc1a680, transno 21474839173 00000004:00080000:0.0:1763343274.434086:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc18700, transno 21474839174 00000100:00100000:0.0:1763343274.434093:0:3659:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9400c5bfed80 x1848998412964608/t21474839180(21474839180) o2->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763343290 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1763343274.434100:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bfed80/2, rc 0, transno 21474839180 00000100:00100000:0.0:1763343274.434104:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412964608:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763343274.434116:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5a3c380/2, rc 0, transno 17179871909 00000100:00100000:0.0:1763343274.434120:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412963968:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763343274.434127:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bfd500/2, rc 0, transno 21474839179 00000100:00100000:0.0:1763343274.434130:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412964480:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343274.434336:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+9:3662:x1848998412964352:12345-0@lo:6:osp-syn-0-1.0 Request processed in 1267us (1776us total) trans 21474839178 rc 0/0 00000100:00100000:1.0:1763343274.434342:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7200 00010000:00010000:1.0:1763343274.434375:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763343274.434381:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2e58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.434388:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fd800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343274.434392:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2e58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.434400:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2e58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.434414:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2e58 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.434420:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2e58 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.434433:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343274.434437:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5177800/0x9104b1ba770a2e51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.434443:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343274.434446:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5177800/0x9104b1ba770a2e51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.434452:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5177800/0x9104b1ba770a2e51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.434461:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5177800/0x9104b1ba770a2e51 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.434467:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177800/0x9104b1ba770a2e51 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.434478:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343274.434480:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343274.434482:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343274.435298:0:8616:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 4 in progress, 2 in flight, 32 done 00010000:00010000:2.0:1763343274.435480:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343274.437730:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bfd880/2, rc 0, transno 21474839178 00000100:00100000:0.0:1763343274.437748:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412964352:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343274.439584:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.440155:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399840384 00000100:00100000:1.0:1763343274.440168:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399840384 00000100:00100000:1.0:1763343274.440231:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10609 00000100:00100000:1.0:1763343274.440242:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+287:55884:x1848998399840384:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343274.440265:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.440306:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a2e5f lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49400 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.440442:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2e66 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343274.440460:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2e66 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.440472:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2e66 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.440484:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2e6d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343274.440490:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2e6d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.440496:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2e6d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.440550:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2e74 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x201:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343274.440557:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2e74 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.440565:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2e74 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:1.0:1763343274.440574:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x201:0x0]: returning size 0 00010000:00010000:1.0:1763343274.440663:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2e66 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.440671:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2e66 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.440677:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2e66 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.440682:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2e66 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.440689:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.440693:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2e66 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.440701:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2e66 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.440712:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fc4f1e00) 00010000:00010000:1.0:1763343274.440715:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.440721:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2e66 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.440726:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2e66 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.440738:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2e6d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.440744:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2e6d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.440749:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2e6d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.440754:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.440756:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2e6d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.440762:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2e6d lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.440769:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fc4f1100) 00010000:00010000:1.0:1763343274.440771:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.440774:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2e6d lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.440779:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2e6d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.440820:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a2e5f lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49400 expref: 290 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.440836:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2e74 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49400 expref: 289 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.440843:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x201:0x0].0x0 (ffff9401fc4f1700) 00010000:00010000:1.0:1763343274.440846:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343274.440848:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177c00, rc 0) 00000100:00100000:1.0:1763343274.440917:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:55884:x1848998399840384:12345-192.168.201.40@tcp:101:bash.0 Request processed in 675us (1347us total) trans 4294973569 rc 0/0 00000100:00100000:1.0:1763343274.440925:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10609 00000100:00100000:3.0:1763343274.441342:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.441449:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.441471:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.441496:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399840512 00000100:00100000:3.0:1763343274.441503:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399840512 00000100:00100000:0.0:1763343274.441522:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399840640 00000100:00100000:0.0:1763343274.441529:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399840640 00010000:00010000:3.0:1763343274.441533:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2d39 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493ac expref: 14 pid: 8413 timeout: 1167 lvb_type: 0 00000100:00100000:0.0:1763343274.441564:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10610 00000100:00100000:0.0:1763343274.441572:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57117:x1848998399840640:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343274.441587:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343274.441601:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fc000/0x9104b1ba770a2e82 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49407 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343274.441613:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399840768 00000100:00100000:3.0:1763343274.441618:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399840768 00010000:00010000:3.0:1763343274.441641:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2d47 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493b3 expref: 22 pid: 8413 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.441641:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fc000/0x9104b1ba770a2e82 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49407 expref: 290 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.441667:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fc000/0x9104b1ba770a2e82 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49407 expref: 290 pid: 7641 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343274.441678:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3444 00010000:00010000:0.0:1763343274.441682:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:0.0:1763343274.441687:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1763343274.441689:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399840512:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343274.441691:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fc000, rc 0) 00010000:00010000:3.0:1763343274.441704:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343274.441711:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2d39 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493ac expref: 14 pid: 8413 timeout: 1167 lvb_type: 0 00010000:00010000:3.0:1763343274.441723:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2d39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493ac expref: 14 pid: 8413 timeout: 1167 lvb_type: 0 00000100:00100000:0.0:1763343274.441728:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57117:x1848998399840640:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 154us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343274.441740:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10610 00010000:00010000:3.0:1763343274.441752:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343274.441756:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343274.441761:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2e4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.441771:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2e4a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.441801:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343274.441843:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399840512:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 157us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343274.441851:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3444 00000100:00100000:3.0:1763343274.441869:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3445 00000100:00100000:3.0:1763343274.441875:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399840768:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343274.441884:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343274.441889:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2d47 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493b3 expref: 22 pid: 8413 timeout: 1167 lvb_type: 0 00010000:00010000:3.0:1763343274.441900:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2d47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493b3 expref: 22 pid: 8413 timeout: 1167 lvb_type: 0 00010000:00010000:3.0:1763343274.441915:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343274.441917:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343274.441920:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2e43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.441927:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2e43 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.441940:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343274.441961:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399840768:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 86us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343274.441968:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3445 00010000:00010000:3.0:1763343274.442146:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2d47 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493b3 expref: 21 pid: 8413 timeout: 1167 lvb_type: 0 00000100:00100000:3.0:1763343274.442160:0:8413:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b9d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8413:1848998412964736:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343274.442180:0:8413:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2e43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.442190:0:8413:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2e43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.442196:0:8413:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2e43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.442204:0:8413:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2e43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.442212:0:8413:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2e43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.442229:0:8413:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343274.442505:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+26:3661:x1848998412963712:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11712us (11844us total) trans 17179871911 rc 0/0 00000100:00100000:3.0:1763343274.442513:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7197 00010000:00010000:3.0:1763343274.442536:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343274.442543:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2e43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.442551:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343274.442556:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2e43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.442564:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2e43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.442575:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2e43 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.442582:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2e43 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.442601:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343274.442603:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343274.442605:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343274.443215:0:35266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2d39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493ac expref: 13 pid: 8413 timeout: 1167 lvb_type: 0 00000100:00100000:2.0:1763343274.443231:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c39b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35266:1848998412964864:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343274.443248:0:35266:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2e4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1763343274.443298:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5a3d880/2, rc 0, transno 17179871911 00000100:00100000:2.0:1763343274.443304:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412963712:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1763343274.443323:0:35266:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2e4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.443332:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2e4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.443340:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2e4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.443349:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2e4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.443375:0:35266:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343274.443558:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3661:x1848998412964224:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11448us (12848us total) trans 21474839181 rc 0/0 00000100:00100000:2.0:1763343274.443566:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7198 00000004:00080000:2.0:1763343274.443596:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5a3c000/2, rc 0, transno 21474839181 00000100:00100000:2.0:1763343274.443601:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412964224:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763343274.443654:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343274.443660:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2e4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.443668:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a7e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343274.443671:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2e4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.443679:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2e4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.443694:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2e4a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.443701:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2e4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.443716:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343274.443718:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343274.443719:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343274.446949:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.447002:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.447011:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399841024 00000100:00100000:3.0:1763343274.447044:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399841024 00000100:00100000:3.0:1763343274.447117:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3740 00000100:00100000:3.0:1763343274.447129:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8443c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57117:x1848998399841024:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:2.0:1763343274.447592:0:6528:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1fd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1763343274.447664:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1714, 64 off142752 00000100:00100000:1.0:1763343274.447664:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399841152 00000100:00100000:1.0:1763343274.447671:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399841152 00000040:00080000:2.0:1763343274.447696:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1706, 64 off142096 00000040:00080000:2.0:1763343274.447712:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1707, 64 off142160 00000100:00100000:1.0:1763343274.447716:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10611 00000100:00100000:1.0:1763343274.447727:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:55884:x1848998399841152:12345-192.168.201.40@tcp:101:bash.0 00000040:00080000:2.0:1763343274.447728:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1715, 64 off142816 00010000:00010000:1.0:1763343274.447746:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.447771:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a2e89 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x201:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4940e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.447793:0:6528:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a2e90 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 00010000:00010000:1.0:1763343274.447810:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a2e97 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x201:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343274.447813:0:6528:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a2e90 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6528 initiator: MDT1 00010000:00010000:1.0:1763343274.447829:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a2e97 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.447833:0:6528:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a2e90 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT1 00010000:00010000:1.0:1763343274.447846:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a2e97 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.447847:0:6528:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a2e90 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343274.447863:0:6528:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a2e90 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343274.447869:0:6528:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a2e90 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343274.447894:0:6528:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343274.447949:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a2e89 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x201:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4940e expref: 294 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.447972:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a2e97 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4940e expref: 293 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.447981:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x201:0x0].0x0 (ffff9401fc4f1700) 00010000:00010000:1.0:1763343274.447984:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343274.447988:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176c00, rc 0) 00000100:00100000:1.0:1763343274.448067:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:55884:x1848998399841152:12345-192.168.201.40@tcp:101:bash.0 Request processed in 341us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.448076:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10611 00000100:00100000:2.0:1763343274.448099:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8443c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57117:x1848998399841024:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 970us (1162us total) trans 4294973570 rc 0/0 00000100:00100000:2.0:1763343274.448108:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3740 00010000:00010000:0.0:1763343274.448992:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343274.449002:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a2e90 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343274.449011:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343274.449016:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a2e90 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343274.449050:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a2e90 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343274.449066:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1fd:0x0].0x0 (ffff9400c497e100) 00010000:00010000:0.0:1763343274.449069:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343274.449073:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a2e90 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343274.449078:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a2e90 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343274.449092:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343274.449094:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343274.449096:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343274.452548:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.452595:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.452856:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399841408 00000100:00100000:1.0:1763343274.452867:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399841408 00000100:00100000:1.0:1763343274.452928:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399841664 00000100:00100000:1.0:1763343274.452932:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399841664 00000100:00100000:1.0:1763343274.452955:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10612 00000100:00100000:1.0:1763343274.452964:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57117:x1848998399841408:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343274.452990:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.453013:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a2e9e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x201:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49415 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.453151:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2ea5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x201:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343274.453166:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2ea5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x201:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.453183:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2ea5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x201:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:1.0:1763343274.453195:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x201:0x0]: returning size 0 00010000:00010000:1.0:1763343274.453319:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a2e9e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x201:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49415 expref: 296 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.453336:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2ea5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x201:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49415 expref: 295 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.453344:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x201:0x0].0x0 (ffff9401fc4f1700) 00010000:00010000:1.0:1763343274.453347:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1763343274.453351:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177000, rc 0) 00000100:00100000:1.0:1763343274.453413:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57117:x1848998399841408:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 450us (875us total) trans 4294973571 rc 0/0 00000100:00100000:1.0:1763343274.453421:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10612 00000100:00100000:1.0:1763343274.453442:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10613 00000100:00100000:1.0:1763343274.453450:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:55884:x1848998399841664:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:1.0:1763343274.453475:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343274.453490:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2e74 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49400 expref: 294 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.453502:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x201:0x0].0x0 (ffff9401fc4f1700) 00010000:00010000:1.0:1763343274.453506:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343274.453611:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2eb3 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x201:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343274.453622:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2eb3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x201:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.453630:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2eb3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x201:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000001:00080000:1.0:1763343274.453676:0:6524:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973572 00000004:00010000:1.0:1763343274.453704:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ed942bdb reply state 00000000b47f70ae transno 4294973573 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2eb3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x201:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.453716:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2eb3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x201:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.453723:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x201:0x0].0x0 (ffff9401fc4f1700) 00010000:00010000:1.0:1763343274.453727:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343274.453730:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343274.453798:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:55884:x1848998399841664:12345-192.168.201.40@tcp:36:bash.0 Request processed in 348us (1201us total) trans 4294973573 rc 0/0 00000100:00100000:1.0:1763343274.453805:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10613 00000020:00080000:1.0:1763343274.453809:0:6524:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343274.458094:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.458184:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.458238:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399841792 00000100:00100000:1.0:1763343274.458249:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399841792 00000100:00100000:1.0:1763343274.458330:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399842048 00000100:00100000:1.0:1763343274.458334:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399842048 00000100:00100000:2.0:1763343274.458342:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10614 00000100:00100000:2.0:1763343274.458365:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57117:x1848998399841792:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.458401:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.458428:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2eba lrc: 2/0,0 mode: --/CR res: [0x240000404:0x201:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4941c expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.458544:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2ec1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x201:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.458562:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2ec1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.458582:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2ec1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343274.458616:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x201:0x0]: returning size 0 00000004:00200000:2.0:1763343274.458621:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343274.458642:0:7641:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2ec1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.458674:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2eba lrc: 0/0,0 mode: --/CR res: [0x240000404:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4941c expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.458691:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2ec1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4941c expref: 298 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.458701:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x201:0x0].0x0 (ffff9401fc4f1700) 00010000:00010000:2.0:1763343274.458704:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343274.458707:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917a00, rc 0) 00000100:00100000:2.0:1763343274.458795:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57117:x1848998399841792:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 442us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.459044:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10615 00000100:00100000:1.0:1763343274.459057:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:55884:x1848998399842048:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343274.459066:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.459069:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343274.459100:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a2ea5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x201:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49415 expref: 298 pid: 6524 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343274.459107:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10614 00010000:00010000:1.0:1763343274.459118:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x201:0x0].0x0 (ffff9401fc4f1700) 00010000:00010000:1.0:1763343274.459125:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343274.459133:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a2ec8 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x201:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49423 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.459165:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a2ecf lrc: 3/0,1 mode: --/EX res: [0x240000404:0x201:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343274.459176:0:6524:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2ec1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4941c expref: 297 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.459185:0:6524:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a2ecf lrc: 4/0,1 mode: --/EX res: [0x240000404:0x201:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.459224:0:6524:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2ec1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4941c expref: 297 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.459251:0:6524:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2ec1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4941c expref: 297 pid: 7641 timeout: 1167 lvb_type: 0 00000100:00100000:1.0:1763343274.459266:0:6524:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c2f86300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412964992:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343274.459351:0:6524:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c546e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343274.460990:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.461169:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399842176 00000100:00100000:2.0:1763343274.461178:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399842176 00000100:00100000:2.0:1763343274.461236:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7205 00000100:00100000:2.0:1763343274.461246:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399842176:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.461262:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.461293:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2ed6 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4942a expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343274.461317:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343274.461336:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.461338:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.461349:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2ed6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4942a expref: 22 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343274.461366:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2ed6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4942a expref: 22 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343274.461378:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917000, rc 0) 00000100:00100000:2.0:1763343274.461434:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2408:x1848998399842176:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 189us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.461442:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7205 00000100:00100000:1.0:1763343274.461648:0:6524:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c2f86300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412964992:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343274.461668:0:6524:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a2ecf lrc: 3/0,1 mode: --/EX res: [0x240000404:0x201:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000100:00100000:0.0:1763343274.463362:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.463438:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.463468:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399842304 00000100:00100000:1.0:1763343274.463478:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399842304 00000100:00100000:2.0:1763343274.463480:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399842432 00000100:00100000:2.0:1763343274.463488:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399842432 00010000:00010000:1.0:1763343274.463519:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2ec1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4941c expref: 299 pid: 7641 timeout: 1167 lvb_type: 0 00000100:00100000:2.0:1763343274.463544:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10616 00000100:00100000:2.0:1763343274.463555:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57117:x1848998399842432:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:1.0:1763343274.463564:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3446 00010000:00010000:2.0:1763343274.463575:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1763343274.463576:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6281c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:2409:x1848998399842304:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343274.463592:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343274.463598:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2edd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x201:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49431 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.463599:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2ec1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4941c expref: 299 pid: 7641 timeout: 1167 lvb_type: 0 00010000:00010000:1.0:1763343274.463614:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2ec1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4941c expref: 299 pid: 7641 timeout: 1167 lvb_type: 0 00010000:00010000:1.0:1763343274.463635:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2ec1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4941c expref: 299 pid: 7641 timeout: 1167 lvb_type: 0 00010000:00010000:1.0:1763343274.463651:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x201:0x0].0x0 (ffff9401fc4f1700) 00010000:00010000:1.0:1763343274.463656:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a2ecf lrc: 3/0,1 mode: --/EX res: [0x240000404:0x201:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.463665:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a2ecf lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x201:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.463672:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a2ecf lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x201:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.463704:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343274.463747:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6281c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:2409:x1848998399842304:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 174us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.463755:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3446 00010000:00010000:0.0:1763343274.464057:0:6524:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a2ecf lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x201:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.464065:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a2ecf lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x201:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000040:00080000:0.0:1763343274.464311:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1716, 88 off142904 00000004:00080000:0.0:1763343274.464320:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1067588294950ns, next at 1068000121327ns, rc = 0 00000040:00080000:0.0:1763343274.464347:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1708, 88 off142248 00000004:00080000:0.0:1763343274.464352:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1067588327222ns, next at 1068000150895ns, rc = 0 00000040:00080000:0.0:1763343274.464367:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1709, 88 off142336 00000004:00080000:0.0:1763343274.464371:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1067588346205ns, next at 1068000150895ns, rc = 0 00000040:00080000:0.0:1763343274.464380:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1717, 88 off142992 00000004:00080000:0.0:1763343274.464383:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1067588358558ns, next at 1068000121327ns, rc = 0 00010000:00010000:2.0:1763343274.464492:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a2ecf lrc: 2/0,1 mode: EX/EX res: [0x240000404:0x201:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.464505:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2edd lrc: 4/0,0 mode: --/CR res: [0x240000404:0x201:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49431 expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.464525:0:7641:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a2ecf lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x201:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.464539:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2edd lrc: 3/0,0 mode: --/CR res: [0x240000404:0x201:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49431 expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.464554:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x201:0x0].0x0 (ffff9401fc4f1700) 00010000:00010000:2.0:1763343274.464558:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343274.464562:0:7641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2edd lrc: 3/0,0 mode: --/CR res: [0x240000404:0x201:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49431 expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.464570:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c7bb2400, rc 0) 00000100:00100000:2.0:1763343274.464621:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57117:x1848998399842432:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1068us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.464629:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10616 00000001:00080000:1.0:1763343274.472540:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973574 is committed 00000004:00080000:1.0:1763343274.472558:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1102 committed 00000004:00080000:1.0:1763343274.472578:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1094 committed 00000004:00080000:1.0:1763343274.472594:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1093 committed 00000004:00080000:1.0:1763343274.472598:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1101 committed 00000100:00100000:2.0:1763343274.472770:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412965248:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763343274.472818:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a2ecf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x201:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49423 expref: 292 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.472834:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x201:0x0].0x0 (ffff9401fc4f1700) 00010000:00010000:0.0:1763343274.472838:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343274.472844:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2edd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x201:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49431 expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343274.472846:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763343274.472862:0:6524:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2edd lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x201:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49431 expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.472871:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2edd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x201:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49431 expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343274.472883:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412965760:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1763343274.472902:0:6524:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2edd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x201:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49431 expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343274.472913:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343274.472917:0:6524:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6282d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412966144:192.168.201.40@tcp:105: 00010000:00010000:3.0:1763343274.472923:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2eb3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.472935:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2eb3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00000100:00100000:2.0:1763343274.472941:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00010000:00010000:3.0:1763343274.472943:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2eb3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00000100:00100000:2.0:1763343274.472950:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412965120:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763343274.472954:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343274.472960:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2eb3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.472970:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2eb3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00000100:00100000:2.0:1763343274.472979:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343274.472983:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x201:0x0].0x0 (ffff9401fc4f1700) 00010000:00010000:3.0:1763343274.472988:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343274.472992:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2eb3 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000100:00100000:0.0:1763343274.472994:0:6524:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9180 going to sleep for 11 seconds 00010000:00010000:3.0:1763343274.473004:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a2eb3 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000100:00100000:2.0:1763343274.473004:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412965632:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343274.473055:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343274.473068:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412965248 00000100:00100000:3.0:1763343274.473076:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412965248 00000100:00100000:2.0:1763343274.473088:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412965376:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343274.473114:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343274.473127:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412965760 00000100:00100000:3.0:1763343274.473131:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412965760 00000100:00100000:2.0:1763343274.473136:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412965888:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343274.473156:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412965120 00000100:00100000:2.0:1763343274.473157:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343274.473162:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412965120 00000100:00100000:2.0:1763343274.473181:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1763343274.473189:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412965632 00000100:00100000:2.0:1763343274.473190:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412965504:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343274.473194:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412965632 00000100:00100000:2.0:1763343274.473220:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343274.473230:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412966016:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343274.473246:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343274.473263:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412965376 00000100:00100000:2.0:1763343274.473268:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412965376 00000100:00100000:2.0:1763343274.473298:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412965888 00000100:00100000:2.0:1763343274.473302:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412965888 00000100:00100000:2.0:1763343274.473311:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412965504 00000100:00100000:2.0:1763343274.473312:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412965504 00000100:00100000:2.0:1763343274.473323:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7206 00000100:00100000:2.0:1763343274.473330:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+11:3662:x1848998412965248:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763343274.473359:0:8414:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:690 count 1 00010000:00010000:2.0:1763343274.473387:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2ee4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.473411:0:8414:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a2baa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49320 expref: 12 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.473419:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343274.473421:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343274.473424:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2ee4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.473448:0:8414:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a2baa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49320 expref: 12 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.473462:0:8414:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a2baa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49320 expref: 12 pid: 27798 timeout: 1167 lvb_type: 0 00000100:00100000:2.0:1763343274.473473:0:8414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1848998412966272:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343274.473507:0:8414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401ed059180 going to sleep for 11 seconds 00000100:00100000:2.0:1763343274.473524:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412966016 00000100:00100000:2.0:1763343274.473528:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412966016 00000100:00100000:2.0:1763343274.473547:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7207 00000100:00100000:2.0:1763343274.473552:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+12:3662:x1848998412965760:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343274.473731:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+13:3662:x1848998412965760:12345-0@lo:2:osp-syn-0-1.0 Request processed in 177us (818us total) trans 21474839182 rc 0/0 00000100:00100000:2.0:1763343274.473738:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7207 00000100:00100000:2.0:1763343274.473758:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7208 00000100:00100000:2.0:1763343274.473765:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+29:3662:x1848998412965120:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763343274.473776:0:11289:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:691 count 1 00010000:00010000:2.0:1763343274.473790:0:11289:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2eeb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.473801:0:11289:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a2cd0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49382 expref: 21 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343274.473808:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.473810:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.473813:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2eeb lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.473833:0:11289:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a2cd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49382 expref: 21 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343274.473843:0:11289:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a2cd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49382 expref: 21 pid: 8413 timeout: 1167 lvb_type: 1 00000100:00100000:2.0:1763343274.473855:0:11289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11289:1848998412966400:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343274.473894:0:11289:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401ed059000 going to sleep for 11 seconds 00000100:00100000:2.0:1763343274.473912:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7209 00000100:00100000:2.0:1763343274.473920:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+29:3662:x1848998412965632:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1763343274.474697:0:8626:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2b7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343274.474703:0:8626:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2b7:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763343274.474705:0:8626:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2b7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343274.474707:0:8626:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2b7:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763343274.474709:0:8626:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2b7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343274.474748:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+30:3662:x1848998412965632:12345-0@lo:2:osp-syn-1-1.0 Request processed in 829us (1692us total) trans 17179871912 rc 0/0 00000100:00100000:2.0:1763343274.474759:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7209 00000100:00100000:2.0:1763343274.474776:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7210 00000100:00100000:2.0:1763343274.474784:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+29:3659:x1848998412965376:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763343274.474799:0:8626:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:692 count 1 00010000:00010000:2.0:1763343274.474813:0:8626:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2ef2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.474827:0:8626:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a2dbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493d6 expref: 21 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.474833:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343274.474835:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343274.474838:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2ef2 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.474861:0:8626:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a2dbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493d6 expref: 21 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.474871:0:8626:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a2dbe lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493d6 expref: 21 pid: 35266 timeout: 1167 lvb_type: 0 00000100:00100000:2.0:1763343274.474882:0:8626:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998412966528:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343274.474922:0:8626:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c32170c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343274.474944:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7211 00000100:00100000:2.0:1763343274.474952:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+29:3659:x1848998412965888:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343274.476120:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7212 00000100:00100000:3.0:1763343274.476136:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+12:3659:x1848998412965504:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343274.476158:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:691 count 1 00010000:00010000:3.0:1763343274.476179:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2ef9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.476196:0:8413:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a2da2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493cf expref: 12 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.476204:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343274.476206:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343274.476210:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2ef9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.476238:0:8413:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a2da2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493cf expref: 12 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.477084:0:8413:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a2da2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493cf expref: 12 pid: 35266 timeout: 1167 lvb_type: 0 00000100:00100000:3.0:1763343274.477105:0:8413:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c39b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412966656:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343274.477161:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+30:3659:x1848998412965888:12345-0@lo:2:osp-syn-1-1.0 Request processed in 2207us (4001us total) trans 17179871913 rc 0/0 00000100:00100000:2.0:1763343274.477175:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7211 00000100:00100000:3.0:1763343274.477179:0:8413:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c3be8300 going to sleep for 11 seconds 00000100:00100000:2.0:1763343274.477207:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7213 00000004:00080000:1.0:1763343274.477286:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c59b7800/2, rc 0, transno 17179871913 00000100:00100000:1.0:1763343274.477292:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412965888:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343274.477329:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+12:3659:x1848998412966016:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343274.477499:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+13:3659:x1848998412966016:12345-0@lo:2:osp-syn-0-1.0 Request processed in 284us (4251us total) trans 21474839183 rc 0/0 00000004:00080000:1.0:1763343274.477549:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6280e00/2, rc 0, transno 21474839183 00000100:00100000:1.0:1763343274.477555:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412966016:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343274.477610:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7213 00000004:00080000:2.0:1763343274.477660:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c59b5500/2, rc 0, transno 17179871912 00000100:00100000:2.0:1763343274.477666:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412965632:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1763343274.477676:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6281180/2, rc 0, transno 21474839182 00000100:00100000:2.0:1763343274.477679:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412965760:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343274.477950:0:6524:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6282d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412966144:192.168.201.40@tcp:105: 00010000:00010000:2.0:1763343274.477991:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a2ec8 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x201:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49423 expref: 291 pid: 6524 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763343274.478016:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a2ecf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x201:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49423 expref: 290 pid: 6524 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343274.478017:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:2.0:1763343274.478085:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177e00, rc 0) 00000100:00100000:2.0:1763343274.478124:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:55884:x1848998399842048:12345-192.168.201.40@tcp:101:bash.0 Request processed in 19070us (19939us total) trans 4294973574 rc 0/0 00000100:00100000:2.0:1763343274.478131:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10615 00000100:00100000:2.0:1763343274.478771:0:8414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1848998412966272:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343274.478791:0:8414:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2ee4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343274.478876:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399842560 00000100:00100000:1.0:1763343274.478883:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399842560 00000100:00100000:1.0:1763343274.478935:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3741 00000100:00100000:1.0:1763343274.478943:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57117:x1848998399842560:12345-192.168.201.40@tcp:49:lfs.0 00000100:00100000:1.0:1763343274.479051:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57117:x1848998399842560:12345-192.168.201.40@tcp:49:lfs.0 Request processed in 108us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.479059:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3741 00000100:00100000:2.0:1763343274.480080:0:11289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11289:1848998412966400:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343274.480099:0:11289:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2eeb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343274.480759:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.480988:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399842816 00000100:00100000:3.0:1763343274.480996:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399842816 00010000:00010000:3.0:1763343274.481073:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a2cd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49382 expref: 22 pid: 8413 timeout: 1167 lvb_type: 1 00000100:00100000:3.0:1763343274.481102:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3447 00000100:00100000:3.0:1763343274.481111:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8393450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399842816:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343274.481125:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343274.481131:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a2cd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49382 expref: 22 pid: 8413 timeout: 1167 lvb_type: 1 00010000:00010000:3.0:1763343274.481142:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a2cd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49382 expref: 22 pid: 8413 timeout: 1167 lvb_type: 1 00010000:00010000:3.0:1763343274.481169:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a2cd0 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49382 expref: 22 pid: 8413 timeout: 1167 lvb_type: 1 00010000:00010000:3.0:1763343274.481191:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343274.481193:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343274.481198:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2eeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.481209:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2eeb lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.481242:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343274.481294:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8393450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399842816:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 184us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343274.481301:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3447 00010000:00010000:2.0:1763343274.481698:0:11289:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2eeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.481707:0:11289:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2eeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.481717:0:11289:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2eeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.481726:0:11289:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2eeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.481746:0:11289:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343274.481747:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998412966528:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343274.481768:0:8626:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2ef2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.482448:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343274.482456:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2eeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.482465:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb3e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343274.482469:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2eeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.482480:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2eeb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.482498:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2eeb lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.482506:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a2eeb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.482527:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343274.482528:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343274.482530:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343274.482852:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+30:3662:x1848998412965120:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9083us (9870us total) trans 17179871914 rc 0/0 00000100:00100000:2.0:1763343274.482863:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7208 00000004:00080000:3.0:1763343274.483760:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c59b4380/2, rc 0, transno 17179871914 00000100:00100000:3.0:1763343274.483825:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412965120:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343274.484756:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.484810:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399842688 00000100:00100000:0.0:1763343274.484817:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.484818:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399842688 00010000:00010000:2.0:1763343274.484858:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a2baa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49320 expref: 13 pid: 27798 timeout: 1167 lvb_type: 0 00000100:00100000:0.0:1763343274.484887:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.484914:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399842944 00000100:00100000:0.0:1763343274.484919:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399842944 00000100:00100000:1.0:1763343274.484924:0:8413:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c39b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412966656:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343274.484941:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a2dbe lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493d6 expref: 21 pid: 35266 timeout: 1167 lvb_type: 0 00010000:00010000:1.0:1763343274.484954:0:8413:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2ef9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343274.484975:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399843072 00000100:00100000:0.0:1763343274.484979:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399843072 00010000:00010000:0.0:1763343274.484994:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a2da2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493cf expref: 14 pid: 35266 timeout: 1167 lvb_type: 0 00000100:00100000:0.0:1763343274.485070:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3448 00000100:00100000:0.0:1763343274.485081:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6281c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399842944:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343274.485096:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343274.485102:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a2dbe lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493d6 expref: 21 pid: 35266 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.485113:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a2dbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493d6 expref: 21 pid: 35266 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.485137:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a2dbe lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493d6 expref: 21 pid: 35266 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.485155:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1763343274.485156:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3449 00010000:00010000:0.0:1763343274.485160:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.485167:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2ef2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343274.485168:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6282d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399843072:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343274.485183:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343274.485184:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2ef2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.485193:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a2da2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493cf expref: 14 pid: 35266 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343274.485205:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a2da2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493cf expref: 14 pid: 35266 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.485215:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343274.485221:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a2da2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b493cf expref: 14 pid: 35266 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343274.485232:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.485234:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.485238:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2ef9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.485246:0:6511:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2ef9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343274.485258:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6281c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399842944:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 177us (441us total) trans 0 rc 0/0 00010000:00010000:2.0:1763343274.485266:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343274.485266:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3448 00000100:00100000:2.0:1763343274.485303:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6282d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2407:x1848998399843072:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 135us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343274.485303:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3450 00000100:00100000:2.0:1763343274.485316:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3449 00000100:00100000:0.0:1763343274.485317:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6282a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2410:x1848998399842688:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343274.485329:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343274.485335:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a2baa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49320 expref: 12 pid: 27798 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343274.485344:0:8413:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2ef9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.485349:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a2baa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49320 expref: 12 pid: 27798 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343274.485363:0:8413:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2ef9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.485373:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a2baa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49320 expref: 12 pid: 27798 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343274.485375:0:8413:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2ef9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.485394:0:8413:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2ef9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.485396:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.485400:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.485405:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2ee4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.485415:0:8413:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343274.485416:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2ee4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.485450:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343274.485473:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6282a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+11:2410:x1848998399842688:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 159us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343274.485480:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3450 00010000:00010000:0.0:1763343274.485503:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343274.485509:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2ef9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.485517:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a7200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343274.485522:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2ef9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.485530:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2ef9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.485544:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2ef9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.485551:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2ef9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.485568:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343274.485570:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343274.485573:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343274.485599:0:8414:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2ee4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.485608:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2ee4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.485615:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2ee4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.485623:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2ee4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.485638:0:8414:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343274.485717:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+14:3659:x1848998412965504:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9585us (12495us total) trans 21474839184 rc 0/0 00000100:00100000:2.0:1763343274.485726:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7212 00000100:00100000:0.0:1763343274.485774:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+13:3662:x1848998412965248:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12443us (12928us total) trans 21474839185 rc 0/0 00000100:00100000:0.0:1763343274.485783:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7206 00010000:00010000:0.0:1763343274.485801:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343274.485807:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2ee4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.485814:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb3800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343274.485818:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2ee4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.485825:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2ee4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.485836:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2ee4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.485843:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba770a2ee4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.485856:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343274.485858:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343274.485860:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343274.485885:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6282300/2, rc 0, transno 21474839185 00000100:00100000:0.0:1763343274.485890:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412965248:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763343274.485909:0:8626:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2ef2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.485917:0:8626:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2ef2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.485925:0:8626:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2ef2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.485937:0:8626:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2ef2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.485952:0:8626:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343274.486106:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+30:3659:x1848998412965376:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11323us (12990us total) trans 17179871915 rc 0/0 00000100:00100000:0.0:1763343274.486113:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7210 00010000:00010000:0.0:1763343274.486131:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343274.486135:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2ef2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.486142:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd9000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343274.486145:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2ef2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.486153:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2ef2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.486163:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2ef2 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.486170:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2ef2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.486182:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343274.486184:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343274.486186:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343274.486384:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6283b80/2, rc 0, transno 21474839184 00000100:00100000:1.0:1763343274.486390:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412965504:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1763343274.486402:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c59b4700/2, rc 0, transno 17179871915 00000100:00100000:1.0:1763343274.486405:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412965376:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343274.486772:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.486944:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.488184:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399843200 00000100:00100000:0.0:1763343274.488197:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399843200 00000100:00100000:0.0:1763343274.489090:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399843456 00000100:00100000:0.0:1763343274.489097:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399843456 00000100:00100000:0.0:1763343274.490474:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3742 00000100:00100000:0.0:1763343274.490493:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:55884:x1848998399843200:12345-192.168.201.40@tcp:49:bash.0 00000100:00100000:1.0:1763343274.490733:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3743 00000100:00100000:1.0:1763343274.490750:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57117:x1848998399843456:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343274.491007:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:55884:x1848998399843200:12345-192.168.201.40@tcp:49:bash.0 Request processed in 521us (5231us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343274.491014:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3742 00000100:00100000:1.0:1763343274.491128:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57117:x1848998399843456:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 386us (4186us total) trans 4294973575 rc 0/0 00000100:00100000:1.0:1763343274.491134:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3743 00000100:00100000:3.0:1763343274.494287:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.494410:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399843584 00000100:00100000:1.0:1763343274.494420:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399843584 00000100:00100000:1.0:1763343274.494474:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7214 00000100:00100000:1.0:1763343274.494484:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:55884:x1848998399843584:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343274.494503:0:8626:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.494529:0:8626:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2f00 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49438 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.494566:0:8626:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2ed6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4942a expref: 21 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343274.494574:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.494576:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.494580:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2f00 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49438 expref: 21 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.494615:0:8626:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2ed6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4942a expref: 21 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343274.494630:0:8626:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2ed6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4942a expref: 21 pid: 35266 timeout: 1167 lvb_type: 1 00000100:00100000:1.0:1763343274.494643:0:8626:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c2f86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998412966784:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343274.494739:0:8626:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c546ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1763343274.497072:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.497407:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399843840 00000100:00100000:0.0:1763343274.497420:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399843840 00000100:00100000:0.0:1763343274.497493:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10617 00000100:00100000:0.0:1763343274.497505:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57117:x1848998399843840:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343274.497533:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343274.497558:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2f07 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4943f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.497647:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2f0e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343274.497661:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2f0e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.497673:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2f0e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.497687:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2f15 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343274.497694:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2f15 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.497701:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2f15 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.497826:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a2f1c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x201:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343274.497836:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a2f1c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.497843:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a2f1c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:0.0:1763343274.497854:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x201:0x0]: returning size 2 00010000:00010000:0.0:1763343274.497964:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2f0e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.497972:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2f0e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.497979:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2f0e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.497986:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2f0e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.497992:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fdc00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343274.497996:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2f0e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.498003:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2f0e lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.498205:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9402021da200) 00010000:00010000:0.0:1763343274.498210:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343274.498218:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2f0e lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.498225:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a2f0e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.498239:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2f15 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.498244:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2f15 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.498250:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2f15 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.498255:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fd800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343274.498257:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2f15 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.498263:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2f15 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.498280:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9402021da400) 00010000:00010000:0.0:1763343274.498284:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343274.498287:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2f15 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.498292:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a2f15 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.498331:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a2f07 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4943f expref: 294 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.498346:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a2f1c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4943f expref: 293 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.498353:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x201:0x0].0x0 (ffff9401fc4f1700) 00010000:00010000:0.0:1763343274.498355:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343274.498357:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fd600, rc 0) 00000100:00100000:0.0:1763343274.498413:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57117:x1848998399843840:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 910us (1349us total) trans 4294973576 rc 0/0 00000100:00100000:0.0:1763343274.498420:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10617 00000100:00100000:3.0:1763343274.498764:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.498854:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399843968 00000100:00100000:0.0:1763343274.498863:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399843968 00010000:00010000:0.0:1763343274.498888:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2ed6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4942a expref: 22 pid: 35266 timeout: 1167 lvb_type: 1 00000100:00100000:0.0:1763343274.498921:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3451 00000100:00100000:0.0:1763343274.498930:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399843968:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343274.498943:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343274.498947:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2ed6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4942a expref: 22 pid: 35266 timeout: 1167 lvb_type: 1 00010000:00010000:0.0:1763343274.498958:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2ed6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4942a expref: 22 pid: 35266 timeout: 1167 lvb_type: 1 00010000:00010000:0.0:1763343274.499322:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.499325:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.499333:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2f00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49438 expref: 22 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.499343:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2f00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49438 expref: 22 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.499379:0:35278:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2f00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49438 expref: 22 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343274.499393:0:35278:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4b23b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:35278:1848998412966912:192.168.201.40@tcp:105: 00000100:00100000:0.0:1763343274.499466:0:35278:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9480 going to sleep for 11 seconds 00010000:00010000:1.0:1763343274.499961:0:8626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2ed6 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4942a expref: 22 pid: 35266 timeout: 1167 lvb_type: 1 00000100:00100000:1.0:1763343274.499975:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c2f86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998412966784:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343274.499998:0:8626:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2f00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49438 expref: 21 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.500008:0:8626:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177c00, rc 0) 00000100:00100000:1.0:1763343274.500051:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:55884:x1848998399843584:12345-192.168.201.40@tcp:101:bash.0 Request processed in 5569us (5783us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.500059:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7214 00000100:00100000:3.0:1763343274.500481:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.502751:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399844224 00000100:00100000:1.0:1763343274.502766:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399844224 00000100:00100000:1.0:1763343274.502835:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3744 00000100:00100000:1.0:1763343274.502848:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57117:x1848998399844224:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343274.502858:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.502985:0:35278:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4b23b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:35278:1848998412966912:192.168.201.40@tcp:105: 00010000:00010000:3.0:1763343274.503008:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343274.503088:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57117:x1848998399844224:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 241us (2605us total) trans 4294973577 rc 0/0 00000100:00100000:1.0:1763343274.503096:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3744 00000100:00100000:1.0:1763343274.503123:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399844352 00000100:00100000:1.0:1763343274.503126:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399844352 00000100:00100000:1.0:1763343274.503157:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7215 00000100:00100000:1.0:1763343274.503164:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+11:55884:x1848998399844352:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343274.503236:0:8626:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.503260:0:8626:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5177200/0x9104b1ba770a2f2a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49446 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343274.503297:0:8626:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343274.503315:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.503317:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.503328:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177200/0x9104b1ba770a2f2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49446 expref: 12 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.503345:0:8626:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177200/0x9104b1ba770a2f2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49446 expref: 12 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.503357:0:8626:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177200, rc 0) 00000100:00100000:3.0:1763343274.503380:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399843968:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 4410us (4575us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343274.503391:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3451 00000100:00100000:1.0:1763343274.503481:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:55884:x1848998399844352:12345-192.168.201.40@tcp:101:bash.0 Request processed in 315us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.503488:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7215 00000100:00100000:2.0:1763343274.506377:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.506534:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.507521:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399844480 00000100:00100000:0.0:1763343274.507533:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399844480 00000100:00100000:0.0:1763343274.507592:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3745 00000100:00100000:0.0:1763343274.507602:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8443850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57117:x1848998399844480:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:2.0:1763343274.507675:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.507715:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399844608 00000100:00100000:2.0:1763343274.507721:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399844608 00002000:00010000:2.0:1763343274.507746:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/695 (0->18446744073709551615) 00002000:00100000:2.0:1763343274.507751:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c390f100 with x1848998399844608 ext(0->18446744073709551615) 00000100:00100000:0.0:1763343274.507761:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8443850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57117:x1848998399844480:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 159us (1392us total) trans 0 rc 0/0 00002000:00010000:2.0:1763343274.507765:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c390f100. 00000100:00100000:0.0:1763343274.507773:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3745 00000100:00100000:2.0:1763343274.507790:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399844736 00000100:00100000:2.0:1763343274.507795:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399844736 00002000:00010000:2.0:1763343274.507809:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/694 (0->18446744073709551615) 00002000:00100000:2.0:1763343274.507813:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c390ed80 with x1848998399844736 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343274.507818:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c390ed80. 00000100:00100000:2.0:1763343274.507839:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1721 00000100:00100000:2.0:1763343274.507848:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2408:x1848998399844608:12345-192.168.201.40@tcp:10:bash.0 00000100:00100000:1.0:1763343274.507999:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1722 00000100:00100000:1.0:1763343274.508011:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:2408:x1848998399844736:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:1.0:1763343274.508198:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2b6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343274.508202:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2b6:0x0] updating lvb mtime from disk: 0 -> 1763343273 00002000:00010000:1.0:1763343274.508205:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2b6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343274.508207:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2b6:0x0] updating lvb ctime from disk: 0 -> 1763343273 00002000:00010000:1.0:1763343274.508209:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2b6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343274.508246:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2408:x1848998399844736:12345-192.168.201.40@tcp:10:bash.0 Request processed in 238us (571us total) trans 21474839186 rc 0/0 00000100:00100000:1.0:1763343274.508253:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1722 00002000:00010000:1.0:1763343274.508256:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/694 (0->18446744073709551615) 00002000:00100000:1.0:1763343274.508259:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c390ed80 with x1848998399844736 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343274.508263:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c390ed80. 00002000:00010000:2.0:1763343274.508705:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2b7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343274.508709:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2b7:0x0] updating lvb mtime from disk: 0 -> 1763343273 00002000:00010000:2.0:1763343274.508711:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2b7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343274.508714:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2b7:0x0] updating lvb ctime from disk: 0 -> 1763343273 00002000:00010000:2.0:1763343274.508716:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2b7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343274.508758:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399844608:12345-192.168.201.40@tcp:10:bash.0 Request processed in 910us (2222us total) trans 17179871916 rc 0/0 00000100:00100000:2.0:1763343274.508766:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1721 00002000:00010000:2.0:1763343274.508770:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/695 (0->18446744073709551615) 00002000:00100000:2.0:1763343274.508773:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c390f100 with x1848998399844608 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343274.508780:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c390f100. 00000100:00100000:0.0:1763343274.511842:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.511907:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399844992 00000100:00100000:3.0:1763343274.511920:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399844992 00000100:00100000:3.0:1763343274.511984:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3746 00000100:00100000:3.0:1763343274.511995:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:55884:x1848998399844992:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:1.0:1763343274.512463:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:55884:x1848998399844992:12345-192.168.201.40@tcp:35:bash.0 Request processed in 464us (624us total) trans 4294973578 rc 0/0 00000100:00100000:1.0:1763343274.512473:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3746 00000100:00100000:0.0:1763343274.523352:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.523556:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399845248 00000100:00100000:2.0:1763343274.523567:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399845248 00000100:00100000:2.0:1763343274.524315:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10618 00000100:00100000:2.0:1763343274.524329:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57123:x1848998399845248:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:2.0:1763343274.524431:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1763343274.524461:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a2ecf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x201:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49423 expref: 295 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.524482:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2edd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x201:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49431 expref: 294 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.524500:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a2f1c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4943f expref: 293 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.524513:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a2e97 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x201:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4940e expref: 292 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.524523:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x201:0x0].0x0 (ffff9401fc4f1700) 00010000:00010000:2.0:1763343274.524533:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343274.524561:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2f31 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343274.524572:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2f31 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.524581:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2f31 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.524594:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2f38 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343274.524601:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2f38 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.524607:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2f38 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.524689:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2f3f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x201:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343274.524697:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2f3f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.524708:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2f3f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000040:00080000:2.0:1763343274.524944:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1718, 64 off143056 00000040:00080000:2.0:1763343274.525149:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1710, 64 off142400 00000040:00080000:2.0:1763343274.525165:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1711, 64 off142464 00000040:00080000:2.0:1763343274.525177:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1719, 64 off143120 00010000:00010000:2.0:1763343274.525231:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a2f46 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x201:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343274.525241:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a2f46 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x201:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.525249:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a2f46 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x201:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.525256:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a2f46 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x201:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.525262:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a2f46 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x201:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.525268:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a2f46 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x201:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.525299:0:6524:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343274.525318:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2f3f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x201:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.525325:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2f3f lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x201:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.525325:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343274.525330:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2f3f lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x201:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.525331:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a2f46 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x201:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.525338:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8693c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343274.525339:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd8e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.525342:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2f3f lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x201:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.525342:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a2f46 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x201:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.525350:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2f3f lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x201:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.525350:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a2f46 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x201:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.525361:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x201:0x0].0x0 (ffff9400c48a8700) 00010000:00010000:2.0:1763343274.525363:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763343274.525366:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x201:0x0].0x0 (ffff9400c48a8700) 00010000:00010000:2.0:1763343274.525367:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2f3f lrc: 2/0,0 mode: --/EX res: [0x240000404:0x201:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.525369:0:7451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343274.525372:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a2f46 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x201:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.525373:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a2f3f lrc: 0/0,0 mode: --/EX res: [0x240000404:0x201:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.525377:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a2f46 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x201:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343274.525389:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343274.525390:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343274.525392:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343274.525483:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2f31 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.525491:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2f31 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.525497:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2f31 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.525502:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2f31 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.525508:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd9000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.525511:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2f31 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.525517:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2f31 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.525528:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8300) 00010000:00010000:2.0:1763343274.525531:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.525534:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2f31 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.525540:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a2f31 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000004:00010000:2.0:1763343274.525551:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009b6f5f07 reply state 00000000b1a6a8f6 transno 4294973579 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2f38 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.525561:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2f38 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.525566:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8600) 00010000:00010000:2.0:1763343274.525569:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343274.525572:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343274.525650:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57123:x1848998399845248:12345-192.168.201.40@tcp:36:rm.0 Request processed in 1324us (2308us total) trans 4294973579 rc 0/0 00000100:00100000:2.0:1763343274.525658:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10618 00000100:00100000:3.0:1763343274.529897:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.529957:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399845504 00000100:00100000:2.0:1763343274.529980:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399845504 00000100:00100000:2.0:1763343274.530094:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10619 00000100:00100000:2.0:1763343274.530105:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57122:x1848998399845504:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.530128:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.530152:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a2f4d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4944d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.530242:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2f54 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343274.530256:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2f54 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.530267:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2f54 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.530290:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a2f5b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343274.530297:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a2f5b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.530303:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a2f5b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.530345:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2f54 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.530351:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2f54 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.530357:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2f54 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.530363:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2f54 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.530368:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8692c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.530372:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2f54 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.530379:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2f54 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.530394:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8000) 00010000:00010000:2.0:1763343274.530397:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.530402:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2f54 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.530408:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a2f54 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.530419:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a2f5b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.530425:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a2f5b lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.530431:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a2f5b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.530436:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c589ba00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.530438:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a2f5b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.530444:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a2f5b lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.530451:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8600) 00010000:00010000:2.0:1763343274.530454:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.530456:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a2f5b lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.530466:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a2f5b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.530494:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a2f4d lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4944d expref: 294 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.530505:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8000) 00010000:00010000:2.0:1763343274.530507:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343274.530510:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a2f4d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4944d expref: 294 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.530522:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8693e00, rc 0) 00000100:00100000:2.0:1763343274.530587:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57122:x1848998399845504:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 484us (698us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343274.530595:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10619 00000100:00100000:0.0:1763343274.534292:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.534417:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399845632 00000100:00100000:2.0:1763343274.534427:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399845632 00000100:00100000:2.0:1763343274.534483:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10620 00000100:00100000:2.0:1763343274.534492:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57122:x1848998399845632:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.534513:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.534536:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a2f62 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49454 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.534601:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2f69 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343274.534615:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2f69 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.534626:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2f69 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.534635:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2f70 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343274.534646:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2f70 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.534652:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2f70 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.534688:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2f69 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.534694:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2f69 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.534700:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2f69 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.534707:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2f69 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.534713:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.534716:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2f69 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.534723:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2f69 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.534733:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8800) 00010000:00010000:2.0:1763343274.534736:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.534740:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2f69 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.534746:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2f69 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.534757:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2f70 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.534763:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2f70 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.534769:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2f70 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.534773:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.534776:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2f70 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.534781:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2f70 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.534786:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8600) 00010000:00010000:2.0:1763343274.534789:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.534791:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2f70 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.534796:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2f70 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.534818:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a2f62 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49454 expref: 294 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.534828:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8800) 00010000:00010000:2.0:1763343274.534830:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.534833:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a2f62 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49454 expref: 294 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.534845:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c589be00, rc 0) 00000100:00100000:2.0:1763343274.534900:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57122:x1848998399845632:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 410us (619us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343274.534909:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10620 00000100:00100000:0.0:1763343274.556978:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.557094:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399845760 00000100:00100000:1.0:1763343274.557104:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399845760 00000100:00100000:1.0:1763343274.557167:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10621 00000100:00100000:1.0:1763343274.557177:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57124:x1848998399845760:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343274.557199:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.557224:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a2f77 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4945b expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.557314:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2f7e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343274.557329:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2f7e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.557341:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2f7e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.557351:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2f85 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343274.557359:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2f85 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.557365:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2f85 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.557402:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2f7e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.557411:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2f7e lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.557418:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2f7e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.557423:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.557427:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2f7e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.557435:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2f7e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.557446:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5c00) 00010000:00010000:1.0:1763343274.557449:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.557454:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2f7e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.557459:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2f7e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.557470:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2f85 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.557476:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2f85 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.557482:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2f85 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.557487:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.557489:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2f85 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.557498:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2f85 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.557504:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8600) 00010000:00010000:1.0:1763343274.557507:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.557510:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2f85 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.557515:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2f85 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.557543:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a2f77 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4945b expref: 294 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.557553:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5c00) 00010000:00010000:1.0:1763343274.557555:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.557559:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a2f77 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4945b expref: 294 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.557572:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176400, rc 0) 00000100:00100000:1.0:1763343274.557636:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57124:x1848998399845760:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 460us (669us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343274.557644:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10621 00000100:00100000:3.0:1763343274.561193:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.561309:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399846016 00000100:00100000:2.0:1763343274.561320:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399846016 00000100:00100000:2.0:1763343274.561378:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10622 00000100:00100000:2.0:1763343274.561388:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57125:x1848998399846016:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.561409:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.561431:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2f8c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49462 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.561520:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2f93 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343274.561534:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2f93 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.561545:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2f93 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.561554:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2f9a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343274.561561:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2f9a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.561567:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2f9a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.561603:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2f93 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.561608:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2f93 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.561615:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2f93 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.561621:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2f93 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.561626:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.561630:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2f93 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.561637:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2f93 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.561648:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8800) 00010000:00010000:2.0:1763343274.561651:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.561656:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2f93 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.561662:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2f93 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.561674:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2f9a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.561680:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2f9a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.561685:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2f9a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.561690:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3916200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.561693:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2f9a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.561702:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2f9a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.561708:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8600) 00010000:00010000:2.0:1763343274.561710:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.561712:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2f9a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.561718:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2f9a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.561745:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2f8c lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49462 expref: 294 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.561754:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8800) 00010000:00010000:2.0:1763343274.561757:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343274.561760:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2f8c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49462 expref: 294 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.561772:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917a00, rc 0) 00000100:00100000:2.0:1763343274.561836:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57125:x1848998399846016:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 449us (651us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343274.561844:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10622 00000100:00100000:0.0:1763343274.570743:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.570829:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399846144 00000100:00100000:1.0:1763343274.570841:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399846144 00000100:00100000:2.0:1763343274.571585:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10623 00000100:00100000:2.0:1763343274.571606:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57125:x1848998399846144:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.571639:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.571681:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2fa1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49469 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.571789:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2fa8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343274.571805:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2fa8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.571820:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2fa8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.571830:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2faf lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343274.571837:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2faf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.571843:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2faf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.571901:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2fa8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.571910:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2fa8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.571916:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2fa8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.571925:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2fa8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.571932:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3916200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.571939:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2fa8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.571951:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2fa8 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.571964:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8800) 00010000:00010000:2.0:1763343274.571967:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.571971:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2fa8 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.571977:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2fa8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.571992:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2faf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.571997:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2faf lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.572003:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2faf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.572007:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.572010:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2faf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.572014:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2faf lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.572020:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8600) 00010000:00010000:2.0:1763343274.572060:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.572063:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2faf lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.572069:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2faf lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.572102:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2fa1 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49469 expref: 294 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.572112:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8800) 00010000:00010000:2.0:1763343274.572114:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.572117:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a2fa1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49469 expref: 294 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.572131:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917a00, rc 0) 00000100:00100000:2.0:1763343274.572215:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57125:x1848998399846144:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 616us (1481us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343274.572223:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10623 00000100:00100000:0.0:1763343274.575410:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.575496:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399846272 00000100:00100000:1.0:1763343274.575506:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399846272 00000100:00100000:1.0:1763343274.575560:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10624 00000100:00100000:1.0:1763343274.575571:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57124:x1848998399846272:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343274.575590:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.575616:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a2fb6 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49470 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.575681:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2fbd lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343274.575695:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2fbd lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.575707:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2fbd lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.575717:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2fc4 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343274.575725:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2fc4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.575731:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2fc4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.575768:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2fbd lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.575775:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2fbd lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.575780:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2fbd lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.575786:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.575790:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2fbd lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.575800:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2fbd lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.575812:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5c00) 00010000:00010000:1.0:1763343274.575814:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.575818:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2fbd lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.575824:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a2fbd lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.575836:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2fc4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.575841:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2fc4 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.575846:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2fc4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.575850:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.575852:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2fc4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.575858:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2fc4 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.575864:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8600) 00010000:00010000:1.0:1763343274.575866:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.575870:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2fc4 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.575875:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a2fc4 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.575901:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a2fb6 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49470 expref: 294 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.575911:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5c00) 00010000:00010000:1.0:1763343274.575914:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.575918:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a2fb6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49470 expref: 294 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.575930:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176400, rc 0) 00000100:00100000:1.0:1763343274.577675:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57124:x1848998399846272:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2098us (2266us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343274.577685:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10624 00000100:00100000:3.0:1763343274.583658:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.583717:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399846400 00000100:00100000:1.0:1763343274.583727:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399846400 00000100:00100000:1.0:1763343274.583973:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10625 00000100:00100000:1.0:1763343274.583985:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57124:x1848998399846400:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343274.584008:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.584071:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a2fcb lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49477 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.584186:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2fd2 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343274.584203:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2fd2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.584216:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2fd2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:0.0:1763343274.584282:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343274.584287:0:33856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343274.584324:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a2fcb lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49477 expref: 295 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.584342:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2fd2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49477 expref: 294 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.584351:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5c00) 00010000:00010000:0.0:1763343274.584355:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343274.584358:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c7bb2400, rc 0) 00000100:00100000:0.0:1763343274.584426:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57124:x1848998399846400:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 443us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343274.584434:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10625 00000100:00100000:0.0:1763343274.593739:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.595243:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399846528 00000100:00100000:3.0:1763343274.595257:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399846528 00000100:00100000:2.0:1763343274.595884:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10626 00000100:00100000:2.0:1763343274.595900:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57124:x1848998399846528:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.595924:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.595950:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2fd9 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4947e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.596020:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2fe0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343274.596057:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2fe0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.596069:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2fe0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.596079:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a2fe7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343274.596086:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a2fe7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.596091:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a2fe7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.596130:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2fe0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.596137:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2fe0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.596142:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2fe0 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.596148:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2fe0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.596153:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3916200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.596158:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2fe0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.596164:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2fe0 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.596175:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5c00) 00010000:00010000:2.0:1763343274.596178:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.596182:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2fe0 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.596188:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a2fe0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.596201:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a2fe7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.596206:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a2fe7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.596212:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a2fe7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.596216:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.596218:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a2fe7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.596223:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a2fe7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.596228:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8600) 00010000:00010000:2.0:1763343274.596231:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.596234:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a2fe7 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.596239:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a2fe7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.596278:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2fd9 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4947e expref: 295 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.596288:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5c00) 00010000:00010000:2.0:1763343274.596290:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.596294:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a2fd9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4947e expref: 295 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.596302:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917000, rc 0) 00000100:00100000:2.0:1763343274.596435:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57124:x1848998399846528:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 540us (2706us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343274.596444:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10626 00000100:00100000:2.0:1763343274.604281:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.604393:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399846784 00000100:00100000:3.0:1763343274.604407:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399846784 00000100:00100000:3.0:1763343274.604531:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10627 00000100:00100000:3.0:1763343274.604541:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57124:x1848998399846784:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343274.604563:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343274.604566:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343274.604594:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a2fd2 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49477 expref: 294 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.604617:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5c00) 00010000:00010000:3.0:1763343274.604628:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343274.604647:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2fee lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49485 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.604765:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2ff5 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343274.604779:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2ff5 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.604788:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2ff5 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.604800:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2ffc lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343274.604806:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2ffc lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.604812:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2ffc lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.605922:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a3003 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343274.605937:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a3003 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.605946:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a3003 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:3.0:1763343274.605957:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x203:0x0]: returning size 0 00010000:00010000:3.0:1763343274.605984:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2ff5 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.605991:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2ff5 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.605997:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2ff5 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.606003:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a6a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343274.606008:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2ff5 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.606015:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2ff5 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.606062:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b600) 00010000:00010000:3.0:1763343274.606066:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343274.606070:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2ff5 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.606077:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a2ff5 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:3.0:1763343274.606090:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004b2057f3 reply state 0000000060163d6d transno 4294973580 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2ffc lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.606100:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2ffc lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.606110:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8600) 00010000:00010000:3.0:1763343274.606112:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343274.606115:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343274.606148:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a2fee lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49485 expref: 296 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.606165:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a3003 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49485 expref: 295 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.606172:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c488b300) 00010000:00010000:3.0:1763343274.606174:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343274.606176:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c7ec0600, rc 0) 00000100:00100000:3.0:1763343274.607072:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57124:x1848998399846784:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2525us (2806us total) trans 4294973580 rc 0/0 00000100:00100000:3.0:1763343274.607084:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10627 00000100:00100000:0.0:1763343274.617648:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.617885:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399847040 00000100:00100000:3.0:1763343274.617896:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399847040 00000100:00100000:3.0:1763343274.617960:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10628 00000100:00100000:3.0:1763343274.617970:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57124:x1848998399847040:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343274.618001:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343274.618408:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a3011 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4948c expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.618598:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3018 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343274.618614:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a3003 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49485 expref: 297 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.618624:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3018 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.618661:0:33856:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a3003 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49485 expref: 297 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.618674:0:33856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a3003 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49485 expref: 297 pid: 33856 timeout: 1167 lvb_type: 0 00000100:00100000:0.0:1763343274.618688:0:33856:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4b23b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412967040:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343274.618775:0:33856:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9480 going to sleep for 11 seconds 00000100:00100000:0.0:1763343274.624553:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.624641:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399847168 00000100:00100000:3.0:1763343274.624651:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399847168 00010000:00010000:3.0:1763343274.624692:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a3003 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49485 expref: 298 pid: 33856 timeout: 1167 lvb_type: 0 00000100:00100000:3.0:1763343274.624742:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3452 00000100:00100000:3.0:1763343274.624753:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:2408:x1848998399847168:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343274.624768:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343274.624775:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a3003 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49485 expref: 298 pid: 33856 timeout: 1167 lvb_type: 0 00010000:00010000:3.0:1763343274.624789:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a3003 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49485 expref: 298 pid: 33856 timeout: 1167 lvb_type: 0 00010000:00010000:3.0:1763343274.624813:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c488b300) 00010000:00010000:3.0:1763343274.624818:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3018 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.624828:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3018 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.624834:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3018 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.624855:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343274.624915:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:2408:x1848998399847168:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 163us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343274.624923:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3452 00010000:00010000:2.0:1763343274.625539:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a3003 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49485 expref: 297 pid: 33856 timeout: 1167 lvb_type: 0 00000100:00100000:2.0:1763343274.625563:0:33856:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4b23b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412967040:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343274.625590:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3018 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.625619:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3018 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.625625:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3018 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:2.0:1763343274.625655:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x203:0x0]: returning size 0 00000004:00080000:2.0:1763343274.626615:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2b8:0x0], index 0: 0 00000004:00080000:2.0:1763343274.626627:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2b9:0x0], index 1: 0 00000004:00080000:2.0:1763343274.626632:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2ba:0x0], index 1: 0 00000004:00080000:2.0:1763343274.626636:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2b9:0x0], index 0: 0 00010000:00010000:2.0:1763343274.626932:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3018 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.626943:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3018 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.626950:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3018 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.626956:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb2400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.626961:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3018 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.626969:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3018 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.626985:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c488b300) 00010000:00010000:2.0:1763343274.626989:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343274.626994:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3018 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.626999:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3018 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.627079:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a3011 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x203:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4948c expref: 297 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.627091:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c488b300) 00010000:00010000:2.0:1763343274.627094:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343274.627098:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a3011 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x203:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4948c expref: 297 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.627113:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c7ec1c00, rc 0) 00000100:00100000:2.0:1763343274.627562:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57124:x1848998399847040:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 9590us (9922us total) trans 4294973581 rc 301/301 00000100:00100000:2.0:1763343274.627572:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10628 00000100:00100000:0.0:1763343274.629794:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.629868:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399847424 00000100:00100000:1.0:1763343274.629878:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399847424 00000100:00100000:1.0:1763343274.630260:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3747 00000100:00100000:1.0:1763343274.630280:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57124:x1848998399847424:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343274.630860:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57124:x1848998399847424:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 588us (1071us total) trans 4294973582 rc 0/0 00000100:00100000:1.0:1763343274.630872:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3747 00000100:00100000:0.0:1763343274.633844:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.636170:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399847680 00000100:00100000:1.0:1763343274.636189:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399847680 00000100:00100000:1.0:1763343274.636263:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3748 00000100:00100000:1.0:1763343274.636284:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57124:x1848998399847680:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343274.636541:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57124:x1848998399847680:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 259us (2708us total) trans 4294973583 rc 0/0 00000100:00100000:1.0:1763343274.636550:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3748 00000100:00100000:0.0:1763343274.640204:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.640553:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399847936 00000100:00100000:2.0:1763343274.640564:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399847936 00000100:00100000:2.0:1763343274.642553:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10629 00000100:00100000:2.0:1763343274.642577:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57126:x1848998399847936:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.642603:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.642629:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3026 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49493 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.642711:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a302d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343274.642724:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a302d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.642735:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a302d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.642744:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3034 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343274.642751:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3034 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.642756:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3034 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.642868:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a303b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343274.642875:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a303b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.642882:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a303b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:2.0:1763343274.642892:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x203:0x0]: returning size 0 00010000:00010000:2.0:1763343274.642974:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a302d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.642985:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a302d lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.642991:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a302d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.642997:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.643001:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a302d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.643008:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a302d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.643020:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48a8800) 00010000:00010000:2.0:1763343274.643045:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.643050:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a302d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.643056:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a302d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.643069:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3034 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.643075:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3034 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.643080:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3034 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.643085:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.643088:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3034 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.643097:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3034 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.643103:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8600) 00010000:00010000:2.0:1763343274.643106:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.643108:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3034 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.643113:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3034 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.643149:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3026 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49493 expref: 301 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.643166:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a303b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49493 expref: 300 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.643173:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c48a8000) 00010000:00010000:2.0:1763343274.643175:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343274.643178:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c589be00, rc 0) 00000100:00100000:2.0:1763343274.643245:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57126:x1848998399847936:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 679us (3052us total) trans 4294973584 rc 0/0 00000100:00100000:2.0:1763343274.643252:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10629 00000100:00100000:2.0:1763343274.659428:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.659530:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399848064 00000100:00100000:1.0:1763343274.659542:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399848064 00000100:00100000:1.0:1763343274.660694:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7216 00000100:00100000:1.0:1763343274.660711:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399848064:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343274.660730:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.660755:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3049 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4949a expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343274.660783:0:8414:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343274.660810:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.660813:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.660823:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3049 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4949a expref: 22 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343274.660842:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3049 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4949a expref: 22 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343274.662368:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176000, rc 0) 00000100:00100000:1.0:1763343274.662472:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2408:x1848998399848064:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1763us (3051us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.662481:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7216 00000100:00100000:0.0:1763343274.662724:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.662772:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.662869:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399848192 00000100:00100000:2.0:1763343274.662877:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399848192 00000100:00100000:3.0:1763343274.663084:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399848320 00000100:00100000:3.0:1763343274.663089:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399848320 00000100:00100000:3.0:1763343274.663126:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10630 00000100:00100000:3.0:1763343274.663135:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:55884:x1848998399848320:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343274.663160:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343274.663178:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3050 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b494a8 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.663213:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a3057 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343274.663227:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a3057 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.663240:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a3057 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.663365:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3050 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x203:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494a8 expref: 302 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343274.663639:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7217 00000100:00100000:2.0:1763343274.663650:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2408:x1848998399848192:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.663663:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.663678:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c589ba00/0x9104b1ba770a305e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b494a1 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343274.663699:0:8414:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343274.663714:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.663716:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.663723:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c589ba00/0x9104b1ba770a305e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494a1 expref: 14 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343274.663737:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c589ba00/0x9104b1ba770a305e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494a1 expref: 14 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343274.663747:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c589ba00, rc 0) 00000100:00100000:2.0:1763343274.663790:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399848192:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 143us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.663796:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7217 00010000:00010000:3.0:1763343274.664783:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a3057 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494a8 expref: 301 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.664795:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c48a8000) 00010000:00010000:3.0:1763343274.664799:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343274.664802:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c7ec1c00, rc 0) 00000100:00100000:3.0:1763343274.664850:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:55884:x1848998399848320:12345-192.168.201.40@tcp:101:bash.0 Request processed in 1715us (2077us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343274.664858:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10630 00000100:00100000:0.0:1763343274.669635:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.669683:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.669744:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399848576 00000100:00100000:1.0:1763343274.669754:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399848576 00000100:00100000:1.0:1763343274.669810:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399848832 00000100:00100000:1.0:1763343274.669814:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399848832 00000100:00100000:1.0:1763343274.669845:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10631 00000100:00100000:1.0:1763343274.669855:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:55884:x1848998399848576:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:1.0:1763343274.669908:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343274.669936:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a303b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49493 expref: 302 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.669955:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c48a8000) 00010000:00010000:1.0:1763343274.669961:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343274.670127:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10632 00000100:00100000:3.0:1763343274.670143:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57126:x1848998399848832:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343274.670152:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.670163:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3065 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343274.670168:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a306c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b494af expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.670177:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3065 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.670185:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3065 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.670218:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a3073 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343274.670226:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a3073 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00000001:00080000:1.0:1763343274.670231:0:6524:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973585 00010000:00010000:3.0:1763343274.670233:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a3073 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.670242:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a307a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343274.670249:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a307a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00000004:00010000:1.0:1763343274.670252:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003b58b64b reply state 00000000315300c3 transno 4294973586 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3065 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.670254:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a307a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.670264:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3065 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.670291:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c48a8000) 00010000:00010000:1.0:1763343274.670294:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343274.670297:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343274.670382:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:55884:x1848998399848576:12345-192.168.201.40@tcp:36:bash.0 Request processed in 527us (759us total) trans 4294973586 rc 0/0 00000100:00100000:1.0:1763343274.670389:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10631 00000020:00080000:1.0:1763343274.670393:0:6524:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1763343274.671347:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3081 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343274.671361:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3081 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.671370:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3081 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:3.0:1763343274.671380:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x203:0x0]: returning size 0 00010000:00010000:3.0:1763343274.671459:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a3073 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.671466:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a3073 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.671477:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a3073 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.671482:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a7e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343274.671486:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a3073 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.671494:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a3073 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.671503:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b600) 00010000:00010000:3.0:1763343274.671506:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343274.671510:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a3073 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.671515:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a3073 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.671524:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a307a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.671529:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a307a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.671534:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a307a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.671538:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a6a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343274.671540:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a307a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.671545:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a307a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.671556:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8600) 00010000:00010000:3.0:1763343274.671558:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343274.671561:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a307a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.671566:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a307a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.671603:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a306c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494af expref: 306 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.671619:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3081 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494af expref: 305 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.671626:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c48a8000) 00010000:00010000:3.0:1763343274.671628:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343274.671631:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c7ec0c00, rc 0) 00000100:00100000:3.0:1763343274.671680:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57126:x1848998399848832:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1538us (1995us total) trans 4294973587 rc 0/0 00000100:00100000:3.0:1763343274.671687:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10632 00000100:00100000:0.0:1763343274.679455:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.679837:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399849088 00000100:00100000:2.0:1763343274.679850:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399849088 00000100:00100000:2.0:1763343274.679919:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3749 00000100:00100000:2.0:1763343274.679930:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57126:x1848998399849088:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343274.680196:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57126:x1848998399849088:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 268us (761us total) trans 4294973588 rc 0/0 00000100:00100000:2.0:1763343274.680204:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3749 00000100:00100000:3.0:1763343274.680486:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.681644:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399849344 00000100:00100000:2.0:1763343274.681654:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399849344 00000100:00100000:0.0:1763343274.682253:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10633 00000100:00100000:0.0:1763343274.682279:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:55884:x1848998399849344:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343274.682304:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343274.682307:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343274.682337:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3081 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494af expref: 306 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.682354:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c48a8000) 00010000:00010000:0.0:1763343274.682359:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343274.682372:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a308f lrc: 2/0,0 mode: --/EX res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b494b6 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.682414:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3096 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343274.682426:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3096 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.682434:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3096 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000040:00080000:0.0:1763343274.682743:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1712, 88 off142552 00000004:00080000:0.0:1763343274.682751:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1067806726251ns, next at 1068000150895ns, rc = 0 00000040:00080000:0.0:1763343274.682838:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1720, 88 off143208 00000004:00080000:0.0:1763343274.682843:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1067806818604ns, next at 1068000121327ns, rc = 0 00000040:00080000:0.0:1763343274.683580:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1721, 88 off143296 00000004:00080000:0.0:1763343274.683591:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1067807566304ns, next at 1068000121327ns, rc = 0 00000100:00100000:2.0:1763343274.684123:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000040:00080000:0.0:1763343274.684337:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1713, 88 off142640 00000004:00080000:0.0:1763343274.684344:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1067808319444ns, next at 1068000150895ns, rc = 0 00000100:00100000:3.0:1763343274.684624:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399849600 00000100:00100000:3.0:1763343274.684635:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399849600 00000100:00100000:3.0:1763343274.685123:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10634 00000100:00100000:3.0:1763343274.685134:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57126:x1848998399849600:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343274.685157:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343274.685182:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a309d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b494bd expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.685265:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a30a4 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343274.685289:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a30a4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.685300:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a30a4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.685312:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a30ab lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343274.685318:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a30ab lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.685324:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a30ab lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.685417:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a30b2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343274.685426:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a30b2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.685432:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a30b2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:3.0:1763343274.685452:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x203:0x0]: returning size 2 00010000:00010000:3.0:1763343274.685538:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a30b2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.685546:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a30b2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.685557:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a30b2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.685563:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a7e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343274.685567:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a30b2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.685574:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a30b2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.685585:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c48a8000) 00010000:00010000:3.0:1763343274.685588:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1763343274.685592:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a30b2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x203:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.685598:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a30b2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x203:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.685613:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a30a4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.685619:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a30a4 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.685624:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a30a4 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.685629:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c7ec0600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343274.685632:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a30a4 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.685637:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a30a4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.685648:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b600) 00010000:00010000:3.0:1763343274.685650:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343274.685653:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a30a4 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.685658:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a30a4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.685667:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a30ab lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.685673:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a30ab lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.685679:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a30ab lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.685685:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a6a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343274.685687:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a30ab lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.685693:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a30ab lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.685700:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8600) 00010000:00010000:3.0:1763343274.685703:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343274.685706:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a30ab lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.685712:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a30ab lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.685748:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a309d lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494bd expref: 310 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.685759:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b600) 00010000:00010000:3.0:1763343274.685761:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343274.685765:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a309d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494bd expref: 310 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.685780:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3bcc200, rc 0) 00000100:00100000:3.0:1763343274.685854:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57126:x1848998399849600:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 722us (1735us total) trans 4294973590 rc 301/301 00000100:00100000:3.0:1763343274.685862:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10634 00000100:00100000:0.0:1763343274.690532:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.690596:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399849856 00000100:00100000:1.0:1763343274.690607:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399849856 00000100:00100000:1.0:1763343274.690663:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3750 00000100:00100000:1.0:1763343274.690672:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57126:x1848998399849856:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343274.690895:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57126:x1848998399849856:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 223us (372us total) trans 4294973591 rc 0/0 00000100:00100000:1.0:1763343274.690905:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3750 00000001:00080000:0.0:1763343274.691215:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973589 is committed 00000004:00080000:0.0:1763343274.691223:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1096 committed 00000004:00080000:0.0:1763343274.691239:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1104 committed 00000004:00080000:0.0:1763343274.691250:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1103 committed 00000004:00080000:0.0:1763343274.691254:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1095 committed 00000100:00100000:3.0:1763343274.691344:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343274.691364:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6e8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412967296:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343274.691415:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343274.691435:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412967552:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343274.691450:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c39b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412967168:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763343274.691470:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343274.691485:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343274.691491:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1763343274.691497:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6e8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412967424:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343274.691501:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412967808:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343274.691517:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343274.691522:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412967680:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343274.691535:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412967296 00000100:00100000:3.0:1763343274.691540:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412967296 00000100:00100000:2.0:1763343274.691549:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412967552 00000100:00100000:2.0:1763343274.691552:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412967552 00000100:00100000:1.0:1763343274.691567:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343274.691903:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2f38 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.691915:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2f38 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.691922:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2f38 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.691929:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd9a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.691934:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2f38 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.691946:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2f38 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.691965:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8600) 00010000:00010000:1.0:1763343274.691968:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343274.691971:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412967168 00010000:00010000:1.0:1763343274.691974:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2f38 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000100:00100000:3.0:1763343274.691977:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412967168 00010000:00010000:1.0:1763343274.691985:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a2f38 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.692002:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2ffc lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00000100:00100000:3.0:1763343274.692005:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412967424 00000100:00100000:3.0:1763343274.692009:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412967424 00010000:00010000:1.0:1763343274.692011:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2ffc lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.692019:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2ffc lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.692063:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a7200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.692066:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2ffc lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.692073:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2ffc lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00000100:00100000:3.0:1763343274.692074:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412967680 00000100:00100000:3.0:1763343274.692079:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412967680 00010000:00010000:1.0:1763343274.692087:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48a8600) 00010000:00010000:1.0:1763343274.692092:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.692095:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2ffc lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000100:00100000:3.0:1763343274.692099:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7218 00010000:00010000:1.0:1763343274.692107:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a2ffc lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000100:00100000:3.0:1763343274.692112:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+31:3662:x1848998412967296:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1763343274.692134:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3065 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00002000:00080000:3.0:1763343274.692139:0:8414:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:695 count 1 00010000:00010000:1.0:1763343274.692142:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3065 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.692150:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3065 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.692155:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.692157:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3065 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.692164:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3065 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.692165:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a30c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.692181:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c48a8000) 00010000:00010000:3.0:1763343274.692191:0:8414:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2f00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49438 expref: 21 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.692191:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.692195:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3065 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.692207:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343274.692209:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3065 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343274.692212:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343274.692218:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a30c0 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.692249:0:8414:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2f00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49438 expref: 21 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343274.692264:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412967936:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1763343274.692278:0:8414:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2f00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49438 expref: 21 pid: 8626 timeout: 1167 lvb_type: 0 00000100:00100000:3.0:1763343274.692294:0:8414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c39b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8414:1848998412968064:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343274.692318:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343274.692362:0:8414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c6e2a240 going to sleep for 11 seconds 00000100:00100000:3.0:1763343274.692381:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412967936 00000100:00100000:3.0:1763343274.692386:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412967936 00000100:00100000:3.0:1763343274.692407:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7219 00000100:00100000:3.0:1763343274.692414:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+15:3660:x1848998412967552:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763343274.692422:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7220 00002000:00080000:3.0:1763343274.692428:0:35281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:695 count 1 00000100:00100000:2.0:1763343274.692430:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+15:3662:x1848998412967168:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763343274.692439:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:694 count 1 00010000:00010000:2.0:1763343274.692449:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c3917e00/0x9104b1ba770a30ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343274.692451:0:35281:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343274.692468:0:35281:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a30c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.692474:0:8413:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177200/0x9104b1ba770a2f2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49446 expref: 13 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.692476:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343274.692478:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.692481:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343274.692482:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a30c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.692482:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343274.692485:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3917e00/0x9104b1ba770a30ce lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.692494:0:35281:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a30c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.692502:0:35281:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a30c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.692503:0:8413:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5177200/0x9104b1ba770a2f2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49446 expref: 13 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.692510:0:35281:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a30c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.692513:0:8413:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177200/0x9104b1ba770a2f2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49446 expref: 13 pid: 8626 timeout: 1167 lvb_type: 0 00000100:00100000:2.0:1763343274.692523:0:8413:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412968320:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343274.692527:0:35281:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343274.693978:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763343274.693995:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412968192:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343274.694058:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343274.694121:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3096 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x203:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494b6 expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.694137:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c48a8000) 00010000:00010000:1.0:1763343274.694139:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343274.694157:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a308f lrc: 0/0,0 mode: --/EX res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494b6 expref: 292 pid: 7641 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343274.694178:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3096 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x203:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494b6 expref: 291 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.694214:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c48a8000) 00010000:00010000:1.0:1763343274.694216:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343274.694218:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c7bb2400, rc 0) 00000100:00100000:1.0:1763343274.694262:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:55884:x1848998399849344:12345-192.168.201.40@tcp:101:bash.0 Request processed in 11997us (13776us total) trans 4294973589 rc 0/0 00000100:00100000:1.0:1763343274.694283:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10633 00000100:00100000:3.0:1763343274.694749:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+16:3660:x1848998412967552:12345-0@lo:6:osp-syn-0-1.0 Request processed in 2332us (3274us total) trans 21474839187 rc 0/0 00000100:00100000:3.0:1763343274.694757:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7219 00000100:00100000:2.0:1763343274.694867:0:8413:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401ed059180 going to sleep for 11 seconds 00000100:00100000:2.0:1763343274.694887:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412968192 00000100:00100000:2.0:1763343274.694895:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412968192 00000100:00100000:2.0:1763343274.695086:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7221 00000100:00100000:2.0:1763343274.695095:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+33:3660:x1848998412967424:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763343274.695121:0:11289:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:696 count 1 00002000:00010000:2.0:1763343274.695151:0:11289:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343274.695157:0:11289:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba770a30d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.695170:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.695172:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.695176:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba770a30d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.695189:0:11289:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba770a30d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.695198:0:11289:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba770a30d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.695206:0:11289:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba770a30d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.695231:0:11289:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1763343274.695433:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+34:3660:x1848998412967424:12345-0@lo:6:osp-syn-1-1.0 Request processed in 338us (3914us total) trans 17179871917 rc 0/0 00000100:00100000:2.0:1763343274.695440:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7221 00000100:00100000:2.0:1763343274.695456:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7222 00000100:00100000:2.0:1763343274.695463:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+15:3661:x1848998412967680:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343274.695578:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+16:3661:x1848998412967680:12345-0@lo:2:osp-syn-0-1.0 Request processed in 115us (4011us total) trans 21474839188 rc 0/0 00000100:00100000:2.0:1763343274.695585:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7222 00000100:00100000:2.0:1763343274.695597:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7223 00000100:00100000:2.0:1763343274.695604:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+33:3659:x1848998412967936:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343274.695672:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+34:3659:x1848998412967936:12345-0@lo:2:osp-syn-1-1.0 Request processed in 69us (3354us total) trans 17179871918 rc 0/0 00000100:00100000:2.0:1763343274.695678:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7223 00000100:00100000:2.0:1763343274.695689:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7224 00000100:00100000:2.0:1763343274.695695:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+33:3659:x1848998412968192:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1763343274.695743:0:11289:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2ba:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343274.695746:0:11289:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2ba:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763343274.695748:0:11289:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2ba:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343274.695750:0:11289:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2ba:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763343274.695752:0:11289:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2ba:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343274.695790:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+34:3659:x1848998412968192:12345-0@lo:2:osp-syn-1-1.0 Request processed in 94us (1731us total) trans 17179871919 rc 0/0 00000100:00100000:2.0:1763343274.695796:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7224 00000004:00080000:2.0:1763343274.695853:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6e8df80/2, rc 0, transno 17179871917 00000100:00100000:2.0:1763343274.695861:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6e8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412967424:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1763343274.695874:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c390c700/2, rc 0, transno 21474839187 00000100:00100000:2.0:1763343274.695878:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412967552:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763343274.695899:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343274.695941:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412967808 00000100:00100000:2.0:1763343274.695946:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412967808 00000100:00100000:2.0:1763343274.695972:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7225 00000100:00100000:2.0:1763343274.695981:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401ede69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+16:3662:x1848998412967808:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1763343274.696060:0:28562:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2b9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343274.696062:0:28562:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2b9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763343274.696064:0:28562:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2b9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343274.696066:0:28562:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2b9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763343274.696067:0:28562:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2b9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343274.696104:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401ede69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+17:3662:x1848998412967808:12345-0@lo:2:osp-syn-0-1.0 Request processed in 125us (204us total) trans 21474839189 rc 0/0 00000100:00100000:2.0:1763343274.696110:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7225 00000004:00080000:2.0:1763343274.696142:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c390d880/2, rc 0, transno 21474839189 00000100:00100000:2.0:1763343274.696146:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412967808:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1763343274.696227:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763343274.696234:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a30c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.696243:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b99600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343274.696247:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a30c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.696256:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a30c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.696284:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a30c7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.696297:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a30c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.696316:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343274.696319:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba770a30d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.696325:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3916200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343274.696328:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba770a30d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.696335:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba770a30d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.696344:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba770a30d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.696350:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c3916200/0x9104b1ba770a30d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.696365:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343274.696366:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343274.696368:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343274.697051:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343274.697086:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c390f800/2, rc 0, transno 21474839188 00000100:00100000:1.0:1763343274.697094:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412967680:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763343274.697121:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6b56a00/2, rc 0, transno 17179871919 00000100:00100000:1.0:1763343274.697125:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412968192:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763343274.697134:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6e8ce00/2, rc 0, transno 17179871918 00000100:00100000:1.0:1763343274.697137:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412967936:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343274.698333:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.698387:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.698446:0:8413:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412968320:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343274.698481:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399849984 00000100:00100000:1.0:1763343274.698490:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399849984 00000100:00100000:1.0:1763343274.698533:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3751 00000100:00100000:1.0:1763343274.698542:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8443450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57126:x1848998399849984:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:3.0:1763343274.698562:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399850112 00000100:00100000:3.0:1763343274.698569:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399850112 00010000:00010000:0.0:1763343274.698574:0:8413:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c3917e00/0x9104b1ba770a30ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.698595:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2f00 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49438 expref: 22 pid: 8626 timeout: 1167 lvb_type: 0 00000100:00100000:0.0:1763343274.698620:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.698626:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3453 00000100:00100000:3.0:1763343274.698637:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399850112:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343274.698650:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343274.698658:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2f00 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49438 expref: 22 pid: 8626 timeout: 1167 lvb_type: 0 00000100:00100000:0.0:1763343274.698661:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.698682:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399850368 00010000:00010000:3.0:1763343274.698684:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2f00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49438 expref: 22 pid: 8626 timeout: 1167 lvb_type: 0 00000100:00100000:0.0:1763343274.698687:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399850368 00000100:00100000:1.0:1763343274.698696:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8443450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57126:x1848998399849984:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 153us (365us total) trans 0 rc 0/0 00010000:00010000:0.0:1763343274.698706:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177200/0x9104b1ba770a2f2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49446 expref: 14 pid: 8626 timeout: 1167 lvb_type: 0 00000100:00100000:1.0:1763343274.698710:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3751 00010000:00010000:3.0:1763343274.698713:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343274.698718:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343274.698724:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a30c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.698734:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a30c0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343274.698739:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3454 00000100:00100000:0.0:1763343274.698750:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8393050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399850368:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343274.698760:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343274.698761:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343274.698767:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5177200/0x9104b1ba770a2f2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49446 expref: 14 pid: 8626 timeout: 1167 lvb_type: 0 00000100:00100000:3.0:1763343274.698789:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399850112:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 152us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343274.698803:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3453 00010000:00010000:0.0:1763343274.698806:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5177200/0x9104b1ba770a2f2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49446 expref: 14 pid: 8626 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.698823:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177200/0x9104b1ba770a2f2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49446 expref: 14 pid: 8626 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.698834:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.698837:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.698840:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c3917e00/0x9104b1ba770a30ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.698848:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a2f00 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49438 expref: 21 pid: 8626 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.698849:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3917e00/0x9104b1ba770a30ce lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.698885:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343274.698890:0:8414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c39b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8414:1848998412968064:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343274.698906:0:8414:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a30c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343274.698913:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8393050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2408:x1848998399850368:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 163us (259us total) trans 0 rc 0/0 00010000:00010000:3.0:1763343274.698917:0:8414:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a30c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343274.698923:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3454 00010000:00010000:3.0:1763343274.698931:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a30c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.698941:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a30c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.698948:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a30c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.698967:0:8414:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343274.699063:0:8413:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c3917e00/0x9104b1ba770a30ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.699075:0:8413:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c3917e00/0x9104b1ba770a30ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.699085:0:8413:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c3917e00/0x9104b1ba770a30ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.699093:0:8413:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3917e00/0x9104b1ba770a30ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.699111:0:8413:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1763343274.699122:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763343274.699130:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a30c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.699139:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400cbad3c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343274.699144:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a30c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.699153:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a30c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.699168:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a30c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.699177:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a30c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343274.699187:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399850240 00000100:00100000:2.0:1763343274.699192:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399850240 00010000:00010000:0.0:1763343274.699197:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343274.699201:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c3917e00/0x9104b1ba770a30ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.699208:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917e00 already unused, calling callback (ffffffffc0ca3b40) 00000100:00100000:3.0:1763343274.699212:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+34:3662:x1848998412967296:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7100us (7793us total) trans 17179871920 rc 0/0 00010000:00010000:0.0:1763343274.699214:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c3917e00/0x9104b1ba770a30ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.699221:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c3917e00/0x9104b1ba770a30ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343274.699228:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7226 00010000:00010000:0.0:1763343274.699236:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c3917e00/0x9104b1ba770a30ce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343274.699241:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7218 00000100:00100000:2.0:1763343274.699242:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:55884:x1848998399850240:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343274.699249:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c3917e00/0x9104b1ba770a30ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.699254:0:27798:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343274.699264:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343274.699277:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343274.699280:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343274.699282:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343274.699282:0:27798:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a30dc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b494c4 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343274.699292:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+17:3662:x1848998412967168:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6858us (7801us total) trans 21474839190 rc 0/0 00000100:00100000:1.0:1763343274.699302:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7220 00002000:00010000:2.0:1763343274.699305:0:27798:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:3.0:1763343274.699310:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6e8c380/2, rc 0, transno 17179871920 00000100:00100000:3.0:1763343274.699317:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6e8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412967296:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1763343274.699320:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.699324:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.699331:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a30dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494c4 expref: 14 pid: 27798 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763343274.699333:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c39b4000/2, rc 0, transno 21474839190 00000100:00100000:3.0:1763343274.699342:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c39b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412967168:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1763343274.699352:0:27798:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a30dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494c4 expref: 14 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.699369:0:27798:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917a00, rc 0) 00000100:00100000:2.0:1763343274.699454:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:55884:x1848998399850240:12345-192.168.201.40@tcp:101:bash.0 Request processed in 218us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.699587:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7226 00000100:00100000:0.0:1763343274.703317:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.703371:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399850496 00000100:00100000:2.0:1763343274.703382:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399850496 00000100:00100000:2.0:1763343274.703447:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7227 00000100:00100000:2.0:1763343274.703457:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:55884:x1848998399850496:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343274.703475:0:27798:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.703498:0:27798:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a30e3 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b494cb expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343274.703522:0:27798:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343274.703548:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.703551:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.703561:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a30e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494cb expref: 22 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.703578:0:27798:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a30e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494cb expref: 22 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.703591:0:27798:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917000, rc 0) 00000100:00100000:2.0:1763343274.703886:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:55884:x1848998399850496:12345-192.168.201.40@tcp:101:bash.0 Request processed in 429us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.703894:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7227 00000100:00100000:1.0:1763343274.709428:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.709478:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.709580:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399850752 00000100:00100000:2.0:1763343274.709590:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399850752 00002000:00010000:2.0:1763343274.709644:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/697 (0->18446744073709551615) 00002000:00100000:2.0:1763343274.709650:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c2f86680 with x1848998399850752 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343274.709665:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c2f86680. 00000100:00100000:2.0:1763343274.709692:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399850624 00000100:00100000:2.0:1763343274.709696:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399850624 00002000:00010000:2.0:1763343274.709709:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/696 (0->18446744073709551615) 00002000:00100000:2.0:1763343274.709711:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c2f86300 with x1848998399850624 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343274.709717:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c2f86300. 00000100:00100000:2.0:1763343274.709738:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1723 00000100:00100000:2.0:1763343274.709747:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399850752:12345-192.168.201.40@tcp:10:bash.0 00000100:00100000:0.0:1763343274.709747:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1724 00000100:00100000:0.0:1763343274.709755:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399850624:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:2.0:1763343274.709903:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2b9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343274.709907:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2b9:0x0] updating lvb mtime from disk: 0 -> 1763343274 00002000:00010000:2.0:1763343274.709910:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2b9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343274.709912:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2b9:0x0] updating lvb ctime from disk: 0 -> 1763343274 00002000:00010000:2.0:1763343274.709914:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2b9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343274.709977:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2407:x1848998399850752:12345-192.168.201.40@tcp:10:bash.0 Request processed in 230us (564us total) trans 17179871921 rc 0/0 00000100:00100000:2.0:1763343274.709985:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1723 00002000:00010000:2.0:1763343274.709989:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/697 (0->18446744073709551615) 00002000:00100000:2.0:1763343274.709991:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c2f86680 with x1848998399850752 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343274.709996:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c2f86680. 00002000:00010000:0.0:1763343274.710342:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2b8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343274.710345:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2b8:0x0] updating lvb mtime from disk: 0 -> 1763343274 00002000:00010000:0.0:1763343274.710348:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2b8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343274.710350:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2b8:0x0] updating lvb ctime from disk: 0 -> 1763343274 00002000:00010000:0.0:1763343274.710352:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2b8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343274.710379:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998399850624:12345-192.168.201.40@tcp:10:bash.0 Request processed in 624us (900us total) trans 21474839191 rc 0/0 00000100:00100000:0.0:1763343274.710386:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1724 00002000:00010000:0.0:1763343274.710390:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/696 (0->18446744073709551615) 00002000:00100000:0.0:1763343274.710393:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c2f86300 with x1848998399850624 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343274.710397:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c2f86300. 00000100:00100000:0.0:1763343274.717013:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.718405:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.718987:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399851008 00000100:00100000:1.0:1763343274.719000:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399851008 00000100:00100000:1.0:1763343274.719098:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10635 00000100:00100000:1.0:1763343274.719109:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57127:x1848998399851008:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343274.719133:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.719159:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a30ea lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b494d2 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.719238:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a30f1 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343274.719251:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a30f1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.719261:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a30f1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.719285:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a30f8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343274.719291:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a30f8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.719297:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a30f8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.719403:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a30ff lrc: 3/1,0 mode: --/PR res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343274.719412:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a30ff lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.719419:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a30ff lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343274.719430:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x203:0x0]: returning size 2 00010000:00010000:1.0:1763343274.719509:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a30f1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.719516:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a30f1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.719521:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a30f1 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.719528:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a30f1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.719533:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.719537:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a30f1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.719544:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a30f1 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.719557:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5d00) 00010000:00010000:1.0:1763343274.719560:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.719564:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a30f1 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.719569:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a30f1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.719580:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a30f8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.719585:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a30f8 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.719591:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a30f8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.719594:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.719597:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a30f8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.719605:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a30f8 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.719611:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5400) 00010000:00010000:1.0:1763343274.719613:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.719615:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a30f8 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.719619:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a30f8 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.719658:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a30ea lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494d2 expref: 294 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.719670:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a30ff lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494d2 expref: 293 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.719676:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c48a8000) 00010000:00010000:1.0:1763343274.719678:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343274.719680:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176200, rc 0) 00000100:00100000:1.0:1763343274.719738:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57127:x1848998399851008:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 632us (2739us total) trans 4294973592 rc 0/0 00000100:00100000:1.0:1763343274.719745:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10635 00000100:00100000:2.0:1763343274.720381:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399851264 00000100:00100000:2.0:1763343274.720389:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399851264 00000100:00100000:2.0:1763343274.720427:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3752 00000100:00100000:2.0:1763343274.720435:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:55884:x1848998399851264:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:2.0:1763343274.720646:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:55884:x1848998399851264:12345-192.168.201.40@tcp:35:bash.0 Request processed in 210us (2246us total) trans 4294973593 rc 0/0 00000100:00100000:2.0:1763343274.720653:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3752 00000100:00100000:2.0:1763343274.724734:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.724909:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399851520 00000100:00100000:1.0:1763343274.724921:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399851520 00000100:00100000:2.0:1763343274.725125:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3753 00000100:00100000:2.0:1763343274.725137:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57127:x1848998399851520:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343274.725628:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57127:x1848998399851520:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 492us (902us total) trans 4294973594 rc 0/0 00000100:00100000:2.0:1763343274.725636:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3753 00000100:00100000:0.0:1763343274.728881:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.729348:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399851776 00000100:00100000:3.0:1763343274.729359:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399851776 00000100:00100000:1.0:1763343274.731526:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10636 00000100:00100000:2.0:1763343274.731674:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57127:x1848998399851776:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.731706:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.731729:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a310d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b494d9 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.731842:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3114 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.731858:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a30ff lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494d2 expref: 296 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.731867:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3114 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x203:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.731905:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a30ff lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494d2 expref: 296 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.731920:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a30ff lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494d2 expref: 296 pid: 7641 timeout: 1167 lvb_type: 0 00000100:00100000:2.0:1763343274.731933:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412968448:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343274.732405:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c3be8300 going to sleep for 11 seconds 00000100:00100000:2.0:1763343274.734227:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.734506:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399852032 00000100:00100000:3.0:1763343274.734515:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399852032 00000100:00100000:3.0:1763343274.734622:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10637 00000100:00100000:3.0:1763343274.734633:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57128:x1848998399852032:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:3.0:1763343274.734685:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763343274.734716:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3096 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x203:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494b6 expref: 297 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.734746:0:33856:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a30ff lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494d2 expref: 296 pid: 7641 timeout: 1167 lvb_type: 0 00010000:00010000:3.0:1763343274.734760:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a3057 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x203:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494a8 expref: 296 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.734770:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c48a8000) 00010000:00010000:3.0:1763343274.734774:0:33856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3114 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x203:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.734783:0:33856:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3114 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x203:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.734790:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3114 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x203:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.734811:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343274.734840:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a311b lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343274.734849:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a311b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.734856:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a311b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.734867:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a3122 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343274.734873:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a3122 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.734883:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a3122 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.734985:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3129 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343274.734994:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3114 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x203:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.735001:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3129 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x203:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.735012:0:33856:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3114 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x203:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.735021:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3129 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x203:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.736393:0:7641:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.40@tcp) returned -22 from blocking AST (req@000000003d37fc5f x1848998412968448) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a30ff lrc: 1/0,0 mode: --/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494d2 expref: 295 pid: 7641 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343274.736413:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a30ff lrc: 0/0,0 mode: --/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494d2 expref: 295 pid: 7641 timeout: 1167 lvb_type: 0 00000100:00100000:2.0:1763343274.736427:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412968448:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343274.736456:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c48a8000) 00010000:00010000:2.0:1763343274.736462:0:7641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3129 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x203:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.736470:0:7641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3129 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x203:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.736478:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3114 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x203:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.736487:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3114 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x203:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.736493:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3114 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x203:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343274.736520:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x203:0x0]: returning size 5 00010000:00010000:2.0:1763343274.736685:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a310d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x203:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494d9 expref: 296 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.736710:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3114 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x203:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494d9 expref: 295 pid: 7641 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343274.736720:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3114 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x203:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494d9 expref: 295 pid: 7641 timeout: 1167 lvb_type: 0 00010000:00010000:2.0:1763343274.736728:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917e00, rc 0) 00000100:00100000:2.0:1763343274.736812:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57127:x1848998399851776:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 5272us (7940us total) trans 4294973595 rc 0/0 00000100:00100000:2.0:1763343274.736823:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10636 00000100:00100000:2.0:1763343274.740107:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.741360:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399852288 00000100:00100000:1.0:1763343274.741373:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399852288 00010000:00010000:0.0:1763343274.741477:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3114 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x203:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494d9 expref: 295 pid: 7641 timeout: 1167 lvb_type: 0 00000100:00100000:0.0:1763343274.741524:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3455 00000100:00100000:0.0:1763343274.741534:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:2408:x1848998399852288:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343274.741550:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343274.741558:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3114 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x203:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494d9 expref: 295 pid: 7641 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.741571:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3114 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x203:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494d9 expref: 295 pid: 7641 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.741601:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3114 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x203:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494d9 expref: 295 pid: 7641 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.741616:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c48a8000) 00010000:00010000:0.0:1763343274.741622:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3129 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x203:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.741632:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3129 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.741638:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3129 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343274.741743:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343274.741844:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3129 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.741852:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3129 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:0.0:1763343274.743249:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:2408:x1848998399852288:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1706us (3140us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343274.743262:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3455 00000004:00080000:2.0:1763343274.743732:0:33856:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x203:0x0] is inserted into orphan list, open count = 1 00010000:00010000:2.0:1763343274.743830:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3129 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.743840:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3129 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.743848:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3129 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.743854:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b99600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.743859:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3129 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.743866:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3129 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.743888:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c48a8000) 00010000:00010000:2.0:1763343274.743891:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763343274.743895:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3129 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.743901:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3129 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.743922:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a311b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.743929:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a311b lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.743934:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a311b lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.743939:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b98000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.743941:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a311b lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.743949:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a311b lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.743956:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b600) 00010000:00010000:2.0:1763343274.743958:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.743961:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a311b lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.743966:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a311b lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:2.0:1763343274.743977:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000eb725eaf reply state 00000000db9365b1 transno 4294973596 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a3122 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.743989:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a3122 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343274.743996:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c488bc00) 00010000:00010000:2.0:1763343274.743998:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343274.744000:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343274.744412:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.745146:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57128:x1848998399852032:12345-192.168.201.40@tcp:36:rm.0 Request processed in 10511us (10926us total) trans 4294973596 rc 0/0 00000100:00100000:2.0:1763343274.745155:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10637 00000100:00100000:1.0:1763343274.745544:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399852160 00000100:00100000:1.0:1763343274.745556:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399852160 00000100:00100000:1.0:1763343274.745607:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10638 00000100:00100000:1.0:1763343274.745617:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57127:x1848998399852160:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343274.745646:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.745667:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3137 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b494e0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.745734:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a313e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343274.745747:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a313e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.745757:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a313e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343274.745792:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x203:0x0]: returning size 5 00000004:00200000:1.0:1763343274.745797:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343274.745813:0:7641:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a313e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.745837:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3137 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494e0 expref: 297 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.745854:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a313e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494e0 expref: 296 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.745861:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c38f5d00) 00010000:00010000:1.0:1763343274.745864:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1763343274.745866:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177e00, rc 0) 00000100:00100000:1.0:1763343274.745908:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57127:x1848998399852160:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 292us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.745915:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10638 00010000:00010000:1.0:1763343274.747535:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343274.753071:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.757873:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399852544 00000100:00100000:1.0:1763343274.757894:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399852544 00000100:00100000:1.0:1763343274.757977:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10639 00000100:00100000:1.0:1763343274.757988:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57127:x1848998399852544:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343274.758016:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.758057:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3145 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b494e7 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.758174:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a314c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343274.758189:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a314c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x203:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.758199:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a314c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x203:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343274.758213:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x203:0x0]: returning size 5 00010000:00010000:1.0:1763343274.758340:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3145 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x203:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494e7 expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.758356:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a314c lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x203:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494e7 expref: 298 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.758365:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c38f5d00) 00010000:00010000:1.0:1763343274.758368:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763343274.758371:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177a00, rc 0) 00000100:00100000:1.0:1763343274.758448:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57127:x1848998399852544:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 461us (5391us total) trans 4294973597 rc 0/0 00000100:00100000:1.0:1763343274.758455:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10639 00000100:00100000:0.0:1763343274.761525:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.762433:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399852672 00000100:00100000:1.0:1763343274.762445:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399852672 00000100:00100000:0.0:1763343274.762467:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.762514:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399852800 00000100:00100000:2.0:1763343274.762518:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399852800 00000100:00100000:2.0:1763343274.762563:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7228 00000100:00100000:2.0:1763343274.762574:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998399852800:12345-192.168.201.40@tcp:1:lfs.0 00010000:00010000:2.0:1763343274.762666:0:27798:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a315a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.762689:0:27798:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a30dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494c4 expref: 15 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.762697:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343274.762699:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343274.762703:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a315a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.762739:0:27798:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a30dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494c4 expref: 15 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.762751:0:27798:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a30dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494c4 expref: 15 pid: 27798 timeout: 1167 lvb_type: 0 00000100:00100000:2.0:1763343274.762764:0:27798:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27798:1848998412968576:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343274.762863:0:27798:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c29c40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343274.763009:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10640 00000100:00100000:1.0:1763343274.763019:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57129:x1848998399852672:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343274.763051:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.763070:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3161 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b494ee expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.763132:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3168 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343274.763841:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3168 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.763857:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3168 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.763872:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a316f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343274.763879:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a316f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.763885:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a316f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.763927:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3168 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.763933:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3168 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.763939:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3168 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.763946:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3168 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.763951:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.763955:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3168 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.763961:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3168 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.763974:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5400) 00010000:00010000:1.0:1763343274.763977:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.763982:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3168 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.763987:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3168 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.763999:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a316f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.764005:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a316f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.764011:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a316f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.764016:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.764019:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a316f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.764050:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a316f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.764057:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c488bc00) 00010000:00010000:1.0:1763343274.764059:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.764062:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a316f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.764067:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a316f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.764097:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3161 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494ee expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.764106:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5400) 00010000:00010000:1.0:1763343274.764109:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.764112:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3161 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494ee expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.764125:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176800, rc 0) 00000100:00100000:1.0:1763343274.764178:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57129:x1848998399852672:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1160us (2664us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343274.764185:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10640 00000100:00100000:0.0:1763343274.767613:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.767686:0:27798:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27798:1848998412968576:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343274.767714:0:27798:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a315a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343274.767783:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.767838:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399852928 00000100:00100000:1.0:1763343274.767845:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399852928 00002000:00100000:1.0:1763343274.767889:0:8419:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b8:0x0] (0->4) req@ffff9400c6b55f80 x1848998399852928/t0(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:15/0 lens 496/0 e 0 to 0 dl 1763343285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763343274.767899:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6b55f80 with x1848998399852928 ext(0->4) 00010000:00010000:1.0:1763343274.767908:0:8419:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a30dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494c4 expref: 16 pid: 27798 timeout: 1167 lvb_type: 0 00010000:00010000:1.0:1763343274.767922:0:8419:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a30dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494c4 expref: 16 pid: 27798 timeout: 1167 lvb_type: 0 00002000:00010000:1.0:1763343274.767930:0:8419:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9400c6b55f80 00000100:00100000:2.0:1763343274.768004:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399853056 00000100:00100000:2.0:1763343274.768009:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399853056 00000100:00100000:1.0:1763343274.768108:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 119 00000100:00100000:1.0:1763343274.768118:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399852928:12345-192.168.201.40@tcp:4:bash.0 00000100:00100000:2.0:1763343274.768131:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10641 00000100:00100000:2.0:1763343274.768137:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57129:x1848998399853056:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.768150:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.768172:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3176 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b494f5 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.768227:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a317d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.768238:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a317d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.768249:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a317d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.768258:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3184 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.768264:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3184 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.768284:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3184 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.768319:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a317d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.768325:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a317d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.768331:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a317d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.768336:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a317d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.768341:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b98000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.768344:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a317d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.768351:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a317d lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.768361:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f669d500) 00010000:00010000:2.0:1763343274.768363:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.768367:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a317d lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.768373:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a317d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.768383:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3184 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.768388:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3184 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.768393:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3184 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.768397:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b99600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.768401:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3184 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.768406:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3184 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.768413:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c488bc00) 00010000:00010000:2.0:1763343274.768415:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.768417:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3184 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.768422:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3184 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.768448:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3176 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494f5 expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.768456:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f669d500) 00010000:00010000:2.0:1763343274.768459:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.768462:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3176 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494f5 expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.768548:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917e00, rc 0) 00000100:00100000:2.0:1763343274.768933:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57129:x1848998399853056:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 737us (1091us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343274.768942:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10641 00000100:00100000:1.0:1763343274.771548:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998399852928:12345-192.168.201.40@tcp:4:bash.0 Request processed in 3418us (3930us total) trans 21474839192 rc 0/0 00000100:00100000:1.0:1763343274.771560:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 119 00002000:00100000:1.0:1763343274.771573:0:8419:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b8:0x0] (0->4) req@ffff9400c6b55f80 x1848998399852928/t21474839192(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:15/0 lens 496/448 e 0 to 0 dl 1763343285 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763343274.771583:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6b55f80 with x1848998399852928 ext(0->4) 00010000:00010000:1.0:1763343274.771591:0:8419:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a30dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494c4 expref: 18 pid: 27798 timeout: 1167 lvb_type: 0 00010000:00010000:1.0:1763343274.771608:0:8419:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a30dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494c4 expref: 18 pid: 27798 timeout: 1167 lvb_type: 0 00002000:00010000:1.0:1763343274.771615:0:8419:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9400c6b55f80 00000100:00100000:0.0:1763343274.772334:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.772598:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399853184 00000100:00100000:2.0:1763343274.772607:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399853184 00000100:00100000:2.0:1763343274.772677:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10642 00000100:00100000:2.0:1763343274.772687:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57129:x1848998399853184:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.772705:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.772734:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a318b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b494fc expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.772796:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a3192 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.772809:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a3192 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.772820:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a3192 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343274.772868:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763343274.772873:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763343274.773359:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a318b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494fc expref: 300 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.773377:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a3192 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494fc expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.773386:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53f00) 00010000:00010000:2.0:1763343274.773389:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763343274.773391:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5bd9000, rc 0) 00000100:00100000:2.0:1763343274.773496:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57129:x1848998399853184:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 809us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.773505:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10642 00000100:00100000:2.0:1763343274.775765:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.775856:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399853312 00000100:00100000:0.0:1763343274.775865:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399853312 00010000:00010000:0.0:1763343274.775898:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a30dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494c4 expref: 18 pid: 27798 timeout: 1167 lvb_type: 0 00000100:00100000:0.0:1763343274.775934:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3456 00000100:00100000:0.0:1763343274.775944:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2409:x1848998399853312:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343274.775960:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1763343274.775977:0:14071:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2b8:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:0.0:1763343274.775980:0:14071:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2b8:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1763343274.775986:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a30dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494c4 expref: 18 pid: 27798 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.776857:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a30dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494c4 expref: 18 pid: 27798 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.776886:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a30dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494c4 expref: 18 pid: 27798 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.776905:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.776907:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.776913:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a315a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.776923:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a315a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.776965:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343274.777202:0:27798:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a315a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.777211:0:27798:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a315a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.777570:0:27798:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a315a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.777581:0:27798:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a315a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.777593:0:27798:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a315a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.777599:0:27798:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3916200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343274.777603:0:27798:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a315a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.777610:0:27798:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a315a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.777622:0:27798:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a315a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.777629:0:27798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a315a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343274.778351:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2409:x1848998399853312:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 2403us (2590us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343274.778362:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3456 00000100:00100000:2.0:1763343274.778456:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998399852800:12345-192.168.201.40@tcp:1:lfs.0 Request processed in 15883us (15988us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.778466:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7228 00000100:00100000:0.0:1763343274.779674:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.779934:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399853440 00000100:00100000:2.0:1763343274.779945:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399853440 00000100:00100000:2.0:1763343274.779998:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10643 00000100:00100000:2.0:1763343274.780008:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57129:x1848998399853440:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.780410:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.780433:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3199 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49503 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.780881:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a31a0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.780898:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a31a0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.780911:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a31a0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.780921:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a31a7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.780927:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a31a7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.780933:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a31a7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.780975:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a31a0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.780981:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a31a0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.780986:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a31a0 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.780992:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a31a0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.780998:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85aa600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.781001:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a31a0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.781012:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a31a0 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.781021:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53f00) 00010000:00010000:2.0:1763343274.781066:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.781071:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a31a0 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.781969:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a31a0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.781986:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a31a7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.781992:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a31a7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.781998:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a31a7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.782003:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85abe00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.782006:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a31a7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.782013:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a31a7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.782070:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c488bc00) 00010000:00010000:2.0:1763343274.782073:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.782078:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a31a7 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.782083:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a31a7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.782121:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3199 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49503 expref: 300 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.782132:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53f00) 00010000:00010000:2.0:1763343274.782135:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.782138:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3199 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49503 expref: 300 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.782148:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5bd8e00, rc 0) 00000100:00100000:2.0:1763343274.782220:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57129:x1848998399853440:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2214us (2551us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343274.782229:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10643 00000100:00100000:1.0:1763343274.783663:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.783737:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399853696 00000100:00100000:2.0:1763343274.783747:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399853696 00000100:00100000:2.0:1763343274.783993:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10644 00000100:00100000:2.0:1763343274.784006:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57127:x1848998399853696:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:2.0:1763343274.785314:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343274.785352:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a313e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494e0 expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.785370:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c38f5d00) 00010000:00010000:2.0:1763343274.785375:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343274.785408:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a31ae lrc: 3/0,1 mode: --/EX res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.785420:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a31ae lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.785431:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a31ae lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:0.0:1763343274.785687:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.785754:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399853952 00000100:00100000:1.0:1763343274.785761:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399853952 00000040:00080000:2.0:1763343274.786002:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1714, 88 off142728 00000004:00080000:2.0:1763343274.786223:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1067910197380ns, next at 1068000150895ns, rc = 0 00000100:00100000:1.0:1763343274.786260:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10645 00000100:00100000:1.0:1763343274.786282:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57129:x1848998399853952:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343274.786301:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.786303:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343274.786318:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a3192 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494fc expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.786331:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53f00) 00010000:00010000:1.0:1763343274.786341:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343274.786353:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a31b5 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4950a expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1763343274.786375:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1722, 88 off143384 00000004:00080000:2.0:1763343274.786383:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1067910358207ns, next at 1068000121327ns, rc = 0 00000040:00080000:2.0:1763343274.786400:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1723, 88 off143472 00000004:00080000:2.0:1763343274.786405:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1067910380172ns, next at 1068000121327ns, rc = 0 00000040:00080000:2.0:1763343274.786416:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1715, 88 off142816 00000004:00080000:2.0:1763343274.786420:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1067910394997ns, next at 1068000150895ns, rc = 0 00010000:00010000:1.0:1763343274.786435:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a31bc lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343274.786446:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a31bc lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.786455:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a31bc lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.786466:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a31c3 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343274.786473:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a31c3 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.786479:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a31c3 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.787776:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a31ca lrc: 3/1,0 mode: --/PR res: [0x240000404:0x204:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343274.787792:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a31ca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.787803:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a31ca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:1.0:1763343274.787814:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x204:0x0]: returning size 0 00010000:00010000:1.0:1763343274.787840:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a31bc lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.787846:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a31bc lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.787854:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a31bc lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.787860:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.787864:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a31bc lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.787871:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a31bc lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.787882:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5400) 00010000:00010000:1.0:1763343274.787885:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.787888:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a31bc lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.787895:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a31bc lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:1.0:1763343274.787906:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fdd060e3 reply state 000000005b149a69 transno 4294973599 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a31c3 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.787917:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a31c3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343274.787929:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c488bc00) 00010000:00010000:1.0:1763343274.787931:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343274.787934:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343274.787968:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a31b5 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4950a expref: 302 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.787986:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a31ca lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4950a expref: 301 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.787994:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x204:0x0].0x0 (ffff9400c38f5a00) 00010000:00010000:1.0:1763343274.787996:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343274.787999:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176e00, rc 0) 00000100:00100000:1.0:1763343274.788106:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57129:x1848998399853952:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1825us (2417us total) trans 4294973599 rc 0/0 00000100:00100000:1.0:1763343274.788114:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10645 00000001:00080000:0.0:1763343274.791515:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973599 is committed 00000004:00080000:0.0:1763343274.791528:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1098 committed 00000004:00080000:0.0:1763343274.791543:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1106 committed 00000004:00080000:0.0:1763343274.791552:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1105 committed 00000004:00080000:0.0:1763343274.791555:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1097 committed 00010000:00010000:3.0:1763343274.791624:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a3122 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.791636:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a3122 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.791644:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a3122 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.791653:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b98200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343274.791658:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a3122 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.791666:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a3122 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.791686:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c488bc00) 00010000:00010000:3.0:1763343274.791690:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343274.791694:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a3122 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.791702:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a3122 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.791720:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a31c3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.791726:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a31c3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.791732:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a31c3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.791739:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343274.791742:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a31c3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.791749:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a31c3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.791758:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c488bc00) 00010000:00010000:3.0:1763343274.791761:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343274.791765:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a31c3 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.791771:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a31c3 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:2.0:1763343274.791774:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000007c040d9 reply state 000000000f70f223 transno 4294973598 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a31ae lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.791791:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a31ae lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.791799:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c38f5d00) 00010000:00010000:2.0:1763343274.791802:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1763343274.791806:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412968832:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343274.791807:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343274.791886:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1763343274.791913:0:7641:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1763343274.791932:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57127:x1848998399853696:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 7925us (8271us total) trans 4294973598 rc 0/0 00000100:00100000:3.0:1763343274.791934:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343274.791947:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412968704:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343274.791948:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10644 00000100:00100000:3.0:1763343274.791978:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343274.791981:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a31ae lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343274.791986:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412969088:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1763343274.791995:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a31ae lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.792003:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a31ae lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.792010:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85ab400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.792013:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a31ae lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343274.792017:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412968832 00010000:00010000:1.0:1763343274.792020:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a31ae lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343274.792050:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343274.792054:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c38f5d00) 00010000:00010000:1.0:1763343274.792058:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343274.792064:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a31ae lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.792069:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85ab400/0x9104b1ba770a31ae lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343274.792077:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1763343274.792086:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412968960:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343274.792106:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412968832 00000100:00100000:2.0:1763343274.792116:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343274.792150:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412968704 00000100:00100000:3.0:1763343274.792154:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412968704 00000100:00100000:2.0:1763343274.792175:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412969088 00000100:00100000:2.0:1763343274.792180:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412969088 00000100:00100000:2.0:1763343274.792215:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412968960 00000100:00100000:2.0:1763343274.792218:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412968960 00000100:00100000:3.0:1763343274.792594:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7229 00000100:00100000:3.0:1763343274.792604:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+18:3662:x1848998412968832:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763343274.793114:0:27798:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2b9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343274.793118:0:27798:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2b9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343274.793120:0:27798:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2b9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343274.793122:0:27798:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2b9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343274.793124:0:27798:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2b9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343274.793338:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7230 00000100:00100000:2.0:1763343274.793348:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+19:3662:x1848998412968704:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343274.793397:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7231 00000100:00100000:0.0:1763343274.793409:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+35:3660:x1848998412969088:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343274.793423:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7232 00000100:00100000:1.0:1763343274.793436:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+35:3660:x1848998412968960:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343274.793463:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+20:3662:x1848998412968704:12345-0@lo:2:osp-syn-0-1.0 Request processed in 117us (1485us total) trans 21474839194 rc 0/0 00000100:00100000:2.0:1763343274.793472:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7230 00002000:00010000:0.0:1763343274.793493:0:8626:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2ba:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343274.793497:0:8626:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2ba:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343274.793499:0:8626:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2ba:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343274.793501:0:8626:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2ba:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343274.793504:0:8626:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2ba:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1763343274.793517:0:35266:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2b9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343274.793522:0:35266:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2b9:0x0] updating lvb mtime from disk: 1763343274 -> 1763343274 00002000:00010000:1.0:1763343274.793525:0:35266:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2b9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343274.793528:0:35266:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2b9:0x0] updating lvb ctime from disk: 1763343274 -> 1763343274 00002000:00010000:1.0:1763343274.793530:0:35266:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2b9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343274.793542:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+37:3660:x1848998412969088:12345-0@lo:2:osp-syn-1-1.0 Request processed in 136us (1515us total) trans 17179871922 rc 0/0 00000100:00100000:0.0:1763343274.793548:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7231 00000004:00080000:2.0:1763343274.793585:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c390e680/2, rc 0, transno 21474839194 00000100:00100000:2.0:1763343274.793592:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412968704:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343274.793799:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+36:3660:x1848998412968960:12345-0@lo:2:osp-syn-1-1.0 Request processed in 367us (1682us total) trans 17179871923 rc 0/0 00000100:00100000:1.0:1763343274.793807:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7232 00000004:00080000:0.0:1763343274.794052:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401edc2ce00/2, rc 0, transno 17179871923 00000100:00100000:0.0:1763343274.794059:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412968960:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763343274.794070:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401efc70700/2, rc 0, transno 17179871922 00000100:00100000:0.0:1763343274.794072:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412969088:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343274.796312:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+19:3662:x1848998412968832:12345-0@lo:2:osp-syn-0-1.0 Request processed in 3699us (4414us total) trans 21474839193 rc 0/0 00000100:00100000:2.0:1763343274.796328:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7229 00000100:00100000:0.0:1763343274.796974:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.797075:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399854080 00000100:00100000:2.0:1763343274.797084:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399854080 00000100:00100000:2.0:1763343274.797140:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10646 00000100:00100000:2.0:1763343274.797151:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+289:57127:x1848998399854080:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.797178:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.797200:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a31d8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49511 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763343274.797228:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c390ca80/2, rc 0, transno 21474839193 00000100:00100000:1.0:1763343274.797238:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412968832:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1763343274.797277:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a31d8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49511 expref: 290 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.797294:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a31d8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49511 expref: 290 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.797314:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c38f5d00) 00010000:00010000:2.0:1763343274.797317:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343274.797321:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3916200, rc 0) 00000100:00100000:2.0:1763343274.797368:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57127:x1848998399854080:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 218us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.797374:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10646 00000100:00100000:1.0:1763343274.797992:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.798109:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399854336 00000100:00100000:2.0:1763343274.798115:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399854336 00000100:00100000:2.0:1763343274.798152:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10647 00000100:00100000:2.0:1763343274.798161:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57129:x1848998399854336:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.798172:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.798183:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a31df lrc: 2/0,0 mode: --/CR res: [0x240000404:0x204:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49518 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.798288:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a31e6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x204:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.798301:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a31ca lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4950a expref: 291 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.798309:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a31e6 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x204:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.798343:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a31ca lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4950a expref: 291 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.798358:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a31ca lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4950a expref: 291 pid: 33856 timeout: 1167 lvb_type: 0 00000100:00100000:2.0:1763343274.798377:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4b23b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412969216:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343274.798976:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c29c40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343274.799995:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.800111:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399854464 00000100:00100000:3.0:1763343274.800120:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399854464 00000100:00100000:3.0:1763343274.800202:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10648 00000100:00100000:3.0:1763343274.800213:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57127:x1848998399854464:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343274.800228:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343274.800245:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a31ed lrc: 2/0,0 mode: --/CR res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4951f expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.800319:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a31f4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343274.800334:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a31f4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.800345:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a31f4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:3.0:1763343274.800386:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x203:0x0]: returning size 5 00000004:00200000:3.0:1763343274.800391:0:33856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343274.800408:0:33856:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a31f4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343274.800435:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a31ed lrc: 0/0,0 mode: --/CR res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4951f expref: 294 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.800450:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a31f4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4951f expref: 293 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.800459:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c38f5d00) 00010000:00010000:3.0:1763343274.800462:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1763343274.800465:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c7bb2400, rc 0) 00000100:00100000:1.0:1763343274.802778:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.802923:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57127:x1848998399854464:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2710us (2930us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343274.802934:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10648 00000100:00100000:3.0:1763343274.803016:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4b23b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412969216:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343274.803068:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a31e6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x204:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:0.0:1763343274.803233:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399854592 00000100:00100000:0.0:1763343274.803241:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399854592 00010000:00010000:0.0:1763343274.803280:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a31ca lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4950a expref: 293 pid: 33856 timeout: 1167 lvb_type: 0 00000100:00100000:0.0:1763343274.803305:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3457 00000100:00100000:0.0:1763343274.803314:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:2408:x1848998399854592:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343274.803328:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343274.803335:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a31ca lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4950a expref: 293 pid: 33856 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.803347:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a31ca lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4950a expref: 293 pid: 33856 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.803369:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a31ca lrc: 0/0,0 mode: --/PR res: [0x240000404:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4950a expref: 293 pid: 33856 timeout: 1167 lvb_type: 0 00010000:00010000:0.0:1763343274.803383:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x204:0x0].0x0 (ffff9400c38f5a00) 00010000:00010000:0.0:1763343274.803388:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a31e6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x204:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.803397:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a31e6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x204:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.803404:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a31e6 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x204:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.803434:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343274.803485:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:2408:x1848998399854592:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 173us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343274.803492:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3457 00010000:00010000:3.0:1763343274.803829:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a31e6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x204:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.803838:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a31e6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x204:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:3.0:1763343274.803861:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x204:0x0]: returning size 0 00000004:00080000:3.0:1763343274.804066:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2bb:0x0], index 1: 0 00000004:00080000:3.0:1763343274.804074:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2ba:0x0], index 0: 0 00000004:00080000:3.0:1763343274.804079:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2bb:0x0], index 0: 0 00000004:00080000:3.0:1763343274.804083:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2bc:0x0], index 1: 0 00010000:00010000:0.0:1763343274.804238:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a31e6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x204:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.804247:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a31e6 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x204:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.804253:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a31e6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x204:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.804258:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343274.804262:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a31e6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x204:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.804281:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a31e6 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x204:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.804293:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x204:0x0].0x0 (ffff9400c38f5a00) 00010000:00010000:0.0:1763343274.804295:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343274.804299:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a31e6 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x204:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.804305:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a31e6 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x204:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.804356:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a31df lrc: 1/0,0 mode: --/CR res: [0x240000404:0x204:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49518 expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.804366:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x204:0x0].0x0 (ffff9400c38f5a00) 00010000:00010000:0.0:1763343274.804369:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343274.804372:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a31df lrc: 0/0,0 mode: --/CR res: [0x240000404:0x204:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49518 expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.804385:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917e00, rc 0) 00000100:00100000:0.0:1763343274.804419:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57129:x1848998399854336:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 6259us (6430us total) trans 4294973600 rc 301/301 00000100:00100000:0.0:1763343274.804425:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10647 00000100:00100000:0.0:1763343274.810428:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.810552:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.810661:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399854976 00000100:00100000:1.0:1763343274.810674:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399854976 00000100:00100000:1.0:1763343274.810748:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3754 00000100:00100000:1.0:1763343274.810761:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:57129:x1848998399854976:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343274.811374:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399854720 00000100:00100000:3.0:1763343274.811381:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399854720 00000100:00100000:2.0:1763343274.811438:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7233 00000100:00100000:2.0:1763343274.811451:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998399854720:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.811463:0:27798:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.811489:0:27798:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c85ab400/0x9104b1ba770a3202 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49526 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343274.811515:0:27798:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2b8:0x0] initial LVB size: 5, mtime: 0x691a7baa, atime: 0x0, ctime: 0x691a7baa, blocks: 0x8 00010000:00010000:2.0:1763343274.811537:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.811540:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.811549:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c85ab400/0x9104b1ba770a3202 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49526 expref: 17 pid: 27798 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343274.811567:0:27798:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c85ab400/0x9104b1ba770a3202 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49526 expref: 17 pid: 27798 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343274.811579:0:27798:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c85ab400, rc 0) 00000100:00100000:1.0:1763343274.811603:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57129:x1848998399854976:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 844us (1049us total) trans 4294973601 rc 0/0 00000100:00100000:2.0:1763343274.811607:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998399854720:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 158us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.811620:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3754 00000100:00100000:2.0:1763343274.811621:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7233 00000100:00100000:1.0:1763343274.814754:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.814937:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399855232 00000100:00100000:2.0:1763343274.814948:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399855232 00000100:00100000:2.0:1763343274.815005:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3755 00000100:00100000:2.0:1763343274.815016:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57129:x1848998399855232:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343274.816166:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57129:x1848998399855232:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1145us (1416us total) trans 4294973602 rc 0/0 00000100:00100000:2.0:1763343274.816177:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3755 00000100:00100000:0.0:1763343274.822974:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.823059:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399855488 00000100:00100000:2.0:1763343274.823070:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399855488 00000100:00100000:2.0:1763343274.823138:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10649 00000100:00100000:2.0:1763343274.823150:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:55884:x1848998399855488:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343274.823184:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.823212:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a3209 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4952d expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.823401:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a3210 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.823420:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a3210 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.823432:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a3210 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.823446:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3217 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.823453:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3217 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.823458:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3217 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.823527:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a321e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x204:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.823539:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a321e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.823545:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a321e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343274.823556:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x204:0x0]: returning size 0 00010000:00010000:2.0:1763343274.823669:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a3210 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.823676:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a3210 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.823682:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a3210 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.823688:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a3210 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.823694:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85aa600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.823699:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a3210 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.823706:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a3210 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.823719:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53a00) 00010000:00010000:2.0:1763343274.823722:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.823728:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a3210 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.823734:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a3210 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.823755:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3217 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.823761:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3217 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.823766:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3217 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.823770:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd8e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.823773:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3217 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.823779:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3217 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.823786:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53600) 00010000:00010000:2.0:1763343274.823788:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.823791:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3217 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.823795:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3217 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.823839:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a3209 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4952d expref: 296 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.823856:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a321e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4952d expref: 295 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.823863:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x204:0x0].0x0 (ffff9401edc53500) 00010000:00010000:2.0:1763343274.823866:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343274.823868:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5bd9000, rc 0) 00000100:00100000:2.0:1763343274.823948:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:55884:x1848998399855488:12345-192.168.201.40@tcp:101:bash.0 Request processed in 799us (985us total) trans 4294973603 rc 0/0 00000100:00100000:2.0:1763343274.823956:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10649 00000100:00100000:2.0:1763343274.830624:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.830724:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399855616 00000100:00100000:0.0:1763343274.830735:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399855616 00000100:00100000:0.0:1763343274.830797:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10650 00000100:00100000:0.0:1763343274.830809:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:55884:x1848998399855616:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343274.830837:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343274.830859:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a322c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x204:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49534 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.830908:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3233 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x204:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343274.830922:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3233 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x204:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.830932:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3233 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x204:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.831091:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a322c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x204:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49534 expref: 297 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.831117:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3233 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x204:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49534 expref: 296 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.831129:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x204:0x0].0x0 (ffff9401edc53500) 00010000:00010000:0.0:1763343274.831133:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343274.831138:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c7ec0c00, rc 0) 00000100:00100000:0.0:1763343274.831215:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:55884:x1848998399855616:12345-192.168.201.40@tcp:101:bash.0 Request processed in 408us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343274.831224:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10650 00000100:00100000:1.0:1763343274.839821:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.840064:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399855872 00000100:00100000:3.0:1763343274.840077:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399855872 00000100:00100000:0.0:1763343274.841216:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10651 00000100:00100000:0.0:1763343274.841238:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:55884:x1848998399855872:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:0.0:1763343274.841325:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343274.841364:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a321e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4952d expref: 296 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.841387:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x204:0x0].0x0 (ffff9401edc53500) 00010000:00010000:0.0:1763343274.841393:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343274.841615:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a323a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x204:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343274.841631:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a323a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x204:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.841641:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a323a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x204:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000001:00080000:0.0:1763343274.841691:0:7641:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973604 00000004:00010000:0.0:1763343274.841719:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f89e2b6d reply state 000000002a9857c5 transno 4294973605 ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a323a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x204:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.841731:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a323a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x204:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.841737:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x204:0x0].0x0 (ffff9401edc53500) 00010000:00010000:0.0:1763343274.841740:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343274.841742:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343274.841854:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:55884:x1848998399855872:12345-192.168.201.40@tcp:36:bash.0 Request processed in 623us (2045us total) trans 4294973605 rc 0/0 00000100:00100000:0.0:1763343274.841863:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10651 00000100:00100000:2.0:1763343274.844791:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.844890:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399856000 00000100:00100000:1.0:1763343274.844900:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399856000 00000100:00100000:1.0:1763343274.844964:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10652 00000100:00100000:1.0:1763343274.844975:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:55884:x1848998399856000:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343274.845006:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.845067:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3241 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x204:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4953b expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.845127:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3241 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x204:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4953b expref: 300 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.845142:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3241 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x204:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4953b expref: 300 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.845163:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x204:0x0].0x0 (ffff9401edc53500) 00010000:00010000:1.0:1763343274.845167:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343274.845171:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177800, rc 0) 00000100:00100000:1.0:1763343274.845233:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:55884:x1848998399856000:12345-192.168.201.40@tcp:101:bash.0 Request processed in 260us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.845240:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10652 00000020:00080000:0.0:1763343274.845785:0:7641:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763343274.849490:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.849640:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399856256 00000100:00100000:1.0:1763343274.849653:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399856256 00000100:00100000:1.0:1763343274.849739:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10653 00000100:00100000:1.0:1763343274.849760:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:55884:x1848998399856256:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343274.849786:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.849790:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343274.849822:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3241 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x204:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4953b expref: 299 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.849843:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x204:0x0].0x0 (ffff9401edc53500) 00010000:00010000:1.0:1763343274.849850:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343274.849865:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3248 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x204:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49542 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.849921:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a324f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x204:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343274.849937:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a324f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x204:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.849949:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a324f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x204:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000040:00080000:1.0:1763343274.850284:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1724, 88 off143560 00000004:00080000:1.0:1763343274.850297:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1067974271738ns, next at 1068000121327ns, rc = 0 00000040:00080000:1.0:1763343274.850344:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1716, 88 off142904 00000004:00080000:1.0:1763343274.850350:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1067974325045ns, next at 1068000150895ns, rc = 0 00000040:00080000:1.0:1763343274.850376:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1717, 88 off142992 00000004:00080000:1.0:1763343274.850382:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1067974356623ns, next at 1068000150895ns, rc = 0 00000040:00080000:1.0:1763343274.850811:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1725, 88 off143648 00000004:00080000:1.0:1763343274.850820:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1067974795091ns, next at 1068000121327ns, rc = 0 00000100:00100000:3.0:1763343274.853197:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.853781:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399856384 00000100:00100000:0.0:1763343274.853794:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399856384 00000100:00100000:0.0:1763343274.853863:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7234 00000100:00100000:0.0:1763343274.853876:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2410:x1848998399856384:12345-192.168.201.40@tcp:23:lfs.0 00000001:00080000:3.0:1763343274.854005:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973606 is committed 00000100:00100000:0.0:1763343274.854005:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2410:x1848998399856384:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 131us (816us total) trans 0 rc 0/0 00000004:00080000:3.0:1763343274.854016:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1108 committed 00000100:00100000:0.0:1763343274.854019:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7234 00000004:00080000:3.0:1763343274.854054:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1100 committed 00000004:00080000:3.0:1763343274.854066:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1099 committed 00000004:00080000:3.0:1763343274.854070:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1107 committed 00000100:00100000:3.0:1763343274.854161:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343274.854180:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412969728:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343274.854182:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c517a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412969472:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1763343274.854278:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a323a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x204:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00000100:00100000:0.0:1763343274.854288:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412969344:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1763343274.854291:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a323a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x204:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.854303:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a323a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x204:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.854309:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c7ec0600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.854314:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a323a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x204:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.854322:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a323a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x204:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.854339:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x204:0x0].0x0 (ffff9401edc53500) 00010000:00010000:2.0:1763343274.854342:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.854347:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a323a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x204:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.854352:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a323a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x204:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000100:00100000:1.0:1763343274.854407:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763343274.854473:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a324f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x204:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49542 expref: 293 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.854484:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x204:0x0].0x0 (ffff9401edc53500) 00010000:00010000:0.0:1763343274.854487:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343274.854501:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3248 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x204:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49542 expref: 293 pid: 7641 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763343274.854518:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a324f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x204:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49542 expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.854546:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x204:0x0].0x0 (ffff9401edc53500) 00010000:00010000:0.0:1763343274.854549:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343274.854552:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177000, rc 0) 00000100:00100000:1.0:1763343274.854561:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343274.854589:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:55884:x1848998399856256:12345-192.168.201.40@tcp:101:bash.0 Request processed in 4841us (5156us total) trans 4294973606 rc 0/0 00000100:00100000:0.0:1763343274.854597:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10653 00000100:00100000:1.0:1763343274.854631:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c517ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412969600:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343274.854663:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343274.854690:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412969472 00000100:00100000:2.0:1763343274.854696:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412969472 00000100:00100000:2.0:1763343274.854729:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412969728 00000100:00100000:2.0:1763343274.854733:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412969728 00000100:00100000:2.0:1763343274.854763:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7235 00000100:00100000:2.0:1763343274.854771:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+19:3662:x1848998412969472:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343274.854797:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7236 00000100:00100000:3.0:1763343274.854808:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+36:3660:x1848998412969728:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343274.854933:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+20:3662:x1848998412969472:12345-0@lo:2:osp-syn-0-1.0 Request processed in 162us (527us total) trans 21474839195 rc 0/0 00000100:00100000:2.0:1763343274.854940:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7235 00000100:00100000:1.0:1763343274.855018:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412969600 00000100:00100000:1.0:1763343274.855052:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412969600 00000100:00100000:1.0:1763343274.855084:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7237 00000100:00100000:1.0:1763343274.855093:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+20:3660:x1848998412969600:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343274.855105:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+37:3660:x1848998412969728:12345-0@lo:2:osp-syn-1-1.0 Request processed in 298us (544us total) trans 17179871924 rc 0/0 00000100:00100000:3.0:1763343274.855113:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7236 00000100:00100000:1.0:1763343274.855177:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+21:3660:x1848998412969600:12345-0@lo:2:osp-syn-0-1.0 Request processed in 86us (514us total) trans 21474839196 rc 0/0 00000100:00100000:1.0:1763343274.855183:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7237 00000100:00100000:1.0:1763343274.855206:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343274.855237:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412969344 00000100:00100000:1.0:1763343274.855242:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412969344 00000100:00100000:1.0:1763343274.855281:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7238 00000100:00100000:1.0:1763343274.855288:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+37:3661:x1848998412969344:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343274.855365:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+38:3661:x1848998412969344:12345-0@lo:2:osp-syn-1-1.0 Request processed in 78us (158us total) trans 17179871925 rc 0/0 00000100:00100000:1.0:1763343274.855372:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7238 00000004:00080000:1.0:1763343274.855407:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c59b5f80/2, rc 0, transno 17179871925 00000100:00100000:1.0:1763343274.855413:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412969344:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763343274.855432:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c517a680/2, rc 0, transno 21474839195 00000100:00100000:1.0:1763343274.855436:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c517a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412969472:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763343274.855452:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c59b6680/2, rc 0, transno 17179871924 00000100:00100000:1.0:1763343274.855456:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412969728:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763343274.855463:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c517ad80/2, rc 0, transno 21474839196 00000100:00100000:1.0:1763343274.855467:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c517ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412969600:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343274.859322:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.859407:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399856512 00000100:00100000:2.0:1763343274.859418:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399856512 00000100:00100000:2.0:1763343274.859479:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7239 00000100:00100000:2.0:1763343274.859490:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998399856512:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:2.0:1763343274.859678:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998399856512:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 126us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.859688:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7239 00000100:00100000:3.0:1763343274.861365:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.861455:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399856640 00000100:00100000:1.0:1763343274.861467:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399856640 00000100:00100000:1.0:1763343274.861591:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7240 00000100:00100000:1.0:1763343274.861602:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:55884:x1848998399856640:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343274.861621:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.861649:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3256 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49549 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343274.861676:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343274.861699:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.861701:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.861710:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3256 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49549 expref: 24 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.861725:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3256 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49549 expref: 24 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.861738:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177800, rc 0) 00000100:00100000:1.0:1763343274.861867:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:55884:x1848998399856640:12345-192.168.201.40@tcp:101:bash.0 Request processed in 267us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.861875:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7240 00000100:00100000:0.0:1763343274.865221:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.865279:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.865299:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399856768 00000100:00100000:1.0:1763343274.865309:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399856768 00000100:00100000:2.0:1763343274.865851:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399856896 00000100:00100000:2.0:1763343274.865860:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399856896 00000100:00100000:1.0:1763343274.866509:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7241 00000100:00100000:1.0:1763343274.866530:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6282a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:55884:x1848998399856768:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343274.866546:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.866568:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a325d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49550 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343274.866593:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343274.866617:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.866620:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.866636:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a325d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49550 expref: 19 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.866653:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a325d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49550 expref: 19 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.866665:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176c00, rc 0) 00000100:00100000:1.0:1763343274.866734:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6282a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:55884:x1848998399856768:12345-192.168.201.40@tcp:101:bash.0 Request processed in 212us (1524us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.866743:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7241 00000100:00100000:2.0:1763343274.867205:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1725 00000100:00100000:2.0:1763343274.867217:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2410:x1848998399856896:12345-192.168.201.40@tcp:3:lfs.0 00010000:00010000:2.0:1763343274.867256:0:8419:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9000/0x9104b1ba770a3264 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.867276:0:8419:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.867278:0:8419:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.867281:0:8419:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9000/0x9104b1ba770a3264 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.867293:0:8419:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9000/0x9104b1ba770a3264 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.867395:0:8419:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9000/0x9104b1ba770a3264 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.867405:0:8419:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9000/0x9104b1ba770a3264 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.867412:0:8419:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9000/0x9104b1ba770a3264 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.867420:0:8419:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd9000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343274.867425:0:8419:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9000/0x9104b1ba770a3264 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.867434:0:8419:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9000/0x9104b1ba770a3264 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.867449:0:8419:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9000/0x9104b1ba770a3264 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.867456:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9000/0x9104b1ba770a3264 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343274.867515:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2410:x1848998399856896:12345-192.168.201.40@tcp:3:lfs.0 Request processed in 301us (2236us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763343274.867522:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1725 00000100:00100000:3.0:1763343274.868839:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.868872:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.869615:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399857024 00000100:00100000:1.0:1763343274.869625:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399857024 00000100:00100000:0.0:1763343274.869630:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399857152 00000100:00100000:0.0:1763343274.869637:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399857152 00002000:00010000:1.0:1763343274.869670:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/699 (0->18446744073709551615) 00002000:00010000:0.0:1763343274.869670:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/698 (0->18446744073709551615) 00002000:00100000:0.0:1763343274.869679:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5956300 with x1848998399857152 ext(0->18446744073709551615) 00002000:00100000:1.0:1763343274.869680:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5957100 with x1848998399857024 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343274.869695:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5957100. 00002000:00010000:0.0:1763343274.869695:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5956300. 00000100:00100000:0.0:1763343274.870205:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1726 00000100:00100000:0.0:1763343274.870217:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2408:x1848998399857024:12345-192.168.201.40@tcp:10:bash.0 00000100:00100000:2.0:1763343274.870292:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1727 00000100:00100000:2.0:1763343274.870302:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998399857152:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:0.0:1763343274.870667:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2bb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343274.870671:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2bb:0x0] updating lvb mtime from disk: 0 -> 1763343274 00002000:00010000:0.0:1763343274.870673:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2bb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343274.870675:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2bb:0x0] updating lvb ctime from disk: 0 -> 1763343274 00002000:00010000:0.0:1763343274.870677:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2bb:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1763343274.870818:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2ba:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343274.870821:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2ba:0x0] updating lvb mtime from disk: 0 -> 1763343274 00002000:00010000:2.0:1763343274.870823:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2ba:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343274.870825:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2ba:0x0] updating lvb ctime from disk: 0 -> 1763343274 00002000:00010000:2.0:1763343274.870827:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2ba:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343274.870971:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2408:x1848998399857024:12345-192.168.201.40@tcp:10:bash.0 Request processed in 755us (2142us total) trans 17179871926 rc 0/0 00000100:00100000:0.0:1763343274.870980:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1726 00002000:00010000:0.0:1763343274.870985:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/699 (0->18446744073709551615) 00002000:00100000:0.0:1763343274.870988:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5957100 with x1848998399857024 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343274.870993:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5957100. 00000100:00100000:2.0:1763343274.871155:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2408:x1848998399857152:12345-192.168.201.40@tcp:10:bash.0 Request processed in 853us (2281us total) trans 21474839197 rc 0/0 00000100:00100000:2.0:1763343274.871163:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1727 00002000:00010000:2.0:1763343274.871166:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/698 (0->18446744073709551615) 00002000:00100000:2.0:1763343274.871169:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5956300 with x1848998399857152 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343274.871174:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5956300. 00000100:00100000:0.0:1763343274.873405:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.873582:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399857280 00000100:00100000:1.0:1763343274.873592:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399857280 00000100:00100000:1.0:1763343274.873669:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10654 00000100:00100000:1.0:1763343274.873680:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57127:x1848998399857280:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343274.873706:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.873729:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a326b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49557 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.873767:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177600/0x9104b1ba770a3272 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343274.873782:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177600/0x9104b1ba770a3272 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.873793:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177600/0x9104b1ba770a3272 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.873914:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a326b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x203:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49557 expref: 294 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.873932:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177600/0x9104b1ba770a3272 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x203:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49557 expref: 293 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.873941:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c38f5d00) 00010000:00010000:1.0:1763343274.873944:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343274.873947:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177600, rc 0) 00000100:00100000:1.0:1763343274.874000:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57127:x1848998399857280:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 322us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.874008:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10654 00000100:00100000:3.0:1763343274.874118:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.874160:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399857536 00000100:00100000:2.0:1763343274.874166:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399857536 00000100:00100000:2.0:1763343274.874209:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3756 00000100:00100000:2.0:1763343274.874216:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:55884:x1848998399857536:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:2.0:1763343274.874466:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:55884:x1848998399857536:12345-192.168.201.40@tcp:35:bash.0 Request processed in 249us (349us total) trans 4294973607 rc 0/0 00000100:00100000:2.0:1763343274.874474:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3756 00000100:00100000:3.0:1763343274.884145:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.884191:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399857792 00000100:00100000:1.0:1763343274.884202:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399857792 00000100:00100000:1.0:1763343274.884261:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10655 00000100:00100000:1.0:1763343274.884584:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57130:x1848998399857792:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:1.0:1763343274.884612:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.884635:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a3279 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4955e expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.884706:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3280 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343274.884718:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3280 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.884730:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3280 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.884741:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3287 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343274.884746:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3287 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.884752:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3287 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.884823:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a328e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x204:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343274.884831:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a328e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x204:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.884838:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a328e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x204:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343274.884873:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x204:0x0]: returning size 5 00000004:00200000:1.0:1763343274.884877:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343274.884895:0:7641:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a328e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x204:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.884905:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a328e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.884914:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3280 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.884921:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3280 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.884926:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3280 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.884932:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3280 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.884937:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.884941:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3280 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.884948:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3280 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.884960:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5800) 00010000:00010000:1.0:1763343274.884964:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.884968:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3280 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.884974:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3280 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.884985:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3287 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.884990:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3287 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.884995:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3287 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.885000:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.885002:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3287 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.885007:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3287 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.885013:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5b00) 00010000:00010000:1.0:1763343274.885015:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.885018:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3287 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.885022:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3287 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.885089:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a3279 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4955e expref: 296 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.885103:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a328e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4955e expref: 295 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.885110:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x204:0x0].0x0 (ffff9401edc53500) 00010000:00010000:1.0:1763343274.885112:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343274.885115:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176600, rc 0) 00000100:00100000:1.0:1763343274.885179:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57130:x1848998399857792:12345-192.168.201.40@tcp:101:rm.0 Request processed in 599us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.885187:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10655 00000100:00100000:1.0:1763343274.885230:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.885713:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399857664 00000100:00100000:3.0:1763343274.885720:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399857664 00000100:00100000:3.0:1763343274.885837:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1728 00000100:00100000:3.0:1763343274.885846:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2408:x1848998399857664:12345-192.168.201.40@tcp:4:lfs.0 00010000:00010000:3.0:1763343274.885872:0:28399:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a3295 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.885950:0:28399:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3049 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4949a expref: 25 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343274.885958:0:28399:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343274.885960:0:28399:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343274.885964:0:28399:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a3295 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.885997:0:28399:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3049 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4949a expref: 25 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343274.886011:0:28399:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3049 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4949a expref: 25 pid: 8414 timeout: 1168 lvb_type: 1 00000100:00100000:3.0:1763343274.886056:0:28399:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5955c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_017:lustre-OST0001_UUID:28399:1848998412969856:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343274.886130:0:28399:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c5965540 going to sleep for 11 seconds 00000100:00100000:1.0:1763343274.891607:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.891669:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.891741:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399858048 00000100:00100000:0.0:1763343274.891751:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399858048 00000100:00100000:0.0:1763343274.891808:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10656 00000100:00100000:0.0:1763343274.891819:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57130:x1848998399858048:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:0.0:1763343274.891876:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1763343274.891903:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a324f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x204:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49542 expref: 295 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.891925:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a328e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4955e expref: 294 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.891940:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3233 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x204:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49534 expref: 293 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.891952:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x204:0x0].0x0 (ffff9401edc53500) 00010000:00010000:0.0:1763343274.891963:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343274.891992:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a329c lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343274.892005:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a329c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.892015:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a329c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.892049:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a32a3 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343274.892056:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a32a3 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.892062:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a32a3 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.892147:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a32aa lrc: 3/0,1 mode: --/EX res: [0x240000404:0x204:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343274.892155:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a32aa lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x204:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.892162:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a32aa lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x204:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000040:00080000:0.0:1763343274.892415:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1726, 64 off143712 00000004:00080000:0.0:1763343274.892425:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1068016400283ns, next at 1069016397451ns, rc = 0 00000040:00080000:0.0:1763343274.892449:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1718, 64 off143056 00000004:00080000:0.0:1763343274.892452:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1068016427411ns, next at 1069016426495ns, rc = 0 00000040:00080000:0.0:1763343274.892461:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1719, 64 off143120 00000040:00080000:0.0:1763343274.892470:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1727, 64 off143776 00010000:00010000:0.0:1763343274.892520:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a32b1 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x204:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343274.892529:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a32b1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x204:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.892536:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a32b1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x204:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.892542:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a32b1 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x204:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.892548:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a32b1 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x204:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.892555:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a32b1 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x204:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.892571:0:7641:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343274.892588:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a32aa lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x204:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.892594:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a32aa lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x204:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.892599:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a32aa lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x204:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.892605:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343274.892609:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a32aa lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x204:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.892616:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a32aa lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x204:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.892624:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x204:0x0].0x0 (ffff9401f6695500) 00010000:00010000:0.0:1763343274.892627:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763343274.892631:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a32aa lrc: 2/0,0 mode: --/EX res: [0x240000404:0x204:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.892637:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a32aa lrc: 0/0,0 mode: --/EX res: [0x240000404:0x204:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.892759:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a329c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.892765:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a329c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.892770:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a329c lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.892775:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a329c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.892780:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c7ec0600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343274.892783:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a329c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.892788:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a329c lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.892795:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695e00) 00010000:00010000:0.0:1763343274.892798:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343274.892801:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a329c lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.892805:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a329c lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00010000:0.0:1763343274.892818:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e514e7ef reply state 000000008495e0e1 transno 4294973608 ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a32a3 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.892828:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a32a3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.892833:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695000) 00010000:00010000:0.0:1763343274.892835:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343274.892837:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343274.892918:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57130:x1848998399858048:12345-192.168.201.40@tcp:36:rm.0 Request processed in 1097us (1320us total) trans 4294973608 rc 0/0 00000100:00100000:0.0:1763343274.892926:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10656 00010000:00010000:3.0:1763343274.893165:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343274.893172:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a32b1 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x204:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.893178:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917a00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343274.893181:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a32b1 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x204:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.893186:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a32b1 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x204:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.893194:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x204:0x0].0x0 (ffff9401f6695500) 00010000:00010000:3.0:1763343274.893196:0:7451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343274.893199:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a32b1 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x204:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.893203:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a32b1 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x204:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.893215:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343274.893217:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343274.893219:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343274.893261:0:28399:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5955c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_017:lustre-OST0001_UUID:28399:1848998412969856:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343274.893291:0:28399:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a3295 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343274.893455:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399858176 00000100:00100000:2.0:1763343274.893463:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399858176 00010000:00010000:2.0:1763343274.893490:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3049 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4949a expref: 26 pid: 8414 timeout: 1168 lvb_type: 1 00000100:00100000:2.0:1763343274.893513:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3458 00000100:00100000:2.0:1763343274.893521:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2408:x1848998399858176:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343274.893534:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343274.893551:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3049 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4949a expref: 26 pid: 8414 timeout: 1168 lvb_type: 1 00010000:00010000:2.0:1763343274.893563:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3049 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4949a expref: 26 pid: 8414 timeout: 1168 lvb_type: 1 00010000:00010000:2.0:1763343274.893583:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3049 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4949a expref: 26 pid: 8414 timeout: 1168 lvb_type: 1 00010000:00010000:2.0:1763343274.893596:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.893598:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.893602:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a3295 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.893610:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a3295 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.893638:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343274.893671:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2408:x1848998399858176:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 150us (2000us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.893678:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3458 00010000:00010000:0.0:1763343274.897483:0:28399:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a3295 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.897503:0:28399:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a3295 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1763343274.904079:0:25994:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871927 is committed 00000001:00080000:2.0:1763343274.904098:0:25994:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871925 is committed 00002000:00010000:0.0:1763343274.904280:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2ba:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:0.0:1763343274.904285:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2ba:0x0] updating lvb mtime from disk: 0 -> 1763343274 00002000:00010000:0.0:1763343274.904288:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2ba:0x0] updating lvb ctime from disk: 0 -> 1763343274 00002000:00010000:0.0:1763343274.904290:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2ba:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1763343274.904302:0:28399:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a3295 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.904313:0:28399:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a3295 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.904321:0:28399:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a3295 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.904327:0:28399:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb3e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343274.904331:0:28399:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a3295 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.904340:0:28399:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a3295 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.904357:0:28399:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a3295 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.904376:0:28399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a3295 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343274.905371:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2408:x1848998399857664:12345-192.168.201.40@tcp:4:lfs.0 Request processed in 19512us (20126us total) trans 17179871927 rc 0/0 00000100:00100000:0.0:1763343274.905383:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1728 00000100:00100000:0.0:1763343274.919081:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.919118:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.919193:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399858304 00000100:00100000:1.0:1763343274.919204:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399858304 00000100:00100000:2.0:1763343274.919226:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399858560 00000100:00100000:2.0:1763343274.919232:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399858560 00000100:00100000:2.0:1763343274.919679:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10657 00000100:00100000:1.0:1763343274.919689:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10658 00000100:00100000:2.0:1763343274.919695:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57127:x1848998399858560:12345-192.168.201.40@tcp:36:lfs.0 00000100:00100000:1.0:1763343274.919704:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57131:x1848998399858304:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343274.919723:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.919751:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a32b8 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49565 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.919767:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343274.919795:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb2400/0x9104b1ba770a31f4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x203:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4951f expref: 296 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.919813:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c38f5d00) 00010000:00010000:1.0:1763343274.919814:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a32bf lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343274.919821:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343274.919830:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a32bf lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343274.919842:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a32bf lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343274.919853:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a32c6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343274.919861:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a32c6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343274.919867:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a32c6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.919887:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a32cd lrc: 3/0,1 mode: --/PW res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.919899:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a32cd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.919906:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a32cd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.919912:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a32bf lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343274.919921:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a32bf lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343274.919927:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a32bf lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343274.919935:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a32bf lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343274.919941:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.919946:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a32bf lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343274.919953:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a32bf lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343274.919961:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5800) 00010000:00010000:1.0:1763343274.919965:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.919968:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a32bf lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343274.919974:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a32bf lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343274.919985:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a32c6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343274.919990:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a32c6 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343274.919995:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a32c6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343274.919999:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.920002:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a32c6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343274.920007:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a32c6 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343274.920016:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695000) 00010000:00010000:1.0:1763343274.920019:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.920065:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a32c6 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343274.920073:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a32c6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343274.920096:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a32b8 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49565 expref: 296 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.920105:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5800) 00010000:00010000:1.0:1763343274.920107:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.920111:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a32b8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49565 expref: 296 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.920121:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176200, rc 0) 00000100:00100000:1.0:1763343274.920183:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57131:x1848998399858304:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 484us (1160us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343274.920190:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10658 00000004:00010000:2.0:1763343274.920247:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000e9e83f0 reply state 000000001dc04b45 transno 4294973609 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a32cd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.920260:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a32cd lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.920278:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c38f5d00) 00010000:00010000:2.0:1763343274.920280:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343274.920283:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343274.920337:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57127:x1848998399858560:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 649us (1217us total) trans 4294973609 rc 0/0 00000100:00100000:2.0:1763343274.920344:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10657 00000100:00100000:1.0:1763343274.923999:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.924795:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.924833:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399858688 00000100:00100000:3.0:1763343274.924843:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399858688 00000100:00100000:0.0:1763343274.925259:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7242 00000100:00100000:0.0:1763343274.925279:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:57127:x1848998399858688:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343274.925300:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343274.925329:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a32d4 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4956c expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343274.925361:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2ba:0x0] initial LVB size: 4096, mtime: 0x691a7baa, atime: 0x0, ctime: 0x691a7baa, blocks: 0x8 00000100:00100000:2.0:1763343274.925365:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399858816 00000100:00100000:2.0:1763343274.925372:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399858816 00010000:00010000:0.0:1763343274.925386:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.925391:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.925399:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a32d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4956c expref: 14 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.925415:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a32d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4956c expref: 14 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.925429:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400cbad3c00, rc 0) 00000100:00100000:2.0:1763343274.925449:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10659 00000100:00100000:2.0:1763343274.925459:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57131:x1848998399858816:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.925478:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.925498:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a32db lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49573 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343274.925499:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:57127:x1848998399858688:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 220us (1511us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343274.925514:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7242 00010000:00010000:2.0:1763343274.925574:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a32e2 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.925588:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a32e2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.926141:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a32e2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.926161:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a32e9 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.926171:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a32e9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.926179:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a32e9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.926219:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a32e2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.926227:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a32e2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.926234:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a32e2 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.926240:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a32e2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.926247:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd9000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.926252:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a32e2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.926260:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a32e2 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.926354:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c6733500) 00010000:00010000:2.0:1763343274.926358:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.926363:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a32e2 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.926370:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a32e2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.926386:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a32e9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.926392:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a32e9 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.926397:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a32e9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.926402:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85abe00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.926405:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a32e9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.926657:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a32e9 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.926668:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695000) 00010000:00010000:2.0:1763343274.926671:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.926675:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a32e9 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.926684:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a32e9 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.926719:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a32db lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49573 expref: 296 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.926730:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c6733500) 00010000:00010000:2.0:1763343274.926732:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.926736:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a32db lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49573 expref: 296 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.926750:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5bd8e00, rc 0) 00000100:00100000:2.0:1763343274.926819:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57131:x1848998399858816:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1361us (2025us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343274.926827:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10659 00000100:00100000:1.0:1763343274.927689:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.927763:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399858944 00000100:00100000:3.0:1763343274.927771:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399858944 00000100:00100000:3.0:1763343274.927828:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7243 00000100:00100000:3.0:1763343274.927838:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:57127:x1848998399858944:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343274.927853:0:27798:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343274.927868:0:27798:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba770a32f0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4957a expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.927893:0:27798:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c589ba00/0x9104b1ba770a305e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494a1 expref: 20 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343274.927901:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343274.927904:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343274.927909:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba770a32f0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4957a expref: 20 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.927943:0:27798:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c589ba00/0x9104b1ba770a305e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494a1 expref: 20 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343274.927955:0:27798:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c589ba00/0x9104b1ba770a305e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494a1 expref: 20 pid: 8414 timeout: 1168 lvb_type: 1 00000100:00100000:3.0:1763343274.927968:0:27798:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5955c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27798:1848998412969984:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343274.928066:0:27798:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c5965540 going to sleep for 11 seconds 00000100:00100000:3.0:1763343274.931893:0:27798:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5955c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27798:1848998412969984:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343274.931931:0:27798:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba770a32f0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4957a expref: 20 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.931952:0:27798:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c7bb3800, rc 0) 00000100:00100000:3.0:1763343274.932012:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:57127:x1848998399858944:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 4174us (4326us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343274.932020:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7243 00000100:00100000:1.0:1763343274.933875:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.933947:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.934603:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399859072 00000100:00100000:3.0:1763343274.934614:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399859072 00010000:00010000:3.0:1763343274.934656:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c589ba00/0x9104b1ba770a305e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494a1 expref: 20 pid: 8414 timeout: 1168 lvb_type: 1 00000100:00100000:3.0:1763343274.934699:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3459 00000100:00100000:3.0:1763343274.934710:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9833480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2408:x1848998399859072:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343274.934728:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343274.934749:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c589ba00/0x9104b1ba770a305e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494a1 expref: 20 pid: 8414 timeout: 1168 lvb_type: 1 00010000:00010000:3.0:1763343274.934763:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c589ba00/0x9104b1ba770a305e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494a1 expref: 20 pid: 8414 timeout: 1168 lvb_type: 1 00010000:00010000:3.0:1763343274.934788:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c589ba00/0x9104b1ba770a305e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494a1 expref: 20 pid: 8414 timeout: 1168 lvb_type: 1 00010000:00010000:3.0:1763343274.934805:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343274.934807:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343274.934813:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba770a32f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4957a expref: 19 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.934823:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba770a32f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4957a expref: 19 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.934866:0:7904:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba770a32f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4957a expref: 19 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343274.934882:0:7904:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5955c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7904:1848998412970112:192.168.201.40@tcp:105: 00000100:00100000:3.0:1763343274.934964:0:7904:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c5965540 going to sleep for 11 seconds 00000100:00100000:2.0:1763343274.935542:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399859200 00000100:00100000:2.0:1763343274.935549:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399859200 00000100:00100000:2.0:1763343274.935593:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10660 00000100:00100000:2.0:1763343274.935602:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57131:x1848998399859200:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.935621:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.935643:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a32f7 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49581 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.935709:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a32fe lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.935722:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a32fe lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.935739:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a32fe lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343274.935791:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763343274.935797:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763343274.935832:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a32f7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49581 expref: 297 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.935846:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a32fe lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49581 expref: 296 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.935855:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c6733800) 00010000:00010000:2.0:1763343274.935858:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763343274.935861:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c6b98200, rc 0) 00000100:00100000:2.0:1763343274.935913:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57131:x1848998399859200:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 311us (1965us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.935920:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10660 00000100:00100000:1.0:1763343274.938120:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.938146:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.938237:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399859328 00000100:00100000:0.0:1763343274.938245:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399859328 00002000:00010000:0.0:1763343274.938292:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/698 (5->18446744073709551615) 00002000:00100000:0.0:1763343274.938296:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c9833b80 with x1848998399859328 ext(5->18446744073709551615) 00002000:00010000:0.0:1763343274.938308:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401c9833b80. 00000100:00100000:0.0:1763343274.938331:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399859456 00000100:00100000:0.0:1763343274.938334:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399859456 00002000:00010000:0.0:1763343274.938344:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/697 (0->18446744073709551615) 00002000:00100000:0.0:1763343274.938346:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c9831180 with x1848998399859456 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343274.938351:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9401c9831180. 00000100:00100000:0.0:1763343274.938367:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1729 00000100:00100000:0.0:1763343274.938375:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399859328:12345-192.168.201.40@tcp:10:lfs.0 00002000:00010000:0.0:1763343274.938671:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2ba:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:0.0:1763343274.938675:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2ba:0x0] updating lvb mtime from disk: 1763343274 -> 1763343274 00002000:00010000:0.0:1763343274.938678:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2ba:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343274.938680:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2ba:0x0] updating lvb ctime from disk: 1763343274 -> 1763343274 00002000:00010000:0.0:1763343274.938682:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2ba:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763343274.938732:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998399859328:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 357us (623us total) trans 17179871928 rc 0/0 00000100:00100000:0.0:1763343274.938740:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1729 00002000:00010000:0.0:1763343274.938743:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/698 (5->18446744073709551615) 00002000:00100000:0.0:1763343274.938746:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c9833b80 with x1848998399859328 ext(5->18446744073709551615) 00002000:00010000:0.0:1763343274.938750:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401c9833b80. 00000100:00100000:0.0:1763343274.938766:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1730 00000100:00100000:0.0:1763343274.938773:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2408:x1848998399859456:12345-192.168.201.40@tcp:10:lfs.0 00002000:00010000:0.0:1763343274.938891:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2b9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343274.938894:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2b9:0x0] updating lvb mtime from disk: 0 -> 1763343274 00002000:00010000:0.0:1763343274.938896:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2b9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343274.938898:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2b9:0x0] updating lvb ctime from disk: 0 -> 1763343274 00002000:00010000:0.0:1763343274.938900:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2b9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343274.938922:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399859456:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 149us (775us total) trans 21474839198 rc 0/0 00000100:00100000:0.0:1763343274.938929:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1730 00002000:00010000:0.0:1763343274.938932:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/697 (0->18446744073709551615) 00002000:00100000:0.0:1763343274.938934:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c9831180 with x1848998399859456 ext(0->18446744073709551615) 00000100:00100000:3.0:1763343274.939037:0:7904:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5955c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7904:1848998412970112:192.168.201.40@tcp:105: 00010000:00010000:3.0:1763343274.939056:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343274.939076:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9833480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399859072:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 4369us (5208us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343274.939083:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3459 00000100:00100000:3.0:1763343274.939754:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00002000:00010000:0.0:1763343274.940422:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9401c9831180. 00000100:00100000:2.0:1763343274.941794:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399859584 00000100:00100000:2.0:1763343274.941807:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399859584 00000100:00100000:2.0:1763343274.941866:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10661 00000100:00100000:2.0:1763343274.941875:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57131:x1848998399859584:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.941893:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.941913:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3305 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49588 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.941986:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a330c lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343274.942001:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a330c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.942012:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a330c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.942243:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a3313 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343274.942251:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a3313 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.942258:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a3313 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.942326:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a330c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.942334:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a330c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.942340:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a330c lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.942347:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a330c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.942353:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b98000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.942358:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a330c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.942366:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a330c lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.942379:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c6733800) 00010000:00010000:2.0:1763343274.942382:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.942388:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a330c lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.942394:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a330c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.942405:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a3313 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.942410:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a3313 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.942415:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a3313 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.942420:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85abe00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.942422:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a3313 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.942427:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a3313 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.942432:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695000) 00010000:00010000:2.0:1763343274.942434:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.942438:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a3313 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.942444:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a3313 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.942474:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3305 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49588 expref: 297 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.942484:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c6733800) 00010000:00010000:2.0:1763343274.942486:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.942489:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3305 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49588 expref: 297 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.942500:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c6b99600, rc 0) 00000100:00100000:2.0:1763343274.942581:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57131:x1848998399859584:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 707us (2829us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343274.942590:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10661 00000100:00100000:1.0:1763343274.943402:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.943498:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399859840 00000100:00100000:2.0:1763343274.943505:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399859840 00000100:00100000:2.0:1763343274.943548:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10662 00000100:00100000:2.0:1763343274.943556:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57127:x1848998399859840:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:2.0:1763343274.943626:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a331a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343274.943640:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a331a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.943648:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a331a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00010000:2.0:1763343274.943757:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003a9faba5 reply state 0000000077b18ab0 transno 4294973610 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a331a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.943770:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a331a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.943777:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c38f5d00) 00010000:00010000:2.0:1763343274.943780:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343274.943782:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343274.943863:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57127:x1848998399859840:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 308us (465us total) trans 4294973610 rc 0/0 00000100:00100000:2.0:1763343274.943870:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10662 00000100:00100000:1.0:1763343274.945371:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.945633:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399860096 00000100:00100000:0.0:1763343274.945643:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399860096 00000100:00100000:0.0:1763343274.945692:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10663 00000100:00100000:0.0:1763343274.945703:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57131:x1848998399860096:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343274.945719:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343274.945722:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343274.945747:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a32fe lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49581 expref: 298 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.945764:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c6733800) 00010000:00010000:0.0:1763343274.945772:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343274.945786:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3321 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4958f expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343274.945825:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:0.0:1763343274.945876:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3328 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343274.945887:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3328 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.945896:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3328 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.945907:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a332f lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343274.945914:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a332f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.945920:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a332f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343274.945953:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399860224 00000100:00100000:3.0:1763343274.945957:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399860224 00000100:00100000:3.0:1763343274.946001:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7244 00000100:00100000:3.0:1763343274.946009:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:57127:x1848998399860224:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343274.946017:0:27798:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343274.946053:0:27798:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3336 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49596 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.946073:0:27798:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c85ab400/0x9104b1ba770a3202 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49526 expref: 21 pid: 27798 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343274.946080:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343274.946082:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343274.946086:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3336 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49596 expref: 21 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.946118:0:27798:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c85ab400/0x9104b1ba770a3202 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49526 expref: 21 pid: 27798 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343274.946130:0:27798:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c85ab400/0x9104b1ba770a3202 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49526 expref: 21 pid: 27798 timeout: 1168 lvb_type: 1 00000100:00100000:3.0:1763343274.946144:0:27798:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27798:1848998412970240:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343274.946205:0:27798:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c5965540 going to sleep for 11 seconds 00010000:00010000:0.0:1763343274.946309:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a333d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x206:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343274.946318:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a333d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.946325:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a333d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343274.946333:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x206:0x0]: returning size 0 00010000:00010000:0.0:1763343274.946356:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3328 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.946362:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3328 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.946367:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3328 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.946373:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3328 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.946379:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343274.946382:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3328 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.946389:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3328 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.946398:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695800) 00010000:00010000:0.0:1763343274.946401:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343274.946404:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3328 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.946409:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3328 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00010000:0.0:1763343274.946424:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000492759f2 reply state 00000000e5d37837 transno 4294973611 ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a332f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.946434:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a332f lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.946440:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695000) 00010000:00010000:0.0:1763343274.946442:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343274.946445:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343274.946469:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3321 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4958f expref: 300 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.946485:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a333d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4958f expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.946492:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x206:0x0].0x0 (ffff9401f6695f00) 00010000:00010000:0.0:1763343274.946494:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343274.946496:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c7ec0c00, rc 0) 00000100:00100000:0.0:1763343274.946528:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57131:x1848998399860096:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 827us (1163us total) trans 4294973611 rc 0/0 00000100:00100000:0.0:1763343274.946535:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10663 00000100:00100000:1.0:1763343274.948614:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.948803:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399860480 00000100:00100000:2.0:1763343274.948812:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399860480 00000100:00100000:2.0:1763343274.948887:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10664 00000100:00100000:2.0:1763343274.948896:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57131:x1848998399860480:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.948916:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.948932:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a334b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x206:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4959d expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.949018:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3352 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x206:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343274.949051:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a333d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4958f expref: 301 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.949059:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3352 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.949087:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a333d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4958f expref: 301 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.949095:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a333d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4958f expref: 301 pid: 7641 timeout: 1168 lvb_type: 0 00000100:00100000:2.0:1763343274.949107:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9dc8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412970368:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343274.949170:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c29c40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343274.949299:0:27798:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27798:1848998412970240:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343274.949324:0:27798:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3336 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49596 expref: 21 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.949338:0:27798:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c7bb2400, rc 0) 00000100:00100000:0.0:1763343274.949366:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:57127:x1848998399860224:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3358us (3541us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343274.949377:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7244 00000100:00100000:3.0:1763343274.949739:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.949784:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399860608 00000100:00100000:1.0:1763343274.949789:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399860608 00010000:00010000:1.0:1763343274.949812:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c85ab400/0x9104b1ba770a3202 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49526 expref: 21 pid: 27798 timeout: 1168 lvb_type: 1 00000100:00100000:1.0:1763343274.949843:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3460 00000100:00100000:1.0:1763343274.949851:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399860608:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343274.949861:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343274.949879:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c85ab400/0x9104b1ba770a3202 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49526 expref: 21 pid: 27798 timeout: 1168 lvb_type: 1 00010000:00010000:1.0:1763343274.949891:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c85ab400/0x9104b1ba770a3202 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49526 expref: 21 pid: 27798 timeout: 1168 lvb_type: 1 00010000:00010000:1.0:1763343274.949917:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c85ab400/0x9104b1ba770a3202 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49526 expref: 21 pid: 27798 timeout: 1168 lvb_type: 1 00010000:00010000:1.0:1763343274.949929:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.949932:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.949939:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3336 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49596 expref: 20 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.949947:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3336 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49596 expref: 20 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.949977:0:7904:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3336 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49596 expref: 20 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343274.949986:0:7904:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7919c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7904:1848998412970496:192.168.201.40@tcp:105: 00000100:00100000:1.0:1763343274.950042:0:7904:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c3be8300 going to sleep for 11 seconds 00000100:00100000:2.0:1763343274.951398:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9dc8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412970368:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343274.951420:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3352 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343274.951767:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.951873:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.951898:0:7904:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7919c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7904:1848998412970496:192.168.201.40@tcp:105: 00010000:00010000:1.0:1763343274.951918:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343274.951956:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399860736 00000100:00100000:0.0:1763343274.951963:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399860736 00000100:00100000:1.0:1763343274.951972:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399860608:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 2120us (2232us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.951983:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3460 00000100:00100000:3.0:1763343274.951990:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399860864 00010000:00010000:0.0:1763343274.951992:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a333d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4958f expref: 302 pid: 7641 timeout: 1168 lvb_type: 0 00000100:00100000:3.0:1763343274.951996:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399860864 00000100:00100000:3.0:1763343274.952048:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7245 00000100:00100000:0.0:1763343274.952048:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3461 00000100:00100000:0.0:1763343274.952058:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8392450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:2407:x1848998399860736:12345-192.168.201.40@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1763343274.952059:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399860864:12345-192.168.201.40@tcp:2:lfs.0 00010000:00010000:0.0:1763343274.952070:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343274.952076:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a333d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4958f expref: 302 pid: 7641 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343274.952087:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a333d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4958f expref: 302 pid: 7641 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343274.952107:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a333d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4958f expref: 302 pid: 7641 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343274.952120:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x206:0x0].0x0 (ffff9401f6695f00) 00010000:00010000:0.0:1763343274.952124:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3352 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.952131:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3352 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.952137:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3352 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.952165:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:3.0:1763343274.952184:0:27798:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2b8:0x0] updating lvb size from disk: 5 -> 5 00000100:00100000:0.0:1763343274.952186:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8392450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:2407:x1848998399860736:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 131us (420us total) trans 0 rc 0/0 00002000:00010000:3.0:1763343274.952187:0:27798:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2b8:0x0] updating lvb mtime from disk: 1763343274 -> 1763343274 00002000:00010000:3.0:1763343274.952190:0:27798:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2b8:0x0] updating lvb atime from disk: 0 -> 1763343273 00002000:00010000:3.0:1763343274.952192:0:27798:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2b8:0x0] updating lvb ctime from disk: 1763343274 -> 1763343274 00000100:00100000:0.0:1763343274.952193:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3461 00002000:00010000:3.0:1763343274.952194:0:27798:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2b8:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343274.952213:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399860864:12345-192.168.201.40@tcp:2:lfs.0 Request processed in 159us (341us total) trans 21474839199 rc 0/0 00000100:00100000:3.0:1763343274.952218:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7245 00010000:00010000:1.0:1763343274.952379:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3352 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.952386:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3352 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343274.952408:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x206:0x0]: returning size 0 00000004:00080000:1.0:1763343274.952577:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2bc:0x0], index 0: 0 00000004:00080000:1.0:1763343274.952584:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2bd:0x0], index 1: 0 00000004:00080000:1.0:1763343274.952589:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2be:0x0], index 1: 0 00000004:00080000:1.0:1763343274.952593:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2bd:0x0], index 0: 0 00010000:00010000:1.0:1763343274.952682:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3352 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.952690:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3352 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.952701:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3352 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.952707:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b99600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.952711:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3352 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.952718:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3352 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.952728:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x206:0x0].0x0 (ffff9401f6695f00) 00010000:00010000:1.0:1763343274.952731:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343274.952735:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3352 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.952740:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3352 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.952781:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a334b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x206:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4959d expref: 301 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.952791:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x206:0x0].0x0 (ffff9401f6695f00) 00010000:00010000:1.0:1763343274.952793:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343274.952797:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85abe00/0x9104b1ba770a334b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x206:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4959d expref: 301 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.952810:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c85abe00, rc 0) 00000100:00100000:1.0:1763343274.952847:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57131:x1848998399860480:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3953us (4241us total) trans 4294973612 rc 301/301 00000100:00100000:1.0:1763343274.952854:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10664 00000100:00100000:2.0:1763343274.953893:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.953973:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399861120 00000100:00100000:1.0:1763343274.953981:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399861120 00000100:00100000:1.0:1763343274.954042:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3757 00000100:00100000:1.0:1763343274.954052:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8443050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57127:x1848998399861120:12345-192.168.201.40@tcp:35:lfs.0 00000004:00010000:1.0:1763343274.954105:0:6528:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x203:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a314c lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x203:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494e7 expref: 300 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.954142:0:6528:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3360 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 00010000:00010000:1.0:1763343274.954154:0:6528:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a31d8 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49511 expref: 300 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.954163:0:6528:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3360 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT1 00010000:00010000:1.0:1763343274.954195:0:6528:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a31d8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49511 expref: 300 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.954208:0:6528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a31d8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49511 expref: 300 pid: 7641 timeout: 1168 lvb_type: 0 00000100:00100000:1.0:1763343274.954222:0:6528:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7919c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6528:1848998412970624:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343274.954298:0:6528:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9180 going to sleep for 11 seconds 00000100:00100000:2.0:1763343274.954534:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.954802:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399861376 00000100:00100000:3.0:1763343274.954808:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399861376 00000100:00100000:3.0:1763343274.954848:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3758 00000100:00100000:3.0:1763343274.954856:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57131:x1848998399861376:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343274.955102:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57131:x1848998399861376:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 244us (566us total) trans 4294973613 rc 0/0 00000100:00100000:3.0:1763343274.955110:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3758 00000100:00100000:2.0:1763343274.955871:0:6528:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7919c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6528:1848998412970624:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343274.955893:0:6528:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3360 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT1 00000100:00100000:1.0:1763343274.955897:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.955950:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399861504 00000100:00100000:0.0:1763343274.955956:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399861504 00010000:00010000:0.0:1763343274.955979:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a31d8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49511 expref: 302 pid: 7641 timeout: 1168 lvb_type: 0 00000100:00100000:0.0:1763343274.956011:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3462 00000100:00100000:0.0:1763343274.956019:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:2408:x1848998399861504:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343274.956061:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343274.956067:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a31d8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49511 expref: 302 pid: 7641 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343274.956079:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a31d8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49511 expref: 302 pid: 7641 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343274.956099:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a31d8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49511 expref: 302 pid: 7641 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343274.956114:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c38f5d00) 00010000:00010000:0.0:1763343274.956119:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3360 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343274.956129:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3360 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343274.956136:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3360 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343274.956165:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343274.956196:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:2408:x1848998399861504:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 177us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343274.956202:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3462 00010000:00010000:2.0:1763343274.956238:0:6528:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3360 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343274.956246:0:6528:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3360 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT1 00000040:00080000:2.0:1763343274.956452:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1720, 88 off143208 00000004:00080000:2.0:1763343274.956460:0:6528:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1068080434883ns, next at 1069016426495ns, rc = 0 00000040:00080000:2.0:1763343274.956505:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1728, 88 off143864 00000004:00080000:2.0:1763343274.956510:0:6528:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1068080485052ns, next at 1069016397451ns, rc = 0 00000040:00080000:2.0:1763343274.956533:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1729, 88 off143952 00000004:00080000:2.0:1763343274.956537:0:6528:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1068080512680ns, next at 1069016397451ns, rc = 0 00000040:00080000:2.0:1763343274.956547:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1721, 88 off143296 00000004:00080000:2.0:1763343274.956551:0:6528:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1068080526045ns, next at 1069016426495ns, rc = 0 00000100:00100000:2.0:1763343274.957066:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.957110:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399861760 00000100:00100000:1.0:1763343274.957116:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399861760 00000100:00100000:1.0:1763343274.957158:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3759 00000100:00100000:1.0:1763343274.957166:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57131:x1848998399861760:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343274.958001:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57131:x1848998399861760:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 833us (933us total) trans 4294973615 rc 0/0 00000100:00100000:1.0:1763343274.958009:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3759 00000001:00080000:3.0:1763343274.959069:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973614 is committed 00000004:00080000:3.0:1763343274.959080:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1103 committed 00000004:00080000:3.0:1763343274.959091:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1111 committed 00000004:00080000:3.0:1763343274.959101:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1110 committed 00000004:00080000:3.0:1763343274.959103:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1102 committed 00000004:00080000:3.0:1763343274.959118:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1101 committed 00000004:00080000:3.0:1763343274.959120:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1109 committed 00010000:00010000:2.0:1763343274.959202:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a32a3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.959214:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a32a3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.959225:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a32a3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.959230:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c7ec1c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.959234:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a32a3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00000004:00010000:3.0:1763343274.959239:0:6528:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a4deb093 reply state 00000000859a1373 transno 4294973614 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3360 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343274.959241:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a32a3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.959256:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695000) 00010000:00010000:3.0:1763343274.959257:0:6528:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3360 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343274.959259:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.959274:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a32a3 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.959279:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c38f5d00) 00010000:00010000:3.0:1763343274.959281:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343274.959282:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a32a3 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343274.959283:0:6528:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343274.959288:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c38f5d00) 00010000:00010000:3.0:1763343274.959290:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763343274.959296:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a314c lrc: 0/0,0 mode: --/PW res: [0x240000404:0x203:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494e7 expref: 293 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.959299:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a32cd lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.959305:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a32cd lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.959309:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a32cd lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.959313:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd9a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.959315:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a32cd lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.959320:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a32cd lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.959328:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c38f5d00) 00010000:00010000:2.0:1763343274.959330:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.959333:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a32cd lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.959337:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a32cd lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.959346:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a331a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.959351:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a331a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.959356:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a331a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.959360:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c85aa600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.959363:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a331a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343274.959367:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a331a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00080000:3.0:1763343274.959372:0:6528:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00010000:00010000:2.0:1763343274.959374:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c38f5d00) 00010000:00010000:2.0:1763343274.959376:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.959379:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a331a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000100:00100000:3.0:1763343274.959383:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8443050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57127:x1848998399861120:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 5334us (5494us total) trans 4294973614 rc 0/0 00010000:00010000:2.0:1763343274.959384:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c85aa600/0x9104b1ba770a331a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000100:00100000:3.0:1763343274.959392:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3757 00010000:00010000:2.0:1763343274.959394:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a332f lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.959399:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a332f lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.959404:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a332f lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.959408:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c7ec0600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.959410:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a332f lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.959416:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a332f lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.959422:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695000) 00010000:00010000:2.0:1763343274.959424:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.959426:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a332f lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.959431:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a332f lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.959443:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3360 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343274.959450:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3360 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343274.959456:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3360 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343274.959461:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343274.959464:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3360 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343274.959470:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3360 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343274.959478:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c38f5d00) 00010000:00010000:3.0:1763343274.959480:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343274.959482:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3360 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343274.959488:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3360 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT1 00000100:00100000:1.0:1763343274.959787:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412970752:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343274.959834:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343274.959864:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c859a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412971264:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343274.959892:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343274.960193:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1763343274.960201:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412970880:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343274.960250:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412970752 00000100:00100000:0.0:1763343274.960259:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412970752 00000100:00100000:3.0:1763343274.960282:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412971264 00000100:00100000:3.0:1763343274.960286:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412971264 00000100:00100000:1.0:1763343274.960331:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343274.960451:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c859aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412971392:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343274.960474:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343274.960505:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412970880 00000100:00100000:0.0:1763343274.960508:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412970880 00000100:00100000:3.0:1763343274.960513:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7246 00000100:00100000:3.0:1763343274.960522:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3661:x1848998412970752:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343274.960531:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7247 00000100:00100000:0.0:1763343274.960536:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+21:3661:x1848998412971264:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343274.960549:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:699 count 1 00002000:00080000:0.0:1763343274.960549:0:27798:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:698 count 1 00010000:00010000:3.0:1763343274.960572:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a336e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2bb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.960572:0:27798:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a3367 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.960591:0:35266:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3256 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49549 expref: 14 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.960591:0:27798:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a325d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49550 expref: 20 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.960599:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343274.960602:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343274.960604:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343274.960606:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343274.960606:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a3367 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.960608:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a336e lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.960631:0:35266:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3256 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49549 expref: 14 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.960631:0:27798:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a325d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49550 expref: 20 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.960645:0:35266:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3256 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49549 expref: 14 pid: 35266 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343274.960645:0:27798:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a325d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49550 expref: 20 pid: 35266 timeout: 1168 lvb_type: 0 00000100:00100000:3.0:1763343274.960657:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412971776:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343274.960661:0:27798:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c859ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27798:1848998412971904:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343274.960703:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c5965540 going to sleep for 11 seconds 00000100:00100000:3.0:1763343274.960719:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412971392 00000100:00100000:3.0:1763343274.960722:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412971392 00000100:00100000:2.0:1763343274.960739:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7248 00000100:00100000:3.0:1763343274.960744:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7249 00000100:00100000:2.0:1763343274.960748:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3661:x1848998412970880:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343274.960749:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+22:3661:x1848998412971392:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343274.960758:0:8414:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:699 count 1 00002000:00080000:2.0:1763343274.960758:0:8626:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:700 count 1 00002000:00010000:3.0:1763343274.960778:0:8414:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1763343274.960778:0:8626:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343274.960784:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a337c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.960784:0:8626:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3375 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.960793:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.960793:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.960794:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343274.960795:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343274.960799:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a337c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.960799:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3375 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.960811:0:8626:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3375 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.960814:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a337c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.960820:0:8626:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3375 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.960821:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a337c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.960827:0:8626:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3375 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.960828:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a337c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.960843:0:8626:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1763343274.960847:0:8414:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1763343274.961091:0:27798:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401ed059000 going to sleep for 11 seconds 00010000:00010000:0.0:1763343274.961110:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763343274.961116:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3375 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.961123:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd8e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343274.961127:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3375 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.961136:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3375 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.961150:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3375 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.961158:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3375 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.961172:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343274.961176:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a337c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.961181:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb3e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343274.961184:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a337c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.961194:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a337c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.961204:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a337c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.961210:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a337c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.961220:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343274.961221:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343274.961223:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343274.961296:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412971008:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343274.961324:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343274.961346:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c859b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412971520:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343274.961368:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343274.961388:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1763343274.961393:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412971136:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343274.961412:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343274.961429:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c8599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412971648:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343274.961446:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343274.961466:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343274.961476:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412971008 00000100:00100000:1.0:1763343274.961480:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412971008 00000100:00100000:1.0:1763343274.961499:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412971520 00000100:00100000:1.0:1763343274.961501:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412971520 00000100:00100000:1.0:1763343274.961510:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412971136 00000100:00100000:1.0:1763343274.961512:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412971136 00000100:00100000:1.0:1763343274.961520:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412971648 00000100:00100000:1.0:1763343274.961522:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412971648 00000100:00100000:1.0:1763343274.961533:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7250 00000100:00100000:1.0:1763343274.961538:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+9:3659:x1848998412971008:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763343274.961623:0:28562:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2b9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343274.961626:0:28562:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2b9:0x0] updating lvb mtime from disk: 1763343274 -> 1763343274 00002000:00010000:1.0:1763343274.961629:0:28562:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2b9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343274.961631:0:28562:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2b9:0x0] updating lvb ctime from disk: 1763343274 -> 1763343274 00002000:00010000:1.0:1763343274.961633:0:28562:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2b9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343274.961665:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+10:3659:x1848998412971008:12345-0@lo:2:osp-syn-1-1.0 Request processed in 126us (339us total) trans 17179871930 rc 0/0 00000100:00100000:1.0:1763343274.961672:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7250 00000100:00100000:1.0:1763343274.961688:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7251 00000100:00100000:1.0:1763343274.961694:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+25:3659:x1848998412971520:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1763343274.961744:0:28562:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2b8:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763343274.961747:0:28562:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2b8:0x0] updating lvb mtime from disk: 1763343274 -> 1763343274 00002000:00010000:1.0:1763343274.961749:0:28562:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2b8:0x0] updating lvb atime from disk: 1763343273 -> 1763343273 00002000:00010000:1.0:1763343274.961752:0:28562:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2b8:0x0] updating lvb ctime from disk: 1763343274 -> 1763343274 00002000:00010000:1.0:1763343274.961754:0:28562:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2b8:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763343274.961779:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+26:3659:x1848998412971520:12345-0@lo:2:osp-syn-0-1.0 Request processed in 85us (410us total) trans 21474839201 rc 0/0 00000100:00100000:1.0:1763343274.961785:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7251 00000100:00100000:1.0:1763343274.961796:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7252 00000100:00100000:1.0:1763343274.961802:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+9:3659:x1848998412971136:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763343274.961848:0:28562:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2ba:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763343274.961851:0:28562:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2ba:0x0] updating lvb mtime from disk: 1763343274 -> 1763343274 00002000:00010000:1.0:1763343274.961853:0:28562:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2ba:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343274.961855:0:28562:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2ba:0x0] updating lvb ctime from disk: 1763343274 -> 1763343274 00002000:00010000:1.0:1763343274.961857:0:28562:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2ba:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763343274.961881:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+10:3659:x1848998412971136:12345-0@lo:2:osp-syn-1-1.0 Request processed in 79us (467us total) trans 17179871931 rc 0/0 00000100:00100000:1.0:1763343274.961887:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7252 00000100:00100000:1.0:1763343274.961899:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7253 00000100:00100000:1.0:1763343274.961903:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+25:3659:x1848998412971648:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1763343274.961946:0:28562:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2b9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343274.961949:0:28562:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2b9:0x0] updating lvb mtime from disk: 1763343274 -> 1763343274 00002000:00010000:1.0:1763343274.961950:0:28562:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2b9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343274.961952:0:28562:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2b9:0x0] updating lvb ctime from disk: 1763343274 -> 1763343274 00002000:00010000:1.0:1763343274.961954:0:28562:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2b9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343274.961977:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+26:3659:x1848998412971648:12345-0@lo:2:osp-syn-0-1.0 Request processed in 74us (530us total) trans 21474839202 rc 0/0 00000100:00100000:1.0:1763343274.961982:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7253 00000100:00100000:1.0:1763343274.962017:0:3659:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179871925 gen 2 00000004:00080000:1.0:1763343274.962057:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b9ce00, transno 17179871886 00000004:00080000:1.0:1763343274.962066:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400cc5de680, transno 17179871887 00000004:00080000:1.0:1763343274.962069:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400cc5de300, transno 17179871888 00000004:00080000:1.0:1763343274.962071:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b9f480, transno 17179871889 00000004:00080000:1.0:1763343274.962073:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401efc71180, transno 17179871890 00000004:00080000:1.0:1763343274.962075:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401efc71500, transno 17179871891 00000004:00080000:1.0:1763343274.962077:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c8bc3b80, transno 17179871892 00000004:00080000:1.0:1763343274.962080:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c8bc0000, transno 17179871893 00000004:00080000:1.0:1763343274.962083:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c2f86d80, transno 17179871895 00000004:00080000:1.0:1763343274.962085:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c2f84700, transno 17179871896 00000004:00080000:1.0:1763343274.962088:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c2f85180, transno 17179871897 00000004:00080000:1.0:1763343274.962090:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c2f84380, transno 17179871898 00000004:00080000:1.0:1763343274.962092:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5a3e300, transno 17179871901 00000004:00080000:1.0:1763343274.962095:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5a3d500, transno 17179871902 00000004:00080000:1.0:1763343274.962097:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c372b800, transno 17179871903 00000004:00080000:1.0:1763343274.962099:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c3728a80, transno 17179871904 00000004:00080000:1.0:1763343274.962102:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5a3c700, transno 17179871908 00000004:00080000:1.0:1763343274.962104:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5a3c380, transno 17179871909 00000004:00080000:1.0:1763343274.962106:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5a3ed80, transno 17179871910 00000004:00080000:1.0:1763343274.962108:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5a3d880, transno 17179871911 00000004:00080000:1.0:1763343274.962110:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c59b5500, transno 17179871912 00000004:00080000:1.0:1763343274.962112:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c59b7800, transno 17179871913 00000004:00080000:1.0:1763343274.962114:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c59b4380, transno 17179871914 00000004:00080000:1.0:1763343274.962117:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c59b4700, transno 17179871915 00000004:00080000:1.0:1763343274.962119:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6e8df80, transno 17179871917 00000004:00080000:1.0:1763343274.962122:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6e8ce00, transno 17179871918 00000004:00080000:1.0:1763343274.962124:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6b56a00, transno 17179871919 00000004:00080000:1.0:1763343274.962127:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6e8c380, transno 17179871920 00000004:00080000:1.0:1763343274.962129:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401efc70700, transno 17179871922 00000004:00080000:1.0:1763343274.962132:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc2ce00, transno 17179871923 00000004:00080000:1.0:1763343274.962134:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c59b6680, transno 17179871924 00000004:00080000:1.0:1763343274.962137:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c59b5f80, transno 17179871925 00000100:00100000:1.0:1763343274.962143:0:3659:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9400c5bfc380 x1848998412971136/t17179871931(17179871931) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763343290 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1763343274.962153:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bfc380/2, rc 0, transno 17179871931 00000100:00100000:1.0:1763343274.962157:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412971136:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763343274.962171:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c8599880/2, rc 0, transno 21474839202 00000100:00100000:1.0:1763343274.962176:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c8599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412971648:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763343274.962185:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bff800/2, rc 0, transno 17179871930 00000100:00100000:1.0:1763343274.962189:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412971008:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763343274.962198:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c859b800/2, rc 0, transno 21474839201 00000100:00100000:1.0:1763343274.962201:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c859b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412971520:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763343274.962383:0:9930:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 4 in progress, 2 in flight, 32 done 00000100:00100000:2.0:1763343274.962486:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3661:x1848998412970880:12345-0@lo:6:osp-syn-1-1.0 Request processed in 1739us (2154us total) trans 17179871929 rc 0/0 00000100:00100000:2.0:1763343274.962494:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7248 00000004:00080000:1.0:1763343274.962690:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bfe680/2, rc 0, transno 17179871929 00000100:00100000:1.0:1763343274.962695:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412970880:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343274.964614:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+25:3661:x1848998412971392:12345-0@lo:6:osp-syn-0-1.0 Request processed in 3854us (4130us total) trans 21474839200 rc 0/0 00000100:00100000:3.0:1763343274.964626:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7249 00000004:00080000:1.0:1763343274.964753:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c859aa00/2, rc 0, transno 21474839200 00000100:00100000:1.0:1763343274.964760:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c859aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412971392:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763343274.965096:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.965167:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.965239:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399862144 00000100:00100000:1.0:1763343274.965246:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399862144 00000100:00100000:1.0:1763343274.965500:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399862016 00000100:00100000:1.0:1763343274.965505:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399862016 00000100:00100000:2.0:1763343274.965753:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10665 00000100:00100000:2.0:1763343274.965763:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+290:57127:x1848998399862144:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343274.965794:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.965815:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a3383 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b495ab expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.965875:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a3383 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495ab expref: 291 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.965891:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9000/0x9104b1ba770a3383 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495ab expref: 291 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.965911:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c38f5d00) 00010000:00010000:2.0:1763343274.965914:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343274.965917:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5bd9000, rc 0) 00000100:00100000:1.0:1763343274.966114:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10666 00000100:00100000:1.0:1763343274.966123:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+291:55884:x1848998399862016:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343274.966132:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.966146:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a338a lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b495a4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.966275:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3391 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343274.966285:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3391 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.966299:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3391 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.966312:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3398 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343274.966319:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3398 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.966325:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3398 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.966394:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a339f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x206:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343274.966403:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a339f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.966410:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a339f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:1.0:1763343274.966421:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x206:0x0]: returning size 0 00010000:00010000:1.0:1763343274.966505:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3391 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.966513:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3391 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.966519:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3391 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.966525:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3391 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.966530:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.966535:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3391 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.966542:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3391 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.966553:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5800) 00010000:00010000:1.0:1763343274.966556:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.966559:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3391 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.966566:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3391 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.966578:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3398 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.966584:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3398 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.966589:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3398 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.966594:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343274.966597:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3398 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.966602:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3398 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.966609:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5b00) 00010000:00010000:1.0:1763343274.966612:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343274.966615:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3398 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.966624:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3398 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343274.966672:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a338a lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495a4 expref: 294 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.966687:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a339f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495a4 expref: 293 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.966694:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x206:0x0].0x0 (ffff9400c38f5e00) 00010000:00010000:1.0:1763343274.966696:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343274.966698:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177e00, rc 0) 00000100:00100000:2.0:1763343274.966870:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57127:x1848998399862144:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1108us (1775us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.966877:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10665 00000100:00100000:1.0:1763343274.967900:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:55884:x1848998399862016:12345-192.168.201.40@tcp:101:bash.0 Request processed in 1772us (2727us total) trans 4294973616 rc 0/0 00000100:00100000:1.0:1763343274.967908:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10666 00000100:00100000:2.0:1763343274.968612:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.968633:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.968638:0:27798:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c859ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27798:1848998412971904:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343274.968655:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399862272 00000100:00100000:2.0:1763343274.968661:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399862272 00010000:00010000:1.0:1763343274.968662:0:27798:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a3367 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.968689:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3256 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49549 expref: 15 pid: 35266 timeout: 1168 lvb_type: 0 00000100:00100000:2.0:1763343274.968717:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399862400 00000100:00100000:2.0:1763343274.968720:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399862400 00010000:00010000:2.0:1763343274.968733:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a325d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49550 expref: 21 pid: 35266 timeout: 1168 lvb_type: 0 00000100:00100000:2.0:1763343274.968753:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3463 00000100:00100000:2.0:1763343274.968760:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6507b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998399862272:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343274.968773:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343274.968778:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3256 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49549 expref: 15 pid: 35266 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343274.968788:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3256 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49549 expref: 15 pid: 35266 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343274.968820:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343274.968823:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1763343274.968823:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3464 00010000:00010000:2.0:1763343274.968827:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a336e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343274.968831:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6505880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399862400:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343274.968837:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a336e lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.968841:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343274.968846:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a325d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49550 expref: 21 pid: 35266 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343274.968853:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343274.968855:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a325d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49550 expref: 21 pid: 35266 timeout: 1168 lvb_type: 0 00010000:00010000:1.0:1763343274.968868:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a325d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49550 expref: 21 pid: 35266 timeout: 1168 lvb_type: 0 00010000:00010000:1.0:1763343274.968879:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.968880:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343274.968883:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a3367 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343274.968884:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6507b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998399862272:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 125us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.968890:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3463 00010000:00010000:1.0:1763343274.968898:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a3367 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.968915:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343274.968934:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6505880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399862400:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 105us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.968945:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3464 00010000:00010000:1.0:1763343274.968964:0:27798:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a3367 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.968971:0:27798:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a3367 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.968980:0:27798:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a3367 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.968987:0:27798:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a3367 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.969015:0:27798:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343274.969156:0:35266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3256 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49549 expref: 14 pid: 35266 timeout: 1168 lvb_type: 0 00000100:00100000:3.0:1763343274.969167:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412971776:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343274.969180:0:35266:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a336e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.969187:0:35266:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a336e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.969193:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a336e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.969205:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a336e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.969211:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a336e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.969232:0:35266:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1763343274.969243:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+25:3661:x1848998412971264:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8706us (9350us total) trans 21474839203 rc 0/0 00000100:00100000:1.0:1763343274.969251:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7247 00000004:00080000:1.0:1763343274.969307:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c859a680/2, rc 0, transno 21474839203 00000100:00100000:1.0:1763343274.969314:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c859a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412971264:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343274.969380:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3661:x1848998412970752:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8858us (9544us total) trans 17179871932 rc 0/0 00000100:00100000:3.0:1763343274.969387:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7246 00010000:00010000:0.0:1763343274.969660:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763343274.969668:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a3367 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.969675:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8692c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343274.969679:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a3367 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.969687:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a3367 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.969700:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a3367 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.969708:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a3367 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.969724:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343274.969728:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a336e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.969734:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b98200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343274.969737:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a336e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.969743:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a336e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.969754:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a336e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.969761:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a336e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.969772:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343274.969774:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343274.969776:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343274.970339:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343274.971462:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bfce00/2, rc 0, transno 17179871932 00000100:00100000:1.0:1763343274.971474:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412970752:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343274.973180:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.973224:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.973305:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399862528 00000100:00100000:1.0:1763343274.973315:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399862528 00000100:00100000:1.0:1763343274.973381:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10667 00000100:00100000:1.0:1763343274.973392:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:55884:x1848998399862528:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343274.973417:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343274.973440:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a33ad lrc: 2/0,0 mode: --/PR res: [0x240000404:0x206:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b495b2 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.973473:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a33b4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x206:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343274.973486:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a33b4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x206:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.973496:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a33b4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x206:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.973619:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a33ad lrc: 0/0,0 mode: --/PR res: [0x240000404:0x206:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495b2 expref: 294 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.973642:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a33b4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x206:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495b2 expref: 293 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.973650:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x206:0x0].0x0 (ffff9400c38f5e00) 00010000:00010000:1.0:1763343274.973653:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343274.973663:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176600, rc 0) 00000100:00100000:1.0:1763343274.973727:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:55884:x1848998399862528:12345-192.168.201.40@tcp:101:bash.0 Request processed in 337us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.973735:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10667 00000100:00100000:3.0:1763343274.974164:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399862784 00000100:00100000:3.0:1763343274.974170:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399862784 00000100:00100000:3.0:1763343274.974202:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3760 00000100:00100000:3.0:1763343274.974209:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57127:x1848998399862784:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:3.0:1763343274.974730:0:6528:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x203:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1763343274.974883:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1722, 64 off143360 00000040:00080000:3.0:1763343274.974909:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1730, 64 off144016 00000040:00080000:3.0:1763343274.974918:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1731, 64 off144080 00000040:00080000:3.0:1763343274.974929:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1723, 64 off143424 00010000:00010000:3.0:1763343274.975188:0:6528:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a33bb lrc: 3/0,1 mode: --/PW res: [0x240000404:0x203:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 00010000:00010000:3.0:1763343274.975202:0:6528:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a33bb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x203:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343274.975212:0:6528:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a33bb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x203:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343274.975223:0:6528:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a33bb lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x203:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343274.975229:0:6528:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a33bb lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x203:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343274.975234:0:6528:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a33bb lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x203:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343274.975257:0:6528:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343274.975458:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.975522:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399863040 00000100:00100000:2.0:1763343274.975530:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399863040 00000100:00100000:2.0:1763343274.975581:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10668 00000100:00100000:2.0:1763343274.975590:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:55884:x1848998399863040:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:2.0:1763343274.975627:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343274.975644:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a339f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495a4 expref: 295 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.975658:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x206:0x0].0x0 (ffff9400c38f5e00) 00010000:00010000:2.0:1763343274.975661:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343274.975688:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343274.975696:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a33bb lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x203:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT1 00010000:00010000:1.0:1763343274.975705:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c7bb3e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343274.975709:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a33bb lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x203:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT1 00010000:00010000:1.0:1763343274.975718:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a33bb lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x203:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT1 00010000:00010000:1.0:1763343274.975728:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x203:0x0].0x0 (ffff9400c38f5d00) 00010000:00010000:1.0:1763343274.975732:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763343274.975736:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a33bb lrc: 1/0,0 mode: --/PW res: [0x240000404:0x203:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT1 00010000:00010000:1.0:1763343274.975743:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c7bb3e00/0x9104b1ba770a33bb lrc: 0/0,0 mode: --/PW res: [0x240000404:0x203:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT1 00010000:00010000:1.0:1763343274.975757:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343274.975759:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343274.975780:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a33c2 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x206:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343274.975791:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a33c2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x206:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.975799:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a33c2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x206:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000001:00080000:2.0:1763343274.975838:0:6524:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973618 00000100:00100000:3.0:1763343274.975847:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57127:x1848998399862784:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1636us (2620us total) trans 4294973617 rc 0/0 00000100:00100000:3.0:1763343274.975857:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3760 00000004:00010000:2.0:1763343274.975862:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f97904ee reply state 0000000029121659 transno 4294973619 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a33c2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x206:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.975875:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a33c2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x206:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.975881:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x206:0x0].0x0 (ffff9400c38f5e00) 00010000:00010000:2.0:1763343274.975883:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343274.975886:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343274.975902:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343274.975937:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:55884:x1848998399863040:12345-192.168.201.40@tcp:36:bash.0 Request processed in 348us (480us total) trans 4294973619 rc 0/0 00000100:00100000:2.0:1763343274.975945:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10668 00000020:00080000:2.0:1763343274.975950:0:6524:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343274.982062:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.982120:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399863296 00000100:00100000:0.0:1763343274.982136:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399863296 00000100:00100000:1.0:1763343274.982143:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343274.982191:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399863424 00000100:00100000:2.0:1763343274.982196:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399863424 00000100:00100000:0.0:1763343274.982204:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10669 00000100:00100000:0.0:1763343274.982218:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57127:x1848998399863296:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:1.0:1763343274.982238:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10670 00010000:00010000:0.0:1763343274.982247:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1763343274.982253:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:55884:x1848998399863424:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343274.982277:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343274.982287:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a33c9 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b495b9 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.982290:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a33d0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x206:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b495c0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.982347:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a33d0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495c0 expref: 299 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343274.982361:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a33d0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495c0 expref: 299 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.982371:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a33d7 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343274.982378:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x206:0x0].0x0 (ffff9400c38f5e00) 00010000:00010000:0.0:1763343274.982382:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a33d7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343274.982383:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343274.982389:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176c00, rc 0) 00010000:00010000:0.0:1763343274.982395:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a33d7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.982408:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a33de lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343274.982414:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a33de lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.982420:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a33de lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:1.0:1763343274.982454:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:55884:x1848998399863424:12345-192.168.201.40@tcp:101:bash.0 Request processed in 206us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343274.982461:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10670 00010000:00010000:0.0:1763343274.982522:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a33e5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x206:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343274.982531:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a33e5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.982538:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a33e5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343274.982547:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x206:0x0]: returning size 0 00010000:00010000:0.0:1763343274.982631:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a33d7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.982642:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a33d7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.982647:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a33d7 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.982655:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a33d7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.982660:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8693c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343274.982664:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a33d7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.982671:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a33d7 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.982681:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48aa600) 00010000:00010000:0.0:1763343274.982683:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343274.982687:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a33d7 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.982693:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a33d7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.983677:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a33de lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.983683:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a33de lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.983689:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a33de lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.983694:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8693e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343274.983702:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a33de lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.983708:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a33de lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.983719:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48aa900) 00010000:00010000:0.0:1763343274.983721:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343274.983724:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a33de lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.983729:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a33de lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.983775:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a33c9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495b9 expref: 300 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.983787:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a33e5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495b9 expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.983793:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x206:0x0].0x0 (ffff9400c38f5e00) 00010000:00010000:0.0:1763343274.983796:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343274.983798:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c7ec0600, rc 0) 00000100:00100000:0.0:1763343274.983852:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57127:x1848998399863296:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1639us (1830us total) trans 4294973620 rc 0/0 00000100:00100000:0.0:1763343274.983859:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10669 00000100:00100000:1.0:1763343274.990328:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.990421:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399863680 00000100:00100000:0.0:1763343274.990432:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399863680 00000100:00100000:0.0:1763343274.990493:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10671 00000100:00100000:0.0:1763343274.990503:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:55884:x1848998399863680:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343274.990527:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343274.990530:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343274.990557:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a33d0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495c0 expref: 299 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.990576:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x206:0x0].0x0 (ffff9400c38f5e00) 00010000:00010000:0.0:1763343274.990581:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343274.990595:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a33f3 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x206:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b495c7 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.990642:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a33fa lrc: 3/0,1 mode: --/EX res: [0x240000404:0x206:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343274.990656:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a33e5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495b9 expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.990664:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a33fa lrc: 4/0,1 mode: --/EX res: [0x240000404:0x206:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343274.990696:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a33e5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495b9 expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.990709:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a33e5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495b9 expref: 299 pid: 7641 timeout: 1168 lvb_type: 0 00000100:00100000:0.0:1763343274.990724:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412972032:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343274.990963:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c546e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343274.991651:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343274.991799:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399863808 00000100:00100000:0.0:1763343274.991807:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399863808 00000100:00100000:0.0:1763343274.991966:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7254 00000100:00100000:0.0:1763343274.991975:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399863808:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343274.991988:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343274.992006:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a3401 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b495ce expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343274.992078:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343274.992096:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.992099:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343274.992109:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a3401 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495ce expref: 21 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343274.992124:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a3401 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495ce expref: 21 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343274.992136:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3916200, rc 0) 00000100:00100000:0.0:1763343274.992186:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399863808:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 213us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343274.992194:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7254 00000100:00100000:0.0:1763343274.994829:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412972032:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343274.994861:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a33fa lrc: 3/0,1 mode: --/EX res: [0x240000404:0x206:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:1.0:1763343274.994916:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343274.995000:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343274.995120:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399863936 00000100:00100000:3.0:1763343274.995128:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399863936 00010000:00010000:3.0:1763343274.995164:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a33e5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495b9 expref: 300 pid: 7641 timeout: 1168 lvb_type: 0 00000100:00100000:3.0:1763343274.995198:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3465 00000100:00100000:3.0:1763343274.995207:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:2408:x1848998399863936:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343274.995226:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1763343274.995273:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399864064 00000100:00100000:2.0:1763343274.995278:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399864064 00010000:00010000:3.0:1763343274.995315:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a33e5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495b9 expref: 301 pid: 7641 timeout: 1168 lvb_type: 0 00000100:00100000:2.0:1763343274.995321:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10672 00000100:00100000:2.0:1763343274.995334:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57127:x1848998399864064:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343274.995336:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a33e5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495b9 expref: 301 pid: 7641 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343274.995360:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343274.995379:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3408 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x206:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b495d5 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.995483:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a33e5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495b9 expref: 302 pid: 7641 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343274.995498:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a33fa lrc: 3/0,1 mode: --/EX res: [0x240000404:0x206:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.995514:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3408 lrc: 4/0,0 mode: --/CR res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495d5 expref: 301 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.995524:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x206:0x0].0x0 (ffff9400c38f5e00) 00010000:00010000:3.0:1763343274.995533:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a33fa lrc: 4/0,1 mode: --/EX res: [0x240000404:0x206:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000020 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.995542:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a33fa lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000020 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.995548:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a33fa lrc: 5/0,1 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000020 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343274.995557:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3408 lrc: 4/0,0 mode: --/CR res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495d5 expref: 301 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.995568:0:33856:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a33fa lrc: 5/0,1 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343274.995583:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3408 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495d5 expref: 301 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343274.995587:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343274.995595:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x206:0x0].0x0 (ffff9400c38f5e00) 00010000:00010000:2.0:1763343274.995600:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343274.995604:0:33856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3408 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495d5 expref: 301 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343274.995611:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5bd8e00, rc 0) 00000100:00100000:3.0:1763343274.995646:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:2408:x1848998399863936:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 439us (730us total) trans 0 rc 0/0 00010000:00010000:0.0:1763343274.995652:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a33fa lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343274.995654:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3465 00010000:00010000:0.0:1763343274.995659:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a33fa lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343274.995688:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57127:x1848998399864064:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 353us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343274.995696:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10672 00000040:00080000:0.0:1763343274.995906:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1724, 88 off143512 00000004:00080000:0.0:1763343274.995913:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1068119888507ns, next at 1069016426495ns, rc = 0 00000040:00080000:0.0:1763343274.995953:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1732, 88 off144168 00000004:00080000:0.0:1763343274.995958:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1068119933526ns, next at 1069016397451ns, rc = 0 00000040:00080000:0.0:1763343274.995993:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1733, 88 off144256 00000004:00080000:0.0:1763343274.995999:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1068119973972ns, next at 1069016397451ns, rc = 0 00000040:00080000:0.0:1763343274.996013:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1725, 88 off143600 00000004:00080000:0.0:1763343274.996017:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1068119992116ns, next at 1069016426495ns, rc = 0 00000001:00080000:3.0:1763343274.998522:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973621 is committed 00000004:00080000:3.0:1763343274.998535:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1105 committed 00000004:00080000:3.0:1763343274.998544:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1113 committed 00000004:00080000:3.0:1763343274.998555:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1112 committed 00000004:00080000:3.0:1763343274.998558:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1104 committed 00010000:00010000:2.0:1763343274.998643:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a33c2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x206:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.998656:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a33c2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x206:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.998664:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a33c2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x206:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.998671:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd9a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343274.998676:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a33c2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x206:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.998685:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a33c2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x206:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.998702:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x206:0x0].0x0 (ffff9400c38f5e00) 00010000:00010000:2.0:1763343274.998706:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343274.998712:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a33c2 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x206:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343274.998718:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a33c2 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x206:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000100:00100000:1.0:1763343274.998795:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412972288:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763343274.998840:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a33fa lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x206:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495c7 expref: 293 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.998851:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x206:0x0].0x0 (ffff9400c38f5e00) 00010000:00010000:0.0:1763343274.998853:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343274.998858:0:7641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3408 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495d5 expref: 293 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343274.998861:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763343274.998875:0:7641:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3408 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495d5 expref: 293 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343274.998884:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3408 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495d5 expref: 293 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343274.998903:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763343274.998911:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412972160:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763343274.998919:0:7641:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3408 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495d5 expref: 293 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343274.998931:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc70700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412972672:192.168.201.40@tcp:105: 00000100:00100000:1.0:1763343274.998938:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343274.998992:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc440a80 going to sleep for 11 seconds 00000100:00100000:2.0:1763343274.999106:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412972416:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343274.999312:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412972544:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343274.999337:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343274.999751:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412973184:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343274.999780:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343274.999841:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c2f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412972800:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343274.999872:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343275.000291:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763343275.000293:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763343275.000300:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c2f85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412972928:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343275.000305:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c2f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412973056:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343275.000338:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343275.000358:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412972288 00000100:00100000:1.0:1763343275.000366:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412972288 00000100:00100000:0.0:1763343275.000379:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412972160 00000100:00100000:0.0:1763343275.000385:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412972160 00000100:00100000:1.0:1763343275.000413:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412972544 00000100:00100000:1.0:1763343275.000418:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412972544 00000100:00100000:0.0:1763343275.000419:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412973184 00000100:00100000:0.0:1763343275.000424:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412973184 00000100:00100000:1.0:1763343275.000442:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412972800 00000100:00100000:1.0:1763343275.000446:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412972800 00000100:00100000:0.0:1763343275.000456:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412972928 00000100:00100000:0.0:1763343275.000460:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412972928 00000100:00100000:1.0:1763343275.000469:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7255 00000100:00100000:1.0:1763343275.000479:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+27:3662:x1848998412972288:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343275.000484:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7256 00000100:00100000:0.0:1763343275.000493:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+27:3662:x1848998412972160:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763343275.000508:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:697 count 1 00002000:00080000:0.0:1763343275.000509:0:8412:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:696 count 1 00010000:00010000:0.0:1763343275.000536:0:8412:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a340f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.000537:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176400/0x9104b1ba770a3416 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.000569:0:35266:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba770a32f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4957a expref: 20 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.000570:0:8412:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3336 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49596 expref: 20 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.000589:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343275.000590:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343275.000594:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343275.000595:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343275.000598:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a340f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.000600:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176400/0x9104b1ba770a3416 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.000640:0:8412:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3336 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49596 expref: 20 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.000642:0:35266:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba770a32f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4957a expref: 20 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.000666:0:8412:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3336 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49596 expref: 20 pid: 27798 timeout: 1168 lvb_type: 0 00010000:00010000:1.0:1763343275.000667:0:35266:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba770a32f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4957a expref: 20 pid: 27798 timeout: 1168 lvb_type: 0 00000100:00100000:1.0:1763343275.000692:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35266:1848998412973440:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343275.000695:0:8412:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6e8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998412973312:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343275.000750:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c3be3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1763343275.000750:0:8412:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c1370240 going to sleep for 11 seconds 00000100:00100000:0.0:1763343275.000773:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7257 00000100:00100000:0.0:1763343275.000781:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+27:3660:x1848998412972544:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343275.000945:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+28:3660:x1848998412972544:12345-0@lo:2:osp-syn-0-1.0 Request processed in 163us (1606us total) trans 21474839204 rc 0/0 00000100:00100000:1.0:1763343275.002182:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7258 00000100:00100000:1.0:1763343275.002204:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+11:3660:x1848998412973184:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343275.002470:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+12:3660:x1848998412973184:12345-0@lo:2:osp-syn-1-1.0 Request processed in 271us (2688us total) trans 17179871933 rc 0/0 00000100:00100000:1.0:1763343275.002479:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7258 00000100:00100000:1.0:1763343275.002503:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7259 00000100:00100000:1.0:1763343275.002511:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+11:3661:x1848998412972800:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343275.002760:0:11289:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:697 count 1 00010000:00010000:1.0:1763343275.002782:0:11289:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a341d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.002802:0:11289:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a30e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494cb expref: 13 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.002810:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343275.002812:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343275.002816:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a341d lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.002850:0:11289:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a30e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494cb expref: 13 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.002864:0:11289:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a30e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494cb expref: 13 pid: 27798 timeout: 1168 lvb_type: 0 00000100:00100000:1.0:1763343275.002878:0:11289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11289:1848998412973568:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343275.002939:0:11289:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c32170c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343275.002972:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7260 00000100:00100000:1.0:1763343275.002982:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+11:3661:x1848998412972928:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343275.002997:0:27798:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:698 count 1 00010000:00010000:1.0:1763343275.003009:0:27798:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3424 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.003021:0:27798:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a32d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4956c expref: 13 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.003048:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343275.003050:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343275.003054:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3424 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.003077:0:27798:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a32d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4956c expref: 13 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.003087:0:27798:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a32d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4956c expref: 13 pid: 35266 timeout: 1168 lvb_type: 0 00000100:00100000:1.0:1763343275.003103:0:27798:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:27798:1848998412973696:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343275.003129:0:27798:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9180 going to sleep for 11 seconds 00000100:00100000:1.0:1763343275.003258:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.003686:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7257 00000100:00100000:0.0:1763343275.003731:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343275.003759:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412973056 00000100:00100000:2.0:1763343275.003768:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412973056 00000004:00080000:0.0:1763343275.003779:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6b56a00/2, rc 0, transno 17179871933 00000100:00100000:0.0:1763343275.003787:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412973184:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763343275.003803:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401efc71500/2, rc 0, transno 21474839204 00000100:00100000:0.0:1763343275.003807:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412972544:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343275.003821:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7261 00000100:00100000:3.0:1763343275.003833:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+12:3660:x1848998412973056:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343275.003849:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc70700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412972672:192.168.201.40@tcp:105: 00010000:00010000:0.0:1763343275.003886:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a33f3 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495c7 expref: 293 pid: 7641 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763343275.003908:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a33fa lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x206:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495c7 expref: 292 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.003942:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c7ec0c00, rc 0) 00000100:00100000:0.0:1763343275.003990:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:55884:x1848998399863680:12345-192.168.201.40@tcp:101:bash.0 Request processed in 13487us (13671us total) trans 4294973621 rc 0/0 00000100:00100000:3.0:1763343275.003994:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+13:3660:x1848998412973056:12345-0@lo:2:osp-syn-1-1.0 Request processed in 162us (260us total) trans 17179871934 rc 0/0 00000100:00100000:0.0:1763343275.004002:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10671 00000100:00100000:3.0:1763343275.004008:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7261 00000100:00080000:3.0:1763343275.004054:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1763343275.004060:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1763343275.004084:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c2f84380/2, rc 0, transno 17179871934 00000100:00100000:3.0:1763343275.004089:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c2f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412973056:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343275.004111:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399864192 00000100:00100000:3.0:1763343275.004115:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399864192 00000100:00100000:3.0:1763343275.004166:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3761 00000100:00100000:3.0:1763343275.004172:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57127:x1848998399864192:12345-192.168.201.40@tcp:49:lfs.0 00000100:00100000:3.0:1763343275.004252:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57127:x1848998399864192:12345-192.168.201.40@tcp:49:lfs.0 Request processed in 80us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343275.004259:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3761 00000100:00080000:0.0:1763343275.004835:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1763343275.005809:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343275.005876:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412972416 00000100:00100000:0.0:1763343275.005885:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412972416 00000100:00100000:0.0:1763343275.005941:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7262 00000100:00100000:0.0:1763343275.005950:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401ede69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+28:3659:x1848998412972416:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763343275.006125:0:8414:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2bc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343275.006129:0:8414:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2bc:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343275.006131:0:8414:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343275.006133:0:8414:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2bc:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343275.006135:0:8414:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2bc:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343275.006208:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401ede69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+29:3659:x1848998412972416:12345-0@lo:2:osp-syn-0-1.0 Request processed in 259us (401us total) trans 21474839205 rc 0/0 00000100:00100000:0.0:1763343275.006216:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7262 00000004:00080000:1.0:1763343275.006249:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401efc71180/2, rc 0, transno 21474839205 00000100:00100000:1.0:1763343275.006258:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412972416:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343275.007334:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.008210:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35266:1848998412973440:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343275.008238:0:35266:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5176400/0x9104b1ba770a3416 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343275.008345:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399864320 00000100:00100000:2.0:1763343275.008353:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399864320 00010000:00010000:2.0:1763343275.008404:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba770a32f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4957a expref: 21 pid: 27798 timeout: 1168 lvb_type: 0 00000100:00100000:2.0:1763343275.008435:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3466 00000100:00100000:2.0:1763343275.008443:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2410:x1848998399864320:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343275.008458:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343275.008463:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba770a32f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4957a expref: 21 pid: 27798 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343275.008473:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba770a32f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4957a expref: 21 pid: 27798 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343275.008500:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb3800/0x9104b1ba770a32f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4957a expref: 21 pid: 27798 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343275.008515:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.008517:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.008522:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176400/0x9104b1ba770a3416 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.008532:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176400/0x9104b1ba770a3416 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.008551:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343275.008595:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2410:x1848998399864320:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 153us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.008602:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3466 00010000:00010000:1.0:1763343275.008805:0:35266:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5176400/0x9104b1ba770a3416 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.008813:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5176400/0x9104b1ba770a3416 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.008823:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176400/0x9104b1ba770a3416 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.008829:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176400/0x9104b1ba770a3416 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.008849:0:35266:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343275.009085:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+29:3662:x1848998412972288:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8607us (10225us total) trans 21474839206 rc 0/0 00000100:00100000:1.0:1763343275.009095:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7255 00000004:00080000:1.0:1763343275.009135:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c390c000/2, rc 0, transno 21474839206 00000100:00100000:1.0:1763343275.009143:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412972288:0@lo:6:osp-syn-0-1.0 00000100:00080000:0.0:1763343275.009371:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1763343275.009766:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343275.009774:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5176400/0x9104b1ba770a3416 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.009783:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176400 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343275.009787:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5176400/0x9104b1ba770a3416 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.009797:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5176400/0x9104b1ba770a3416 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.009813:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5176400/0x9104b1ba770a3416 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.009822:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176400/0x9104b1ba770a3416 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.009841:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343275.009843:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343275.009844:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343275.010396:0:8412:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6e8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998412973312:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343275.010419:0:8412:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a340f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343275.010458:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.010489:0:11289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11289:1848998412973568:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343275.010505:0:11289:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a341d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343275.010554:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399864576 00000100:00100000:0.0:1763343275.010563:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399864576 00010000:00010000:0.0:1763343275.010606:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a32d4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4956c expref: 14 pid: 35266 timeout: 1168 lvb_type: 0 00000100:00100000:0.0:1763343275.010637:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3467 00000100:00100000:1.0:1763343275.010644:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.010650:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399864576:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343275.010664:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1763343275.010670:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399864448 00010000:00010000:0.0:1763343275.010671:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a32d4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4956c expref: 14 pid: 35266 timeout: 1168 lvb_type: 0 00000100:00100000:1.0:1763343275.010675:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399864448 00010000:00010000:0.0:1763343275.010687:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a32d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4956c expref: 14 pid: 35266 timeout: 1168 lvb_type: 0 00000100:00080000:3.0:1763343275.010690:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1763343275.010700:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3336 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49596 expref: 20 pid: 27798 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343275.010711:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.010715:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.010720:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3424 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.010729:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3424 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343275.010731:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3468 00000100:00100000:1.0:1763343275.010742:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8390450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2408:x1848998399864448:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343275.010752:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343275.010753:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343275.010761:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3336 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49596 expref: 20 pid: 27798 timeout: 1168 lvb_type: 0 00010000:00010000:1.0:1763343275.010774:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3336 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49596 expref: 20 pid: 27798 timeout: 1168 lvb_type: 0 00010000:00010000:1.0:1763343275.010790:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c7bb2400/0x9104b1ba770a3336 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49596 expref: 20 pid: 27798 timeout: 1168 lvb_type: 0 00000100:00100000:0.0:1763343275.010804:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399864576:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 156us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.010812:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3467 00000100:00100000:3.0:1763343275.010839:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.010863:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399864704 00000100:00100000:0.0:1763343275.010869:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399864704 00010000:00010000:2.0:1763343275.010875:0:27798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a32d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4956c expref: 14 pid: 35266 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343275.010886:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a30e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494cb expref: 14 pid: 27798 timeout: 1168 lvb_type: 0 00000100:00100000:2.0:1763343275.010892:0:27798:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:27798:1848998412973696:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343275.010911:0:27798:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3424 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343275.010918:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3469 00010000:00010000:2.0:1763343275.010925:0:27798:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3424 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343275.010931:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2408:x1848998399864704:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343275.010942:0:27798:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3424 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.010945:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343275.010954:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a30e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494cb expref: 13 pid: 27798 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343275.010958:0:27798:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3424 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.010980:0:27798:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3424 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.010986:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a30e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494cb expref: 13 pid: 27798 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343275.011004:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a30e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b494cb expref: 13 pid: 27798 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343275.011011:0:27798:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343275.011014:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.011017:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.011020:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a341d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.011050:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a341d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.011069:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343275.011097:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:2408:x1848998399864704:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 170us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.011105:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3469 00010000:00010000:0.0:1763343275.011126:0:11289:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a341d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.011135:0:11289:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a341d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.011143:0:11289:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a341d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.011156:0:11289:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a341d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.011172:0:11289:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1763343275.011379:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+14:3661:x1848998412972800:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8868us (11504us total) trans 17179871936 rc 0/0 00000100:00100000:2.0:1763343275.011381:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+14:3661:x1848998412972928:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8399us (11042us total) trans 17179871935 rc 0/0 00000100:00100000:0.0:1763343275.011394:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7259 00010000:00010000:0.0:1763343275.011415:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763343275.011421:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3424 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.011429:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343275.011433:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3424 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.011437:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343275.011443:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3424 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.011445:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a341d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.011465:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343275.011469:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a341d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.011470:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3424 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.011488:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a341d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.011489:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3424 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.011514:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a341d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.011520:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343275.011523:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a341d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.011524:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.011528:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343275.011544:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343275.011547:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343275.011549:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343275.011560:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c2f85180/2, rc 0, transno 17179871935 00000100:00100000:0.0:1763343275.011566:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c2f85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412972928:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1763343275.011577:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c2f84700/2, rc 0, transno 17179871936 00000100:00100000:0.0:1763343275.011582:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c2f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412972800:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1763343275.011615:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.011618:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.011622:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a340f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.011635:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a340f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.011657:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343275.011681:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8390450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2408:x1848998399864448:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 940us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343275.011688:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3468 00000100:00100000:2.0:1763343275.011875:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7260 00000100:00100000:3.0:1763343275.012438:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.012474:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.012482:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399864832 00000100:00100000:2.0:1763343275.012489:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399864832 00000100:00100000:1.0:1763343275.012520:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399865088 00000100:00100000:1.0:1763343275.012525:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399865088 00000100:00100000:1.0:1763343275.012552:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3762 00000100:00100000:1.0:1763343275.012559:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+292:57127:x1848998399865088:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343275.012566:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7263 00000100:00100000:2.0:1763343275.012572:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:55884:x1848998399864832:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343275.012583:0:27798:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.012596:0:27798:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a342b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b495dc expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.012615:0:27798:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a3401 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495ce expref: 20 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343275.012622:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.012623:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.012627:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a342b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495dc expref: 20 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.012651:0:27798:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a3401 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495ce expref: 20 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343275.012663:0:27798:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a3401 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495ce expref: 20 pid: 35266 timeout: 1168 lvb_type: 1 00000100:00100000:2.0:1763343275.012674:0:27798:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6504000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27798:1848998412973824:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343275.012729:0:27798:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c29c40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343275.012735:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57127:x1848998399865088:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 176us (261us total) trans 4294973622 rc 0/0 00000100:00100000:1.0:1763343275.012741:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3762 00010000:00010000:0.0:1763343275.014751:0:8412:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a340f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.014771:0:8412:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a340f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.014783:0:8412:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a340f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.014791:0:8412:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a340f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.014876:0:8412:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343275.014908:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343275.014920:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a340f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.014930:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917a00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343275.014936:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a340f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.014948:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a340f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.014974:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a340f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.014982:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a340f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.015010:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343275.015012:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343275.015014:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343275.015383:0:27798:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6504000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27798:1848998412973824:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343275.015410:0:27798:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a342b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495dc expref: 20 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.015427:0:27798:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3c00, rc 0) 00000100:00100000:2.0:1763343275.015561:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:55884:x1848998399864832:12345-192.168.201.40@tcp:101:bash.0 Request processed in 2985us (3121us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.015583:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+29:3662:x1848998412972160:12345-0@lo:6:osp-syn-0-1.0 Request processed in 15088us (16642us total) trans 21474839207 rc 0/0 00000100:00100000:0.0:1763343275.015594:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7256 00000004:00080000:1.0:1763343275.015608:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c390dc00/2, rc 0, transno 21474839207 00000100:00100000:1.0:1763343275.015616:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412972160:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763343275.015858:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7263 00000100:00100000:2.0:1763343275.017236:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.017320:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399865472 00000100:00100000:1.0:1763343275.017330:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399865472 00010000:00010000:1.0:1763343275.017364:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a3401 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495ce expref: 20 pid: 35266 timeout: 1168 lvb_type: 1 00000100:00100000:1.0:1763343275.017406:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3470 00000100:00100000:1.0:1763343275.017416:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6504000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2408:x1848998399865472:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343275.017431:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343275.017437:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a3401 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495ce expref: 20 pid: 35266 timeout: 1168 lvb_type: 1 00010000:00010000:1.0:1763343275.017450:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a3401 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495ce expref: 20 pid: 35266 timeout: 1168 lvb_type: 1 00010000:00010000:1.0:1763343275.017473:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a3401 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495ce expref: 20 pid: 35266 timeout: 1168 lvb_type: 1 00010000:00010000:1.0:1763343275.017487:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.017489:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.017497:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a342b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495dc expref: 19 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.017507:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a342b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495dc expref: 19 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.017544:0:7904:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a342b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495dc expref: 19 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343275.017558:0:7904:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7904:1848998412973952:192.168.201.40@tcp:105: 00000100:00100000:1.0:1763343275.017636:0:7904:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd0300 going to sleep for 11 seconds 00000100:00100000:3.0:1763343275.017689:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.018196:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399865344 00000100:00100000:1.0:1763343275.018203:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399865344 00000100:00100000:1.0:1763343275.018243:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10673 00000100:00100000:1.0:1763343275.018251:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57127:x1848998399865344:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343275.018281:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343275.018303:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a3432 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b495e3 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.018381:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a3439 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343275.018397:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a3439 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.018409:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a3439 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.018421:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3440 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343275.018428:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3440 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.018435:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3440 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.018547:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a3447 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x206:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343275.018557:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a3447 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.018564:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a3447 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343275.018574:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x206:0x0]: returning size 2 00010000:00010000:1.0:1763343275.018663:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a3439 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.018671:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a3439 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.018677:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a3439 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.018684:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a3439 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.018689:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343275.018694:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a3439 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.018701:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a3439 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.018713:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fc4f1100) 00010000:00010000:1.0:1763343275.018716:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343275.018721:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a3439 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.018727:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a3439 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.018740:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3440 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.018746:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3440 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.018752:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3440 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.018757:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343275.018761:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3440 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.018771:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3440 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.018791:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fc4f1000) 00010000:00010000:1.0:1763343275.018794:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343275.018797:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3440 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.018803:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3440 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.018844:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a3432 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495e3 expref: 296 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.018859:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a3447 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495e3 expref: 295 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.018868:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x206:0x0].0x0 (ffff9400c38f5e00) 00010000:00010000:1.0:1763343275.018870:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343275.018873:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177000, rc 0) 00000100:00100000:1.0:1763343275.018931:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57127:x1848998399865344:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 679us (1242us total) trans 4294973623 rc 0/0 00000100:00100000:1.0:1763343275.018939:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10673 00000100:00100000:1.0:1763343275.021940:0:7904:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7904:1848998412973952:192.168.201.40@tcp:105: 00010000:00010000:1.0:1763343275.021969:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343275.022048:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6504000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2408:x1848998399865472:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 4631us (4817us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343275.022059:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3470 00000100:00100000:2.0:1763343275.022294:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.022342:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.022385:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399865856 00000100:00100000:1.0:1763343275.022393:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399865856 00000100:00100000:0.0:1763343275.022416:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399865600 00000100:00100000:0.0:1763343275.022423:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399865600 00000100:00100000:1.0:1763343275.022439:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3763 00000100:00100000:1.0:1763343275.022450:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8442450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57127:x1848998399865856:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343275.022462:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7264 00000100:00100000:0.0:1763343275.022472:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:55884:x1848998399865600:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343275.022483:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.022504:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3455 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b495ea expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343275.022526:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343275.022543:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.022546:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.022555:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3455 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495ea expref: 13 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.022570:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3455 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495ea expref: 13 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.022582:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917000, rc 0) 00000100:00100000:0.0:1763343275.022613:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:55884:x1848998399865600:12345-192.168.201.40@tcp:101:bash.0 Request processed in 143us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.022620:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7264 00000100:00100000:1.0:1763343275.022633:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8442450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57127:x1848998399865856:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 184us (288us total) trans 4294973624 rc 0/0 00000100:00100000:1.0:1763343275.022643:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3763 00000100:00100000:2.0:1763343275.025655:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.025711:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399865984 00000100:00100000:1.0:1763343275.025722:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399865984 00000100:00100000:1.0:1763343275.025785:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3764 00000100:00100000:1.0:1763343275.025795:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57127:x1848998399865984:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:0.0:1763343275.025877:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.026111:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57127:x1848998399865984:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 316us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343275.026119:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3764 00000100:00100000:2.0:1763343275.026198:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399866240 00000100:00100000:2.0:1763343275.026204:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399866240 00000100:00100000:3.0:1763343275.026229:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00002000:00010000:2.0:1763343275.026232:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/701 (0->18446744073709551615) 00002000:00100000:2.0:1763343275.026239:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6e8f480 with x1848998399866240 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343275.026251:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c6e8f480. 00000100:00100000:2.0:1763343275.026286:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399866112 00000100:00100000:2.0:1763343275.026290:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399866112 00000100:00100000:3.0:1763343275.026305:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1731 00002000:00010000:2.0:1763343275.026306:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/700 (0->18446744073709551615) 00002000:00100000:2.0:1763343275.026311:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5954380 with x1848998399866112 ext(0->18446744073709551615) 00000100:00100000:3.0:1763343275.026318:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2408:x1848998399866240:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:2.0:1763343275.026318:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5954380. 00000100:00100000:2.0:1763343275.026348:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1732 00000100:00100000:2.0:1763343275.026358:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2408:x1848998399866112:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:3.0:1763343275.026502:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2bd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343275.026502:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2bc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343275.026509:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2bd:0x0] updating lvb mtime from disk: 0 -> 1763343274 00002000:00010000:2.0:1763343275.026509:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2bc:0x0] updating lvb mtime from disk: 0 -> 1763343274 00002000:00010000:2.0:1763343275.026514:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343275.026516:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2bd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343275.026518:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2bc:0x0] updating lvb ctime from disk: 0 -> 1763343274 00002000:00010000:3.0:1763343275.026522:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2bd:0x0] updating lvb ctime from disk: 0 -> 1763343274 00002000:00010000:2.0:1763343275.026523:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2bc:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1763343275.026529:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2bd:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343275.026570:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2408:x1848998399866112:12345-192.168.201.40@tcp:10:bash.0 Request processed in 214us (342us total) trans 21474839208 rc 0/0 00000100:00100000:2.0:1763343275.026577:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1732 00002000:00010000:2.0:1763343275.026581:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/700 (0->18446744073709551615) 00002000:00100000:2.0:1763343275.026584:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5954380 with x1848998399866112 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343275.026589:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5954380. 00000100:00100000:3.0:1763343275.027191:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399866240:12345-192.168.201.40@tcp:10:bash.0 Request processed in 874us (1312us total) trans 17179871937 rc 0/0 00000100:00100000:3.0:1763343275.027203:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1731 00002000:00010000:3.0:1763343275.027207:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/701 (0->18446744073709551615) 00002000:00100000:3.0:1763343275.027211:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6e8f480 with x1848998399866240 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343275.027217:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c6e8f480. 00000100:00100000:0.0:1763343275.035358:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.035456:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399866496 00000100:00100000:2.0:1763343275.035467:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399866496 00000100:00100000:2.0:1763343275.035527:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10674 00000100:00100000:2.0:1763343275.035539:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57127:x1848998399866496:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343275.035560:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.035582:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a345c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x206:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b495f1 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.035685:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3463 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x206:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343275.035700:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3463 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x206:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.035711:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3463 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x206:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:2.0:1763343275.035723:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x206:0x0]: returning size 2 00010000:00010000:2.0:1763343275.035824:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a345c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x206:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495f1 expref: 299 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.035840:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3463 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x206:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495f1 expref: 298 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.035848:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x206:0x0].0x0 (ffff9400c38f5e00) 00010000:00010000:2.0:1763343275.035851:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343275.035854:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3200, rc 0) 00000100:00100000:2.0:1763343275.035915:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57127:x1848998399866496:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 378us (722us total) trans 4294973625 rc 0/0 00000100:00100000:2.0:1763343275.035923:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10674 00000100:00100000:3.0:1763343275.035987:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.036911:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399866752 00000100:00100000:2.0:1763343275.036920:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399866752 00000100:00100000:1.0:1763343275.037633:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10675 00000100:00100000:1.0:1763343275.037646:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57132:x1848998399866752:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:1.0:1763343275.037694:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1763343275.037716:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a33fa lrc: 0/0,0 mode: --/CR res: [0x240000404:0x206:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495c7 expref: 298 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.037736:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3408 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495d5 expref: 297 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.037748:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a3447 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495e3 expref: 296 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.037763:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a33b4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x206:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495b2 expref: 295 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.037771:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x206:0x0].0x0 (ffff9400c38f5e00) 00010000:00010000:1.0:1763343275.037776:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343275.037800:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a3471 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343275.037811:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a3471 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.037820:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a3471 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.037831:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3478 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343275.037837:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3478 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.037843:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3478 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.037912:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a347f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x206:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343275.037920:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a347f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.037927:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a347f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:0.0:1763343275.039512:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000004:00080000:1.0:1763343275.039656:0:7641:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x206:0x0] is inserted into orphan list, open count = 2 00010000:00010000:1.0:1763343275.039752:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a347f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.039761:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a347f lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.039768:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a347f lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.039774:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343275.039778:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a347f lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.039785:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a347f lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.039798:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x206:0x0].0x0 (ffff9400c38f5e00) 00010000:00010000:1.0:1763343275.039801:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343275.039805:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a347f lrc: 2/0,0 mode: --/EX res: [0x240000404:0x206:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.039811:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a347f lrc: 0/0,0 mode: --/EX res: [0x240000404:0x206:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.039827:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a3471 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.039834:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a3471 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.039839:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a3471 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.039844:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a3471 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.039853:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343275.039856:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a3471 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.039861:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a3471 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.039868:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fc4f1100) 00010000:00010000:1.0:1763343275.039870:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343275.039873:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a3471 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.039878:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a3471 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00010000:1.0:1763343275.039891:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000018d650b8 reply state 000000007d435372 transno 4294973626 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3478 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.039902:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3478 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.039908:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fc4f1000) 00010000:00010000:1.0:1763343275.039911:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343275.039913:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343275.039991:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57132:x1848998399866752:12345-192.168.201.40@tcp:36:rm.0 Request processed in 2348us (4003us total) trans 4294973626 rc 0/0 00000100:00100000:1.0:1763343275.039999:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10675 00000100:00100000:2.0:1763343275.040548:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399867008 00000100:00100000:2.0:1763343275.040557:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399867008 00000100:00100000:2.0:1763343275.040602:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3765 00000100:00100000:2.0:1763343275.040611:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57127:x1848998399867008:12345-192.168.201.40@tcp:35:lfs.0 00000004:00010000:2.0:1763343275.040668:0:6528:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x206:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3463 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x206:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495f1 expref: 296 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.040700:0:6528:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3486 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x206:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343275.040710:0:6528:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3486 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343275.040718:0:6528:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3486 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT1 00000004:00020000:2.0:1763343275.040839:0:6528:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0001-mdtlov: can not set all stale mirrors for [0x240000404:0x206:0x0]: rc = -1 00010000:00010000:2.0:1763343275.040864:0:6528:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3486 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343275.040871:0:6528:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3486 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343275.040877:0:6528:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3486 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343275.040882:0:6528:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.040885:0:6528:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3486 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343275.040891:0:6528:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3486 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x206:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343275.040904:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x206:0x0].0x0 (ffff9400c38f5e00) 00010000:00010000:2.0:1763343275.040907:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1763343275.040910:0:6528:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3486 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x206:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343275.040915:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3486 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x206:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343275.040924:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x206:0x0].0x0 (ffff9400c38f5e00) 00010000:00010000:2.0:1763343275.040926:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343275.040930:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3463 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x206:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495f1 expref: 296 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343275.041619:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57127:x1848998399867008:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1005us (2109us total) trans 4294973627 rc -1/-1 00000100:00100000:2.0:1763343275.041628:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3765 00000100:00100000:0.0:1763343275.043840:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.043958:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399867136 00000100:00100000:1.0:1763343275.043969:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399867136 00000100:00100000:2.0:1763343275.044111:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10676 00000100:00100000:2.0:1763343275.044123:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57127:x1848998399867136:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343275.044149:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.044173:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a348d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x206:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b495f8 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.044230:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a348d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495f8 expref: 297 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.044245:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba2c00/0x9104b1ba770a348d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x206:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495f8 expref: 297 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.044277:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x206:0x0].0x0 (ffff9400c6733400) 00010000:00010000:2.0:1763343275.044281:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343275.044284:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba2c00, rc 0) 00000100:00100000:2.0:1763343275.044365:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57127:x1848998399867136:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 243us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.044373:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10676 00000100:00100000:0.0:1763343275.048127:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.048290:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399867392 00000100:00100000:2.0:1763343275.048301:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399867392 00000100:00100000:2.0:1763343275.048350:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3766 00000100:00100000:2.0:1763343275.048359:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57127:x1848998399867392:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:2.0:1763343275.048917:0:6528:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x206:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1763343275.048975:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1726, 64 off143664 00000040:00080000:2.0:1763343275.049000:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1734, 64 off144320 00000040:00080000:2.0:1763343275.049008:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1735, 64 off144384 00000040:00080000:2.0:1763343275.049016:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1727, 64 off143728 00010000:00010000:2.0:1763343275.049124:0:6528:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3494 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x206:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343275.049141:0:6528:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3494 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x206:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343275.049152:0:6528:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3494 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x206:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343275.049160:0:6528:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3494 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x206:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343275.049166:0:6528:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3494 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x206:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343275.049176:0:6528:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3494 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x206:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343275.049188:0:6528:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343275.049406:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57127:x1848998399867392:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1044us (1286us total) trans 4294973628 rc 0/0 00000100:00100000:2.0:1763343275.049414:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3766 00010000:00010000:0.0:1763343275.049474:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343275.049481:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3494 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x206:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343275.049487:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343275.049490:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3494 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x206:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343275.049496:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3494 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x206:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343275.049507:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x206:0x0].0x0 (ffff9400c6733400) 00010000:00010000:0.0:1763343275.049510:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343275.049514:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3494 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x206:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343275.049519:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3494 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x206:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343275.049527:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.049528:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.049529:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343275.056430:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.056507:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399867520 00000100:00100000:2.0:1763343275.056518:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399867520 00000100:00100000:2.0:1763343275.056593:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10677 00000100:00100000:2.0:1763343275.056605:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57133:x1848998399867520:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343275.056635:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.056666:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a349b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b495ff expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.056743:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34a2 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343275.056757:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34a2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.056769:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34a2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.056786:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a34a9 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343275.056792:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a34a9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.056809:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a34a9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.056861:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34a2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.056867:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34a2 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.056873:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34a2 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.056878:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.056882:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34a2 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.056889:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34a2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.056900:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c6733700) 00010000:00010000:2.0:1763343275.056903:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.056908:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34a2 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.056914:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34a2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.056927:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a34a9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.056932:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a34a9 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.056937:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a34a9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.056941:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.056944:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a34a9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.056949:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a34a9 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.056955:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fc4f1000) 00010000:00010000:2.0:1763343275.056958:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.056961:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a34a9 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.056965:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a34a9 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.056996:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a349b lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495ff expref: 299 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.057006:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c6733700) 00010000:00010000:2.0:1763343275.057008:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.057012:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a349b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495ff expref: 299 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.057077:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3a00, rc 0) 00000100:00100000:2.0:1763343275.057141:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57133:x1848998399867520:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 538us (722us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343275.057150:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10677 00000100:00100000:3.0:1763343275.062898:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.062994:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399867648 00000100:00100000:2.0:1763343275.063178:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399867648 00000100:00100000:2.0:1763343275.063235:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10678 00000100:00100000:2.0:1763343275.063312:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57133:x1848998399867648:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343275.063340:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.063366:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a34b0 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49606 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.063440:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34b7 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343275.063453:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34b7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.063463:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34b7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.063476:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a34be lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343275.063482:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a34be lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.063488:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a34be lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.063529:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34b7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.063536:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34b7 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.063542:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34b7 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.063547:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.063551:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34b7 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.063563:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34b7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.063573:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:2.0:1763343275.063576:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.063581:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34b7 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.063588:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34b7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.063599:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a34be lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.063604:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a34be lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.063610:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a34be lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.063615:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400cbad3c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.063618:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a34be lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.063623:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a34be lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.063630:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fc4f1000) 00010000:00010000:2.0:1763343275.063633:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.063635:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a34be lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.063641:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a34be lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.063668:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a34b0 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49606 expref: 299 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.063678:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:2.0:1763343275.063681:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.063684:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a34b0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49606 expref: 299 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.063698:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3200, rc 0) 00000100:00100000:2.0:1763343275.063804:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57133:x1848998399867648:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 560us (916us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343275.063811:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10678 00000100:00100000:3.0:1763343275.071999:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.072071:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.072305:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399867776 00000100:00100000:1.0:1763343275.072315:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399867776 00000100:00100000:1.0:1763343275.072377:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399868032 00000100:00100000:1.0:1763343275.072381:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399868032 00000100:00100000:1.0:1763343275.072407:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10679 00000100:00100000:2.0:1763343275.072417:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10680 00000100:00100000:1.0:1763343275.072419:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57133:x1848998399867776:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:2.0:1763343275.072432:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57134:x1848998399868032:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343275.072441:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.072443:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343275.072469:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a34c5 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4960d expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.072473:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a34cc lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49614 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.072537:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a34d3 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343275.072544:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a34da lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343275.072551:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a34d3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.072564:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a34d3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343275.072621:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763343275.072626:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763343275.072896:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a34da lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.072907:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a34da lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.072919:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a34e1 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343275.072926:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a34e1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.072932:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a34e1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.072967:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a34da lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.072969:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a34c5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4960d expref: 302 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.072983:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a34da lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.072992:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a34da lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.072996:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a34d3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4960d expref: 301 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.073002:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd8e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.073008:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a34da lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.073011:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fc4f1100) 00010000:00010000:1.0:1763343275.073018:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343275.073021:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177200, rc 0) 00010000:00010000:2.0:1763343275.073060:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a34da lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.073073:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fc4f1100) 00010000:00010000:2.0:1763343275.073076:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.073080:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a34da lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.073087:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a34da lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.073097:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a34e1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.073103:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a34e1 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.073110:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a34e1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.073114:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd9a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.073118:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a34e1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.073124:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a34e1 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00000100:00100000:1.0:1763343275.073127:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57133:x1848998399867776:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 709us (1137us total) trans 0 rc 0/0 00010000:00010000:2.0:1763343275.073134:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fc4f1000) 00000100:00100000:1.0:1763343275.073140:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10679 00010000:00010000:2.0:1763343275.073141:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.073145:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a34e1 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.073153:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a34e1 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.073178:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a34cc lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49614 expref: 300 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.073188:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fc4f1100) 00010000:00010000:2.0:1763343275.073191:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343275.073195:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a34cc lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49614 expref: 300 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.073204:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3a00, rc 0) 00000100:00100000:2.0:1763343275.073227:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57134:x1848998399868032:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 801us (1156us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343275.073232:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10680 00000100:00100000:0.0:1763343275.083609:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.083700:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399868288 00000100:00100000:2.0:1763343275.083712:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399868288 00000100:00100000:2.0:1763343275.083783:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10681 00000100:00100000:2.0:1763343275.083794:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57133:x1848998399868288:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343275.083818:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.083822:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343275.083854:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a34d3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4960d expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.083873:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fc4f1100) 00010000:00010000:2.0:1763343275.083883:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343275.083901:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a34e8 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4961b expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.084010:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a34ef lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343275.084053:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a34ef lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.084063:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a34ef lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.084074:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34f6 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343275.084081:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34f6 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.084088:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34f6 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.084495:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a34fd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343275.084505:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a34fd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.084512:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a34fd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:2.0:1763343275.084521:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x208:0x0]: returning size 0 00010000:00010000:2.0:1763343275.084544:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a34ef lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.084551:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a34ef lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.084558:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a34ef lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.084563:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.084567:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a34ef lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.084573:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a34ef lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.084582:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:2.0:1763343275.084585:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.084589:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a34ef lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.084594:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a34ef lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:2.0:1763343275.084608:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f978192e reply state 00000000b3e3fa5d transno 4294973629 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34f6 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.084618:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34f6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.084624:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fc4f1000) 00010000:00010000:2.0:1763343275.084626:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343275.084628:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343275.084654:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a34e8 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4961b expref: 301 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.084668:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a34fd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4961b expref: 300 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.084674:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733a00) 00010000:00010000:2.0:1763343275.084676:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343275.084678:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121e200, rc 0) 00000100:00100000:2.0:1763343275.084752:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57133:x1848998399868288:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 960us (1155us total) trans 4294973629 rc 0/0 00000100:00100000:2.0:1763343275.084760:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10681 00000100:00100000:1.0:1763343275.097339:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.097409:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.097504:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399868544 00000100:00100000:0.0:1763343275.097515:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399868544 00000100:00100000:0.0:1763343275.097564:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399868800 00000100:00100000:0.0:1763343275.097568:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399868800 00000100:00100000:0.0:1763343275.097600:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10682 00000100:00100000:0.0:1763343275.097610:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57133:x1848998399868544:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343275.097643:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.097667:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a350b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49622 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.097783:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3512 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343275.097798:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a34fd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4961b expref: 303 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.097808:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3512 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.097841:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a34fd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4961b expref: 303 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.097855:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a34fd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4961b expref: 303 pid: 33856 timeout: 1168 lvb_type: 0 00000100:00100000:0.0:1763343275.097868:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b57b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412974080:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343275.097893:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10683 00000100:00100000:3.0:1763343275.097905:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57135:x1848998399868800:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343275.097914:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343275.097924:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3519 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49629 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343275.097952:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c1370240 going to sleep for 11 seconds 00010000:00010000:3.0:1763343275.097968:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a3520 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343275.097980:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a3520 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.097992:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a3520 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:3.0:1763343275.098003:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x208:0x0]: returning size 0 00010000:00010000:3.0:1763343275.098107:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a3520 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.098115:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a3520 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.098126:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a3520 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.098132:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b98000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343275.098135:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a3520 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.098142:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a3520 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.098154:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733a00) 00010000:00010000:3.0:1763343275.098157:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763343275.098161:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a3520 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.098166:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a3520 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.098202:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3519 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x208:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49629 expref: 305 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.098210:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733a00) 00010000:00010000:3.0:1763343275.098212:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343275.098216:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3519 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x208:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49629 expref: 305 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.098225:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c6b99600, rc 0) 00000100:00100000:3.0:1763343275.098254:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57135:x1848998399868800:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 353us (846us total) trans 4294973630 rc 301/301 00000100:00100000:3.0:1763343275.098279:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10683 00000100:00100000:3.0:1763343275.108812:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.108883:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399869056 00000100:00100000:2.0:1763343275.108893:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399869056 00000100:00100000:0.0:1763343275.108946:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b57b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412974080:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343275.108960:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3767 00000100:00100000:2.0:1763343275.108972:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57135:x1848998399869056:12345-192.168.201.40@tcp:35:lfs.0 00010000:00010000:0.0:1763343275.108978:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3512 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343275.109235:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57135:x1848998399869056:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 265us (430us total) trans 4294973631 rc 0/0 00000100:00100000:2.0:1763343275.109244:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3767 00000100:00100000:0.0:1763343275.114374:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.114479:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399869184 00000100:00100000:1.0:1763343275.114492:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399869184 00010000:00010000:1.0:1763343275.114547:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a34fd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4961b expref: 305 pid: 33856 timeout: 1168 lvb_type: 0 00000100:00100000:1.0:1763343275.114590:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3471 00000100:00100000:1.0:1763343275.114600:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:2407:x1848998399869184:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343275.114617:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343275.114625:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a34fd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4961b expref: 305 pid: 33856 timeout: 1168 lvb_type: 0 00010000:00010000:1.0:1763343275.114638:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a34fd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4961b expref: 305 pid: 33856 timeout: 1168 lvb_type: 0 00010000:00010000:1.0:1763343275.114661:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a34fd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4961b expref: 305 pid: 33856 timeout: 1168 lvb_type: 0 00010000:00010000:1.0:1763343275.114677:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733a00) 00010000:00010000:1.0:1763343275.114683:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3512 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.114693:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3512 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.114700:0:7904:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3512 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.114739:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343275.114841:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3512 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.114851:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3512 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343275.114875:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x208:0x0]: returning size 0 00000004:00080000:2.0:1763343275.115407:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2bf:0x0], index 1: 0 00000004:00080000:2.0:1763343275.115416:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2be:0x0], index 0: 0 00000004:00080000:2.0:1763343275.115420:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2bf:0x0], index 0: 0 00000004:00080000:2.0:1763343275.115424:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2c0:0x0], index 1: 0 00000100:00100000:3.0:1763343275.115659:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.115719:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399869440 00000100:00100000:3.0:1763343275.115727:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399869440 00000100:00100000:3.0:1763343275.115790:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10684 00000100:00100000:3.0:1763343275.115802:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57135:x1848998399869440:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343275.115820:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343275.115841:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a352e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49630 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.115909:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a3535 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343275.115922:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a3535 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.115934:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a3535 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.115945:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a353c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343275.115954:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a353c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.115963:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a353c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:1.0:1763343275.116065:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:2407:x1848998399869184:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1463us (1701us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343275.116075:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3471 00010000:00010000:3.0:1763343275.116080:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3543 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343275.116092:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3543 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.116105:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3543 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.116161:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3543 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.116169:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3543 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.116176:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3543 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.116182:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c7ec0c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343275.116187:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3543 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.116195:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3543 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.116207:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733a00) 00010000:00010000:3.0:1763343275.116210:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763343275.116214:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3543 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.116221:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3543 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.116234:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a3535 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.116241:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a3535 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.116246:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a3535 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.116253:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a3535 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.116258:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b98000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343275.116274:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a3535 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.116281:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a3535 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.116288:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b000) 00010000:00010000:3.0:1763343275.116291:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343275.116293:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a3535 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.116299:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a3535 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.116309:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a353c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.116314:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a353c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.116320:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a353c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.116325:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b98200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343275.116327:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a353c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.116333:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a353c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.116394:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fc4f1000) 00010000:00010000:3.0:1763343275.116397:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343275.116400:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a353c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.116405:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a353c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.116434:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a352e lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49630 expref: 307 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.116446:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b000) 00010000:00010000:3.0:1763343275.116448:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343275.116452:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a352e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49630 expref: 307 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.116466:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c6b99600, rc 0) 00000100:00100000:3.0:1763343275.116510:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57135:x1848998399869440:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 712us (857us total) trans 4294973633 rc 301/301 00000100:00100000:3.0:1763343275.116517:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10684 00010000:00010000:2.0:1763343275.116992:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3512 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.117001:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3512 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.117006:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3512 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.117012:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3916200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.117014:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3512 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.117020:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3512 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.117051:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733a00) 00010000:00010000:2.0:1763343275.117054:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343275.117058:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3512 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.117064:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3512 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.117099:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a350b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x208:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49622 expref: 305 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.117108:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733a00) 00010000:00010000:2.0:1763343275.117112:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343275.117115:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a350b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x208:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49622 expref: 305 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.117128:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917a00, rc 0) 00000100:00100000:2.0:1763343275.117155:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57133:x1848998399868544:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 19547us (19839us total) trans 4294973632 rc 301/301 00000100:00100000:2.0:1763343275.117162:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10682 00000100:00100000:3.0:1763343275.121226:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.121285:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399869568 00000100:00100000:2.0:1763343275.121296:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399869568 00000100:00100000:2.0:1763343275.121357:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10685 00000100:00100000:2.0:1763343275.121367:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57135:x1848998399869568:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343275.121386:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.121410:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a3558 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49637 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.121510:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a355f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343275.121525:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a355f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.121538:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a355f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343275.121572:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343275.121589:0:7641:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a355f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.121614:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a3558 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49637 expref: 306 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.121631:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a355f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49637 expref: 305 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.121640:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:2.0:1763343275.121643:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343275.121647:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121ea00, rc 0) 00000100:00100000:2.0:1763343275.124088:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57135:x1848998399869568:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2711us (2861us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.124101:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10685 00000100:00100000:1.0:1763343275.128723:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.128764:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.131823:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399869952 00000100:00100000:0.0:1763343275.131839:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399869952 00000100:00100000:0.0:1763343275.131918:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7265 00000100:00100000:0.0:1763343275.131928:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2408:x1848998399869952:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343275.131946:0:27798:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.131969:0:27798:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a3566 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4963e expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343275.131992:0:27798:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343275.132011:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.132013:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.132053:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a3566 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4963e expref: 21 pid: 27798 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343275.132078:0:27798:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a3566 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4963e expref: 21 pid: 27798 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343275.132091:0:27798:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917a00, rc 0) 00000100:00100000:0.0:1763343275.132162:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399869952:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 236us (3397us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.132170:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7265 00000100:00100000:3.0:1763343275.132479:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399869824 00000100:00100000:3.0:1763343275.132485:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399869824 00000100:00100000:3.0:1763343275.132573:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3768 00000100:00100000:3.0:1763343275.132582:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8440450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57133:x1848998399869824:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343275.132680:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.132830:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8440450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57133:x1848998399869824:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 248us (4117us total) trans 4294973634 rc 0/0 00000100:00100000:3.0:1763343275.132842:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3768 00000100:00100000:1.0:1763343275.132842:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399870080 00000100:00100000:1.0:1763343275.132846:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399870080 00000100:00100000:1.0:1763343275.132873:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7266 00000100:00100000:1.0:1763343275.132879:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399870080:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343275.132887:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343275.132902:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a356d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49645 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343275.132920:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343275.132931:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.132933:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.132939:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a356d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49645 expref: 15 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343275.132952:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a356d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49645 expref: 15 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343275.132961:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177a00, rc 0) 00000100:00100000:1.0:1763343275.132983:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998399870080:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 104us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343275.132988:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7266 00000100:00100000:2.0:1763343275.134565:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.134630:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399870336 00000100:00100000:1.0:1763343275.134640:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399870336 00000100:00100000:1.0:1763343275.134691:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3769 00000100:00100000:1.0:1763343275.134700:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57133:x1848998399870336:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343275.135745:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57133:x1848998399870336:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1040us (1181us total) trans 4294973635 rc 0/0 00000100:00100000:1.0:1763343275.135967:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3769 00000100:00100000:0.0:1763343275.136932:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.137002:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399870592 00000100:00100000:1.0:1763343275.137010:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399870592 00000100:00100000:1.0:1763343275.137323:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3770 00000100:00100000:1.0:1763343275.137332:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57135:x1848998399870592:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343275.137520:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57135:x1848998399870592:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 189us (590us total) trans 4294973636 rc 0/0 00000100:00100000:1.0:1763343275.137527:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3770 00000100:00100000:0.0:1763343275.144608:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.146682:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399870848 00000100:00100000:2.0:1763343275.146698:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399870848 00000100:00100000:2.0:1763343275.146772:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10686 00000100:00100000:2.0:1763343275.146783:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:55884:x1848998399870848:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343275.146808:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.146837:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a3574 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4964c expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.146975:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a357b lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343275.146996:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a357b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.147010:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a357b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.147020:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3582 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343275.147168:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3582 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.147175:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3582 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.147235:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a3589 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343275.147244:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a3589 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.147252:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a3589 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343275.148196:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x208:0x0]: returning size 0 00010000:00010000:2.0:1763343275.148452:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a357b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.148462:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a357b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.148467:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a357b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.148473:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a357b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.148480:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121e800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.148484:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a357b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.148491:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a357b lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.148505:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c6733a00) 00010000:00010000:2.0:1763343275.148508:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.148513:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a357b lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.148519:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a357b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.148535:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3582 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.148541:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3582 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.148547:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3582 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.148551:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121e200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.148553:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3582 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.148558:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3582 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.148564:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fc4f1000) 00010000:00010000:2.0:1763343275.148565:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.148568:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3582 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.148573:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3582 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.148613:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a3574 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4964c expref: 311 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.148630:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a3589 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4964c expref: 310 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.148637:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:2.0:1763343275.148639:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343275.148641:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400cbad3c00, rc 0) 00000100:00100000:2.0:1763343275.149546:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:55884:x1848998399870848:12345-192.168.201.40@tcp:101:bash.0 Request processed in 2756us (4942us total) trans 4294973637 rc 0/0 00000100:00100000:2.0:1763343275.149557:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10686 00000100:00100000:2.0:1763343275.154576:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.155150:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.155177:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.155286:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399870976 00000100:00100000:0.0:1763343275.155298:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399870976 00000100:00100000:1.0:1763343275.155299:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399871104 00000100:00100000:1.0:1763343275.155306:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399871104 00000100:00100000:1.0:1763343275.155362:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 454 00000100:00100000:0.0:1763343275.155363:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10687 00000100:00100000:0.0:1763343275.155378:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:55884:x1848998399870976:12345-192.168.201.40@tcp:101:bash.0 00000100:00100000:1.0:1763343275.155380:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6506680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:2409:x1848998399871104:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343275.155401:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343275.155405:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.155427:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3597 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49653 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.155462:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a359e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343275.155476:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a359e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.155486:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a359e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.155597:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3597 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49653 expref: 313 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.155616:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a359e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49653 expref: 312 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.155625:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:0.0:1763343275.155628:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343275.155632:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8692c00, rc 0) 00000100:00100000:0.0:1763343275.155691:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:55884:x1848998399870976:12345-192.168.201.40@tcp:101:bash.0 Request processed in 317us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.155698:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10687 00010000:00010000:1.0:1763343275.156332:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400cbad3c00/0x9104b1ba770a3589 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4964c expref: 311 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.156353:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:1.0:1763343275.156358:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343275.156371:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399871232 00000100:00100000:3.0:1763343275.156380:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399871232 00000100:00100000:1.0:1763343275.156402:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6506680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:2409:x1848998399871104:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1026us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343275.156413:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 454 00000100:00100000:2.0:1763343275.156704:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3771 00000100:00100000:2.0:1763343275.156712:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57135:x1848998399871232:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:2.0:1763343275.156799:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57135:x1848998399871232:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 88us (1621us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.156806:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3771 00000100:00100000:0.0:1763343275.160294:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.160519:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399871488 00000100:00100000:2.0:1763343275.160531:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399871488 00000100:00100000:2.0:1763343275.160590:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10688 00000100:00100000:2.0:1763343275.160600:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:55884:x1848998399871488:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:2.0:1763343275.160648:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343275.160674:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a355f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49637 expref: 310 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.160692:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:2.0:1763343275.160698:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343275.161017:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a35a5 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343275.161135:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a35a5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.161146:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a35a5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000001:00080000:2.0:1763343275.161199:0:33856:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973638 00000004:00010000:2.0:1763343275.161229:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000095380333 reply state 00000000d2f91a11 transno 4294973639 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a35a5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.161240:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a35a5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.161247:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:2.0:1763343275.161249:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343275.161252:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343275.161371:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:55884:x1848998399871488:12345-192.168.201.40@tcp:36:bash.0 Request processed in 771us (1087us total) trans 4294973639 rc 0/0 00000100:00100000:2.0:1763343275.161379:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10688 00000020:00080000:2.0:1763343275.161384:0:33856:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343275.167651:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.167707:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399871616 00000100:00100000:2.0:1763343275.167719:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399871616 00000100:00100000:2.0:1763343275.167938:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10689 00000100:00100000:2.0:1763343275.167952:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:55884:x1848998399871616:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343275.167980:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.168002:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a35ac lrc: 2/0,0 mode: --/CR res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4965a expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.168105:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a35ac lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4965a expref: 313 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.168123:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a35ac lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4965a expref: 313 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.168142:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:2.0:1763343275.168146:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343275.168151:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121e200, rc 0) 00000100:00100000:2.0:1763343275.168211:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:55884:x1848998399871616:12345-192.168.201.40@tcp:101:bash.0 Request processed in 263us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.168218:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10689 00000100:00100000:3.0:1763343275.171406:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.171491:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.171627:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399871872 00000100:00100000:2.0:1763343275.171637:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399871872 00000100:00100000:2.0:1763343275.171690:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399872128 00000100:00100000:2.0:1763343275.171693:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399872128 00000100:00100000:2.0:1763343275.171727:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10690 00000100:00100000:2.0:1763343275.171735:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:55884:x1848998399871872:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343275.171758:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.171761:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343275.171789:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a35ac lrc: 0/0,0 mode: --/CR res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4965a expref: 314 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.171808:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:2.0:1763343275.171812:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343275.171825:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a35b3 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49661 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.171874:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a35ba lrc: 3/0,1 mode: --/EX res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343275.171886:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a35ba lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.171896:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a35ba lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000040:00080000:2.0:1763343275.172165:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1736, 88 off144472 00000004:00080000:2.0:1763343275.172173:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1068296147587ns, next at 1069016397451ns, rc = 0 00000040:00080000:2.0:1763343275.172197:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1728, 88 off143816 00000004:00080000:2.0:1763343275.172202:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1068296177288ns, next at 1069016426495ns, rc = 0 00000040:00080000:2.0:1763343275.172216:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1729, 88 off143904 00000004:00080000:2.0:1763343275.172225:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1068296200592ns, next at 1069016426495ns, rc = 0 00000040:00080000:2.0:1763343275.172237:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1737, 88 off144560 00000004:00080000:2.0:1763343275.172242:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1068296216840ns, next at 1069016397451ns, rc = 0 00000100:00100000:3.0:1763343275.172255:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10691 00000100:00100000:3.0:1763343275.172283:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57136:x1848998399872128:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343275.172292:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343275.172305:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a35c1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49668 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.172357:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a35c8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343275.172364:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a35c8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.172370:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a35c8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.172377:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a35cf lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343275.172383:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a35cf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.172387:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a35cf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.172470:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a35d6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343275.172483:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a35d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.172490:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a35d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:3.0:1763343275.172500:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x208:0x0]: returning size 2 00010000:00010000:3.0:1763343275.174904:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a35d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.174920:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a35d6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.174927:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a35d6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.174933:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3916200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343275.174937:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a35d6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.174943:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a35d6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.174959:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:3.0:1763343275.174962:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1763343275.174967:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a35d6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.174973:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a35d6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.174991:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a35c8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.175001:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a35c8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.175005:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a35c8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.175010:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a35c8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.175015:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c7ec1c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343275.175018:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a35c8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.175637:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a35c8 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.175650:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b000) 00010000:00010000:3.0:1763343275.175652:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343275.175655:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a35c8 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.175661:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a35c8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.175671:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a35cf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.175676:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a35cf lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.175681:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a35cf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.175686:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c7ec0600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343275.175689:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a35cf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.175694:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a35cf lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.175700:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fc4f1000) 00010000:00010000:3.0:1763343275.175702:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343275.175704:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a35cf lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.175708:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a35cf lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.175754:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a35c1 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49668 expref: 317 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.175764:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b000) 00010000:00010000:3.0:1763343275.175766:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343275.175770:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a35c1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49668 expref: 317 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.175784:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c7ec0c00, rc 0) 00000001:00080000:2.0:1763343275.176249:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973640 is committed 00000004:00080000:2.0:1763343275.176257:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1115 committed 00010000:00010000:0.0:1763343275.176339:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3478 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.176348:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3478 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.176353:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3478 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.176358:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.176361:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3478 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.176368:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3478 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.176378:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fc4f1000) 00010000:00010000:0.0:1763343275.176381:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.176384:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3478 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.176389:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3478 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.176404:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34f6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.176410:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34f6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.176415:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34f6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.176419:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.176421:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34f6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.176426:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34f6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.176432:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fc4f1000) 00010000:00010000:0.0:1763343275.176434:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.176436:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34f6 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.176441:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a34f6 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.176453:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a35a5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.176458:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a35a5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.176463:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a35a5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.176468:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121fc00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.176470:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a35a5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.176474:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a35a5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.176480:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:0.0:1763343275.176482:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.176484:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a35a5 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.176489:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a35a5 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00080000:2.0:1763343275.176534:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1107 committed 00000004:00080000:2.0:1763343275.176540:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1106 committed 00000004:00080000:2.0:1763343275.176542:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1114 committed 00010000:00010000:2.0:1763343275.176615:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a35ba lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x208:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49661 expref: 295 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.176628:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:2.0:1763343275.176630:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343275.176641:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a35b3 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49661 expref: 295 pid: 6524 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763343275.176655:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a35ba lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x208:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49661 expref: 294 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.176681:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:2.0:1763343275.176684:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343275.176686:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121e800, rc 0) 00000100:00100000:3.0:1763343275.177546:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57136:x1848998399872128:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 5261us (6047us total) trans 4294973641 rc 301/301 00000100:00100000:3.0:1763343275.177557:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10691 00000100:00100000:2.0:1763343275.177711:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:55884:x1848998399871872:12345-192.168.201.40@tcp:101:bash.0 Request processed in 5975us (6315us total) trans 4294973640 rc 0/0 00000100:00100000:2.0:1763343275.177719:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10690 00000100:00100000:0.0:1763343275.178420:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c39b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412974208:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763343275.178421:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9dc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412974592:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343275.178484:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343275.178722:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412974336:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343275.178813:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412974464:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343275.179354:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412974592 00000100:00100000:1.0:1763343275.179363:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412974592 00000100:00100000:2.0:1763343275.179402:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c2f84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412975104:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343275.179411:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7267 00000100:00100000:1.0:1763343275.179423:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+29:3660:x1848998412974592:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1763343275.179571:0:27798:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2bf:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343275.179575:0:27798:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2bf:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343275.179577:0:27798:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2bf:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343275.179579:0:27798:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2bf:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763343275.179581:0:27798:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2bf:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343275.181353:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343275.181415:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412974976:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343275.181439:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+30:3660:x1848998412974592:12345-0@lo:2:osp-syn-0-1.0 Request processed in 2016us (2952us total) trans 21474839209 rc 0/0 00000100:00100000:1.0:1763343275.181450:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7267 00000100:00100000:1.0:1763343275.181477:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412974464 00000100:00100000:1.0:1763343275.181483:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412974464 00000100:00100000:1.0:1763343275.181514:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7268 00000100:00100000:1.0:1763343275.181521:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+30:3659:x1848998412974464:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343275.181556:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1763343275.181606:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c9dc8380/2, rc 0, transno 21474839209 00000100:00100000:2.0:1763343275.181613:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9dc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412974592:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343275.181663:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412975104 00000100:00100000:2.0:1763343275.181668:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412975104 00000100:00100000:1.0:1763343275.181670:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+31:3659:x1848998412974464:12345-0@lo:2:osp-syn-0-1.0 Request processed in 148us (320us total) trans 21474839210 rc 0/0 00000100:00100000:1.0:1763343275.181678:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7268 00000100:00100000:1.0:1763343275.181696:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7269 00000100:00100000:1.0:1763343275.181704:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+13:3660:x1848998412975104:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763343275.181779:0:27798:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2c0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343275.181782:0:27798:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2c0:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343275.181784:0:27798:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2c0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343275.181786:0:27798:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2c0:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763343275.181789:0:27798:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2c0:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343275.181828:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+14:3660:x1848998412975104:12345-0@lo:2:osp-syn-1-1.0 Request processed in 125us (272us total) trans 17179871938 rc 0/0 00000100:00100000:1.0:1763343275.181835:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7269 00000100:00100000:0.0:1763343275.181841:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1763343275.181876:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6282a00/2, rc 0, transno 21474839210 00000100:00100000:0.0:1763343275.181881:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412974464:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763343275.181949:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c2f84a80/2, rc 0, transno 17179871938 00000100:00100000:2.0:1763343275.181954:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c2f84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412975104:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343275.182017:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343275.184687:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412974976 00000100:00100000:0.0:1763343275.184706:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412974976 00000100:00100000:1.0:1763343275.184788:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7270 00000100:00100000:1.0:1763343275.184802:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+14:3659:x1848998412974976:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343275.185083:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+15:3659:x1848998412974976:12345-0@lo:2:osp-syn-1-1.0 Request processed in 284us (3242us total) trans 17179871939 rc 0/0 00000100:00100000:1.0:1763343275.185090:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7270 00000100:00100000:1.0:1763343275.185107:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412974208 00000100:00100000:1.0:1763343275.185111:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412974208 00000100:00100000:1.0:1763343275.185134:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7271 00000100:00100000:1.0:1763343275.185140:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+31:3661:x1848998412974208:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763343275.185154:0:8412:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:700 count 1 00010000:00010000:1.0:1763343275.185176:0:8412:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a35e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.185196:0:8412:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a342b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495dc expref: 20 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.185203:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343275.185206:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343275.185210:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a35e4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.185241:0:8412:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a342b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495dc expref: 20 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.185273:0:8412:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a342b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495dc expref: 20 pid: 27798 timeout: 1168 lvb_type: 0 00000100:00100000:1.0:1763343275.185288:0:8412:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998412975232:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343275.185690:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343275.185737:0:8412:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c5965540 going to sleep for 11 seconds 00000100:00100000:3.0:1763343275.185758:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9dc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412974720:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343275.185758:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9dc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412974848:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343275.185759:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412974336 00000100:00100000:1.0:1763343275.185765:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412974336 00000100:00100000:1.0:1763343275.185794:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7272 00000100:00100000:1.0:1763343275.185799:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+32:3662:x1848998412974336:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763343275.185813:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:701 count 1 00002000:00010000:1.0:1763343275.185833:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343275.185839:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a35eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.185847:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.185848:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.185853:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a35eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.185867:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a35eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343275.185877:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343275.185881:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a35eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.185892:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a35eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343275.185899:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412974720 00000100:00100000:2.0:1763343275.185904:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412974720 00010000:00010000:1.0:1763343275.185914:0:35266:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343275.185923:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343275.185931:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412974848 00000100:00100000:2.0:1763343275.185933:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412974848 00000100:00100000:2.0:1763343275.185953:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7273 00000100:00100000:3.0:1763343275.185957:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7274 00000100:00100000:2.0:1763343275.185960:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+16:3661:x1848998412974720:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343275.185964:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+16:3662:x1848998412974848:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763343275.185972:0:28561:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:701 count 1 00010000:00010000:2.0:1763343275.185985:0:28561:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a35f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.185999:0:28561:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3455 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495ea expref: 14 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.186005:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343275.186007:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343275.186010:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a35f2 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.186059:0:28561:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3455 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495ea expref: 14 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.186069:0:28561:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3455 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495ea expref: 14 pid: 8412 timeout: 1168 lvb_type: 0 00000100:00100000:2.0:1763343275.186081:0:28561:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b2a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998412975360:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343275.186085:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.186115:0:28561:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401ca058300 going to sleep for 11 seconds 00000100:00100000:0.0:1763343275.186123:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399872256 00000100:00100000:0.0:1763343275.186128:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399872256 00000100:00100000:1.0:1763343275.186144:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+33:3662:x1848998412974336:12345-0@lo:6:osp-syn-0-1.0 Request processed in 343us (453us total) trans 21474839211 rc 0/0 00000100:00100000:1.0:1763343275.186152:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7272 00000100:00100000:0.0:1763343275.186173:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10692 00010000:00010000:1.0:1763343275.186175:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343275.186182:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a35eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343275.186185:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57136:x1848998399872256:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343275.186197:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176a00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343275.186202:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a35eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.186206:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343275.186211:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a35eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.186222:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a35f9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4966f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.186229:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a35eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.186239:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a35eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.186255:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343275.186257:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1763343275.186315:0:11289:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:702 count 1 00010000:00010000:1.0:1763343275.186331:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1763343275.186335:0:11289:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343275.186343:0:11289:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3600 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.186352:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343275.186354:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343275.186357:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3600 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.186368:0:11289:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3600 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763343275.186372:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401edc2ce00/2, rc 0, transno 17179871939 00000100:00100000:1.0:1763343275.186381:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412974976:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1763343275.186382:0:11289:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3600 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.186397:0:11289:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3600 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.186417:0:11289:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343275.186429:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a3607 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00000100:00100000:1.0:1763343275.186438:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:0.0:1763343275.186447:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a3607 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.186457:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a3607 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000100:00100000:1.0:1763343275.186458:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399872384 00000100:00100000:1.0:1763343275.186464:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399872384 00000004:00200000:0.0:1763343275.186487:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x208:0x0]: returning size 2 00000100:00100000:1.0:1763343275.186493:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7275 00000004:00200000:0.0:1763343275.186493:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1763343275.186506:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:55884:x1848998399872384:12345-192.168.201.40@tcp:101:bash.0 00000004:00010000:0.0:1763343275.186511:0:6524:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a3607 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343275.186514:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343275.186527:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a360e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49676 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.186542:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a35f9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4966f expref: 295 pid: 6524 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343275.186543:0:8414:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1763343275.186546:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+17:3662:x1848998412974848:12345-0@lo:6:osp-syn-1-1.0 Request processed in 581us (622us total) trans 17179871940 rc 0/0 00000100:00100000:3.0:1763343275.186557:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7274 00010000:00010000:1.0:1763343275.186562:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.186565:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a3607 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4966f expref: 294 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.186566:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.186577:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a360e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49676 expref: 16 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.186578:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:0.0:1763343275.186585:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000004:00080000:3.0:1763343275.186586:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c9dc8700/2, rc 0, transno 17179871940 00010000:00010000:0.0:1763343275.186589:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8693e00, rc 0) 00000100:00100000:3.0:1763343275.186594:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9dc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412974848:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1763343275.186600:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a360e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49676 expref: 16 pid: 8414 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763343275.186607:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6280a80/2, rc 0, transno 21474839211 00010000:00010000:1.0:1763343275.186612:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177000, rc 0) 00000100:00100000:3.0:1763343275.186616:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412974336:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343275.186620:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57136:x1848998399872256:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 438us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.186627:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10692 00000100:00100000:1.0:1763343275.186644:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:55884:x1848998399872384:12345-192.168.201.40@tcp:101:bash.0 Request processed in 139us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343275.186652:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7275 00010000:00010000:2.0:1763343275.186914:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343275.186921:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3600 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.186929:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b99600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343275.186932:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3600 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.186940:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3600 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.186952:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3600 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.186958:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a3600 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.186972:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343275.186984:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343275.186986:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343275.193008:0:8412:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998412975232:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343275.193076:0:8412:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a35e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343275.194140:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.194170:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.194227:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399872640 00000100:00100000:3.0:1763343275.194229:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.194237:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399872640 00000100:00100000:3.0:1763343275.194255:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399872768 00000100:00100000:3.0:1763343275.194280:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399872768 00010000:00010000:0.0:1763343275.194287:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a342b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495dc expref: 21 pid: 27798 timeout: 1168 lvb_type: 0 00010000:00010000:3.0:1763343275.194304:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3455 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495ea expref: 16 pid: 8412 timeout: 1168 lvb_type: 0 00000100:00100000:0.0:1763343275.194325:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3472 00000100:00100000:3.0:1763343275.194339:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3473 00000100:00100000:0.0:1763343275.194340:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4789c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399872640:12345-192.168.201.40@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1763343275.194353:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4788000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399872768:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343275.194358:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343275.194365:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343275.194367:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a342b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495dc expref: 21 pid: 27798 timeout: 1168 lvb_type: 0 00010000:00010000:3.0:1763343275.194374:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3455 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495ea expref: 16 pid: 8412 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343275.194388:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a342b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495dc expref: 21 pid: 27798 timeout: 1168 lvb_type: 0 00010000:00010000:3.0:1763343275.194391:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3455 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495ea expref: 16 pid: 8412 timeout: 1168 lvb_type: 0 00010000:00010000:3.0:1763343275.194424:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.194424:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a342b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495dc expref: 21 pid: 27798 timeout: 1168 lvb_type: 0 00010000:00010000:3.0:1763343275.194428:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343275.194434:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a35f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.194441:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.194445:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343275.194446:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a35f2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.194449:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a35e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.194467:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a35e4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.194476:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343275.194490:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343275.194583:0:28561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3455 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b495ea expref: 16 pid: 8412 timeout: 1168 lvb_type: 0 00000100:00100000:2.0:1763343275.194596:0:28561:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998412975360:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343275.194615:0:28561:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a35f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.194624:0:28561:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a35f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.194630:0:28561:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a35f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.194640:0:28561:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a35f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.194649:0:28561:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a35f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.194668:0:28561:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343275.194678:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399872512 00000100:00100000:1.0:1763343275.194684:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399872512 00000100:00100000:1.0:1763343275.194716:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7276 00000100:00100000:1.0:1763343275.194724:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399872512:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343275.194736:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343275.194751:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3615 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4967d expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343275.194798:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412975488:192.168.201.40@tcp:106: 00000100:00100000:2.0:1763343275.194893:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+17:3661:x1848998412974720:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8932us (9018us total) trans 17179871941 rc 0/0 00000100:00100000:2.0:1763343275.194901:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7273 00000100:00100000:0.0:1763343275.194956:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4789c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2408:x1848998399872640:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 622us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.194964:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3472 00010000:00010000:0.0:1763343275.194999:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343275.195005:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a35f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.195012:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121e200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343275.195017:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a35f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.195062:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a35f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.195075:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a35f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.195083:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401d121e200/0x9104b1ba770a35f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.195097:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.195099:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.195101:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.195110:0:8412:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a35e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.195118:0:8412:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a35e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.195131:0:8412:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a35e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.195138:0:8412:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a35e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.195152:0:8412:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343275.195284:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+33:3661:x1848998412974208:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10143us (13266us total) trans 21474839212 rc 0/0 00000100:00100000:0.0:1763343275.195293:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7271 00000100:00100000:1.0:1763343275.195300:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c8385780 going to sleep for 11 seconds 00010000:00010000:0.0:1763343275.195314:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343275.195321:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a35e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.195329:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343275.195333:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a35e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.195340:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a35e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343275.195468:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4788000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998399872768:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 179us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343275.195478:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3473 00000004:00080000:3.0:1763343275.195526:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c9dc9500/2, rc 0, transno 17179871941 00000100:00100000:3.0:1763343275.195533:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9dc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412974720:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1763343275.195550:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a35e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763343275.195553:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c39b6680/2, rc 0, transno 21474839212 00000100:00100000:3.0:1763343275.195562:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c39b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412974208:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763343275.195563:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a35e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.195587:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.195590:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.195592:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343275.195612:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.195707:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399872896 00000100:00100000:1.0:1763343275.195712:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399872896 00000100:00100000:1.0:1763343275.195748:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7277 00000100:00100000:1.0:1763343275.195755:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:55884:x1848998399872896:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343275.195764:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343275.195777:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a361c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49684 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343275.195793:0:8414:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343275.195805:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.195808:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.195816:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a361c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49684 expref: 21 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.195827:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a361c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49684 expref: 21 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.195837:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176600, rc 0) 00000100:00100000:1.0:1763343275.195862:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:55884:x1848998399872896:12345-192.168.201.40@tcp:101:bash.0 Request processed in 108us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343275.195867:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7277 00000100:00100000:1.0:1763343275.200715:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.200744:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00002000:00010000:2.0:1763343275.200863:0:35266:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000400:0x2bf:0x0] updating lvb mtime: 0 -> 1763343274 00002000:00010000:2.0:1763343275.200868:0:35266:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000400:0x2bf:0x0] updating lvb atime: 0 -> 1763343274 00002000:00010000:2.0:1763343275.200870:0:35266:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000400:0x2bf:0x0] updating lvb ctime: 0 -> 1763343274 00000100:00100000:2.0:1763343275.200890:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412975488:192.168.201.40@tcp:106: 00010000:00010000:2.0:1763343275.200928:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3615 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4967d expref: 16 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343275.200950:0:35266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3615 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4967d expref: 16 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343275.200961:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176a00, rc 0) 00000100:00100000:2.0:1763343275.201020:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998399872512:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 6297us (6885us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343275.201050:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7276 00000100:00100000:0.0:1763343275.201208:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399873024 00000100:00100000:0.0:1763343275.201215:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399873024 00002000:00010000:0.0:1763343275.201254:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/703 (0->18446744073709551615) 00002000:00100000:0.0:1763343275.201278:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c59b4380 with x1848998399873024 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343275.201289:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c59b4380. 00000100:00100000:0.0:1763343275.201314:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399873152 00000100:00100000:0.0:1763343275.201317:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399873152 00002000:00010000:0.0:1763343275.201331:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/702 (0->18446744073709551615) 00002000:00100000:0.0:1763343275.201334:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c59b7800 with x1848998399873152 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343275.201340:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c59b7800. 00000100:00100000:0.0:1763343275.201358:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1733 00000100:00100000:0.0:1763343275.201367:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998399873024:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:0.0:1763343275.201549:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2bf:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343275.201553:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2bf:0x0] updating lvb mtime from disk: 1763343274 -> 1763343274 00002000:00010000:0.0:1763343275.201555:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2bf:0x0] updating lvb atime from disk: 1763343274 -> 0 00002000:00010000:0.0:1763343275.201557:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2bf:0x0] updating lvb ctime from disk: 1763343274 -> 1763343274 00002000:00010000:0.0:1763343275.201559:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2bf:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343275.201586:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399873024:12345-192.168.201.40@tcp:10:bash.0 Request processed in 220us (883us total) trans 17179871942 rc 0/0 00000100:00100000:0.0:1763343275.201593:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1733 00002000:00010000:0.0:1763343275.201596:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/703 (0->18446744073709551615) 00002000:00100000:0.0:1763343275.201598:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c59b4380 with x1848998399873024 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343275.201603:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c59b4380. 00000100:00100000:0.0:1763343275.201618:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1734 00000100:00100000:0.0:1763343275.201625:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399873152:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:0.0:1763343275.201713:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2be:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343275.201716:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2be:0x0] updating lvb mtime from disk: 0 -> 1763343274 00002000:00010000:0.0:1763343275.201719:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2be:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343275.201721:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2be:0x0] updating lvb ctime from disk: 0 -> 1763343274 00002000:00010000:0.0:1763343275.201723:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2be:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343275.201744:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2408:x1848998399873152:12345-192.168.201.40@tcp:10:bash.0 Request processed in 120us (1000us total) trans 21474839213 rc 0/0 00000100:00100000:0.0:1763343275.201750:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1734 00002000:00010000:0.0:1763343275.201753:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/702 (0->18446744073709551615) 00002000:00100000:0.0:1763343275.201755:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c59b7800 with x1848998399873152 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343275.201759:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c59b7800. 00000100:00100000:3.0:1763343275.205357:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.205943:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.206082:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399873408 00000100:00100000:2.0:1763343275.206094:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399873408 00000100:00100000:2.0:1763343275.206432:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399873664 00000100:00100000:2.0:1763343275.206437:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399873664 00000100:00100000:2.0:1763343275.206460:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3772 00000100:00100000:2.0:1763343275.206468:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57136:x1848998399873408:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343275.207059:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3773 00000100:00100000:1.0:1763343275.207070:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:55884:x1848998399873664:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:2.0:1763343275.207448:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57136:x1848998399873408:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 978us (2099us total) trans 4294973642 rc 0/0 00000100:00100000:2.0:1763343275.207456:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3772 00000100:00100000:1.0:1763343275.207568:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:55884:x1848998399873664:12345-192.168.201.40@tcp:35:bash.0 Request processed in 501us (1627us total) trans 4294973643 rc 0/0 00000100:00100000:1.0:1763343275.207575:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3773 00000100:00100000:1.0:1763343275.210617:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.210724:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399873792 00000100:00100000:0.0:1763343275.210734:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399873792 00000100:00100000:0.0:1763343275.211075:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10693 00000100:00100000:0.0:1763343275.211085:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57136:x1848998399873792:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343275.211108:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.211132:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3623 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4968b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.211196:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a362a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343275.211209:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a362a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.211225:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a362a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.211236:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3631 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343275.211241:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3631 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.211246:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3631 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.211339:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3638 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343275.211348:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3638 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.211354:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3638 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:0.0:1763343275.211390:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x208:0x0]: returning size 5 00000004:00200000:0.0:1763343275.211395:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343275.211412:0:6524:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3638 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.211423:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3638 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.211432:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a362a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.211438:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a362a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.211447:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a362a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.211453:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a362a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.211458:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fd800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.211462:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a362a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.211469:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a362a lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.211480:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48aa300) 00010000:00010000:0.0:1763343275.211483:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.211487:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a362a lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.211493:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a362a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.211506:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3631 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.211513:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3631 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.211518:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3631 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.211523:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fca00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.211525:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3631 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.211534:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3631 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.211541:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48aa600) 00010000:00010000:0.0:1763343275.211543:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.211545:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3631 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.211550:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3631 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.211578:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3623 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4968b expref: 298 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.211592:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3638 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4968b expref: 297 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.211599:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:0.0:1763343275.211601:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343275.211604:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fd600, rc 0) 00000100:00100000:0.0:1763343275.211658:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57136:x1848998399873792:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 575us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.211665:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10693 00000100:00100000:0.0:1763343275.217690:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.218518:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399874048 00000100:00100000:2.0:1763343275.218531:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399874048 00000100:00100000:2.0:1763343275.218587:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10694 00000100:00100000:2.0:1763343275.218599:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57136:x1848998399874048:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343275.218622:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.218646:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a363f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49692 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.218755:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3646 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343275.218770:0:6524:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a3607 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4966f expref: 298 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.218782:0:6524:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3638 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4968b expref: 298 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.218791:0:6524:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3646 lrc: 5/0,1 mode: --/CW res: [0x240000404:0x208:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.218826:0:6524:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3638 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4968b expref: 298 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.218839:0:6524:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3638 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4968b expref: 298 pid: 6524 timeout: 1168 lvb_type: 0 00000100:00100000:1.0:1763343275.219077:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.219130:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.219149:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399874432 00000100:00100000:1.0:1763343275.219154:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399874432 00000100:00100000:1.0:1763343275.219182:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10695 00000100:00100000:1.0:1763343275.219190:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57137:x1848998399874432:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:1.0:1763343275.219215:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00000100:00100000:3.0:1763343275.219403:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399874176 00000100:00100000:3.0:1763343275.219408:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399874176 00010000:00010000:3.0:1763343275.219427:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3638 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4968b expref: 300 pid: 6524 timeout: 1168 lvb_type: 0 00000100:00100000:3.0:1763343275.219460:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3474 00000100:00100000:3.0:1763343275.219468:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401cbb1f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:2408:x1848998399874176:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343275.219476:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343275.219481:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3638 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4968b expref: 300 pid: 6524 timeout: 1168 lvb_type: 0 00000100:00100000:2.0:1763343275.219738:0:6524:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b2a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412975616:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343275.219900:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a35ba lrc: 0/0,0 mode: --/CR res: [0x240000404:0x208:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49661 expref: 300 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.219922:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a359e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49653 expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.219935:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:1.0:1763343275.219940:0:9827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3646 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x208:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343275.219946:0:9827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3646 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x208:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343275.219952:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343275.219975:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a364d lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343275.219984:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a364d lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.219993:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a364d lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.220005:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3654 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343275.220011:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3654 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.220017:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3654 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.220112:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a365b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343275.220120:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3646 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x208:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343275.220126:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a365b lrc: 4/0,1 mode: --/EX res: [0x240000404:0x208:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.220139:0:9827:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3646 lrc: 5/0,1 mode: --/CW res: [0x240000404:0x208:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343275.220147:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a365b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x208:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.220245:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a3607 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4966f expref: 298 pid: 6524 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343275.220266:0:6524:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401ca058000 going to sleep for 11 seconds 00010000:00010000:3.0:1763343275.220415:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3638 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4968b expref: 297 pid: 6524 timeout: 1168 lvb_type: 0 00010000:00010000:3.0:1763343275.220429:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:3.0:1763343275.220433:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3646 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x208:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343275.220444:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3646 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x208:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343275.220448:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3646 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x208:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343275.220454:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a365b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x208:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.220458:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a365b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x208:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.220532:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343275.222624:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401cbb1f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:2408:x1848998399874176:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 3144us (3535us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.222643:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3474 00010000:00010000:2.0:1763343275.223349:0:6524:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.40@tcp) returned -22 from blocking AST (req@0000000067ec89dd x1848998412975616) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3638 lrc: 1/0,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4968b expref: 296 pid: 6524 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343275.223370:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3638 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4968b expref: 296 pid: 6524 timeout: 1168 lvb_type: 0 00000100:00100000:2.0:1763343275.223392:0:6524:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412975616:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343275.223415:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:2.0:1763343275.223420:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a365b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x208:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.223428:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a365b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x208:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.223436:0:6524:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3646 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x208:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.223445:0:6524:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3646 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x208:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.223451:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3646 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x208:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00000004:00200000:2.0:1763343275.223475:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x208:0x0]: returning size 5 00010000:00010000:2.0:1763343275.223605:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a363f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x208:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49692 expref: 297 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.223625:0:6524:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3646 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x208:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49692 expref: 296 pid: 6524 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343275.223634:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3646 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x208:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49692 expref: 296 pid: 6524 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343275.223641:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121e200, rc 0) 00000100:00100000:2.0:1763343275.223700:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57136:x1848998399874048:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 5102us (6020us total) trans 4294973644 rc 0/0 00000100:00100000:2.0:1763343275.223708:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10694 00000100:00100000:0.0:1763343275.228245:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.228651:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.228664:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399874560 00000100:00100000:2.0:1763343275.228676:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399874560 00000100:00100000:2.0:1763343275.228739:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10696 00000100:00100000:3.0:1763343275.228742:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399874688 00000100:00100000:3.0:1763343275.228746:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399874688 00000100:00100000:2.0:1763343275.228748:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57136:x1848998399874560:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343275.228769:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3646 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x208:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49692 expref: 297 pid: 6524 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343275.228771:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.228789:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a3669 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49699 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.228901:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3670 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343275.228916:0:6524:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a365b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x208:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.228925:0:6524:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3670 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.228943:0:6524:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a365b lrc: 4/0,1 mode: --/EX res: [0x240000404:0x208:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.228955:0:6524:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3670 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000100:00100000:3.0:1763343275.229069:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3475 00000100:00100000:3.0:1763343275.229077:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:2410:x1848998399874688:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343275.229088:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343275.229095:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3646 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x208:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49692 expref: 298 pid: 6524 timeout: 1168 lvb_type: 0 00010000:00010000:3.0:1763343275.229108:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3646 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x208:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49692 expref: 298 pid: 6524 timeout: 1168 lvb_type: 0 00010000:00010000:3.0:1763343275.229128:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3646 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x208:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49692 expref: 298 pid: 6524 timeout: 1168 lvb_type: 0 00010000:00010000:3.0:1763343275.229142:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:3.0:1763343275.229146:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a365b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x208:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.229153:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a365b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.229160:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a365b lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.229175:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3670 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343275.229181:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3670 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343275.229187:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3670 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343275.229208:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343275.229275:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a365b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.229283:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a365b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 9827 initiator: MDT1 00000004:00080000:1.0:1763343275.229565:0:9827:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x208:0x0] is inserted into orphan list, open count = 1 00010000:00010000:1.0:1763343275.229650:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a365b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.229657:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a365b lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.229663:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a365b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.229669:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343275.229672:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a365b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.229679:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a365b lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.229689:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00000100:00100000:3.0:1763343275.229690:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:2410:x1848998399874688:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 612us (1043us total) trans 0 rc 0/0 00010000:00010000:1.0:1763343275.229691:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343275.229694:0:9827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3670 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000100:00100000:3.0:1763343275.229698:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3475 00010000:00010000:1.0:1763343275.229701:0:9827:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3670 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343275.229706:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3670 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343275.229737:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a365b lrc: 2/0,0 mode: --/EX res: [0x240000404:0x208:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.229743:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a365b lrc: 0/0,0 mode: --/EX res: [0x240000404:0x208:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.229762:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a364d lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.229768:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a364d lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.229778:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a364d lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.229783:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a364d lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.229787:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343275.229790:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a364d lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.229795:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a364d lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.229802:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fc4f1e00) 00010000:00010000:1.0:1763343275.229804:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343275.229807:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a364d lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.229813:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a364d lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000004:00010000:1.0:1763343275.229826:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000001ce88a reply state 0000000071e522a3 transno 4294973645 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3654 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.229835:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3654 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.229840:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fc4f1000) 00010000:00010000:1.0:1763343275.229842:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343275.229845:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343275.229889:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57137:x1848998399874432:12345-192.168.201.40@tcp:36:rm.0 Request processed in 10701us (10759us total) trans 4294973645 rc 0/0 00000100:00100000:1.0:1763343275.229897:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10695 00010000:00010000:2.0:1763343275.230160:0:6524:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3670 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.230168:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3670 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:2.0:1763343275.230195:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x208:0x0]: returning size 5 00000004:00200000:2.0:1763343275.230199:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343275.230216:0:6524:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3670 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.230242:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a3669 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49699 expref: 298 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.230255:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3670 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49699 expref: 297 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.230276:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:2.0:1763343275.230279:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343275.230281:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121e800, rc 0) 00000100:00100000:2.0:1763343275.230316:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57136:x1848998399874560:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1569us (2088us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.230322:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10696 00000100:00100000:0.0:1763343275.235419:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.236483:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399874944 00000100:00100000:2.0:1763343275.236497:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399874944 00000100:00100000:2.0:1763343275.237133:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10697 00000100:00100000:2.0:1763343275.237148:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57136:x1848998399874944:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343275.237176:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.237201:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a3677 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b496a0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.237349:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a367e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343275.237364:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a367e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x208:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.237375:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a367e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x208:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:2.0:1763343275.237390:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x208:0x0]: returning size 5 00010000:00010000:2.0:1763343275.237534:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a3677 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x208:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496a0 expref: 300 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.237552:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a367e lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x208:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496a0 expref: 299 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.237561:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:2.0:1763343275.237564:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343275.237568:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121e200, rc 0) 00000100:00100000:2.0:1763343275.237659:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57136:x1848998399874944:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 515us (2252us total) trans 4294973646 rc 0/0 00000100:00100000:2.0:1763343275.237667:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10697 00000100:00100000:1.0:1763343275.242221:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.242414:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399875072 00000100:00100000:2.0:1763343275.242428:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399875072 00000100:00100000:2.0:1763343275.242505:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7278 00000100:00100000:2.0:1763343275.242516:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399875072:12345-192.168.201.40@tcp:1:lfs.0 00010000:00010000:2.0:1763343275.242566:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a368c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.242586:0:35266:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a360e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49676 expref: 16 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.242594:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343275.242596:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343275.242600:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a368c lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.242639:0:35266:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a360e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49676 expref: 16 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.242655:0:35266:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a360e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49676 expref: 16 pid: 8414 timeout: 1168 lvb_type: 0 00000100:00100000:2.0:1763343275.242670:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b2a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412975872:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343275.242759:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401ca058000 going to sleep for 11 seconds 00000100:00100000:0.0:1763343275.247803:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.248508:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412975872:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343275.248537:0:35266:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a368c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343275.248695:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399875200 00000100:00100000:2.0:1763343275.248705:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399875200 00000100:00100000:2.0:1763343275.248787:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10698 00000100:00100000:2.0:1763343275.248801:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57138:x1848998399875200:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343275.248827:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1763343275.248848:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:2.0:1763343275.248854:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a3693 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b496a7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343275.248917:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399875328 00000100:00100000:0.0:1763343275.248923:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399875328 00002000:00100000:0.0:1763343275.248954:0:8419:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x2bf:0x0] (0->4) req@ffff9400c791a680 x1848998399875328/t0(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:16/0 lens 496/0 e 0 to 0 dl 1763343286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763343275.248964:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c791a680 with x1848998399875328 ext(0->4) 00010000:00010000:0.0:1763343275.248971:0:8419:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a360e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49676 expref: 17 pid: 8414 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343275.248985:0:8419:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a360e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49676 expref: 17 pid: 8414 timeout: 1168 lvb_type: 0 00002000:00010000:0.0:1763343275.248994:0:8419:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9400c791a680 00000100:00100000:0.0:1763343275.249018:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 120 00000100:00100000:0.0:1763343275.249040:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998399875328:12345-192.168.201.40@tcp:4:bash.0 00010000:00010000:2.0:1763343275.249482:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a369a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343275.249498:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a369a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.249509:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a369a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.249521:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a36a1 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343275.249532:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a36a1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.249538:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a36a1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.249575:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a369a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.249582:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a369a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.249588:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a369a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.249595:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a369a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.249600:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.249605:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a369a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.249611:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a369a lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.249624:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758e00) 00010000:00010000:2.0:1763343275.249627:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.249632:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a369a lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.249638:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a369a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.249653:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a36a1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.249659:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a36a1 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.249665:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a36a1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.249669:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.249672:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a36a1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.249677:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a36a1 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.249684:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fc4f1000) 00010000:00010000:2.0:1763343275.249687:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.249690:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a36a1 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.249695:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a36a1 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.249722:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a3693 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496a7 expref: 300 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.249734:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758e00) 00010000:00010000:2.0:1763343275.249736:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.249739:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a3693 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496a7 expref: 300 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.249753:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121ea00, rc 0) 00000100:00100000:2.0:1763343275.249817:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57138:x1848998399875200:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1021us (2029us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343275.249824:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10698 00000100:00100000:1.0:1763343275.250096:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2407:x1848998399875328:12345-192.168.201.40@tcp:4:bash.0 Request processed in 1070us (1247us total) trans 17179871943 rc 0/0 00000100:00100000:1.0:1763343275.250104:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 120 00002000:00100000:1.0:1763343275.250111:0:8419:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x2bf:0x0] (0->4) req@ffff9400c791a680 x1848998399875328/t17179871943(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:16/0 lens 496/448 e 0 to 0 dl 1763343286 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763343275.250121:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c791a680 with x1848998399875328 ext(0->4) 00010000:00010000:1.0:1763343275.250127:0:8419:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a360e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49676 expref: 19 pid: 8414 timeout: 1168 lvb_type: 0 00010000:00010000:1.0:1763343275.250139:0:8419:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a360e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49676 expref: 19 pid: 8414 timeout: 1168 lvb_type: 0 00002000:00010000:1.0:1763343275.250145:0:8419:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9400c791a680 00000100:00100000:0.0:1763343275.254009:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.254502:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.254576:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399875456 00000100:00100000:2.0:1763343275.254587:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399875456 00000100:00100000:2.0:1763343275.254645:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10699 00000100:00100000:2.0:1763343275.254656:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6274700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57138:x1848998399875456:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343275.254680:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.254707:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a36a8 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b496ae expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.254784:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a36af lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343275.254799:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a36af lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.254811:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a36af lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.254821:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a36b6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343275.254828:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a36b6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.254835:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a36b6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.254873:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a36af lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.254880:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a36af lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.254887:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a36af lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.254893:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a36af lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.254898:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.254901:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a36af lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.254908:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a36af lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.254919:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758100) 00010000:00010000:2.0:1763343275.254922:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.254926:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a36af lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.254932:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a36af lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.254944:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a36b6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.254949:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a36b6 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.254960:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a36b6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.254965:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd9a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.254968:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a36b6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.254975:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a36b6 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.254982:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fc4f1000) 00010000:00010000:2.0:1763343275.254984:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.254987:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a36b6 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.254992:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a36b6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.255017:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a36a8 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496ae expref: 300 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.255051:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758100) 00010000:00010000:2.0:1763343275.255053:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.255057:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a36a8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496ae expref: 300 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.255071:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3200, rc 0) 00000100:00100000:2.0:1763343275.255124:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6274700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57138:x1848998399875456:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 470us (1125us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343275.255130:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10699 00000100:00100000:3.0:1763343275.255690:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399875584 00000100:00100000:3.0:1763343275.255697:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399875584 00010000:00010000:2.0:1763343275.255801:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a360e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49676 expref: 19 pid: 8414 timeout: 1168 lvb_type: 0 00000100:00100000:2.0:1763343275.255837:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3476 00000100:00100000:2.0:1763343275.255844:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2407:x1848998399875584:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343275.255862:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1763343275.255880:0:14071:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2bf:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:2.0:1763343275.255884:0:14071:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2bf:0x0] updating lvb atime from disk: 0 -> 1763343274 00002000:00010000:2.0:1763343275.255886:0:14071:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2bf:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1763343275.255891:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a360e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49676 expref: 19 pid: 8414 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343275.255902:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a360e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49676 expref: 19 pid: 8414 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343275.255919:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a360e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49676 expref: 19 pid: 8414 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343275.255932:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.255934:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.255938:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a368c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.255945:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a368c lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.255987:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343275.256053:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2407:x1848998399875584:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 209us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.256060:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3476 00010000:00010000:3.0:1763343275.256120:0:35266:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a368c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.256130:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a368c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.256147:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a368c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.256159:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a368c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.256166:0:35266:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a368c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.256172:0:35266:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121fc00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343275.256175:0:35266:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a368c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.256182:0:35266:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a368c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.256193:0:35266:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a368c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.256200:0:35266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a368c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343275.256244:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998399875072:12345-192.168.201.40@tcp:1:lfs.0 Request processed in 13729us (14035us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343275.256252:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7278 00000100:00100000:1.0:1763343275.258300:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.258374:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399875712 00000100:00100000:0.0:1763343275.258383:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399875712 00000100:00100000:0.0:1763343275.258439:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10700 00000100:00100000:0.0:1763343275.258448:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57138:x1848998399875712:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343275.258467:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.258488:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a36bd lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b496b5 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.258554:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a36c4 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343275.258568:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a36c4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.258583:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a36c4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:0.0:1763343275.258630:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343275.258635:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343275.258670:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a36bd lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496b5 expref: 301 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.258688:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a36c4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496b5 expref: 300 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.258697:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48aa300) 00010000:00010000:0.0:1763343275.258699:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343275.258703:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fd600, rc 0) 00000100:00100000:0.0:1763343275.259555:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57138:x1848998399875712:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1102us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.259563:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10700 00000100:00100000:1.0:1763343275.259754:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.259894:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399875968 00000100:00100000:2.0:1763343275.259902:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399875968 00000100:00100000:2.0:1763343275.259945:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10701 00000100:00100000:2.0:1763343275.259954:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57136:x1848998399875968:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:2.0:1763343275.259991:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343275.260012:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3670 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49699 expref: 300 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.260107:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:2.0:1763343275.260113:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343275.260137:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a36cb lrc: 3/0,1 mode: --/EX res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343275.260149:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a36cb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.260157:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a36cb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000040:00080000:2.0:1763343275.260382:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1738, 88 off144648 00000004:00080000:2.0:1763343275.260391:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1068384365619ns, next at 1069016397451ns, rc = 0 00000040:00080000:2.0:1763343275.260435:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1730, 88 off143992 00000004:00080000:2.0:1763343275.260440:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1068384415170ns, next at 1069016426495ns, rc = 0 00000040:00080000:2.0:1763343275.260467:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1731, 88 off144080 00000004:00080000:2.0:1763343275.260471:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1068384446672ns, next at 1069016426495ns, rc = 0 00000040:00080000:2.0:1763343275.260482:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1739, 88 off144736 00000004:00080000:2.0:1763343275.260486:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1068384461304ns, next at 1069016397451ns, rc = 0 00000100:00100000:1.0:1763343275.263963:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.264068:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399876096 00000100:00100000:3.0:1763343275.264078:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399876096 00000100:00100000:2.0:1763343275.264619:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10702 00000100:00100000:2.0:1763343275.264630:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57138:x1848998399876096:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343275.264652:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000001:00080000:3.0:1763343275.264664:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973647 is committed 00000004:00080000:3.0:1763343275.264677:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1117 committed 00010000:00010000:2.0:1763343275.264677:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a36d2 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b496bc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763343275.264688:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1109 committed 00000004:00080000:3.0:1763343275.264695:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1108 committed 00000004:00080000:3.0:1763343275.264698:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1116 committed 00010000:00010000:2.0:1763343275.264750:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a36d9 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343275.264766:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a36d9 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.264778:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a36d9 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.264788:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a36e0 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343275.264796:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a36e0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.264802:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a36e0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000100:00100000:3.0:1763343275.264825:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412976128:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1763343275.264841:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a36d9 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.264847:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a36d9 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.264853:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a36d9 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.264859:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a36d9 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.264864:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.264881:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a36d9 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00000100:00100000:3.0:1763343275.264883:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763343275.264893:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a36d9 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.264904:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48aa300) 00010000:00010000:2.0:1763343275.264908:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.264913:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a36d9 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000100:00100000:3.0:1763343275.264918:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1763343275.264919:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a36d9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000100:00100000:3.0:1763343275.264923:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4789180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412976000:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1763343275.264934:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a36e0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.264941:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a36e0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00000100:00100000:3.0:1763343275.264944:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763343275.264946:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a36e0 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.264951:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.264954:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a36e0 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.264959:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a36e0 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00000100:00100000:3.0:1763343275.264964:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412976128 00010000:00010000:2.0:1763343275.264966:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fc4f1000) 00000100:00100000:3.0:1763343275.264968:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412976128 00010000:00010000:2.0:1763343275.264968:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.264971:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a36e0 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.264977:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a36e0 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000100:00100000:3.0:1763343275.264996:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412976000 00000100:00100000:3.0:1763343275.264999:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412976000 00010000:00010000:2.0:1763343275.265004:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a36d2 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496bc expref: 295 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.265017:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48aa300) 00010000:00010000:2.0:1763343275.265019:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343275.265043:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7279 00010000:00010000:2.0:1763343275.265043:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a36d2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496bc expref: 295 pid: 6524 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343275.265050:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+18:3662:x1848998412976128:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1763343275.265053:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121ea00, rc 0) 00000100:00100000:2.0:1763343275.265075:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7280 00000100:00100000:2.0:1763343275.265081:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+18:3662:x1848998412976000:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343275.265208:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+20:3662:x1848998412976000:12345-0@lo:2:osp-syn-1-1.0 Request processed in 124us (261us total) trans 17179871944 rc 0/0 00000100:00100000:2.0:1763343275.265215:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7280 00010000:00010000:1.0:1763343275.265220:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3654 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.265227:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3654 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.265233:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3654 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.265238:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343275.265241:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3654 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.265246:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3654 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.265255:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fc4f1000) 00010000:00010000:1.0:1763343275.265270:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343275.265273:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3654 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.265278:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3654 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000100:00100000:2.0:1763343275.265288:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57138:x1848998399876096:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 660us (1336us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343275.265294:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10702 00000100:00100000:1.0:1763343275.265305:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4789c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412976256:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343275.265333:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343275.265356:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763343275.265362:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412976384:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343275.265381:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343275.265486:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412976256 00000100:00100000:1.0:1763343275.265491:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412976256 00000004:00010000:2.0:1763343275.265564:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000092e7dc8e reply state 0000000061b81519 transno 4294973647 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a36cb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.265576:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a36cb lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.265583:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:2.0:1763343275.265585:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1763343275.265588:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1763343275.265635:0:9827:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1763343275.265647:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57136:x1848998399875968:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 5695us (5894us total) trans 4294973647 rc 0/0 00000100:00100000:2.0:1763343275.265654:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10701 00002000:00010000:3.0:1763343275.266485:0:35266:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2c0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343275.266490:0:35266:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2c0:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343275.266492:0:35266:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2c0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343275.266494:0:35266:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2c0:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343275.266496:0:35266:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2c0:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343275.266540:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+19:3662:x1848998412976128:12345-0@lo:2:osp-syn-1-1.0 Request processed in 1489us (1654us total) trans 17179871945 rc 0/0 00000100:00100000:3.0:1763343275.266549:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7279 00000100:00100000:1.0:1763343275.266565:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412976384 00000100:00100000:3.0:1763343275.266570:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7281 00000100:00100000:1.0:1763343275.266573:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412976384 00000100:00100000:3.0:1763343275.266581:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+34:3659:x1848998412976256:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763343275.266679:0:35266:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2be:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343275.266682:0:35266:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2be:0x0] updating lvb mtime from disk: 1763343274 -> 1763343274 00002000:00010000:3.0:1763343275.266684:0:35266:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2be:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343275.266686:0:35266:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2be:0x0] updating lvb ctime from disk: 1763343274 -> 1763343274 00002000:00010000:3.0:1763343275.266688:0:35266:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2be:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343275.266722:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+35:3659:x1848998412976256:12345-0@lo:2:osp-syn-0-1.0 Request processed in 145us (1388us total) trans 21474839214 rc 0/0 00000100:00100000:3.0:1763343275.266728:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7281 00000100:00100000:3.0:1763343275.266741:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7282 00000100:00100000:3.0:1763343275.266747:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+34:3659:x1848998412976384:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763343275.266791:0:35266:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2bf:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343275.266794:0:35266:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2bf:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343275.266796:0:35266:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2bf:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343275.266798:0:35266:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2bf:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343275.266800:0:35266:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2bf:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343275.266823:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+35:3659:x1848998412976384:12345-0@lo:2:osp-syn-0-1.0 Request processed in 77us (1441us total) trans 21474839215 rc 0/0 00000100:00100000:3.0:1763343275.266830:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7282 00010000:00010000:0.0:1763343275.267277:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a36cb lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.267286:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a36cb lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.267292:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a36cb lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.267297:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd8e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.267303:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a36cb lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.267313:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a36cb lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.267327:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:0.0:1763343275.267329:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343275.267333:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a36cb lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.267338:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a36cb lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000004:00080000:2.0:1763343275.268215:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c4789180/2, rc 0, transno 17179871944 00000100:00100000:2.0:1763343275.268225:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4789180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412976000:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1763343275.268238:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c4789880/2, rc 0, transno 17179871945 00000100:00100000:2.0:1763343275.268240:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412976128:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1763343275.268292:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c4788000/2, rc 0, transno 21474839215 00000100:00100000:2.0:1763343275.268297:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412976384:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763343275.268306:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c4789c00/2, rc 0, transno 21474839214 00000100:00100000:2.0:1763343275.268310:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4789c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412976256:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343275.272994:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.273065:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.273403:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399876224 00000100:00100000:3.0:1763343275.273416:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399876224 00000100:00100000:3.0:1763343275.273471:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399876480 00000100:00100000:3.0:1763343275.273475:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399876480 00000100:00100000:0.0:1763343275.274463:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10703 00000100:00100000:0.0:1763343275.274479:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57136:x1848998399876224:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343275.274507:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.274532:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a36e7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b496c3 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.274599:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a36e7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496c3 expref: 294 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.274616:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a36e7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496c3 expref: 294 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.274637:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:0.0:1763343275.274640:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343275.274644:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fdc00, rc 0) 00000100:00100000:0.0:1763343275.274718:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57136:x1848998399876224:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 245us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.274726:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10703 00000100:00100000:0.0:1763343275.274750:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10704 00000100:00100000:0.0:1763343275.274757:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6275500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+293:57138:x1848998399876480:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343275.274765:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.274767:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343275.274786:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a36c4 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496b5 expref: 293 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.274805:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48aa300) 00010000:00010000:0.0:1763343275.274814:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343275.274825:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a36ee lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b496ca expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.274949:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a36f5 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343275.274958:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a36f5 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.274968:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a36f5 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.274981:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a36fc lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343275.274987:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a36fc lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.274994:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a36fc lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.277677:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a3703 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343275.277697:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a3703 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.277707:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a3703 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343275.277718:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x20a:0x0]: returning size 0 00010000:00010000:0.0:1763343275.277743:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a36f5 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.277749:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a36f5 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.277755:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a36f5 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.277761:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a36f5 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.277766:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8693e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.277770:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a36f5 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.277776:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a36f5 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.277787:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48aa600) 00010000:00010000:0.0:1763343275.277790:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.277794:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a36f5 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.277804:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a36f5 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00010000:0.0:1763343275.277819:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c9d079d8 reply state 00000000855a2459 transno 4294973648 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a36fc lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.277828:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a36fc lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.277835:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48aa000) 00010000:00010000:0.0:1763343275.277837:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343275.277840:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343275.277878:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a36ee lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496ca expref: 295 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.277896:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a3703 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496ca expref: 294 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.277902:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20a:0x0].0x0 (ffff9400c48aa900) 00010000:00010000:0.0:1763343275.277904:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343275.277907:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8693c00, rc 0) 00000100:00100000:0.0:1763343275.277990:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6275500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57138:x1848998399876480:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3232us (4923us total) trans 4294973648 rc 0/0 00000100:00100000:0.0:1763343275.277999:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10704 00000100:00100000:1.0:1763343275.281687:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.282440:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.282863:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399876864 00000100:00100000:2.0:1763343275.282875:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399876864 00000100:00100000:3.0:1763343275.282936:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399876736 00000100:00100000:3.0:1763343275.282941:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399876736 00000100:00100000:3.0:1763343275.283052:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10705 00000100:00100000:3.0:1763343275.283064:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57136:x1848998399876864:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343275.283092:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343275.283116:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a3711 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b496d8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.283191:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a3718 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343275.283210:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a3718 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343275.283221:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a3718 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000100:00100000:2.0:1763343275.283989:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10706 00000100:00100000:2.0:1763343275.284001:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57138:x1848998399876736:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343275.284011:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.284038:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a371f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b496d1 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.284109:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3726 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343275.284120:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a3703 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496ca expref: 298 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.284128:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3726 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.284164:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a3703 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496ca expref: 298 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.284177:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a3703 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496ca expref: 298 pid: 7641 timeout: 1168 lvb_type: 0 00000100:00100000:2.0:1763343275.284189:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b28e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412976512:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343275.284293:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401ca058000 going to sleep for 11 seconds 00000004:00200000:3.0:1763343275.284999:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x208:0x0]: returning size 5 00000004:00200000:3.0:1763343275.285005:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343275.285061:0:6524:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a3718 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343275.285094:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a3711 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496d8 expref: 299 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.285111:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a3718 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496d8 expref: 298 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.285119:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:3.0:1763343275.285122:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1763343275.285125:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c6b98000, rc 0) 00000100:00100000:3.0:1763343275.285169:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57136:x1848998399876864:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2107us (3494us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343275.285177:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10705 00000100:00100000:0.0:1763343275.288507:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.288774:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b28e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412976512:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343275.288810:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3726 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:1.0:1763343275.288881:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399876992 00000100:00100000:1.0:1763343275.288890:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399876992 00010000:00010000:1.0:1763343275.288930:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a3703 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496ca expref: 298 pid: 7641 timeout: 1168 lvb_type: 0 00000100:00100000:1.0:1763343275.288968:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3477 00000100:00100000:1.0:1763343275.288977:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6275880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:2408:x1848998399876992:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343275.288993:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343275.288999:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a3703 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496ca expref: 298 pid: 7641 timeout: 1168 lvb_type: 0 00010000:00010000:1.0:1763343275.289011:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a3703 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496ca expref: 298 pid: 7641 timeout: 1168 lvb_type: 0 00010000:00010000:1.0:1763343275.292460:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a3703 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496ca expref: 298 pid: 7641 timeout: 1168 lvb_type: 0 00010000:00010000:1.0:1763343275.292490:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20a:0x0].0x0 (ffff9400c48aa900) 00010000:00010000:1.0:1763343275.292496:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3726 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.292506:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3726 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.292512:0:7904:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3726 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.292556:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343275.292636:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6275880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:2408:x1848998399876992:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 3658us (4139us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343275.292646:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3477 00010000:00010000:2.0:1763343275.293178:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3726 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.293191:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3726 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343275.293221:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x20a:0x0]: returning size 0 00000004:00080000:2.0:1763343275.293410:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2c0:0x0], index 0: 0 00000004:00080000:2.0:1763343275.293417:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2c1:0x0], index 1: 0 00000004:00080000:2.0:1763343275.293422:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2c2:0x0], index 1: 0 00000004:00080000:2.0:1763343275.293426:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2c1:0x0], index 0: 0 00010000:00010000:2.0:1763343275.293530:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3726 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.293538:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3726 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.293548:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3726 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.293554:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.293558:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3726 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.293565:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3726 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.293577:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20a:0x0].0x0 (ffff9400c48aa900) 00010000:00010000:2.0:1763343275.293580:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343275.293584:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3726 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.293590:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3726 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.293642:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a371f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x20a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496d1 expref: 297 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.293654:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20a:0x0].0x0 (ffff9400c48aa900) 00010000:00010000:2.0:1763343275.293656:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343275.293659:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a371f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x20a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496d1 expref: 297 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.293672:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3c00, rc 0) 00000100:00100000:2.0:1763343275.293719:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57138:x1848998399876736:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 9721us (11281us total) trans 4294973649 rc 301/301 00000100:00100000:2.0:1763343275.293726:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10706 00000100:00100000:1.0:1763343275.298834:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.299453:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399877120 00000100:00100000:2.0:1763343275.299464:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399877120 00000100:00100000:2.0:1763343275.299529:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7283 00000100:00100000:2.0:1763343275.299540:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998399877120:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343275.299562:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.299584:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3734 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b496df expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343275.299607:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2bf:0x0] initial LVB size: 5, mtime: 0x691a7baa, atime: 0x691a7baa, ctime: 0x691a7baa, blocks: 0x8 00010000:00010000:2.0:1763343275.299625:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.299628:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.299641:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3734 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496df expref: 18 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343275.299657:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3734 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496df expref: 18 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343275.299671:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3200, rc 0) 00000100:00100000:2.0:1763343275.299726:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2407:x1848998399877120:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 188us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.299733:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7283 00000100:00100000:1.0:1763343275.304984:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.305097:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399877376 00000100:00100000:2.0:1763343275.305107:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399877376 00000100:00100000:2.0:1763343275.305157:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3774 00000100:00100000:2.0:1763343275.305166:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8441c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57138:x1848998399877376:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343275.305503:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8441c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57138:x1848998399877376:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 337us (532us total) trans 4294973650 rc 0/0 00000100:00100000:2.0:1763343275.305514:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3774 00000100:00100000:1.0:1763343275.308723:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.308794:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399877632 00000100:00100000:3.0:1763343275.308805:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399877632 00000100:00100000:3.0:1763343275.308861:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3775 00000100:00100000:3.0:1763343275.308871:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57138:x1848998399877632:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343275.310134:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57138:x1848998399877632:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1259us (1417us total) trans 4294973651 rc 0/0 00000100:00100000:3.0:1763343275.310147:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3775 00000100:00100000:1.0:1763343275.316967:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.317073:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399877888 00000100:00100000:2.0:1763343275.317084:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399877888 00000100:00100000:2.0:1763343275.317142:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10707 00000100:00100000:2.0:1763343275.317150:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:55884:x1848998399877888:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343275.317177:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.317200:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a373b lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b496e6 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.317361:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3742 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343275.317376:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3742 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.317388:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3742 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.317397:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3749 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343275.317405:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3749 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.317410:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3749 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.317471:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3750 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343275.317478:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3750 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.317485:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3750 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343275.317494:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x20a:0x0]: returning size 0 00010000:00010000:2.0:1763343275.317577:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3742 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.317584:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3742 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.317590:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3742 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.317596:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3742 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.317602:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.317606:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3742 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.317612:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3742 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.317625:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758600) 00010000:00010000:2.0:1763343275.317627:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.317632:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3742 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.317637:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3742 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.317650:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3749 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.317660:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3749 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.317664:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3749 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.317669:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.317671:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3749 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.317675:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3749 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.317681:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48aa000) 00010000:00010000:2.0:1763343275.317683:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.317686:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3749 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.317691:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3749 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.317725:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a373b lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496e6 expref: 301 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.317740:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3750 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496e6 expref: 300 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.317746:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20a:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:2.0:1763343275.317748:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343275.317750:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5bd8e00, rc 0) 00000100:00100000:2.0:1763343275.317814:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:55884:x1848998399877888:12345-192.168.201.40@tcp:101:bash.0 Request processed in 663us (858us total) trans 4294973652 rc 0/0 00000100:00100000:2.0:1763343275.317822:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10707 00000100:00100000:1.0:1763343275.323354:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.323531:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399878016 00000100:00100000:0.0:1763343275.323542:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399878016 00000100:00100000:0.0:1763343275.323602:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10708 00000100:00100000:0.0:1763343275.323613:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:55884:x1848998399878016:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343275.323641:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.323664:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a375e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b496ed expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.323699:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a3765 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343275.323713:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a3765 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.323723:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a3765 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.323840:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a375e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496ed expref: 302 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.323857:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a3765 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496ed expref: 301 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.323867:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20a:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:0.0:1763343275.323870:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343275.323873:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8693c00, rc 0) 00000100:00100000:0.0:1763343275.323936:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:55884:x1848998399878016:12345-192.168.201.40@tcp:101:bash.0 Request processed in 325us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.323943:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10708 00000100:00100000:1.0:1763343275.326860:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.327296:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399878272 00000100:00100000:2.0:1763343275.327306:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399878272 00000100:00100000:2.0:1763343275.327944:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10709 00000100:00100000:2.0:1763343275.327957:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:55884:x1848998399878272:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:2.0:1763343275.328011:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343275.328185:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3750 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496e6 expref: 301 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.328208:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20a:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:2.0:1763343275.328213:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343275.328526:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a376c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343275.328539:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a376c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.328547:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a376c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000001:00080000:2.0:1763343275.328594:0:7641:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973653 00000004:00010000:2.0:1763343275.328623:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000464a07f1 reply state 000000007e0143b0 transno 4294973654 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a376c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.328634:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a376c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.328640:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20a:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:2.0:1763343275.328643:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343275.328645:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343275.328750:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:55884:x1848998399878272:12345-192.168.201.40@tcp:36:bash.0 Request processed in 796us (1904us total) trans 4294973654 rc 0/0 00000100:00100000:2.0:1763343275.328758:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10709 00000020:00080000:2.0:1763343275.328763:0:7641:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343275.333493:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.333598:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399878400 00000100:00100000:2.0:1763343275.333609:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399878400 00000100:00100000:2.0:1763343275.333673:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10710 00000100:00100000:2.0:1763343275.333684:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:55884:x1848998399878400:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343275.333709:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.333733:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3773 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b496f4 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.333797:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3773 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496f4 expref: 304 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.333813:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3773 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496f4 expref: 304 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.333831:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20a:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:2.0:1763343275.333834:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343275.333838:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3c00, rc 0) 00000100:00100000:2.0:1763343275.333896:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:55884:x1848998399878400:12345-192.168.201.40@tcp:101:bash.0 Request processed in 214us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.333903:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10710 00000100:00100000:1.0:1763343275.338379:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.338481:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399878656 00000100:00100000:0.0:1763343275.338493:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399878656 00000100:00100000:0.0:1763343275.338560:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10711 00000100:00100000:0.0:1763343275.338570:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:55884:x1848998399878656:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343275.338590:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.338594:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343275.338620:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3773 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496f4 expref: 304 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.338638:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20a:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:0.0:1763343275.338643:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343275.338656:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a377a lrc: 2/0,0 mode: --/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b496fb expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.338705:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a3781 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343275.338718:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a3781 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.338726:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a3781 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000040:00080000:0.0:1763343275.338996:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1732, 88 off144168 00000004:00080000:0.0:1763343275.339004:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1068462979261ns, next at 1069016426495ns, rc = 0 00000040:00080000:0.0:1763343275.339098:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1740, 88 off144824 00000004:00080000:0.0:1763343275.339104:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1068463078947ns, next at 1069016397451ns, rc = 0 00000040:00080000:0.0:1763343275.339159:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1741, 88 off144912 00000004:00080000:0.0:1763343275.339164:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1068463139700ns, next at 1069016397451ns, rc = 0 00000040:00080000:0.0:1763343275.339183:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1733, 88 off144256 00000004:00080000:0.0:1763343275.339188:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1068463163039ns, next at 1069016426495ns, rc = 0 00000001:00080000:1.0:1763343275.342380:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973655 is committed 00000004:00080000:1.0:1763343275.342397:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1111 committed 00010000:00010000:0.0:1763343275.342490:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a36fc lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.342508:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a36fc lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.342517:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a36fc lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.342523:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8692c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.342529:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a36fc lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.342537:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a36fc lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.342556:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48aa000) 00010000:00010000:0.0:1763343275.342560:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.342566:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a36fc lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.342572:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a36fc lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.342605:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a376c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.342610:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a376c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.342615:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a376c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.342621:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd9a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.342623:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a376c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.342629:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a376c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.342637:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20a:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:0.0:1763343275.342639:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.342642:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a376c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.342648:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a376c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00080000:1.0:1763343275.342760:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1119 committed 00000004:00080000:1.0:1763343275.342774:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1118 committed 00000004:00080000:1.0:1763343275.342777:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1110 committed 00000100:00100000:2.0:1763343275.342910:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412976640:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343275.343000:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343275.343523:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412976640 00000100:00100000:1.0:1763343275.343537:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412976640 00000100:00100000:1.0:1763343275.343598:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7284 00000100:00100000:1.0:1763343275.343610:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+35:3661:x1848998412976640:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343275.344042:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c511ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412976768:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343275.344082:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343275.344129:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412976768 00000100:00100000:3.0:1763343275.344134:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412976768 00000100:00100000:3.0:1763343275.344167:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7285 00000100:00100000:3.0:1763343275.344175:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+19:3662:x1848998412976768:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343275.344307:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+20:3662:x1848998412976768:12345-0@lo:2:osp-syn-1-1.0 Request processed in 131us (223us total) trans 17179871946 rc 0/0 00000100:00100000:3.0:1763343275.344314:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7285 00000004:00080000:3.0:1763343275.344370:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c511ed80/2, rc 0, transno 17179871946 00000100:00100000:3.0:1763343275.344378:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c511ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412976768:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343275.344403:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412976896:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343275.344431:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343275.344459:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412976896 00000100:00100000:3.0:1763343275.344463:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412976896 00000100:00100000:3.0:1763343275.344486:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7286 00000100:00100000:3.0:1763343275.344493:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+37:3659:x1848998412976896:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343275.344586:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+38:3659:x1848998412976896:12345-0@lo:2:osp-syn-0-1.0 Request processed in 93us (154us total) trans 21474839217 rc 0/0 00000100:00100000:3.0:1763343275.344593:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7286 00000004:00080000:3.0:1763343275.344622:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5a3d500/2, rc 0, transno 21474839217 00000100:00100000:3.0:1763343275.344628:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412976896:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343275.345178:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+37:3661:x1848998412976640:12345-0@lo:2:osp-syn-0-1.0 Request processed in 1566us (2175us total) trans 21474839216 rc 0/0 00000100:00100000:1.0:1763343275.345187:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7284 00000100:00100000:0.0:1763343275.345373:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c511d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412977024:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343275.345406:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763343275.345491:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a3781 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x20a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496fb expref: 296 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.345507:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20a:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:0.0:1763343275.345511:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343275.345531:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a377a lrc: 0/0,0 mode: --/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496fb expref: 296 pid: 9827 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763343275.345550:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a3781 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x20a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496fb expref: 295 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.345583:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20a:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:0.0:1763343275.345586:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343275.345588:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a4200, rc 0) 00000100:00100000:0.0:1763343275.345637:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:55884:x1848998399878656:12345-192.168.201.40@tcp:101:bash.0 Request processed in 7069us (7272us total) trans 4294973655 rc 0/0 00000100:00100000:0.0:1763343275.345649:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10711 00000100:00100000:1.0:1763343275.345818:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412977024 00000100:00100000:1.0:1763343275.345824:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412977024 00000100:00100000:1.0:1763343275.345864:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7287 00000100:00100000:1.0:1763343275.345872:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c511c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+20:3660:x1848998412977024:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343275.346021:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c511c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+21:3660:x1848998412977024:12345-0@lo:2:osp-syn-1-1.0 Request processed in 150us (613us total) trans 17179871947 rc 0/0 00000100:00100000:1.0:1763343275.346052:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7287 00000004:00080000:1.0:1763343275.346089:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c511d500/2, rc 0, transno 17179871947 00000100:00100000:1.0:1763343275.346095:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c511d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412977024:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1763343275.346170:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5a3e300/2, rc 0, transno 21474839216 00000100:00100000:2.0:1763343275.346177:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412976640:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343275.349280:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.349573:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399878784 00000100:00100000:0.0:1763343275.349584:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399878784 00000100:00100000:0.0:1763343275.349644:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7288 00000100:00100000:0.0:1763343275.349655:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:55884:x1848998399878784:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343275.349673:0:11289:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.349698:0:11289:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a4000/0x9104b1ba770a3788 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49702 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343275.349721:0:11289:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343275.349742:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.349745:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.349755:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a4000/0x9104b1ba770a3788 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49702 expref: 23 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.349771:0:11289:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a4000/0x9104b1ba770a3788 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49702 expref: 23 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.349783:0:11289:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a4000, rc 0) 00000100:00100000:0.0:1763343275.350012:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:55884:x1848998399878784:12345-192.168.201.40@tcp:101:bash.0 Request processed in 357us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.350019:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7288 00000100:00100000:3.0:1763343275.353356:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.355078:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399878912 00000100:00100000:0.0:1763343275.355094:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399878912 00000100:00100000:0.0:1763343275.355178:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7289 00000100:00100000:0.0:1763343275.355189:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:55884:x1848998399878912:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343275.355213:0:11289:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.355243:0:11289:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a378f lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49709 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343275.355289:0:11289:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343275.355315:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.355318:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.355328:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a378f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49709 expref: 19 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.355343:0:11289:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a378f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49709 expref: 19 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.355358:0:11289:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8693e00, rc 0) 00000100:00100000:0.0:1763343275.355439:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:55884:x1848998399878912:12345-192.168.201.40@tcp:101:bash.0 Request processed in 251us (2095us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.355446:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7289 00000100:00100000:2.0:1763343275.360835:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.361402:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.361840:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399879168 00000100:00100000:1.0:1763343275.361840:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399879040 00000100:00100000:3.0:1763343275.361851:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399879168 00000100:00100000:1.0:1763343275.361851:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399879040 00002000:00010000:3.0:1763343275.361895:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/705 (0->18446744073709551615) 00002000:00010000:1.0:1763343275.361895:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/704 (0->18446744073709551615) 00002000:00100000:3.0:1763343275.361901:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b28000 with x1848998399879168 ext(0->18446744073709551615) 00002000:00100000:1.0:1763343275.361901:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b29f80 with x1848998399879040 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343275.361915:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5b28000. 00002000:00010000:1.0:1763343275.361915:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5b29f80. 00000100:00100000:1.0:1763343275.361953:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1735 00000100:00100000:3.0:1763343275.361958:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1736 00000100:00100000:1.0:1763343275.361962:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2409:x1848998399879040:12345-192.168.201.40@tcp:10:bash.0 00000100:00100000:3.0:1763343275.361964:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2409:x1848998399879168:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:3.0:1763343275.362142:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2c1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343275.362142:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2c0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343275.362146:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2c1:0x0] updating lvb mtime from disk: 0 -> 1763343274 00002000:00010000:1.0:1763343275.362146:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2c0:0x0] updating lvb mtime from disk: 0 -> 1763343274 00002000:00010000:3.0:1763343275.362150:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343275.362150:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2c0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343275.362152:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2c1:0x0] updating lvb ctime from disk: 0 -> 1763343274 00002000:00010000:1.0:1763343275.362153:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2c0:0x0] updating lvb ctime from disk: 0 -> 1763343274 00002000:00010000:3.0:1763343275.362155:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2c1:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1763343275.362155:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2c0:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343275.362208:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2409:x1848998399879168:12345-192.168.201.40@tcp:10:bash.0 Request processed in 243us (806us total) trans 17179871948 rc 0/0 00000100:00100000:3.0:1763343275.362214:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1736 00002000:00010000:3.0:1763343275.362218:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/705 (0->18446744073709551615) 00002000:00100000:3.0:1763343275.362221:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b28000 with x1848998399879168 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343275.362225:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5b28000. 00000100:00100000:1.0:1763343275.362619:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2409:x1848998399879040:12345-192.168.201.40@tcp:10:bash.0 Request processed in 655us (1797us total) trans 21474839218 rc 0/0 00000100:00100000:1.0:1763343275.362627:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1735 00002000:00010000:1.0:1763343275.362630:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/704 (0->18446744073709551615) 00002000:00100000:1.0:1763343275.362634:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b29f80 with x1848998399879040 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343275.362639:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5b29f80. 00000100:00100000:3.0:1763343275.362857:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.362974:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399879296 00000100:00100000:1.0:1763343275.362981:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399879296 00000100:00100000:1.0:1763343275.363019:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7290 00000100:00100000:1.0:1763343275.363073:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399879296:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:1.0:1763343275.363444:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399879296:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 402us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343275.363452:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7290 00000100:00100000:3.0:1763343275.366430:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.366547:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399879424 00000100:00100000:2.0:1763343275.366559:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399879424 00000100:00100000:2.0:1763343275.366629:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7291 00000100:00100000:2.0:1763343275.366640:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2410:x1848998399879424:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:2.0:1763343275.366769:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2410:x1848998399879424:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 130us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.366778:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7291 00000100:00100000:3.0:1763343275.369990:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.370301:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399879680 00000100:00100000:2.0:1763343275.370315:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399879680 00000100:00100000:2.0:1763343275.370473:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3776 00000100:00100000:2.0:1763343275.370487:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:55884:x1848998399879680:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:2.0:1763343275.371085:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:55884:x1848998399879680:12345-192.168.201.40@tcp:35:bash.0 Request processed in 597us (1104us total) trans 4294973656 rc 0/0 00000100:00100000:2.0:1763343275.371093:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3776 00000100:00100000:1.0:1763343275.373243:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.374252:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399879808 00000100:00100000:2.0:1763343275.374274:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399879808 00000100:00100000:2.0:1763343275.374350:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1737 00000100:00100000:2.0:1763343275.374361:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2410:x1848998399879808:12345-192.168.201.40@tcp:3:lfs.0 00010000:00010000:2.0:1763343275.374404:0:28399:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3796 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.374423:0:28399:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.374425:0:28399:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.374431:0:28399:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3796 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.374446:0:28399:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3796 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.374567:0:28399:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3796 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.374576:0:28399:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3796 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.374583:0:28399:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3796 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.374591:0:28399:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343275.374596:0:28399:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3796 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.374606:0:28399:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3796 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.374623:0:28399:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3796 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.374630:0:28399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3796 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343275.374712:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2410:x1848998399879808:12345-192.168.201.40@tcp:3:lfs.0 Request processed in 352us (1477us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763343275.374719:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1737 00000100:00100000:3.0:1763343275.379391:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.379431:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.379657:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399879936 00000100:00100000:0.0:1763343275.379668:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399879936 00000100:00100000:0.0:1763343275.379714:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399880064 00000100:00100000:0.0:1763343275.379716:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399880064 00000100:00100000:0.0:1763343275.379741:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10712 00000100:00100000:0.0:1763343275.379750:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c372b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57139:x1848998399879936:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:0.0:1763343275.379772:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.379795:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a379d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49710 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.379863:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a37a4 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343275.379877:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a37a4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.379890:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a37a4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.379903:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a37ab lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343275.379910:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a37ab lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.379916:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a37ab lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.379996:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a37b2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343275.380004:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a37b2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.380010:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a37b2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:0.0:1763343275.380086:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x20a:0x0]: returning size 5 00000004:00200000:0.0:1763343275.380092:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343275.380115:0:9827:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a37b2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.380127:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a37b2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.380135:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a37a4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.380144:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a37a4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.380150:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a37a4 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.380156:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a37a4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.380162:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff940202040400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.380167:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a37a4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.380174:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a37a4 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.380187:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53f00) 00010000:00010000:0.0:1763343275.380190:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.380195:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a37a4 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.380201:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a37a4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.380217:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a37ab lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.380223:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a37ab lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.380228:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a37ab lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.380232:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff940202041000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.380235:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a37ab lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.380240:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a37ab lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.380246:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53500) 00010000:00010000:0.0:1763343275.380248:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.380251:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a37ab lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.380284:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a37ab lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.380315:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a379d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49710 expref: 299 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.380330:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a37b2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49710 expref: 298 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.380336:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20a:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:0.0:1763343275.380338:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343275.380340:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940202040c00, rc 0) 00000100:00100000:0.0:1763343275.380405:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c372b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57139:x1848998399879936:12345-192.168.201.40@tcp:101:rm.0 Request processed in 655us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.380414:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10712 00000100:00100000:0.0:1763343275.380437:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10713 00000100:00100000:0.0:1763343275.380445:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57136:x1848998399880064:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343275.380454:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.380465:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a37b9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49717 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.380482:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a37c0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343275.380490:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a37c0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.380496:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a37c0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.380568:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a37b9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49717 expref: 299 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.380580:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661000/0x9104b1ba770a37c0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x208:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49717 expref: 298 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.380586:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:0.0:1763343275.380588:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343275.380590:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c1661000, rc 0) 00000100:00100000:0.0:1763343275.380608:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57136:x1848998399880064:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 165us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.380613:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10713 00000100:00100000:0.0:1763343275.387888:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.388020:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399880320 00000100:00100000:1.0:1763343275.388057:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399880320 00000100:00100000:1.0:1763343275.388128:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10714 00000100:00100000:1.0:1763343275.388138:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57139:x1848998399880320:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:1.0:1763343275.388199:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763343275.388229:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a4200/0x9104b1ba770a3781 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x20a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496fb expref: 298 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.388266:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040c00/0x9104b1ba770a37b2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49710 expref: 297 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.388281:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a3765 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x20a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496ed expref: 296 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.388290:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20a:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:1.0:1763343275.388301:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343275.388332:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a37c7 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343275.388346:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a37c7 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.388355:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a37c7 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.388367:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a37ce lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343275.388374:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a37ce lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.388379:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a37ce lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.388467:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a37d5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343275.388475:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a37d5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.388482:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a37d5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000040:00080000:1.0:1763343275.388718:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1734, 64 off144320 00000040:00080000:1.0:1763343275.388743:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1742, 64 off144976 00000040:00080000:1.0:1763343275.388753:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1743, 64 off145040 00000040:00080000:1.0:1763343275.388761:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1735, 64 off144384 00010000:00010000:1.0:1763343275.388813:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a37dc lrc: 3/0,1 mode: --/PW res: [0x240000404:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343275.388821:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a37dc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.388828:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a37dc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.388834:0:33856:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a37dc lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x20a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.388843:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a37dc lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x20a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.388848:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a37dc lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x20a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.388869:0:33856:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343275.388886:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a37d5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.388891:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a37d5 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.388896:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a37d5 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.388902:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343275.388905:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a37d5 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.388912:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a37d5 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.388920:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20a:0x0].0x0 (ffff9401fc4f1100) 00010000:00010000:1.0:1763343275.388922:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343275.388925:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a37d5 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.388931:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a37d5 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.389064:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a37c7 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.389074:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a37c7 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.389079:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a37c7 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.389083:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343275.389085:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a37c7 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.389090:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a37c7 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.389098:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fc4f1000) 00010000:00010000:1.0:1763343275.389100:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343275.389103:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a37c7 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.389107:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a37c7 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:1.0:1763343275.389117:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f25dc06f reply state 00000000dfcf2a2d transno 4294973657 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a37ce lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.389127:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a37ce lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.389132:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fc4f1e00) 00010000:00010000:1.0:1763343275.389134:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343275.389136:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343275.389209:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57139:x1848998399880320:12345-192.168.201.40@tcp:36:rm.0 Request processed in 1070us (1330us total) trans 4294973657 rc 0/0 00000100:00100000:1.0:1763343275.389220:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10714 00010000:00010000:0.0:1763343275.389811:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343275.389817:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a37dc lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x20a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.389824:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343275.389827:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a37dc lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x20a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.389836:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a37dc lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x20a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.389846:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20a:0x0].0x0 (ffff9401fc4f1100) 00010000:00010000:0.0:1763343275.389848:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343275.389850:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a37dc lrc: 1/0,0 mode: --/PW res: [0x240000404:0x20a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.389855:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a37dc lrc: 0/0,0 mode: --/PW res: [0x240000404:0x20a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.389868:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.389870:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.389872:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343275.390798:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.391616:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399880448 00000100:00100000:0.0:1763343275.391628:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399880448 00000100:00100000:2.0:1763343275.392307:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1738 00000100:00100000:2.0:1763343275.392322:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2407:x1848998399880448:12345-192.168.201.40@tcp:4:lfs.0 00010000:00010000:2.0:1763343275.392362:0:28399:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a37e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.392381:0:28399:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a3566 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4963e expref: 24 pid: 27798 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343275.392388:0:28399:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.392390:0:28399:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.392394:0:28399:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a37e3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.392428:0:28399:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a3566 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4963e expref: 24 pid: 27798 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343275.392442:0:28399:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a3566 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4963e expref: 24 pid: 27798 timeout: 1168 lvb_type: 1 00000100:00100000:2.0:1763343275.392456:0:28399:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_017:lustre-OST0000_UUID:28399:1848998412977152:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343275.393571:0:28399:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c29c40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343275.398014:0:28399:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_017:lustre-OST0000_UUID:28399:1848998412977152:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343275.398082:0:28399:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a37e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343275.398765:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.398943:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399880576 00000100:00100000:0.0:1763343275.398953:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399880576 00010000:00010000:0.0:1763343275.398994:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a3566 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4963e expref: 25 pid: 27798 timeout: 1168 lvb_type: 1 00000100:00100000:0.0:1763343275.399071:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3478 00000100:00100000:0.0:1763343275.399081:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2408:x1848998399880576:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343275.399096:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343275.399116:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a3566 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4963e expref: 25 pid: 27798 timeout: 1168 lvb_type: 1 00010000:00010000:0.0:1763343275.399127:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a3566 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4963e expref: 25 pid: 27798 timeout: 1168 lvb_type: 1 00010000:00010000:0.0:1763343275.399154:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a3566 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4963e expref: 25 pid: 27798 timeout: 1168 lvb_type: 1 00010000:00010000:0.0:1763343275.399170:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.399172:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.399177:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a37e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.399187:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a37e3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.399213:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343275.399288:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2408:x1848998399880576:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 207us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.399296:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3478 00010000:00010000:3.0:1763343275.399814:0:28399:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a37e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.399824:0:28399:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a37e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1763343275.402381:0:24675:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839219 is committed 00000001:00080000:0.0:1763343275.402403:0:24675:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839217 is committed 00002000:00010000:3.0:1763343275.402594:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2bf:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:3.0:1763343275.402599:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2bf:0x0] updating lvb mtime from disk: 0 -> 1763343274 00002000:00010000:3.0:1763343275.402601:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2bf:0x0] updating lvb ctime from disk: 0 -> 1763343274 00002000:00010000:3.0:1763343275.402603:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2bf:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1763343275.402615:0:28399:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a37e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.402626:0:28399:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a37e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.402635:0:28399:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a37e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.402642:0:28399:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343275.402647:0:28399:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a37e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.402655:0:28399:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a37e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.402676:0:28399:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a37e3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.402683:0:28399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a37e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343275.402783:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:2407:x1848998399880448:12345-192.168.201.40@tcp:4:lfs.0 Request processed in 10462us (11986us total) trans 21474839219 rc 0/0 00000100:00100000:3.0:1763343275.402793:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1738 00000100:00100000:1.0:1763343275.429480:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.429641:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399880704 00000100:00100000:2.0:1763343275.429652:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399880704 00000100:00100000:2.0:1763343275.429717:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10715 00000100:00100000:2.0:1763343275.429728:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57140:x1848998399880704:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343275.429754:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.429780:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a37ea lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4971e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.429858:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a37f1 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343275.429873:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a37f1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.429885:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a37f1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.429896:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a37f8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343275.429904:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a37f8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.429910:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a37f8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.429955:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a37f1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.429962:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a37f1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.429968:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a37f1 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.429974:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a37f1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.429981:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.429985:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a37f1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.429994:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a37f1 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.430007:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758600) 00010000:00010000:2.0:1763343275.430010:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.430016:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a37f1 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.430817:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a37f1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.430840:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a37f8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.430846:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a37f8 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.430852:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a37f8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.430857:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.430860:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a37f8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.430866:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a37f8 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.430876:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fc4f1e00) 00010000:00010000:2.0:1763343275.430879:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.430883:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a37f8 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.430889:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a37f8 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.430921:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a37ea lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4971e expref: 298 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.430932:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758600) 00010000:00010000:2.0:1763343275.430934:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.430937:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a37ea lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4971e expref: 298 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.430949:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3000, rc 0) 00000100:00100000:2.0:1763343275.432231:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57140:x1848998399880704:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2498us (2756us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343275.432242:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10715 00000100:00100000:1.0:1763343275.437869:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.437913:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.437993:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399881088 00000100:00100000:3.0:1763343275.438005:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399881088 00000100:00100000:3.0:1763343275.438095:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399880960 00000100:00100000:3.0:1763343275.438099:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399880960 00000100:00100000:3.0:1763343275.438132:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10716 00000100:00100000:3.0:1763343275.438142:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57140:x1848998399881088:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343275.438164:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343275.438189:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a37ff lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49725 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343275.438366:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10717 00000100:00100000:0.0:1763343275.438376:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57136:x1848998399880960:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:0.0:1763343275.438409:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343275.438433:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a3718 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x208:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496d8 expref: 299 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.438460:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:0.0:1763343275.438465:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343275.438529:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a3806 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343275.438544:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a3806 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.438553:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a3806 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00010000:0.0:1763343275.438677:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003d8838a0 reply state 00000000581ec6d6 transno 4294973658 ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a3806 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.438689:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a3806 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.438694:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:0.0:1763343275.438697:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343275.438700:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343275.438791:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57136:x1848998399880960:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 416us (876us total) trans 4294973658 rc 0/0 00000100:00100000:0.0:1763343275.438798:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10717 00010000:00010000:3.0:1763343275.440062:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a380d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343275.440079:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a380d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.440089:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a380d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.440101:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3814 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343275.440108:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3814 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.440114:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3814 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.440155:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a380d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.440162:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a380d lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.440168:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a380d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.440174:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fca00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343275.440178:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a380d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.440185:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a380d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.440195:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b000) 00010000:00010000:3.0:1763343275.440198:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343275.440202:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a380d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.440208:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a380d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.440219:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3814 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.440225:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3814 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.440230:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3814 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.440235:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fd800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343275.440238:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3814 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.440243:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3814 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.440248:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fc4f1e00) 00010000:00010000:3.0:1763343275.440251:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343275.440264:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3814 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.440270:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3814 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.440303:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a37ff lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49725 expref: 299 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.440316:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b000) 00010000:00010000:3.0:1763343275.440318:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343275.440323:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a37ff lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49725 expref: 299 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.440337:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fd600, rc 0) 00000100:00100000:0.0:1763343275.440498:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57140:x1848998399881088:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2354us (2637us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343275.440507:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10716 00000100:00100000:1.0:1763343275.444943:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.445005:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399881216 00000100:00100000:0.0:1763343275.445017:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399881216 00000100:00100000:0.0:1763343275.445116:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7292 00000100:00100000:0.0:1763343275.445129:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:57136:x1848998399881216:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343275.445151:0:11289:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.445178:0:11289:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a381b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4972c expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343275.445207:0:11289:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2bf:0x0] initial LVB size: 4096, mtime: 0x691a7baa, atime: 0x0, ctime: 0x691a7baa, blocks: 0x8 00010000:00010000:0.0:1763343275.445230:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.445233:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.445241:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a381b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4972c expref: 13 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.445272:0:11289:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a381b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4972c expref: 13 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.445286:0:11289:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8693c00, rc 0) 00000100:00100000:0.0:1763343275.445340:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:57136:x1848998399881216:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 214us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.445347:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7292 00000100:00100000:1.0:1763343275.449513:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.449610:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399881344 00000100:00100000:1.0:1763343275.449619:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399881344 00000100:00100000:1.0:1763343275.449669:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10718 00000100:00100000:1.0:1763343275.449678:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57140:x1848998399881344:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343275.449703:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343275.449732:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3822 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49733 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.449799:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3829 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343275.449814:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3829 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.449826:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3829 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343275.449868:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763343275.449873:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763343275.449904:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3822 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49733 expref: 300 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.449926:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3829 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49733 expref: 299 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.449935:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fc4f1000) 00010000:00010000:1.0:1763343275.449938:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343275.449941:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176400, rc 0) 00000100:00100000:1.0:1763343275.450100:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57140:x1848998399881344:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 423us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343275.450107:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10718 00000100:00100000:1.0:1763343275.455655:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.457184:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399881472 00000100:00100000:2.0:1763343275.457199:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399881472 00000100:00100000:2.0:1763343275.457295:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7293 00000100:00100000:2.0:1763343275.457308:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:57136:x1848998399881472:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343275.457329:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.457349:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3830 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4973a expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.457384:0:8414:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a356d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49645 expref: 21 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343275.457399:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.457401:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.457406:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3830 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4973a expref: 21 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.457441:0:8414:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a356d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49645 expref: 21 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343275.457456:0:8414:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a356d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49645 expref: 21 pid: 8412 timeout: 1168 lvb_type: 1 00000100:00100000:2.0:1763343275.457474:0:8414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8414:1848998412977280:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343275.457573:0:8414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c29c40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343275.461603:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.461670:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399881600 00000100:00100000:3.0:1763343275.461680:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399881600 00000100:00100000:3.0:1763343275.461740:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10719 00000100:00100000:3.0:1763343275.461750:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57140:x1848998399881600:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:2.0:1763343275.461757:0:8414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8414:1848998412977280:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343275.461773:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.461791:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3830 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4973a expref: 21 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.461796:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3837 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49741 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.461817:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3c00, rc 0) 00010000:00010000:3.0:1763343275.461882:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a383e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343275.461897:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a383e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.461909:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a383e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.461921:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3845 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343275.461928:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3845 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.461935:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3845 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:2.0:1763343275.461960:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:57136:x1848998399881472:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 4653us (6315us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.461969:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7293 00010000:00010000:3.0:1763343275.461979:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a383e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.461988:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a383e lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.461995:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a383e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.462001:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fd800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343275.462006:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a383e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.462014:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a383e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.462058:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fc4f1000) 00010000:00010000:3.0:1763343275.462062:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343275.462068:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a383e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.462074:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a383e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.462086:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3845 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.462092:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3845 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.462097:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3845 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.462102:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fca00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343275.462104:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3845 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.462110:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3845 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.462117:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fc4f1e00) 00010000:00010000:3.0:1763343275.462119:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343275.462122:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3845 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.462128:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3845 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.462156:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3837 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49741 expref: 300 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.462166:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fc4f1000) 00010000:00010000:3.0:1763343275.462168:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343275.462173:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3837 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49741 expref: 300 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.462182:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fd600, rc 0) 00000100:00100000:3.0:1763343275.462209:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57140:x1848998399881600:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 462us (616us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343275.462216:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10719 00000100:00100000:3.0:1763343275.463252:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.466282:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.466400:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399881984 00000100:00100000:1.0:1763343275.466411:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399881984 00000100:00100000:1.0:1763343275.466465:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10720 00000100:00100000:1.0:1763343275.466475:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57140:x1848998399881984:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343275.466496:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343275.466499:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343275.466527:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3829 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49733 expref: 299 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.466545:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fc4f1000) 00010000:00010000:1.0:1763343275.466556:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343275.466571:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a384c lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49748 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.466676:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3853 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343275.466694:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3853 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.466703:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3853 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.466713:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a385a lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343275.466721:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a385a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.466727:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a385a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.467122:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3861 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343275.467131:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3861 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.467139:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3861 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:1.0:1763343275.467148:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x20c:0x0]: returning size 0 00010000:00010000:1.0:1763343275.467172:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3853 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.467180:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3853 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.467186:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3853 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.467192:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343275.467197:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3853 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.467204:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3853 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.467213:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fc4f1100) 00010000:00010000:1.0:1763343275.467216:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343275.467220:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3853 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.467226:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3853 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:1.0:1763343275.467235:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008030c04a reply state 00000000d1dd0ced transno 4294973659 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a385a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.467246:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a385a lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.467251:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fc4f1e00) 00010000:00010000:1.0:1763343275.467268:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343275.467271:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343275.467298:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a384c lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49748 expref: 301 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.467316:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3861 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49748 expref: 300 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.467323:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20c:0x0].0x0 (ffff9401fc4f1300) 00010000:00010000:1.0:1763343275.467325:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343275.467328:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177c00, rc 0) 00000100:00100000:1.0:1763343275.467399:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57140:x1848998399881984:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 925us (1126us total) trans 4294973659 rc 0/0 00000100:00100000:1.0:1763343275.467407:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10720 00000100:00100000:2.0:1763343275.469195:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399881728 00000100:00100000:2.0:1763343275.469210:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399881728 00010000:00010000:2.0:1763343275.469267:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a356d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49645 expref: 21 pid: 8412 timeout: 1168 lvb_type: 1 00000100:00100000:2.0:1763343275.469316:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3479 00000100:00100000:2.0:1763343275.469328:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3728700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399881728:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343275.469342:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343275.469364:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a356d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49645 expref: 21 pid: 8412 timeout: 1168 lvb_type: 1 00010000:00010000:2.0:1763343275.469377:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a356d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49645 expref: 21 pid: 8412 timeout: 1168 lvb_type: 1 00010000:00010000:2.0:1763343275.469401:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a356d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49645 expref: 21 pid: 8412 timeout: 1168 lvb_type: 1 00010000:00010000:2.0:1763343275.469417:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.469420:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.469426:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3830 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4973a expref: 20 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.469436:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3830 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4973a expref: 20 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.469478:0:14071:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3830 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4973a expref: 20 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343275.469493:0:14071:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b29c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:14071:1848998412977408:192.168.201.40@tcp:105: 00000100:00100000:2.0:1763343275.469589:0:14071:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c29c40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343275.480456:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.480582:0:14071:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b29c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:14071:1848998412977408:192.168.201.40@tcp:105: 00010000:00010000:2.0:1763343275.480608:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343275.480723:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399882240 00000100:00100000:1.0:1763343275.480731:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399882240 00000100:00100000:1.0:1763343275.480783:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10721 00000100:00100000:1.0:1763343275.480793:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57140:x1848998399882240:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343275.480817:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343275.480838:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a386f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x20c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4974f expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.480944:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3876 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343275.480959:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3861 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49748 expref: 302 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.480968:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3876 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.481003:0:9827:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3861 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49748 expref: 302 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.481017:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3861 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49748 expref: 302 pid: 33856 timeout: 1168 lvb_type: 0 00000100:00100000:1.0:1763343275.481073:0:9827:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412977536:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343275.481157:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3728700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2408:x1848998399881728:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 11829us (17909us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.481167:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3479 00000100:00100000:1.0:1763343275.483296:0:9827:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401cbf743c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343275.485462:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.488367:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399882368 00000100:00100000:3.0:1763343275.488385:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399882368 00002000:00010000:3.0:1763343275.489405:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/703 (5->18446744073709551615) 00002000:00100000:3.0:1763343275.489413:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b29c00 with x1848998399882368 ext(5->18446744073709551615) 00002000:00010000:3.0:1763343275.489640:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5b29c00. 00000100:00100000:3.0:1763343275.489830:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1739 00000100:00100000:3.0:1763343275.489847:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2408:x1848998399882368:12345-192.168.201.40@tcp:10:lfs.0 00002000:00010000:3.0:1763343275.490179:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2bf:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:3.0:1763343275.490183:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2bf:0x0] updating lvb mtime from disk: 1763343274 -> 1763343274 00002000:00010000:3.0:1763343275.490186:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2bf:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343275.490188:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2bf:0x0] updating lvb ctime from disk: 1763343274 -> 1763343274 00002000:00010000:3.0:1763343275.490190:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2bf:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343275.490251:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399882368:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 411us (4800us total) trans 21474839220 rc 0/0 00000100:00100000:3.0:1763343275.490269:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1739 00002000:00010000:3.0:1763343275.490274:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/703 (5->18446744073709551615) 00002000:00100000:3.0:1763343275.490277:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b29c00 with x1848998399882368 ext(5->18446744073709551615) 00002000:00010000:3.0:1763343275.490282:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5b29c00. 00000100:00100000:1.0:1763343275.490958:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.491266:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399882496 00000100:00100000:3.0:1763343275.491274:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399882496 00002000:00010000:3.0:1763343275.491384:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/704 (0->18446744073709551615) 00002000:00100000:3.0:1763343275.491389:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5951f80 with x1848998399882496 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343275.491396:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5951f80. 00000100:00100000:3.0:1763343275.492171:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1740 00000100:00100000:3.0:1763343275.492183:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2408:x1848998399882496:12345-192.168.201.40@tcp:10:lfs.0 00002000:00010000:2.0:1763343275.492430:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2c0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343275.492434:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2c0:0x0] updating lvb mtime from disk: 0 -> 1763343274 00002000:00010000:2.0:1763343275.492437:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2c0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343275.492439:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2c0:0x0] updating lvb ctime from disk: 0 -> 1763343274 00002000:00010000:2.0:1763343275.492442:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2c0:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343275.492512:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399882496:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 331us (1554us total) trans 17179871949 rc 0/0 00000100:00100000:2.0:1763343275.492520:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1740 00002000:00010000:2.0:1763343275.492525:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/704 (0->18446744073709551615) 00002000:00100000:2.0:1763343275.492528:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5951f80 with x1848998399882496 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343275.492533:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5951f80. 00000100:00100000:3.0:1763343275.496727:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.496814:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412977536:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343275.496845:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3876 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:3.0:1763343275.496982:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.497406:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399882752 00000100:00100000:2.0:1763343275.497415:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399882752 00000100:00100000:2.0:1763343275.497473:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10722 00000100:00100000:2.0:1763343275.497483:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57136:x1848998399882752:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:2.0:1763343275.497576:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a387d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343275.497593:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a387d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.497605:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a387d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00010000:2.0:1763343275.497725:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000aec6631b reply state 000000000fbd3826 transno 4294973660 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a387d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.497737:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a387d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.497745:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:2.0:1763343275.497748:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343275.497751:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343275.497842:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57136:x1848998399882752:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 360us (1180us total) trans 4294973660 rc 0/0 00000100:00100000:2.0:1763343275.497850:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10722 00000100:00100000:0.0:1763343275.498234:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399882880 00000100:00100000:0.0:1763343275.498240:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399882880 00010000:00010000:0.0:1763343275.498279:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3861 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49748 expref: 305 pid: 33856 timeout: 1168 lvb_type: 0 00000100:00100000:0.0:1763343275.498308:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3480 00000100:00100000:0.0:1763343275.498315:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:2408:x1848998399882880:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343275.498325:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343275.498330:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3861 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49748 expref: 305 pid: 33856 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343275.498345:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3861 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49748 expref: 305 pid: 33856 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343275.498361:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3861 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49748 expref: 305 pid: 33856 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343275.498373:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20c:0x0].0x0 (ffff9401fc4f1300) 00010000:00010000:0.0:1763343275.498377:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3876 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.498384:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3876 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.498391:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3876 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.498417:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343275.498444:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:2408:x1848998399882880:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 126us (1458us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.498451:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3480 00010000:00010000:0.0:1763343275.498490:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3876 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.498497:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3876 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:0.0:1763343275.498516:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x20c:0x0]: returning size 0 00000004:00080000:0.0:1763343275.498648:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2c3:0x0], index 1: 0 00000004:00080000:0.0:1763343275.498654:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2c2:0x0], index 0: 0 00000004:00080000:0.0:1763343275.498658:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2c3:0x0], index 0: 0 00000004:00080000:0.0:1763343275.498662:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2c4:0x0], index 1: 0 00010000:00010000:0.0:1763343275.498735:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3876 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.498742:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3876 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.498748:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3876 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.498753:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.498757:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3876 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.498763:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3876 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.498771:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20c:0x0].0x0 (ffff9401fc4f1300) 00010000:00010000:0.0:1763343275.498773:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343275.498776:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3876 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.498781:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3876 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.498814:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a386f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x20c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4974f expref: 304 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.498823:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20c:0x0].0x0 (ffff9401fc4f1300) 00010000:00010000:0.0:1763343275.498825:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343275.498828:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a386f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x20c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4974f expref: 304 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.498844:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176400, rc 0) 00000100:00100000:0.0:1763343275.498870:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57140:x1848998399882240:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 18079us (18425us total) trans 4294973661 rc 301/301 00000100:00100000:0.0:1763343275.498877:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10721 00000100:00100000:0.0:1763343275.500355:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.500505:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399883008 00000100:00100000:2.0:1763343275.500514:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399883008 00000100:00100000:2.0:1763343275.500558:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7294 00000100:00100000:2.0:1763343275.500571:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399883008:12345-192.168.201.40@tcp:2:lfs.0 00002000:00010000:2.0:1763343275.500705:0:8414:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2bf:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763343275.500709:0:8414:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2bf:0x0] updating lvb mtime from disk: 1763343274 -> 1763343274 00002000:00010000:2.0:1763343275.500711:0:8414:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2bf:0x0] updating lvb atime from disk: 1763343274 -> 1763343274 00002000:00010000:2.0:1763343275.500714:0:8414:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2bf:0x0] updating lvb ctime from disk: 1763343274 -> 1763343274 00002000:00010000:2.0:1763343275.500716:0:8414:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2bf:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763343275.500774:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399883008:12345-192.168.201.40@tcp:2:lfs.0 Request processed in 207us (426us total) trans 17179871950 rc 0/0 00000100:00100000:2.0:1763343275.500780:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7294 00000100:00100000:0.0:1763343275.503643:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.503768:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399883264 00000100:00100000:2.0:1763343275.503779:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399883264 00000100:00100000:2.0:1763343275.503834:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3777 00000100:00100000:2.0:1763343275.503843:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57140:x1848998399883264:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343275.504972:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57140:x1848998399883264:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1123us (1332us total) trans 4294973662 rc 0/0 00000100:00100000:2.0:1763343275.504983:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3777 00000100:00100000:0.0:1763343275.505432:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.505633:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399883520 00000100:00100000:2.0:1763343275.505640:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399883520 00000100:00100000:2.0:1763343275.506338:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3778 00000100:00100000:2.0:1763343275.506350:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57136:x1848998399883520:12345-192.168.201.40@tcp:35:lfs.0 00000004:00010000:2.0:1763343275.506415:0:6527:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x208:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a367e lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x208:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496a0 expref: 304 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.506466:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a388b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343275.506480:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a36e7 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496c3 expref: 304 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.506490:0:6527:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a388b lrc: 4/0,1 mode: --/EX res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343275.506524:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a36e7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496c3 expref: 304 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.506538:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a36e7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496c3 expref: 304 pid: 7641 timeout: 1168 lvb_type: 0 00000100:00100000:2.0:1763343275.506553:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4b21c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6527:1848998412977664:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343275.506617:0:6527:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401d862c600 going to sleep for 11 seconds 00000100:00100000:0.0:1763343275.511887:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.512000:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.512118:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399883776 00000100:00100000:1.0:1763343275.512128:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399883776 00000100:00100000:1.0:1763343275.512185:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3779 00000100:00100000:1.0:1763343275.512196:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8442c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57140:x1848998399883776:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343275.512910:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399883904 00000100:00100000:3.0:1763343275.512917:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399883904 00010000:00010000:3.0:1763343275.512945:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a36e7 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496c3 expref: 307 pid: 7641 timeout: 1168 lvb_type: 0 00000100:00100000:3.0:1763343275.512977:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3481 00000100:00100000:3.0:1763343275.513059:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c32b3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:2407:x1848998399883904:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343275.513072:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343275.513079:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a36e7 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496c3 expref: 307 pid: 7641 timeout: 1168 lvb_type: 0 00010000:00010000:3.0:1763343275.513092:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a36e7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496c3 expref: 307 pid: 7641 timeout: 1168 lvb_type: 0 00010000:00010000:3.0:1763343275.513114:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:3.0:1763343275.513120:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a388b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343275.513130:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a388b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343275.513137:0:7904:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a388b lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343275.513153:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343275.513589:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a36e7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496c3 expref: 307 pid: 7641 timeout: 1168 lvb_type: 0 00000100:00100000:2.0:1763343275.513608:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4b21c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6527:1848998412977664:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343275.513627:0:6527:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a388b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343275.513634:0:6527:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a388b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343275.513639:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a388b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00000100:00100000:3.0:1763343275.513648:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c32b3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:2407:x1848998399883904:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 664us (1649us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343275.513657:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3481 00000100:00100000:1.0:1763343275.513886:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8442c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57140:x1848998399883776:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1690us (2007us total) trans 4294973663 rc 0/0 00000100:00100000:1.0:1763343275.513895:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3779 00000040:00080000:2.0:1763343275.515569:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1744, 88 off145128 00000004:00080000:2.0:1763343275.515586:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1068639560606ns, next at 1069016397451ns, rc = 0 00000040:00080000:2.0:1763343275.515626:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1736, 88 off144472 00000004:00080000:2.0:1763343275.515632:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1068639606992ns, next at 1069016426495ns, rc = 0 00000040:00080000:2.0:1763343275.515664:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1737, 88 off144560 00000004:00080000:2.0:1763343275.516855:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1068640827959ns, next at 1069016426495ns, rc = 0 00000040:00080000:2.0:1763343275.516909:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1745, 88 off145216 00000004:00080000:2.0:1763343275.516914:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1068640888889ns, next at 1069016397451ns, rc = 0 00000100:00100000:1.0:1763343275.519641:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.519690:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399884160 00000100:00100000:2.0:1763343275.519701:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399884160 00000100:00100000:2.0:1763343275.520151:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10723 00000100:00100000:2.0:1763343275.520163:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:55884:x1848998399884160:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343275.520197:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.520225:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3892 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49756 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.520484:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3899 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343275.520499:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3899 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.520511:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3899 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.520522:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a38a0 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343275.520530:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a38a0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.520537:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a38a0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.520586:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a38a7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343275.520593:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a38a7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.520599:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a38a7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:2.0:1763343275.520608:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x20c:0x0]: returning size 0 00010000:00010000:2.0:1763343275.520687:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3899 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.520694:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3899 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.520705:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3899 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.520711:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3899 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.520717:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c0030200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.520721:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3899 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.520727:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3899 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.520738:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758600) 00010000:00010000:2.0:1763343275.520741:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.520745:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3899 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.520750:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3899 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.520764:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a38a0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.520769:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a38a0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.520775:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a38a0 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.520779:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5b3de00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.520782:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a38a0 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.520791:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a38a0 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.520797:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fc4f1e00) 00010000:00010000:2.0:1763343275.520799:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.520802:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a38a0 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.520806:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a38a0 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.520838:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3892 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49756 expref: 309 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.520853:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a38a7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49756 expref: 308 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.520860:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20c:0x0].0x0 (ffff9400c4758700) 00010000:00010000:2.0:1763343275.520863:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343275.520865:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5b3d200, rc 0) 00000100:00100000:2.0:1763343275.520926:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:55884:x1848998399884160:12345-192.168.201.40@tcp:101:bash.0 Request processed in 766us (1296us total) trans 4294973665 rc 0/0 00000100:00100000:2.0:1763343275.520933:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10723 00000001:00080000:3.0:1763343275.521274:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973664 is committed 00000004:00080000:3.0:1763343275.521281:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1121 committed 00000004:00080000:3.0:1763343275.521290:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1113 committed 00000004:00080000:3.0:1763343275.521303:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1112 committed 00000004:00080000:3.0:1763343275.521305:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1120 committed 00000004:00010000:3.0:1763343275.521402:0:6527:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000048fefab1 reply state 0000000003866867 transno 4294973664 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a388b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343275.521418:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a388b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343275.521496:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:3.0:1763343275.521500:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1763343275.521504:0:6527:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343275.521509:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:3.0:1763343275.521511:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763343275.521517:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a367e lrc: 0/0,0 mode: --/PW res: [0x240000404:0x208:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496a0 expref: 298 pid: 6524 timeout: 0 lvb_type: 0 00010000:00080000:3.0:1763343275.521576:0:6527:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763343275.521586:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57136:x1848998399883520:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 15239us (16155us total) trans 4294973664 rc 0/0 00000100:00100000:3.0:1763343275.521594:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3778 00000100:00100000:3.0:1763343275.521688:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412977792:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1763343275.521704:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a37ce lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.521713:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a37ce lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.521719:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a37ce lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.521724:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343275.521728:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a37ce lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00000100:00100000:3.0:1763343275.521731:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343275.521740:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a37ce lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.521749:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a388b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343275.521751:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fc4f1e00) 00010000:00010000:1.0:1763343275.521754:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343275.521757:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a37ce lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.521757:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a388b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT1 00000100:00100000:3.0:1763343275.521762:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1763343275.521764:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a37ce lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.521764:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a388b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT1 00000100:00100000:3.0:1763343275.521770:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412977920:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1763343275.521773:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd8e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.521777:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a388b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343275.521782:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a3806 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.521787:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a3806 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343275.521796:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343275.521803:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a3806 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343275.521822:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412977792 00000100:00100000:3.0:1763343275.521829:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412977792 00000100:00100000:3.0:1763343275.521858:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412977920 00000100:00100000:3.0:1763343275.521861:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412977920 00000100:00100000:3.0:1763343275.521883:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7295 00000100:00100000:3.0:1763343275.521891:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+22:3661:x1848998412977792:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343275.521911:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412978304:0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343275.521912:0:11289:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:705 count 1 00010000:00010000:3.0:1763343275.521934:0:11289:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a38b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343275.521946:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343275.521951:0:11289:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a378f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49709 expref: 21 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.521961:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343275.521963:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343275.521967:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a38b5 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343275.521971:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763343275.521980:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c478bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412978432:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1763343275.521994:0:11289:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a378f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49709 expref: 21 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343275.522006:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343275.522019:0:11289:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a378f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49709 expref: 21 pid: 11289 timeout: 1168 lvb_type: 0 00000100:00100000:3.0:1763343275.522055:0:11289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c372ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11289:1848998412978816:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343275.522088:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a388b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343275.522103:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00000100:00100000:3.0:1763343275.522107:0:11289:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c8284840 going to sleep for 11 seconds 00010000:00010000:0.0:1763343275.522107:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343275.522111:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a388b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT1 00000100:00100000:2.0:1763343275.522120:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412978304 00010000:00010000:0.0:1763343275.522122:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a388b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT1 00000100:00100000:2.0:1763343275.522124:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412978304 00000100:00100000:0.0:1763343275.522147:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412978048:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343275.522153:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412978432 00000100:00100000:2.0:1763343275.522156:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412978432 00000100:00100000:0.0:1763343275.522172:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343275.522174:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7296 00000100:00100000:2.0:1763343275.522181:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edde6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+22:3661:x1848998412977920:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343275.522190:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c478b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412978560:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343275.522209:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343275.522226:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1763343275.522231:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c514d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412978176:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343275.522248:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343275.522268:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c1661c00 already unused, calling callback (ffffffffc18dd550) 00000100:00100000:0.0:1763343275.522268:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c39b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412978688:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1763343275.522272:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a3806 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.522279:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a3806 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.522287:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:1.0:1763343275.522290:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343275.522293:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a3806 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000100:00100000:0.0:1763343275.522295:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343275.522299:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c1661c00/0x9104b1ba770a3806 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.522312:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a385a lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.522317:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a385a lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.522325:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a385a lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.522330:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343275.522332:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a385a lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.522338:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a385a lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.522345:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fc4f1e00) 00010000:00010000:1.0:1763343275.522348:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343275.522350:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a385a lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.522355:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a385a lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.522368:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a387d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.522374:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a387d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.522380:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a387d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.522384:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343275.522387:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a387d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.522393:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a387d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.522400:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:1.0:1763343275.522402:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343275.522405:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a387d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.522410:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a387d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x208:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000100:00100000:1.0:1763343275.522435:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412978048 00000100:00100000:1.0:1763343275.522439:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412978048 00000100:00100000:1.0:1763343275.522454:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412978560 00000100:00100000:1.0:1763343275.522456:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412978560 00000100:00100000:1.0:1763343275.522465:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412978176 00000100:00100000:1.0:1763343275.522467:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412978176 00000100:00100000:1.0:1763343275.522475:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412978688 00000100:00100000:1.0:1763343275.522477:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412978688 00000100:00100000:1.0:1763343275.522488:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7297 00000100:00100000:1.0:1763343275.522493:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:3661:x1848998412978304:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763343275.522506:0:27798:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:704 count 1 00010000:00010000:1.0:1763343275.522519:0:27798:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a38bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.522532:0:27798:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a4000/0x9104b1ba770a3788 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49702 expref: 13 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.522546:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343275.522547:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343275.522550:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a38bc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.522575:0:27798:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a4000/0x9104b1ba770a3788 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49702 expref: 13 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.522584:0:27798:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a4000/0x9104b1ba770a3788 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49702 expref: 13 pid: 11289 timeout: 1168 lvb_type: 0 00000100:00100000:1.0:1763343275.522596:0:27798:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5953100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27798:1848998412978944:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343275.522635:0:27798:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401cbf743c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343275.522652:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7298 00000100:00100000:1.0:1763343275.522659:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+8:3661:x1848998412978432:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763343275.522683:0:28561:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:705 count 1 00002000:00010000:1.0:1763343275.522703:0:28561:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343275.522709:0:28561:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a38c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.522717:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.522718:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.522723:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a38c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.522732:0:28561:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a38c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.522740:0:28561:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a38c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.522750:0:28561:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a38c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.522768:0:28561:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343275.522971:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+9:3661:x1848998412978432:12345-0@lo:6:osp-syn-0-1.0 Request processed in 311us (966us total) trans 21474839221 rc 0/0 00000100:00100000:1.0:1763343275.522977:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7298 00000100:00100000:1.0:1763343275.522991:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7299 00000100:00100000:1.0:1763343275.522997:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+24:3659:x1848998412978048:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763343275.523116:0:28561:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2bf:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763343275.523120:0:28561:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2bf:0x0] updating lvb mtime from disk: 1763343274 -> 1763343274 00002000:00010000:1.0:1763343275.523122:0:28561:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2bf:0x0] updating lvb atime from disk: 1763343274 -> 1763343274 00002000:00010000:1.0:1763343275.523125:0:28561:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2bf:0x0] updating lvb ctime from disk: 1763343274 -> 1763343274 00002000:00010000:1.0:1763343275.523127:0:28561:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2bf:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763343275.523158:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+25:3659:x1848998412978048:12345-0@lo:2:osp-syn-1-1.0 Request processed in 162us (985us total) trans 17179871951 rc 0/0 00000100:00100000:1.0:1763343275.523164:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7299 00000100:00100000:1.0:1763343275.523177:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7300 00000100:00100000:1.0:1763343275.523182:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+8:3659:x1848998412978560:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1763343275.523245:0:28561:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2be:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343275.523248:0:28561:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2be:0x0] updating lvb mtime from disk: 1763343274 -> 1763343274 00002000:00010000:1.0:1763343275.523250:0:28561:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2be:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343275.523263:0:28561:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2be:0x0] updating lvb ctime from disk: 1763343274 -> 1763343274 00002000:00010000:1.0:1763343275.523265:0:28561:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2be:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343275.523292:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+9:3659:x1848998412978560:12345-0@lo:2:osp-syn-0-1.0 Request processed in 109us (1081us total) trans 21474839222 rc 0/0 00000100:00100000:1.0:1763343275.523298:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7300 00000100:00100000:1.0:1763343275.523310:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7301 00000100:00100000:1.0:1763343275.523316:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+24:3659:x1848998412978176:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763343275.523363:0:28561:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2c0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343275.523366:0:28561:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2c0:0x0] updating lvb mtime from disk: 1763343274 -> 1763343274 00002000:00010000:1.0:1763343275.523368:0:28561:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2c0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343275.523370:0:28561:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2c0:0x0] updating lvb ctime from disk: 1763343274 -> 1763343274 00002000:00010000:1.0:1763343275.523372:0:28561:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2c0:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343275.523398:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+25:3659:x1848998412978176:12345-0@lo:2:osp-syn-1-1.0 Request processed in 82us (1147us total) trans 17179871952 rc 0/0 00000100:00100000:1.0:1763343275.523403:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7301 00000100:00100000:1.0:1763343275.523415:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7302 00000100:00100000:1.0:1763343275.523421:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+8:3659:x1848998412978688:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1763343275.523466:0:28561:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2bf:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763343275.523469:0:28561:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2bf:0x0] updating lvb mtime from disk: 1763343274 -> 1763343274 00002000:00010000:1.0:1763343275.523471:0:28561:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2bf:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343275.523473:0:28561:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2bf:0x0] updating lvb ctime from disk: 1763343274 -> 1763343274 00002000:00010000:1.0:1763343275.523475:0:28561:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2bf:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763343275.523499:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+9:3659:x1848998412978688:12345-0@lo:2:osp-syn-0-1.0 Request processed in 78us (1203us total) trans 21474839223 rc 0/0 00000100:00100000:1.0:1763343275.523505:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7302 00010000:00010000:1.0:1763343275.523533:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343275.523539:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a38c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.523553:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343275.523556:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a38c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.523565:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a38c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.523581:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a38c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.523588:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a38c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.523603:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343275.523605:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343275.523607:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343275.523636:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c514d880/2, rc 0, transno 17179871952 00000100:00100000:1.0:1763343275.523642:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c514d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412978176:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343275.523652:0:3659:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474839217 gen 2 00000004:00080000:1.0:1763343275.523657:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bfd880, transno 21474839178 00000004:00080000:1.0:1763343275.523669:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bfd500, transno 21474839179 00000004:00080000:1.0:1763343275.523672:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bfed80, transno 21474839180 00000004:00080000:1.0:1763343275.523674:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5a3c000, transno 21474839181 00000004:00080000:1.0:1763343275.523677:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6281180, transno 21474839182 00000004:00080000:1.0:1763343275.523679:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6280e00, transno 21474839183 00000004:00080000:1.0:1763343275.523681:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6283b80, transno 21474839184 00000004:00080000:1.0:1763343275.523684:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6282300, transno 21474839185 00000004:00080000:1.0:1763343275.523687:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c390c700, transno 21474839187 00000004:00080000:1.0:1763343275.523689:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c390f800, transno 21474839188 00000004:00080000:1.0:1763343275.523692:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c390d880, transno 21474839189 00000004:00080000:1.0:1763343275.523694:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c39b4000, transno 21474839190 00000004:00080000:1.0:1763343275.523696:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c390ca80, transno 21474839193 00000004:00080000:1.0:1763343275.523698:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c390e680, transno 21474839194 00000004:00080000:1.0:1763343275.523700:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c517a680, transno 21474839195 00000004:00080000:1.0:1763343275.523702:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c517ad80, transno 21474839196 00000004:00080000:1.0:1763343275.523705:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c859aa00, transno 21474839200 00000004:00080000:1.0:1763343275.523707:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c859b800, transno 21474839201 00000004:00080000:1.0:1763343275.523710:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c8599880, transno 21474839202 00000004:00080000:1.0:1763343275.523713:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c859a680, transno 21474839203 00000004:00080000:1.0:1763343275.523716:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401efc71500, transno 21474839204 00000004:00080000:1.0:1763343275.523719:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401efc71180, transno 21474839205 00000004:00080000:1.0:1763343275.523721:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c390c000, transno 21474839206 00000004:00080000:1.0:1763343275.523724:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c390dc00, transno 21474839207 00000004:00080000:1.0:1763343275.523728:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9dc8380, transno 21474839209 00000004:00080000:1.0:1763343275.523731:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6282a00, transno 21474839210 00000004:00080000:1.0:1763343275.523734:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6280a80, transno 21474839211 00000004:00080000:1.0:1763343275.523737:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c39b6680, transno 21474839212 00000004:00080000:1.0:1763343275.523739:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c4789c00, transno 21474839214 00000004:00080000:1.0:1763343275.523743:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c4788000, transno 21474839215 00000004:00080000:1.0:1763343275.523746:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5a3e300, transno 21474839216 00000004:00080000:1.0:1763343275.523748:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5a3d500, transno 21474839217 00000100:00100000:1.0:1763343275.523755:0:3659:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9400c39b5c00 x1848998412978688/t21474839223(21474839223) o2->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763343291 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1763343275.523763:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c39b5c00/2, rc 0, transno 21474839223 00000100:00100000:1.0:1763343275.523767:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c39b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412978688:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763343275.523779:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b2d500/2, rc 0, transno 17179871951 00000100:00100000:1.0:1763343275.523782:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412978048:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763343275.523789:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c478b800/2, rc 0, transno 21474839222 00000100:00100000:1.0:1763343275.523791:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c478b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412978560:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763343275.523813:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c478bb80/2, rc 0, transno 21474839221 00000100:00100000:1.0:1763343275.523817:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c478bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412978432:0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763343275.523900:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:706 count 1 00002000:00010000:2.0:1763343275.523920:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343275.523925:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a38ca lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.523935:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.523937:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.523940:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a38ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.523950:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a38ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.523957:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a38ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.523964:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a38ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.523986:0:35266:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343275.524152:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edde6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+25:3661:x1848998412977920:12345-0@lo:6:osp-syn-1-1.0 Request processed in 1971us (2356us total) trans 17179871953 rc 0/0 00000100:00100000:2.0:1763343275.524160:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7296 00000004:00080000:2.0:1763343275.524362:0:8616:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 4 in progress, 1 in flight, 32 done 00000004:00080000:2.0:1763343275.524387:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b2e300/2, rc 0, transno 17179871953 00000100:00100000:2.0:1763343275.524392:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412977920:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343275.527104:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.527181:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.527282:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399884288 00000100:00100000:2.0:1763343275.527293:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399884288 00000100:00100000:2.0:1763343275.527338:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399884416 00000100:00100000:2.0:1763343275.527342:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399884416 00000100:00100000:2.0:1763343275.527366:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10724 00000100:00100000:3.0:1763343275.527376:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10725 00000100:00100000:2.0:1763343275.527378:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:55884:x1848998399884288:12345-192.168.201.40@tcp:101:bash.0 00000100:00100000:3.0:1763343275.527392:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f648b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57136:x1848998399884416:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343275.527402:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343275.527408:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343275.527428:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a38d1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49764 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.527428:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a38d8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4975d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.527477:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a38df lrc: 3/1,0 mode: --/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343275.527491:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a38df lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343275.527495:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a38d1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49764 expref: 296 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.527507:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a38df lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343275.527513:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98000/0x9104b1ba770a38d1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x208:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49764 expref: 296 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.527533:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:3.0:1763343275.527537:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343275.527541:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c6b98000, rc 0) 00000100:00100000:3.0:1763343275.527589:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f648b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57136:x1848998399884416:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 203us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343275.527598:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10725 00010000:00010000:2.0:1763343275.527619:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a38d8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4975d expref: 296 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.527635:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a38df lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4975d expref: 295 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.527643:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20c:0x0].0x0 (ffff9400c4758700) 00010000:00010000:2.0:1763343275.527646:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343275.527650:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401f1bf1c00, rc 0) 00000100:00100000:2.0:1763343275.527689:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:55884:x1848998399884288:12345-192.168.201.40@tcp:101:bash.0 Request processed in 314us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.527695:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10724 00010000:00010000:1.0:1763343275.527900:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343275.527908:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a38ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.527917:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5b3d000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343275.527921:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a38ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.527930:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a38ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.527948:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a38ca lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.527955:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a38ca lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.527971:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343275.527973:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343275.527975:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343275.530997:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.531000:0:11289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c372ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11289:1848998412978816:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343275.531080:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399884544 00000100:00100000:0.0:1763343275.531088:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399884544 00010000:00010000:2.0:1763343275.531097:0:11289:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a38b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.531129:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a378f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49709 expref: 22 pid: 11289 timeout: 1168 lvb_type: 0 00000100:00100000:0.0:1763343275.531174:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3482 00000100:00100000:0.0:1763343275.531183:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5951c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399884544:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343275.531197:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343275.531203:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a378f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49709 expref: 22 pid: 11289 timeout: 1168 lvb_type: 0 00000100:00100000:1.0:1763343275.532313:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.532416:0:27798:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5953100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27798:1848998412978944:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343275.532436:0:27798:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a38bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.532478:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a378f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49709 expref: 22 pid: 11289 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343275.532505:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a378f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49709 expref: 22 pid: 11289 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343275.532519:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.532521:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.532526:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a38b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.532536:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a38b5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.532569:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343275.532624:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5951c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399884544:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1441us (1639us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.532633:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3482 00000100:00100000:0.0:1763343275.532655:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399884672 00000100:00100000:0.0:1763343275.532660:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399884672 00010000:00010000:0.0:1763343275.532678:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a4000/0x9104b1ba770a3788 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49702 expref: 14 pid: 11289 timeout: 1168 lvb_type: 0 00000100:00100000:0.0:1763343275.532701:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3483 00000100:00100000:0.0:1763343275.532708:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5953b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399884672:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343275.532719:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343275.532724:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a4000/0x9104b1ba770a3788 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49702 expref: 14 pid: 11289 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343275.532741:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a4000/0x9104b1ba770a3788 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49702 expref: 14 pid: 11289 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343275.532755:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a4000/0x9104b1ba770a3788 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49702 expref: 14 pid: 11289 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343275.532764:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.532766:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.532770:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a38bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.532778:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a38bc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.532794:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343275.532812:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5953b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2408:x1848998399884672:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 104us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.532819:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3483 00010000:00010000:0.0:1763343275.532841:0:27798:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a38bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.532851:0:27798:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a38bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.532860:0:27798:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a38bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.532874:0:27798:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a38bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.532889:0:27798:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343275.533110:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+9:3661:x1848998412978304:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10615us (11162us total) trans 21474839224 rc 0/0 00000100:00100000:0.0:1763343275.533119:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7297 00010000:00010000:0.0:1763343275.533138:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343275.533144:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a38bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.533152:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343275.533156:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a38bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.533166:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a38bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.533178:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a38bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.533186:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a38bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.533201:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.533203:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.533205:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343275.533230:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c4b21c00/2, rc 0, transno 21474839224 00000100:00100000:0.0:1763343275.533236:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412978304:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1763343275.534062:0:11289:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a38b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.534087:0:11289:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a38b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.534096:0:11289:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a38b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.534104:0:11289:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a38b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.534123:0:11289:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343275.534332:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+25:3661:x1848998412977792:12345-0@lo:6:osp-syn-1-1.0 Request processed in 12441us (12601us total) trans 17179871954 rc 0/0 00000100:00100000:2.0:1763343275.534344:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7295 00000004:00080000:3.0:1763343275.534536:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b2dc00/2, rc 0, transno 17179871954 00000100:00100000:3.0:1763343275.534543:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412977792:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1763343275.535107:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343275.535116:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a38b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.535126:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b99600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343275.535130:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a38b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.535140:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a38b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.535159:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a38b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.535167:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a38b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.535187:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.535189:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.535191:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343275.535632:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.535790:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399884928 00000100:00100000:1.0:1763343275.535803:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399884928 00000100:00100000:1.0:1763343275.535860:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10726 00000100:00100000:1.0:1763343275.535870:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:55884:x1848998399884928:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:1.0:1763343275.535923:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343275.535943:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a38a7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49756 expref: 295 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.535958:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20c:0x0].0x0 (ffff9400c4758700) 00010000:00010000:1.0:1763343275.535963:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343275.536660:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a38e6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x20c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343275.536677:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a38e6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.536686:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a38e6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000001:00080000:1.0:1763343275.536730:0:33856:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973666 00000004:00010000:1.0:1763343275.536750:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000059621ca0 reply state 00000000b08b12d3 transno 4294973667 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a38e6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.536760:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a38e6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x20c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.536766:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20c:0x0].0x0 (ffff9400c4758700) 00010000:00010000:1.0:1763343275.536769:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343275.536771:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343275.536870:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:55884:x1848998399884928:12345-192.168.201.40@tcp:36:bash.0 Request processed in 1000us (1239us total) trans 4294973667 rc 0/0 00000100:00100000:1.0:1763343275.536877:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10726 00000020:00080000:1.0:1763343275.536882:0:33856:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343275.544839:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.544931:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.544991:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399885184 00000100:00100000:2.0:1763343275.544991:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399885312 00000100:00100000:3.0:1763343275.545000:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399885184 00000100:00100000:3.0:1763343275.545079:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3780 00000100:00100000:3.0:1763343275.545091:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57136:x1848998399885184:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:3.0:1763343275.545350:0:6527:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x208:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1763343275.545417:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1746, 64 off145280 00000040:00080000:3.0:1763343275.545440:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1738, 64 off144624 00000040:00080000:3.0:1763343275.545450:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1739, 64 off144688 00000040:00080000:3.0:1763343275.545459:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1747, 64 off145344 00010000:00010000:3.0:1763343275.545519:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a38ed lrc: 3/0,1 mode: --/PW res: [0x240000404:0x208:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343275.545536:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a38ed lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x208:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343275.545547:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a38ed lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x208:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343275.545556:0:6527:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a38ed lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x208:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343275.545563:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a38ed lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x208:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT1 00000100:00100000:2.0:1763343275.545571:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399885312 00010000:00010000:3.0:1763343275.545573:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a38ed lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x208:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343275.545598:0:6527:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343275.545614:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10727 00000100:00100000:2.0:1763343275.545624:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:55884:x1848998399885312:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343275.545638:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.545654:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a38f4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x20c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4976b expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.545694:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a38f4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x20c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4976b expref: 300 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.545707:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a38f4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x20c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4976b expref: 300 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.545724:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20c:0x0].0x0 (ffff9400c4758700) 00010000:00010000:2.0:1763343275.545727:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343275.545730:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401f1bf0200, rc 0) 00000100:00100000:2.0:1763343275.545790:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:55884:x1848998399885312:12345-192.168.201.40@tcp:101:bash.0 Request processed in 168us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.545798:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10727 00010000:00010000:0.0:1763343275.545812:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343275.545820:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a38ed lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x208:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343275.545827:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b98200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343275.545832:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a38ed lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x208:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343275.545840:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a38ed lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x208:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343275.545851:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x208:0x0].0x0 (ffff9400c6733f00) 00010000:00010000:0.0:1763343275.545854:0:7451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343275.545858:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a38ed lrc: 1/0,0 mode: --/PW res: [0x240000404:0x208:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343275.545864:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a38ed lrc: 0/0,0 mode: --/PW res: [0x240000404:0x208:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343275.545877:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.545879:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.545881:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343275.546754:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57136:x1848998399885184:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1660us (1922us total) trans 4294973668 rc 0/0 00000100:00100000:3.0:1763343275.546764:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3780 00000100:00100000:0.0:1763343275.549383:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.549532:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399885568 00000100:00100000:2.0:1763343275.549543:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399885568 00000100:00100000:2.0:1763343275.549605:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10728 00000100:00100000:2.0:1763343275.549614:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f648bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57136:x1848998399885568:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343275.549641:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.549668:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a38fb lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49772 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.549741:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3902 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343275.549755:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3902 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.549766:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3902 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.549779:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a3909 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343275.549786:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a3909 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.549792:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a3909 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.549901:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a3910 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343275.549917:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a3910 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.549925:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a3910 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:2.0:1763343275.549936:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x20c:0x0]: returning size 0 00010000:00010000:2.0:1763343275.551242:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3902 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.551267:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3902 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.551449:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3902 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.551455:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3902 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.551461:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd8e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.551465:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3902 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.551472:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3902 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.551487:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758600) 00010000:00010000:2.0:1763343275.551491:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.551496:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3902 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.551502:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3902 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.551515:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a3909 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.551520:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a3909 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.551525:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a3909 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.551530:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5b3d200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.551533:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a3909 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.551542:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a3909 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.551550:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758900) 00010000:00010000:2.0:1763343275.551553:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.551555:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a3909 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.551560:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a3909 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.551613:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a38fb lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49772 expref: 302 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.551628:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a3910 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49772 expref: 301 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.551634:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20c:0x0].0x0 (ffff9400c4758700) 00010000:00010000:2.0:1763343275.551637:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343275.551639:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5b3c400, rc 0) 00000100:00100000:2.0:1763343275.553357:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f648bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57136:x1848998399885568:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3732us (3974us total) trans 4294973669 rc 0/0 00000100:00100000:2.0:1763343275.553370:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10728 00000100:00100000:2.0:1763343275.555619:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.555673:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399885824 00000100:00100000:0.0:1763343275.555685:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399885824 00000100:00100000:0.0:1763343275.555745:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10729 00000100:00100000:0.0:1763343275.555756:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:55884:x1848998399885824:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343275.555777:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.555781:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343275.555809:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a38f4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x20c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4976b expref: 301 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.555828:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20c:0x0].0x0 (ffff9400c4758700) 00010000:00010000:0.0:1763343275.555833:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343275.555850:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a391e lrc: 2/0,0 mode: --/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49779 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.555901:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a3925 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343275.555914:0:6524:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a3910 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49772 expref: 301 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.555924:0:6524:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a3925 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x20c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.555961:0:6524:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a3910 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49772 expref: 301 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.555976:0:6524:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a3910 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49772 expref: 301 pid: 6524 timeout: 1168 lvb_type: 0 00000100:00100000:0.0:1763343275.555993:0:6524:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f648a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412979072:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343275.556102:0:6524:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c5965540 going to sleep for 11 seconds 00000100:00100000:1.0:1763343275.558639:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.558998:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399885952 00000100:00100000:2.0:1763343275.559010:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399885952 00000100:00100000:2.0:1763343275.559095:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7303 00000100:00100000:2.0:1763343275.559107:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2410:x1848998399885952:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343275.559127:0:11289:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.559150:0:11289:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a392c lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49780 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343275.559175:0:11289:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343275.559194:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.559196:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.559206:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a392c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49780 expref: 22 pid: 11289 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343275.559221:0:11289:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a392c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49780 expref: 22 pid: 11289 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343275.559234:0:11289:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5b3de00, rc 0) 00000100:00100000:2.0:1763343275.559305:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2410:x1848998399885952:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 201us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.559313:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7303 00000100:00100000:0.0:1763343275.559945:0:6524:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f648a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412979072:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343275.559972:0:6524:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a3925 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000100:00100000:1.0:1763343275.565279:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.567867:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399886080 00000100:00100000:2.0:1763343275.567882:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399886080 00010000:00010000:2.0:1763343275.567932:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a3910 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49772 expref: 302 pid: 6524 timeout: 1168 lvb_type: 0 00000100:00100000:1.0:1763343275.569750:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.569811:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399886208 00000100:00100000:3.0:1763343275.569821:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399886208 00000100:00100000:3.0:1763343275.569876:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10730 00000100:00100000:3.0:1763343275.569932:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57136:x1848998399886208:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343275.569957:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343275.569983:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a3933 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x20c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49787 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.570064:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a3925 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343275.570074:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a3933 lrc: 4/0,0 mode: --/CR res: [0x240000404:0x20c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49787 expref: 304 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.570093:0:33856:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a3925 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x20c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343275.570105:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a3933 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x20c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49787 expref: 304 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.570118:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20c:0x0].0x0 (ffff9400c4758700) 00010000:00010000:3.0:1763343275.570121:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343275.570123:0:33856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a3925 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343275.570130:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c6b98200, rc 0) 00000100:00100000:3.0:1763343275.570190:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57136:x1848998399886208:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 304us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343275.570197:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10730 00000100:00100000:2.0:1763343275.572267:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3484 00000100:00100000:2.0:1763343275.572287:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5952a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:2407:x1848998399886080:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343275.572306:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343275.572317:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a3910 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49772 expref: 303 pid: 6524 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343275.572337:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a3910 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49772 expref: 303 pid: 6524 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343275.572361:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a3910 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49772 expref: 303 pid: 6524 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343275.572376:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20c:0x0].0x0 (ffff9400c4758700) 00010000:00010000:2.0:1763343275.572381:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a3925 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.572392:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a3925 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.572400:0:7904:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a3925 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x20c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.572409:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a3933 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x20c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49787 expref: 302 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.572439:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343275.572503:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5952a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:2407:x1848998399886080:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 224us (7250us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.572512:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3484 00010000:00010000:1.0:1763343275.574091:0:6524:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a3925 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343275.574105:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a3925 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00000040:00080000:1.0:1763343275.574364:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1748, 88 off145432 00000004:00080000:1.0:1763343275.574372:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1068698347079ns, next at 1069016397451ns, rc = 0 00000040:00080000:1.0:1763343275.574412:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1740, 88 off144776 00000004:00080000:1.0:1763343275.574417:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1068698392698ns, next at 1069016426495ns, rc = 0 00000040:00080000:1.0:1763343275.574438:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1741, 88 off144864 00000004:00080000:1.0:1763343275.574441:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1068698416833ns, next at 1069016426495ns, rc = 0 00000040:00080000:1.0:1763343275.574451:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1749, 88 off145520 00000004:00080000:1.0:1763343275.574454:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1068698429938ns, next at 1069016397451ns, rc = 0 00000001:00080000:1.0:1763343275.576626:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973670 is committed 00000004:00080000:1.0:1763343275.576640:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1123 committed 00010000:00010000:0.0:1763343275.577300:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a38e6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x20c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.577314:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a38e6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x20c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.577322:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a38e6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x20c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.577333:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.577339:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a38e6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x20c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.577349:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a38e6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x20c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.577370:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20c:0x0].0x0 (ffff9400c4758700) 00010000:00010000:0.0:1763343275.577374:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.577380:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a38e6 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x20c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.577387:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a38e6 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x20c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00080000:1.0:1763343275.577458:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1115 committed 00000100:00100000:2.0:1763343275.577664:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412979456:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343275.577738:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343275.577775:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763343275.577780:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4b21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412979584:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343275.577799:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343275.577834:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412979456 00000100:00100000:2.0:1763343275.577841:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412979456 00000100:00100000:2.0:1763343275.577882:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412979584 00000100:00100000:2.0:1763343275.577885:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412979584 00000100:00100000:2.0:1763343275.577904:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7304 00000100:00100000:2.0:1763343275.577913:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+26:3659:x1848998412979456:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1763343275.578104:0:27798:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2c3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343275.578108:0:27798:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2c3:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763343275.578110:0:27798:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2c3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343275.578112:0:27798:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2c3:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763343275.578114:0:27798:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2c3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343275.578150:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+27:3659:x1848998412979456:12345-0@lo:2:osp-syn-1-1.0 Request processed in 238us (412us total) trans 17179871955 rc 0/0 00000100:00100000:2.0:1763343275.578158:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7304 00000100:00100000:2.0:1763343275.578177:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7305 00000100:00100000:2.0:1763343275.578184:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+26:3659:x1848998412979584:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343275.578247:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+27:3659:x1848998412979584:12345-0@lo:2:osp-syn-1-1.0 Request processed in 63us (445us total) trans 17179871956 rc 0/0 00000100:00100000:2.0:1763343275.578267:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7305 00000004:00080000:2.0:1763343275.578314:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c4b21f80/2, rc 0, transno 17179871956 00000100:00100000:2.0:1763343275.578320:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4b21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412979584:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1763343275.578329:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6506680/2, rc 0, transno 17179871955 00000100:00100000:2.0:1763343275.578332:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412979456:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763343275.578415:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1114 committed 00000100:00100000:0.0:1763343275.578469:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412979200:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343275.578501:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343275.578680:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763343275.578686:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412979328:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343275.578707:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1763343275.579232:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1122 committed 00010000:00010000:1.0:1763343275.579348:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a3925 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x20c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49779 expref: 296 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.579367:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20c:0x0].0x0 (ffff9400c4758700) 00010000:00010000:1.0:1763343275.579371:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343275.579375:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a3933 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x20c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49787 expref: 296 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.579387:0:6524:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a3933 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x20c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49787 expref: 296 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.579395:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a3933 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x20c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49787 expref: 296 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.579429:0:6524:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a3933 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x20c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49787 expref: 296 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343275.579440:0:6524:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b1b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412979712:192.168.201.40@tcp:105: 00000100:00100000:1.0:1763343275.579502:0:6524:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401caf84840 going to sleep for 11 seconds 00000100:00100000:1.0:1763343275.580832:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412980096:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343275.580981:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412979200 00000100:00100000:2.0:1763343275.580989:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412979200 00000100:00100000:2.0:1763343275.581056:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412979328 00000100:00100000:2.0:1763343275.581060:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412979328 00000100:00100000:2.0:1763343275.581082:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7306 00000100:00100000:2.0:1763343275.581090:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f648a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+28:3661:x1848998412979200:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763343275.581122:0:11289:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:703 count 1 00010000:00010000:2.0:1763343275.581154:0:11289:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a393a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.581181:0:11289:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3734 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496df expref: 21 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343275.581190:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.581192:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.581196:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a393a lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.581230:0:11289:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3734 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496df expref: 21 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343275.581244:0:11289:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3734 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496df expref: 21 pid: 35266 timeout: 1168 lvb_type: 1 00000100:00100000:2.0:1763343275.581266:0:11289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6402a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11289:1848998412980352:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343275.581336:0:11289:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c3be8300 going to sleep for 11 seconds 00000100:00100000:2.0:1763343275.581357:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412980224:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343275.581391:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7307 00000100:00100000:2.0:1763343275.581398:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+28:3661:x1848998412979328:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763343275.581410:0:35281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:704 count 1 00010000:00010000:2.0:1763343275.581421:0:35281:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a3941 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.581433:0:35281:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3830 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4973a expref: 21 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.581440:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343275.581442:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343275.581444:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a3941 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.581461:0:35281:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3830 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4973a expref: 21 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.581469:0:35281:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3830 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4973a expref: 21 pid: 8414 timeout: 1168 lvb_type: 0 00000100:00100000:2.0:1763343275.581477:0:35281:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6403480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35281:1848998412980480:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343275.581498:0:35281:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401cbf743c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343275.582079:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c3728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412979968:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343275.582305:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c3729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412979840:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343275.582329:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343275.582356:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412979840 00000100:00100000:0.0:1763343275.582363:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412979840 00000100:00100000:0.0:1763343275.582394:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7308 00000100:00100000:0.0:1763343275.582400:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+9:3661:x1848998412979840:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763343275.582416:0:8414:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:702 count 1 00010000:00010000:0.0:1763343275.582436:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff940202040c00/0x9104b1ba770a3948 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.582453:0:8414:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a361c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49684 expref: 12 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.582461:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343275.582463:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343275.582466:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff940202040c00/0x9104b1ba770a3948 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.582490:0:8414:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a361c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49684 expref: 12 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.582500:0:8414:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a361c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49684 expref: 12 pid: 8414 timeout: 1168 lvb_type: 0 00000100:00100000:0.0:1763343275.582510:0:8414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6488700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1848998412980608:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343275.582552:0:8414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c5965540 going to sleep for 11 seconds 00000100:00100000:2.0:1763343275.582750:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343275.582881:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343275.582955:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343275.583021:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412980224 00000100:00100000:2.0:1763343275.583046:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412980224 00000100:00100000:2.0:1763343275.583075:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412980096 00000100:00100000:2.0:1763343275.583078:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412980096 00000100:00100000:2.0:1763343275.583093:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412979968 00000100:00100000:2.0:1763343275.583095:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412979968 00000100:00100000:2.0:1763343275.583110:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7309 00000100:00100000:2.0:1763343275.583116:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+12:3660:x1848998412980224:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343275.583291:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+13:3660:x1848998412980224:12345-0@lo:2:osp-syn-0-1.0 Request processed in 174us (540us total) trans 21474839225 rc 0/0 00000100:00100000:2.0:1763343275.583302:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7309 00000100:00100000:2.0:1763343275.583319:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7310 00000100:00100000:2.0:1763343275.583325:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+12:3659:x1848998412980096:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343275.583384:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+13:3659:x1848998412980096:12345-0@lo:2:osp-syn-0-1.0 Request processed in 59us (502us total) trans 21474839226 rc 0/0 00000100:00100000:2.0:1763343275.583389:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7310 00000100:00100000:2.0:1763343275.583400:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7311 00000100:00100000:2.0:1763343275.583405:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+12:3662:x1848998412979968:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763343275.583415:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:703 count 1 00010000:00010000:2.0:1763343275.583427:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a394f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.583441:0:35266:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a381b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4972c expref: 12 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.583448:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343275.583450:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343275.583453:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a394f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.583474:0:35266:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a381b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4972c expref: 12 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.583484:0:35266:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a381b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4972c expref: 12 pid: 11289 timeout: 1168 lvb_type: 0 00000100:00100000:2.0:1763343275.583502:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6403100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35266:1848998412980736:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343275.583532:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c7ec3000 going to sleep for 11 seconds 00000004:00080000:2.0:1763343275.583570:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c372ad80/2, rc 0, transno 21474839226 00000100:00100000:2.0:1763343275.583575:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412980096:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763343275.583590:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5a3c700/2, rc 0, transno 21474839225 00000100:00100000:2.0:1763343275.583594:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412980224:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343275.583706:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.583724:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399886336 00000100:00100000:2.0:1763343275.583728:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399886336 00000100:00100000:2.0:1763343275.583753:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3781 00000100:00100000:2.0:1763343275.583759:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57136:x1848998399886336:12345-192.168.201.40@tcp:49:lfs.0 00000100:00100000:2.0:1763343275.583836:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57136:x1848998399886336:12345-192.168.201.40@tcp:49:lfs.0 Request processed in 76us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.583842:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3781 00000100:00100000:1.0:1763343275.584019:0:6524:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b1b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412979712:192.168.201.40@tcp:105: 00010000:00010000:1.0:1763343275.584069:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202041000/0x9104b1ba770a391e lrc: 0/0,0 mode: --/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49779 expref: 296 pid: 6524 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343275.584088:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a3925 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x20c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49779 expref: 295 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.584112:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940202040400, rc 0) 00000100:00100000:1.0:1763343275.584135:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:55884:x1848998399885824:12345-192.168.201.40@tcp:101:bash.0 Request processed in 28382us (28529us total) trans 4294973670 rc 0/0 00000100:00100000:1.0:1763343275.584142:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10729 00000100:00100000:1.0:1763343275.584408:0:11289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6402a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11289:1848998412980352:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343275.584427:0:11289:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a393a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343275.584514:0:8414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6488700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1848998412980608:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343275.584527:0:8414:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff940202040c00/0x9104b1ba770a3948 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343275.586429:0:35281:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6403480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35281:1848998412980480:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343275.586457:0:35281:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a3941 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343275.586740:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.586766:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.586784:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.586825:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.586843:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.586925:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399886464 00000100:00100000:0.0:1763343275.586932:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399886464 00010000:00010000:0.0:1763343275.586962:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3734 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496df expref: 22 pid: 35266 timeout: 1168 lvb_type: 1 00000100:00100000:0.0:1763343275.586986:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399886720 00000100:00100000:0.0:1763343275.586989:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399886720 00010000:00010000:0.0:1763343275.587000:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a361c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49684 expref: 13 pid: 8414 timeout: 1168 lvb_type: 0 00000100:00100000:0.0:1763343275.587015:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399886592 00000100:00100000:0.0:1763343275.587017:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399886592 00010000:00010000:0.0:1763343275.587041:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3830 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4973a expref: 23 pid: 8414 timeout: 1168 lvb_type: 0 00000100:00100000:0.0:1763343275.587052:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399886848 00000100:00100000:0.0:1763343275.587054:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399886848 00010000:00010000:0.0:1763343275.587064:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a381b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4972c expref: 14 pid: 11289 timeout: 1168 lvb_type: 0 00000100:00100000:0.0:1763343275.587087:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3485 00000100:00100000:0.0:1763343275.587095:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2407:x1848998399886464:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343275.587109:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343275.587113:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3734 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496df expref: 23 pid: 35266 timeout: 1168 lvb_type: 1 00010000:00010000:0.0:1763343275.587125:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3734 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496df expref: 23 pid: 35266 timeout: 1168 lvb_type: 1 00010000:00010000:0.0:1763343275.587150:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3734 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b496df expref: 23 pid: 35266 timeout: 1168 lvb_type: 1 00010000:00010000:0.0:1763343275.587166:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.587169:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.587174:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a393a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.587183:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a393a lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.587212:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343275.587276:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399886464:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 181us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.587284:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3485 00000100:00100000:0.0:1763343275.587302:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3486 00000100:00100000:0.0:1763343275.587308:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399886720:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343275.587319:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343275.587324:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a361c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49684 expref: 14 pid: 8414 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343275.587333:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a361c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49684 expref: 14 pid: 8414 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343275.587345:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a361c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49684 expref: 14 pid: 8414 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343275.587355:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.587357:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.587361:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff940202040c00/0x9104b1ba770a3948 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.587369:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff940202040c00/0x9104b1ba770a3948 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.587386:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343275.587405:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2407:x1848998399886720:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 97us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.587411:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3486 00000100:00100000:0.0:1763343275.587425:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3487 00000100:00100000:0.0:1763343275.587431:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399886592:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343275.587438:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343275.587442:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3830 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4973a expref: 21 pid: 8414 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343275.587449:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3830 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4973a expref: 21 pid: 8414 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343275.587461:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3830 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4973a expref: 21 pid: 8414 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343275.587471:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.587472:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.587475:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a3941 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.587482:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a3941 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.587499:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343275.587518:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399886592:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 87us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.587524:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3487 00000100:00100000:0.0:1763343275.587537:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3488 00000100:00100000:0.0:1763343275.587543:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c32b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:2407:x1848998399886848:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343275.587550:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343275.587555:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a381b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4972c expref: 12 pid: 11289 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343275.587565:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a381b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4972c expref: 12 pid: 11289 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343275.587575:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.587576:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.587579:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a394f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.587585:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a394f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.587596:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343275.587614:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c32b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:2407:x1848998399886848:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 71us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.587620:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3488 00010000:00010000:0.0:1763343275.587674:0:8414:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff940202040c00/0x9104b1ba770a3948 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.587684:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff940202040c00/0x9104b1ba770a3948 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.587694:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff940202040c00/0x9104b1ba770a3948 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.587702:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff940202040c00/0x9104b1ba770a3948 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.587718:0:8414:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343275.587960:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+13:3661:x1848998412979840:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5558us (5628us total) trans 21474839227 rc 0/0 00000100:00100000:0.0:1763343275.587968:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7308 00010000:00010000:0.0:1763343275.587986:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343275.587992:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff940202040c00/0x9104b1ba770a3948 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.587999:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff940202040c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343275.588003:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff940202040c00/0x9104b1ba770a3948 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.588012:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff940202040c00/0x9104b1ba770a3948 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.588057:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff940202040c00/0x9104b1ba770a3948 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.588065:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff940202040c00/0x9104b1ba770a3948 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.588090:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.588092:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.588094:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.588105:0:35281:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a3941 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.588113:0:35281:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a3941 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.588120:0:35281:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a3941 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.588127:0:35281:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a3941 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.588140:0:35281:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343275.588302:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+29:3661:x1848998412979328:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6905us (9593us total) trans 17179871957 rc 0/0 00000100:00100000:0.0:1763343275.588309:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7307 00010000:00010000:0.0:1763343275.588331:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343275.588336:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a3941 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.588343:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5b3d000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343275.588345:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a3941 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.588357:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a3941 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.588368:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a3941 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.588374:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a3941 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.588386:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.588388:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.588390:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.588404:0:11289:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a393a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.588411:0:11289:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a393a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.588419:0:11289:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a393a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.588426:0:11289:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a393a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.588439:0:11289:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343275.588623:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f648a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+29:3661:x1848998412979200:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7533us (10120us total) trans 17179871958 rc 0/0 00000100:00100000:0.0:1763343275.588632:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7306 00010000:00010000:0.0:1763343275.588650:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343275.588654:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a393a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.588661:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5b3d200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343275.588664:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a393a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.588671:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a393a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.588682:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a393a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.588688:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a393a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.588700:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.588702:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.588704:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343275.588738:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c3729180/2, rc 0, transno 21474839227 00000100:00100000:0.0:1763343275.588745:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c3729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412979840:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1763343275.588758:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6504000/2, rc 0, transno 17179871957 00000100:00100000:0.0:1763343275.588762:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412979328:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1763343275.588770:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6507b80/2, rc 0, transno 17179871958 00000100:00100000:0.0:1763343275.588774:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412979200:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343275.589047:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399887104 00000100:00100000:2.0:1763343275.589055:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399887104 00000100:00100000:2.0:1763343275.589095:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3782 00000100:00100000:2.0:1763343275.589103:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57136:x1848998399887104:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343275.589290:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57136:x1848998399887104:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 186us (2444us total) trans 4294973671 rc 0/0 00000100:00100000:2.0:1763343275.589298:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3782 00010000:00010000:2.0:1763343275.589334:0:35266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a381b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4972c expref: 11 pid: 11289 timeout: 1168 lvb_type: 0 00000100:00100000:2.0:1763343275.589345:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6403100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35266:1848998412980736:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343275.589363:0:35266:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a394f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.589373:0:35266:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a394f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.589381:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a394f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.589389:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a394f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.589397:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a394f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.589413:0:35266:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343275.589610:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+13:3662:x1848998412979968:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6204us (6653us total) trans 21474839228 rc 0/0 00000100:00100000:2.0:1763343275.589617:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7311 00000004:00080000:2.0:1763343275.589649:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c3728700/2, rc 0, transno 21474839228 00000100:00100000:2.0:1763343275.589654:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c3728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412979968:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1763343275.589668:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343275.589673:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a394f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.589680:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5b3c400 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343275.589683:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a394f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.589692:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a394f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.589706:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a394f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.589712:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a394f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.589726:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343275.589728:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343275.589729:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343275.590174:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.590228:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399887232 00000100:00100000:3.0:1763343275.590234:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399887232 00000100:00100000:3.0:1763343275.590285:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7312 00000100:00100000:3.0:1763343275.590294:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:55884:x1848998399887232:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343275.590309:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343275.590326:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a3956 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4978e expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.590349:0:35266:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a392c lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49780 expref: 21 pid: 11289 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343275.590358:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343275.590360:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343275.590364:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a3956 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4978e expref: 21 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.590397:0:35266:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a392c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49780 expref: 21 pid: 11289 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343275.590411:0:35266:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a392c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49780 expref: 21 pid: 11289 timeout: 1168 lvb_type: 1 00000100:00100000:3.0:1763343275.590423:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412980864:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343275.590483:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c8284540 going to sleep for 11 seconds 00000100:00100000:2.0:1763343275.593760:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.595470:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399887488 00000100:00100000:1.0:1763343275.595485:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399887488 00000100:00100000:1.0:1763343275.595553:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10731 00000100:00100000:1.0:1763343275.595564:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57136:x1848998399887488:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343275.595588:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343275.595619:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a395d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49795 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.595704:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3964 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343275.595720:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3964 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343275.595732:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3964 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343275.595745:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a396b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343275.595754:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a396b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343275.595760:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a396b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000100:00100000:3.0:1763343275.595769:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998412980864:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343275.595802:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a3956 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4978e expref: 21 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.595821:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8693e00, rc 0) 00000100:00100000:3.0:1763343275.595874:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:55884:x1848998399887232:12345-192.168.201.40@tcp:101:bash.0 Request processed in 5581us (5703us total) trans 0 rc 0/0 00010000:00010000:1.0:1763343275.595878:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3972 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00000100:00100000:3.0:1763343275.595885:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7312 00010000:00010000:1.0:1763343275.595893:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3972 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343275.595903:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3972 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:1.0:1763343275.595914:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x20c:0x0]: returning size 2 00000100:00100000:3.0:1763343275.595991:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:1.0:1763343275.596008:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3964 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343275.596017:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3964 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00000100:00100000:3.0:1763343275.596020:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399887616 00000100:00100000:3.0:1763343275.596049:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399887616 00010000:00010000:1.0:1763343275.596055:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3964 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343275.596063:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3964 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343275.596069:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343275.596073:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a392c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49780 expref: 21 pid: 11289 timeout: 1168 lvb_type: 1 00010000:00010000:1.0:1763343275.596085:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3964 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343275.596096:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3964 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00000100:00100000:3.0:1763343275.596107:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3489 00010000:00010000:1.0:1763343275.596112:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6696400) 00000100:00100000:3.0:1763343275.596119:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399887616:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343275.596119:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343275.596125:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3964 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343275.596133:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3964 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343275.596134:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343275.596143:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a392c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49780 expref: 21 pid: 11289 timeout: 1168 lvb_type: 1 00010000:00010000:1.0:1763343275.596150:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a396b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343275.596158:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a396b lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343275.596159:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a392c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49780 expref: 21 pid: 11289 timeout: 1168 lvb_type: 1 00010000:00010000:1.0:1763343275.596172:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a396b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343275.596180:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343275.596182:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a396b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343275.596187:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a396b lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343275.596189:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a392c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49780 expref: 21 pid: 11289 timeout: 1168 lvb_type: 1 00010000:00010000:1.0:1763343275.596202:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6696f00) 00010000:00010000:1.0:1763343275.596209:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343275.596214:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a396b lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343275.596217:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343275.596221:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.596223:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a396b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343275.596231:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a3956 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4978e expref: 20 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.596245:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a3956 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4978e expref: 20 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.596291:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a395d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49795 expref: 299 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.596296:0:6510:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a3956 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4978e expref: 20 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.596317:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3972 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49795 expref: 298 pid: 6524 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343275.596319:0:6510:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6510:1848998412980992:192.168.201.40@tcp:105: 00010000:00010000:1.0:1763343275.596332:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20c:0x0].0x0 (ffff9400c4758700) 00010000:00010000:1.0:1763343275.596335:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343275.596338:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176800, rc 0) 00000100:00100000:3.0:1763343275.596376:0:6510:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c8284540 going to sleep for 11 seconds 00000100:00100000:1.0:1763343275.598177:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57136:x1848998399887488:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2604us (4415us total) trans 4294973672 rc 0/0 00000100:00100000:1.0:1763343275.598189:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10731 00000100:00100000:0.0:1763343275.603234:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.603394:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.603480:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399887872 00000100:00100000:2.0:1763343275.603490:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399887872 00000100:00100000:2.0:1763343275.603549:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3783 00000100:00100000:2.0:1763343275.603558:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57136:x1848998399887872:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343275.603672:0:6510:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6510:1848998412980992:192.168.201.40@tcp:105: 00010000:00010000:3.0:1763343275.603696:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343275.603760:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399887616:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 7644us (7769us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343275.603769:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3489 00000100:00100000:3.0:1763343275.603800:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399888000 00000100:00100000:3.0:1763343275.603804:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399888000 00000100:00100000:3.0:1763343275.603832:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7313 00000100:00100000:3.0:1763343275.603838:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+11:55884:x1848998399888000:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343275.603847:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343275.603868:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a3980 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4979c expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343275.603894:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343275.603911:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343275.603913:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343275.603922:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a3980 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4979c expref: 12 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.603935:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a3980 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4979c expref: 12 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.603946:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8692c00, rc 0) 00000100:00100000:2.0:1763343275.605160:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57136:x1848998399887872:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1595us (1930us total) trans 4294973673 rc 0/0 00000100:00100000:2.0:1763343275.605174:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3783 00000100:00100000:3.0:1763343275.606084:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:55884:x1848998399888000:12345-192.168.201.40@tcp:101:bash.0 Request processed in 2237us (2683us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343275.606095:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7313 00000100:00100000:2.0:1763343275.608994:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.609115:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.609151:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.609196:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399888384 00000100:00100000:1.0:1763343275.609288:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399888256 00000100:00100000:1.0:1763343275.609297:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399888256 00002000:00010000:1.0:1763343275.609334:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/707 (0->18446744073709551615) 00002000:00100000:1.0:1763343275.609338:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401f6403800 with x1848998399888256 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343275.609349:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401f6403800. 00000100:00100000:1.0:1763343275.609380:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1741 00000100:00100000:1.0:1763343275.609388:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2409:x1848998399888256:12345-192.168.201.40@tcp:10:bash.0 00000100:00100000:3.0:1763343275.609544:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399888384 00002000:00010000:1.0:1763343275.609548:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2c3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343275.609552:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2c3:0x0] updating lvb mtime from disk: 0 -> 1763343274 00002000:00010000:1.0:1763343275.609554:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2c3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343275.609556:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2c3:0x0] updating lvb ctime from disk: 0 -> 1763343274 00002000:00010000:1.0:1763343275.609558:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2c3:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1763343275.609566:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/706 (0->18446744073709551615) 00002000:00100000:3.0:1763343275.609571:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401f6403480 with x1848998399888384 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343275.609577:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9401f6403480. 00000100:00100000:3.0:1763343275.609605:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1742 00000100:00100000:1.0:1763343275.609605:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2409:x1848998399888256:12345-192.168.201.40@tcp:10:bash.0 Request processed in 216us (451us total) trans 17179871959 rc 0/0 00000100:00100000:1.0:1763343275.609619:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1741 00000100:00100000:3.0:1763343275.609620:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:2409:x1848998399888384:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:1.0:1763343275.609625:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/707 (0->18446744073709551615) 00002000:00100000:1.0:1763343275.609630:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401f6403800 with x1848998399888256 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343275.609634:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401f6403800. 00002000:00010000:3.0:1763343275.609722:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2c2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343275.609725:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2c2:0x0] updating lvb mtime from disk: 0 -> 1763343274 00002000:00010000:3.0:1763343275.609728:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2c2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343275.609730:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2c2:0x0] updating lvb ctime from disk: 0 -> 1763343274 00002000:00010000:3.0:1763343275.609733:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2c2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343275.609755:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399888128 00000100:00100000:0.0:1763343275.609761:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399888128 00000100:00100000:3.0:1763343275.609763:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2409:x1848998399888384:12345-192.168.201.40@tcp:10:bash.0 Request processed in 146us (647us total) trans 21474839229 rc 0/0 00000100:00100000:3.0:1763343275.609771:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1742 00002000:00010000:3.0:1763343275.609774:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/706 (0->18446744073709551615) 00002000:00100000:3.0:1763343275.609777:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401f6403480 with x1848998399888384 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343275.609781:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9401f6403480. 00000100:00100000:0.0:1763343275.609813:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3784 00000100:00100000:0.0:1763343275.609822:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8440850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57136:x1848998399888128:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:0.0:1763343275.609931:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8440850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57136:x1848998399888128:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 110us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.609938:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3784 00000100:00100000:1.0:1763343275.616126:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.617506:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399888640 00000100:00100000:0.0:1763343275.617521:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399888640 00000100:00100000:0.0:1763343275.617590:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3785 00000100:00100000:0.0:1763343275.617601:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:55884:x1848998399888640:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:0.0:1763343275.617911:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:55884:x1848998399888640:12345-192.168.201.40@tcp:35:bash.0 Request processed in 312us (1797us total) trans 4294973674 rc 0/0 00000100:00100000:0.0:1763343275.617919:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3785 00000100:00100000:1.0:1763343275.628300:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.628536:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.628602:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399889152 00000100:00100000:3.0:1763343275.628613:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399889152 00000100:00100000:3.0:1763343275.628666:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399888896 00000100:00100000:3.0:1763343275.628670:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399888896 00000100:00100000:3.0:1763343275.628699:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10732 00000100:00100000:3.0:1763343275.628709:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57142:x1848998399889152:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:3.0:1763343275.628768:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1763343275.628795:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff940202040400/0x9104b1ba770a3925 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x20c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49779 expref: 301 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.628819:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a3933 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x20c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49787 expref: 300 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.628845:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3972 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49795 expref: 299 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.628859:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a38df lrc: 0/0,0 mode: --/PR res: [0x240000404:0x20c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4975d expref: 298 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.628869:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20c:0x0].0x0 (ffff9400c4758700) 00010000:00010000:3.0:1763343275.628879:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343275.628907:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a3987 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343275.628919:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a3987 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.628929:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a3987 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.628941:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a398e lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343275.628948:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a398e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.628954:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a398e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.629076:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a3995 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343275.629085:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a3995 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.629091:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a3995 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000040:00080000:3.0:1763343275.629341:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1750, 64 off145584 00000040:00080000:3.0:1763343275.629364:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1742, 64 off144928 00000040:00080000:3.0:1763343275.629373:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1743, 64 off144992 00000040:00080000:3.0:1763343275.629383:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1751, 64 off145648 00010000:00010000:3.0:1763343275.629432:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a399c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x20c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343275.629441:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a399c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.629452:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a399c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.629458:0:33856:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a399c lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.629463:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a399c lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.629469:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a399c lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.629486:0:33856:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343275.629503:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343275.629508:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a399c lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.629514:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a2e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343275.629517:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a399c lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.629524:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a399c lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.629531:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20c:0x0].0x0 (ffff9401f669e300) 00010000:00010000:3.0:1763343275.629533:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343275.629537:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a399c lrc: 1/0,0 mode: --/PW res: [0x240000404:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.629542:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a399c lrc: 0/0,0 mode: --/PW res: [0x240000404:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.629551:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343275.629553:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343275.629555:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343275.629566:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a3995 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.629571:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a3995 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.629576:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a3995 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.629581:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a2000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343275.629584:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a3995 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.629589:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a3995 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.629595:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20c:0x0].0x0 (ffff9401f669e300) 00010000:00010000:3.0:1763343275.629597:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763343275.629599:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a3995 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.629604:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a3995 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.629707:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a3987 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.629713:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a3987 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.629718:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a3987 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.629726:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8693c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343275.629729:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a3987 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.629735:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a3987 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.629743:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f669ef00) 00010000:00010000:3.0:1763343275.629746:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343275.629749:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a3987 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.629755:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a3987 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000100:00100000:2.0:1763343275.629758:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10733 00000004:00010000:3.0:1763343275.629771:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000076207e50 reply state 00000000c7e17b96 transno 4294973675 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a398e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:2.0:1763343275.629776:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57141:x1848998399888896:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343275.629790:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a398e lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.629794:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343275.629797:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f669eb00) 00010000:00010000:3.0:1763343275.629801:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343275.629803:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343275.629810:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a39a3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x20c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b497a3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343275.629874:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57142:x1848998399889152:12345-192.168.201.40@tcp:36:rm.0 Request processed in 1165us (1582us total) trans 4294973675 rc 0/0 00000100:00100000:3.0:1763343275.629882:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10732 00010000:00010000:2.0:1763343275.629911:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a39a3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x20c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497a3 expref: 299 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.629922:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20c:0x0].0x0 (ffff9400c4758600) 00010000:00010000:2.0:1763343275.629924:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343275.629929:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a39a3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x20c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497a3 expref: 299 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.629942:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5bd8e00, rc 0) 00000100:00100000:2.0:1763343275.629966:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57141:x1848998399888896:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 197us (1431us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343275.629971:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10733 00000100:00100000:1.0:1763343275.633657:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.633745:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399889408 00000100:00100000:0.0:1763343275.633754:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399889408 00000100:00100000:0.0:1763343275.633812:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10734 00000100:00100000:0.0:1763343275.633821:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57141:x1848998399889408:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343275.633853:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.633877:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a39aa lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b497aa expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.633955:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a39b1 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343275.633967:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a39b1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.633978:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a39b1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.633988:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a39b8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343275.633995:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a39b8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.634001:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a39b8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.634077:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a39b1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.634083:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a39b1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.634089:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a39b1 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.634094:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a39b1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.634099:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fdc00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.634103:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a39b1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.634113:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a39b1 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.634123:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695000) 00010000:00010000:0.0:1763343275.634126:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.634129:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a39b1 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.634135:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a39b1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.634146:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a39b8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.634150:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a39b8 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.634155:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a39b8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.634159:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fd600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.634161:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a39b8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.634165:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a39b8 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.634170:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f669eb00) 00010000:00010000:0.0:1763343275.634173:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.634175:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a39b8 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.634180:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a39b8 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.634206:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a39aa lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497aa expref: 299 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.634215:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695000) 00010000:00010000:0.0:1763343275.634217:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343275.634220:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a39aa lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497aa expref: 299 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.634232:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401f1bf0200, rc 0) 00000100:00100000:0.0:1763343275.634316:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57141:x1848998399889408:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 496us (669us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343275.634324:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10734 00000100:00100000:2.0:1763343275.638653:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.638794:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399889536 00000100:00100000:1.0:1763343275.638804:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399889536 00000100:00100000:1.0:1763343275.638862:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10735 00000100:00100000:1.0:1763343275.638871:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57141:x1848998399889536:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343275.638892:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343275.638915:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a39bf lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b497b1 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.638980:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a39c6 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343275.638998:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a39c6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.639013:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a39c6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.639050:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a39cd lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343275.639058:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a39cd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.639065:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a39cd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.639099:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a39c6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.639106:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a39c6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.639111:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a39c6 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.639117:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a39c6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.639122:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343275.639126:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a39c6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.639132:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a39c6 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.639141:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6696400) 00010000:00010000:1.0:1763343275.639144:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343275.639147:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a39c6 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.639152:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a39c6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.639162:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a39cd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.639167:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a39cd lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.639183:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a39cd lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.639188:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343275.639191:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a39cd lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.639195:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a39cd lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.639202:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f669eb00) 00010000:00010000:1.0:1763343275.639205:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343275.639208:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a39cd lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.639213:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a39cd lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.639240:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a39bf lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497b1 expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.639260:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6696400) 00010000:00010000:1.0:1763343275.639263:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343275.639267:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a39bf lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497b1 expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.639281:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176e00, rc 0) 00000100:00100000:1.0:1763343275.639347:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57141:x1848998399889536:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 476us (704us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343275.639355:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10735 00000100:00100000:2.0:1763343275.641563:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.641676:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399889664 00000100:00100000:1.0:1763343275.641688:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399889664 00000100:00100000:0.0:1763343275.642351:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10736 00000100:00100000:0.0:1763343275.642365:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57143:x1848998399889664:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343275.642389:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.642417:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a39d4 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b497b8 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.642518:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a39db lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343275.642532:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a39db lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.642546:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a39db lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.642557:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a39e2 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343275.642565:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a39e2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.642571:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a39e2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.642612:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a39db lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.642619:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a39db lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.642626:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a39db lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.642632:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a39db lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.642638:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fd800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.642642:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a39db lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.642650:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a39db lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.642663:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695200) 00010000:00010000:0.0:1763343275.642667:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.642673:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a39db lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.642679:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a39db lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.642694:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a39e2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.642700:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a39e2 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.642706:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a39e2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.642710:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121e200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.642713:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a39e2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.642718:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a39e2 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.642724:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f669eb00) 00010000:00010000:0.0:1763343275.642727:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.642730:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a39e2 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.642735:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a39e2 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.642761:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a39d4 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497b8 expref: 299 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.642770:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695200) 00010000:00010000:0.0:1763343275.642772:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.642775:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a39d4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497b8 expref: 299 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.642789:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fca00, rc 0) 00000100:00100000:0.0:1763343275.642865:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57143:x1848998399889664:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 504us (1312us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343275.642874:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10736 00000100:00100000:3.0:1763343275.647351:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.647403:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399889792 00000100:00100000:1.0:1763343275.647414:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399889792 00000100:00100000:1.0:1763343275.647477:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10737 00000100:00100000:1.0:1763343275.647488:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57143:x1848998399889792:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343275.647514:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343275.647539:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a39e9 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b497bf expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.647614:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a39f0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343275.647627:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a39f0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.647639:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a39f0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.647649:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a39f7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343275.647656:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a39f7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.647662:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a39f7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.647701:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a39f0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.647708:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a39f0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.647714:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a39f0 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.647719:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a39f0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.647729:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343275.647732:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a39f0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.647739:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a39f0 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.647751:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:1.0:1763343275.647754:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343275.647758:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a39f0 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.647764:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a39f0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.647777:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a39f7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.647783:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a39f7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.647788:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a39f7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.647793:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343275.647809:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a39f7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.647815:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a39f7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.647823:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f669eb00) 00010000:00010000:1.0:1763343275.647825:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343275.647828:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a39f7 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.647834:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a39f7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343275.647859:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a39e9 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497bf expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.647869:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:1.0:1763343275.647871:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343275.647874:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a39e9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497bf expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.647888:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176a00, rc 0) 00000100:00100000:1.0:1763343275.647952:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57143:x1848998399889792:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 466us (612us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343275.647960:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10737 00000100:00100000:2.0:1763343275.650546:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.650958:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.650976:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399890176 00000100:00100000:0.0:1763343275.650987:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399890176 00000100:00100000:1.0:1763343275.651009:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399890048 00000100:00100000:1.0:1763343275.651013:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399890048 00000100:00100000:0.0:1763343275.651297:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10738 00000100:00100000:0.0:1763343275.651307:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57143:x1848998399890176:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343275.651327:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.651351:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a39fe lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b497cd expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.651414:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3a05 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343275.651429:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3a05 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.651441:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3a05 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:0.0:1763343275.651491:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343275.651496:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343275.651531:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a39fe lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497cd expref: 301 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.651548:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3a05 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497cd expref: 300 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.651557:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695000) 00010000:00010000:0.0:1763343275.651560:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343275.651563:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121e800, rc 0) 00000100:00100000:0.0:1763343275.651617:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57143:x1848998399890176:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 312us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.651623:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10738 00000100:00100000:0.0:1763343275.651642:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10739 00000100:00100000:0.0:1763343275.651649:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57144:x1848998399890048:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343275.651656:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.651663:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a3a0c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b497c6 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.651706:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3a13 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343275.651714:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3a13 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.651721:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3a13 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.651731:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3a1a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343275.651738:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3a1a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.651744:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3a1a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.651861:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3a13 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.651868:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3a13 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.651877:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3a13 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.651883:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3a13 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.651888:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fd600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.651891:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3a13 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.651898:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3a13 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.651907:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695000) 00010000:00010000:0.0:1763343275.651910:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.651914:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3a13 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.651920:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3a13 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.651929:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3a1a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.651934:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3a1a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.651940:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3a1a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.651944:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fdc00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.651947:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3a1a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.651956:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3a1a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.651963:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f669eb00) 00010000:00010000:0.0:1763343275.651965:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.651968:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3a1a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.651973:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3a1a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.651994:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a3a0c lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497c6 expref: 300 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.652002:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695000) 00010000:00010000:0.0:1763343275.652005:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343275.652008:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a3a0c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497c6 expref: 300 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.652015:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121fc00, rc 0) 00000100:00100000:0.0:1763343275.652211:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57144:x1848998399890048:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 561us (1253us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343275.652217:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10739 00000100:00100000:2.0:1763343275.657844:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.658707:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399890432 00000100:00100000:0.0:1763343275.658719:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399890432 00000100:00100000:0.0:1763343275.658840:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10740 00000100:00100000:0.0:1763343275.658854:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57143:x1848998399890432:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343275.658876:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.658880:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343275.658909:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3a05 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497cd expref: 299 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.658931:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695000) 00010000:00010000:0.0:1763343275.658942:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343275.658958:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a3a21 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b497d4 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.659211:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a3a28 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343275.659225:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a3a28 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.659235:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a3a28 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.659247:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3a2f lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343275.659265:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3a2f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.659373:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3a2f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.659783:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3a36 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343275.659792:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3a36 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.659799:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3a36 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:0.0:1763343275.659809:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x20e:0x0]: returning size 0 00010000:00010000:0.0:1763343275.659834:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a3a28 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.659841:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a3a28 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.659848:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a3a28 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.659855:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a3a28 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.659862:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c7ec1c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.659866:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a3a28 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.659873:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a3a28 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.659882:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695200) 00010000:00010000:0.0:1763343275.659885:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.659889:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a3a28 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.659895:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a3a28 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000004:00010000:0.0:1763343275.659907:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000be495c49 reply state 00000000b1559ab1 transno 4294973676 ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3a2f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.659917:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3a2f lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.659928:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f669eb00) 00010000:00010000:0.0:1763343275.659930:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343275.659933:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343275.659962:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a3a21 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497d4 expref: 301 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.659981:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3a36 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497d4 expref: 300 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.659989:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6695e00) 00010000:00010000:0.0:1763343275.659992:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343275.659995:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121e200, rc 0) 00000100:00100000:0.0:1763343275.660114:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57143:x1848998399890432:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1264us (2282us total) trans 4294973676 rc 0/0 00000100:00100000:0.0:1763343275.660122:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10740 00000100:00100000:0.0:1763343275.663350:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.663497:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399890688 00000100:00100000:3.0:1763343275.663508:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399890688 00000100:00100000:3.0:1763343275.664205:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10741 00000100:00100000:3.0:1763343275.664219:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57143:x1848998399890688:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343275.664243:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343275.664430:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3a44 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b497db expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.664545:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3a4b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343275.664559:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3a36 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497d4 expref: 302 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.664568:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3a4b lrc: 4/0,1 mode: --/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.664603:0:9827:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3a36 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497d4 expref: 302 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.664617:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3a36 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497d4 expref: 302 pid: 9827 timeout: 1168 lvb_type: 0 00000100:00100000:3.0:1763343275.664632:0:9827:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412981120:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343275.664766:0:9827:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c8284540 going to sleep for 11 seconds 00000100:00100000:0.0:1763343275.668020:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412981120:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343275.668149:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3a4b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:3.0:1763343275.669001:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.669318:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399890816 00000100:00100000:2.0:1763343275.669330:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399890816 00010000:00010000:2.0:1763343275.669373:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3a36 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497d4 expref: 303 pid: 9827 timeout: 1168 lvb_type: 0 00000100:00100000:2.0:1763343275.669419:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3490 00000100:00100000:2.0:1763343275.669429:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:2408:x1848998399890816:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343275.669444:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343275.669450:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3a36 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497d4 expref: 303 pid: 9827 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343275.669464:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3a36 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497d4 expref: 303 pid: 9827 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343275.669492:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3a36 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497d4 expref: 303 pid: 9827 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343275.669511:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6695e00) 00010000:00010000:2.0:1763343275.669516:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3a4b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.669526:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3a4b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.669533:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3a4b lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.669551:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343275.669607:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:2408:x1848998399890816:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 178us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.669618:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3490 00010000:00010000:1.0:1763343275.670886:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3a4b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.670902:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3a4b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343275.670928:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x20e:0x0]: returning size 0 00000004:00080000:1.0:1763343275.671136:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2c4:0x0], index 0: 0 00000004:00080000:1.0:1763343275.671143:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2c5:0x0], index 1: 0 00000004:00080000:1.0:1763343275.671148:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2c6:0x0], index 1: 0 00000004:00080000:1.0:1763343275.671152:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2c5:0x0], index 0: 0 00010000:00010000:1.0:1763343275.671276:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3a4b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.671284:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3a4b lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.671291:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3a4b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.671297:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343275.671301:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3a4b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.671308:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3a4b lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.671324:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6695e00) 00010000:00010000:1.0:1763343275.671327:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343275.671331:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3a4b lrc: 2/0,0 mode: --/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.671336:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3a4b lrc: 0/0,0 mode: --/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.671390:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3a44 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497db expref: 302 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.671400:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6695e00) 00010000:00010000:1.0:1763343275.671403:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343275.671406:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3a44 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497db expref: 302 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.671423:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3200, rc 0) 00000100:00100000:1.0:1763343275.671497:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57143:x1848998399890688:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 7281us (8155us total) trans 4294973677 rc 301/301 00000100:00100000:1.0:1763343275.671506:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10741 00000100:00100000:3.0:1763343275.676159:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.676199:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.676317:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399891072 00000100:00100000:1.0:1763343275.676328:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399891072 00000100:00100000:1.0:1763343275.676381:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10742 00000100:00100000:1.0:1763343275.676390:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57145:x1848998399891072:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343275.676414:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343275.676444:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3a59 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b497e2 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.676572:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3a60 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343275.676587:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3a60 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.676601:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3a60 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.676611:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3a67 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343275.676619:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3a67 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.676626:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3a67 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.676756:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3a6e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343275.676763:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3a6e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.676771:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3a6e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.676864:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3a60 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.676872:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3a60 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.676877:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3a60 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.676883:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3a60 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.676888:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343275.676892:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3a60 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.676900:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3a60 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.676911:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:1.0:1763343275.676914:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343275.676918:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3a60 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.676924:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3a60 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.676937:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3a67 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.676942:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3a67 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.676948:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3a67 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.676952:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343275.676954:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3a67 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.676959:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3a67 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.676965:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f669eb00) 00010000:00010000:1.0:1763343275.676968:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343275.676970:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3a67 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.676975:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3a67 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.677010:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3a59 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497e2 expref: 304 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.677061:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3a6e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497e2 expref: 303 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.677068:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696400) 00010000:00010000:1.0:1763343275.677071:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343275.677073:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176e00, rc 0) 00000100:00100000:1.0:1763343275.677134:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57145:x1848998399891072:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 745us (990us total) trans 4294973678 rc 0/0 00000100:00100000:1.0:1763343275.677143:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10742 00000100:00100000:0.0:1763343275.677244:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399891328 00000100:00100000:0.0:1763343275.677263:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399891328 00000100:00100000:0.0:1763343275.677305:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3786 00000100:00100000:0.0:1763343275.677312:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57143:x1848998399891328:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343275.677484:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57143:x1848998399891328:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 172us (1283us total) trans 4294973679 rc 0/0 00000100:00100000:0.0:1763343275.677491:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3786 00000100:00100000:0.0:1763343275.680434:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.680508:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399891584 00000100:00100000:1.0:1763343275.680528:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399891584 00000100:00100000:1.0:1763343275.680591:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3787 00000100:00100000:1.0:1763343275.680602:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57143:x1848998399891584:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343275.682143:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57143:x1848998399891584:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1535us (1712us total) trans 4294973680 rc 0/0 00000100:00100000:1.0:1763343275.682156:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3787 00000100:00100000:3.0:1763343275.682621:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.682659:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.682731:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399891712 00000100:00100000:2.0:1763343275.682739:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399891712 00000100:00100000:2.0:1763343275.682779:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399891840 00000100:00100000:2.0:1763343275.682782:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399891840 00000100:00100000:2.0:1763343275.682820:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7314 00000100:00100000:2.0:1763343275.682829:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2409:x1848998399891712:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343275.682844:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.682866:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a3a7c lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b497e9 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343275.682890:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343275.682909:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.682912:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.682921:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a3a7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497e9 expref: 22 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343275.682937:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a3a7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497e9 expref: 22 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343275.682949:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5b3d000, rc 0) 00000100:00100000:2.0:1763343275.682979:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2409:x1848998399891712:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 152us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.682985:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7314 00000100:00100000:2.0:1763343275.683000:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7315 00000100:00100000:2.0:1763343275.683005:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2409:x1848998399891840:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343275.683015:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.683046:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a3a83 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b497f0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343275.683060:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343275.683068:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.683070:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.683074:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a3a83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497f0 expref: 14 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343275.683085:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a3a83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497f0 expref: 14 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343275.683093:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5b3d200, rc 0) 00000100:00100000:2.0:1763343275.683113:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2409:x1848998399891840:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 107us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.683118:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7315 00000100:00100000:0.0:1763343275.688993:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.689092:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399892096 00000100:00100000:3.0:1763343275.689102:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399892096 00000100:00100000:1.0:1763343275.690632:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10743 00000100:00100000:1.0:1763343275.690651:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:55884:x1848998399892096:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343275.690673:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343275.690676:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343275.690701:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3a6e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497e2 expref: 305 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.690717:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696400) 00010000:00010000:1.0:1763343275.690726:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343275.690739:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3a8a lrc: 2/0,0 mode: --/CW res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b497f7 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.690847:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3a91 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343275.690858:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3a91 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x20e:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.690866:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3a91 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x20e:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343275.690878:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x20e:0x0]: returning size 0 00000100:00100000:0.0:1763343275.691999:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.692106:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399892224 00000100:00100000:3.0:1763343275.692114:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399892224 00000100:00100000:3.0:1763343275.692154:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10744 00000100:00100000:3.0:1763343275.692162:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57145:x1848998399892224:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343275.692178:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343275.692191:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3a9f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b497fe expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.692228:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3a9f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497fe expref: 307 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.692239:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3a9f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497fe expref: 307 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.692267:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:3.0:1763343275.692270:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343275.692274:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3a00, rc 0) 00000100:00100000:3.0:1763343275.692339:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57145:x1848998399892224:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 177us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343275.692346:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10744 00010000:00010000:1.0:1763343275.692733:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3a8a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497f7 expref: 308 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.692750:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3a91 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x20e:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497f7 expref: 307 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.692757:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:1.0:1763343275.692760:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:1.0:1763343275.692762:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176400, rc 0) 00000100:00100000:1.0:1763343275.692789:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:55884:x1848998399892096:12345-192.168.201.40@tcp:101:bash.0 Request processed in 2147us (3805us total) trans 4294973681 rc 0/0 00000100:00100000:1.0:1763343275.692807:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10743 00000100:00100000:0.0:1763343275.695854:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.695901:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.695982:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399892608 00000100:00100000:1.0:1763343275.695982:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399892352 00000100:00100000:2.0:1763343275.695991:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399892608 00000100:00100000:1.0:1763343275.695991:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399892352 00000100:00100000:2.0:1763343275.696061:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3788 00000100:00100000:1.0:1763343275.696064:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10745 00000100:00100000:2.0:1763343275.696071:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57145:x1848998399892608:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343275.696071:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:55884:x1848998399892352:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343275.696232:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343275.696264:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3aa6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49805 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343275.696311:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57145:x1848998399892608:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 242us (409us total) trans 4294973682 rc 0/0 00000100:00100000:2.0:1763343275.696318:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3788 00010000:00010000:1.0:1763343275.696829:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3aad lrc: 3/1,0 mode: --/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343275.696844:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3aad lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.696856:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3aad lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.696943:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3aa6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49805 expref: 310 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.696968:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3aad lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49805 expref: 309 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.696977:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:1.0:1763343275.696980:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343275.696983:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176000, rc 0) 00000100:00100000:1.0:1763343275.697020:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:55884:x1848998399892352:12345-192.168.201.40@tcp:101:bash.0 Request processed in 949us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343275.697052:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10745 00000100:00100000:3.0:1763343275.699517:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.700082:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.700375:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399893120 00000100:00100000:1.0:1763343275.700388:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399893120 00000100:00100000:1.0:1763343275.700447:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399892992 00000100:00100000:1.0:1763343275.700450:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399892992 00000100:00100000:1.0:1763343275.700482:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10746 00000100:00100000:1.0:1763343275.700493:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:55884:x1848998399893120:12345-192.168.201.40@tcp:36:bash.0 00000100:00100000:0.0:1763343275.700501:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10747 00000100:00100000:0.0:1763343275.700509:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57145:x1848998399892992:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343275.700518:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.700543:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3ab4 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4980c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.700548:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343275.700570:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3a91 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x20e:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497f7 expref: 311 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.700586:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:1.0:1763343275.700590:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343275.700621:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3abb lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343275.700632:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3abb lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.700641:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3abb lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.700650:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a3ac2 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343275.700656:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a3ac2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.700661:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a3ac2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.700756:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a3ac9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343275.700758:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3ad0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343275.700767:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3ad0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.701142:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3ad0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000001:00080000:1.0:1763343275.701212:0:9827:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973683 00000004:00010000:1.0:1763343275.701236:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000de6a2725 reply state 00000000b31bdc85 transno 4294973684 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3ad0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.701394:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a3ac9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x19/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.701404:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a3ac9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x19/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343275.701407:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3ad0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.701413:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:1.0:1763343275.701416:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00200000:0.0:1763343275.701416:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x20e:0x0]: returning size 0 00000100:00100000:1.0:1763343275.701419:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343275.701475:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3abb lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.701481:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3abb lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.701487:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3abb lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.701493:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3abb lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.701498:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121e800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.701501:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3abb lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.701507:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3abb lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.701516:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695200) 00010000:00010000:0.0:1763343275.701519:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.701522:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3abb lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.701528:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3abb lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.701542:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a3ac2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.701548:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a3ac2 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.701554:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a3ac2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.701558:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121fc00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.701561:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a3ac2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.701566:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a3ac2 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.701572:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f669eb00) 00010000:00010000:0.0:1763343275.701574:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.701577:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a3ac2 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.701581:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a3ac2 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.701609:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3ab4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4980c expref: 315 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.701625:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a3ac9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x19/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4980c expref: 314 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.701631:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:0.0:1763343275.701634:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 19 00010000:00010000:0.0:1763343275.701636:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121ea00, rc 0) 00000100:00100000:1.0:1763343275.701658:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:55884:x1848998399893120:12345-192.168.201.40@tcp:36:bash.0 Request processed in 1167us (2156us total) trans 4294973684 rc 0/0 00000100:00100000:1.0:1763343275.701670:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10746 00000020:00080000:1.0:1763343275.701676:0:9827:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343275.703100:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57145:x1848998399892992:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2581us (3009us total) trans 4294973685 rc 0/0 00000100:00100000:0.0:1763343275.703112:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10747 00000100:00100000:0.0:1763343275.711809:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.711892:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399893248 00000100:00100000:2.0:1763343275.711903:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399893248 00000100:00100000:1.0:1763343275.712262:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10748 00000100:00100000:1.0:1763343275.712285:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57145:x1848998399893248:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343275.712310:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343275.712336:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3ade lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49813 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.712405:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3ae5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343275.712419:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3ae5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.712430:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3ae5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343275.712476:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x20e:0x0]: returning size 0 00000004:00200000:1.0:1763343275.712481:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343275.712498:0:9827:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3ae5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.712508:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3ae5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.712531:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3ade lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49813 expref: 315 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.712554:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3ae5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49813 expref: 314 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.712562:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:1.0:1763343275.712565:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343275.712569:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176e00, rc 0) 00000100:00100000:1.0:1763343275.712630:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57145:x1848998399893248:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 358us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343275.712638:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10748 00000100:00100000:0.0:1763343275.712797:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.712900:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399893504 00000100:00100000:1.0:1763343275.712907:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399893504 00000100:00100000:1.0:1763343275.713016:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10749 00000100:00100000:1.0:1763343275.713049:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:55884:x1848998399893504:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343275.713062:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343275.713065:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1763343275.713080:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a3ac9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4980c expref: 314 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.713095:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3a9f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497fe expref: 313 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.713108:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:1.0:1763343275.713111:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343275.713118:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3aec lrc: 2/0,0 mode: --/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4981a expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.713145:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3af3 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343275.713154:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3ae5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49813 expref: 313 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.713161:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3af3 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x20e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.713187:0:9827:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3ae5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49813 expref: 313 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.713200:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3ae5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49813 expref: 313 pid: 9827 timeout: 1168 lvb_type: 0 00000100:00100000:1.0:1763343275.713212:0:9827:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c7ef4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412981248:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343275.713609:0:9827:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc526c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343275.717067:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.717319:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399893760 00000100:00100000:0.0:1763343275.717332:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399893760 00000100:00100000:0.0:1763343275.717807:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3789 00000100:00100000:0.0:1763343275.717818:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57145:x1848998399893760:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343275.720008:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57145:x1848998399893760:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 2181us (2941us total) trans 4294973686 rc 0/0 00000100:00100000:0.0:1763343275.720039:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3789 00000100:00100000:1.0:1763343275.720602:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.720689:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c7ef4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412981248:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343275.720715:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3af3 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:2.0:1763343275.721184:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399893888 00000100:00100000:2.0:1763343275.721192:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399893888 00010000:00010000:2.0:1763343275.721225:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3ae5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49813 expref: 315 pid: 9827 timeout: 1168 lvb_type: 0 00000100:00100000:2.0:1763343275.721267:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3491 00000100:00100000:2.0:1763343275.721275:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:2407:x1848998399893888:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343275.721288:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343275.721294:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3ae5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49813 expref: 315 pid: 9827 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343275.721305:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3ae5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49813 expref: 315 pid: 9827 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343275.721327:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3ae5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49813 expref: 315 pid: 9827 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343275.721341:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:2.0:1763343275.721346:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3af3 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.721357:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3af3 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.721364:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3af3 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.721395:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343275.721449:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:2407:x1848998399893888:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 174us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.721457:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3491 00010000:00010000:1.0:1763343275.723460:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3af3 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.723478:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3af3 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000040:00080000:1.0:1763343275.723713:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1744, 88 off145080 00000004:00080000:1.0:1763343275.723720:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1068847694802ns, next at 1069016426495ns, rc = 0 00000040:00080000:1.0:1763343275.723742:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1752, 88 off145736 00000004:00080000:1.0:1763343275.723745:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1068847720737ns, next at 1069016397451ns, rc = 0 00000040:00080000:1.0:1763343275.723768:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1753, 88 off145824 00000004:00080000:1.0:1763343275.723772:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1068847747822ns, next at 1069016397451ns, rc = 0 00000040:00080000:1.0:1763343275.723782:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1745, 88 off145168 00000004:00080000:1.0:1763343275.723785:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1068847760277ns, next at 1069016426495ns, rc = 0 00000001:00080000:2.0:1763343275.727971:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973687 is committed 00000004:00080000:2.0:1763343275.727985:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1117 committed 00000004:00080000:2.0:1763343275.728003:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1125 committed 00000004:00080000:2.0:1763343275.728123:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1124 committed 00000004:00080000:2.0:1763343275.728127:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1116 committed 00000100:00100000:2.0:1763343275.728194:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412981504:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343275.728203:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412981632:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343275.728321:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412981376:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343275.728388:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343275.728427:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412982144:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343275.728447:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343275.728464:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1763343275.728469:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412981760:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343275.728486:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343275.728500:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412982272:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343275.728515:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343275.728546:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412981632 00000100:00100000:3.0:1763343275.728553:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412981632 00000100:00100000:3.0:1763343275.728593:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412982144 00000100:00100000:3.0:1763343275.728596:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412982144 00000100:00100000:3.0:1763343275.728611:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412981760 00000100:00100000:3.0:1763343275.728613:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412981760 00000100:00100000:3.0:1763343275.728626:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412982272 00000100:00100000:3.0:1763343275.728628:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412982272 00000100:00100000:3.0:1763343275.728645:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7316 00000100:00100000:3.0:1763343275.728653:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+14:3659:x1848998412981632:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343275.728812:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343275.728834:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+15:3659:x1848998412981632:12345-0@lo:2:osp-syn-0-1.0 Request processed in 178us (443us total) trans 21474839230 rc 0/0 00000100:00100000:3.0:1763343275.728842:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7316 00000100:00100000:2.0:1763343275.728848:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412982016:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343275.728860:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412981504 00000100:00100000:3.0:1763343275.728865:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412981504 00000100:00100000:3.0:1763343275.728885:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7317 00000100:00100000:3.0:1763343275.728890:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+30:3659:x1848998412982144:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343275.728924:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343275.728952:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412982016 00000100:00100000:2.0:1763343275.728957:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412982016 00000100:00100000:2.0:1763343275.728990:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7318 00000100:00100000:3.0:1763343275.728991:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+32:3659:x1848998412982144:12345-0@lo:2:osp-syn-1-1.0 Request processed in 97us (539us total) trans 17179871960 rc 0/0 00000100:00100000:2.0:1763343275.729004:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+15:3659:x1848998412981760:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343275.729006:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7317 00000100:00100000:3.0:1763343275.729052:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7319 00000100:00100000:3.0:1763343275.729060:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+31:3659:x1848998412982272:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1763343275.729094:0:35266:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2c5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343275.729099:0:35266:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2c5:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763343275.729102:0:35266:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2c5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343275.729104:0:35266:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2c5:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763343275.729106:0:35266:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2c5:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1763343275.729119:0:35281:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2c6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343275.729123:0:35281:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2c6:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343275.729126:0:35281:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2c6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343275.729128:0:35281:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2c6:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343275.729131:0:35281:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2c6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343275.729140:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+16:3659:x1848998412981760:12345-0@lo:2:osp-syn-0-1.0 Request processed in 139us (650us total) trans 21474839231 rc 0/0 00000100:00100000:2.0:1763343275.729148:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7318 00000100:00100000:3.0:1763343275.729166:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+32:3659:x1848998412982272:12345-0@lo:2:osp-syn-1-1.0 Request processed in 105us (646us total) trans 17179871961 rc 0/0 00000100:00100000:2.0:1763343275.729171:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7320 00000100:00100000:3.0:1763343275.729179:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7319 00000100:00100000:2.0:1763343275.729184:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+15:3662:x1848998412981504:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343275.729199:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7321 00002000:00080000:2.0:1763343275.729199:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:707 count 1 00000100:00100000:3.0:1763343275.729210:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+31:3662:x1848998412982016:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763343275.729223:0:35281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:708 count 1 00002000:00010000:2.0:1763343275.729226:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343275.729235:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a3afa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343275.729239:0:35281:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343275.729262:0:35281:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3b01 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.729277:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343275.729278:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343275.729282:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.729282:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343275.729292:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3b01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.729292:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a3afa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.729322:0:35281:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3b01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.729323:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a3afa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.729341:0:35281:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3b01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.729344:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a3afa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.729362:0:35281:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3b01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.729364:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a3afa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343275.729470:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343275.729485:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412981888:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343275.729511:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763343275.729771:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a398e lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.729779:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a398e lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.729787:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a398e lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.729792:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b99600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.729797:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a398e lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.729804:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a398e lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.729819:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f669eb00) 00010000:00010000:0.0:1763343275.729822:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.729826:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a398e lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.729832:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a398e lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.729850:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3a2f lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.729857:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3a2f lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.729862:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3a2f lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.729867:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c7ec0c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.729870:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3a2f lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.729875:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3a2f lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.729881:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f669eb00) 00010000:00010000:0.0:1763343275.729883:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.729885:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3a2f lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.729894:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a3a2f lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.729912:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3ad0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.729932:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3ad0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.729937:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3ad0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.729943:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.729945:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3ad0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.729951:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3ad0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.729960:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:0.0:1763343275.729962:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.729965:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3ad0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.729970:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3ad0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.730347:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3af3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x20e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4981a expref: 295 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.730357:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:1.0:1763343275.730359:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343275.730372:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3aec lrc: 0/0,0 mode: --/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4981a expref: 295 pid: 9827 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343275.730384:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3af3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x20e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4981a expref: 294 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.730412:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:1.0:1763343275.730414:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343275.730416:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177800, rc 0) 00000100:00100000:1.0:1763343275.730477:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:55884:x1848998399893504:12345-192.168.201.40@tcp:101:bash.0 Request processed in 17454us (17682us total) trans 4294973687 rc 0/0 00000100:00100000:1.0:1763343275.730485:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10749 00010000:00010000:2.0:1763343275.731292:0:35266:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1763343275.731547:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+16:3662:x1848998412981504:12345-0@lo:6:osp-syn-0-1.0 Request processed in 2364us (2783us total) trans 21474839232 rc 0/0 00000100:00100000:2.0:1763343275.731556:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7320 00000100:00100000:2.0:1763343275.731576:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412981376 00000100:00100000:2.0:1763343275.731590:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412981376 00000100:00100000:2.0:1763343275.731625:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412981888 00000100:00100000:2.0:1763343275.731629:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412981888 00000100:00100000:2.0:1763343275.731642:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7322 00000100:00100000:2.0:1763343275.731649:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+16:3661:x1848998412981376:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763343275.731675:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:706 count 1 00010000:00010000:2.0:1763343275.731695:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3de00/0x9104b1ba770a3b08 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.731725:0:35266:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a3980 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4979c expref: 13 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.731733:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343275.731735:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343275.731739:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3de00/0x9104b1ba770a3b08 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763343275.732263:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401efc71180/2, rc 0, transno 21474839232 00000100:00100000:1.0:1763343275.732272:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412981504:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763343275.732366:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763343275.732376:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3b01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.732386:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343275.732390:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3b01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.732400:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3b01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.732417:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3b01 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.732427:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343275.732431:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a3afa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.732437:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5b3c400 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343275.732439:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a3afa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.732446:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a3afa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.732454:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a3afa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.732460:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a3afa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.732476:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.732478:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.732480:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343275.732739:0:35281:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1763343275.732747:0:35281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3b01 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343275.733019:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.733060:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+33:3662:x1848998412982016:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3849us (4134us total) trans 17179871962 rc 0/0 00010000:00010000:2.0:1763343275.733063:0:35266:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a3980 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4979c expref: 13 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343275.733081:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7321 00010000:00010000:2.0:1763343275.733083:0:35266:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a3980 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4979c expref: 13 pid: 35266 timeout: 1168 lvb_type: 0 00000004:00080000:0.0:1763343275.733085:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5dcb100/2, rc 0, transno 17179871962 00000100:00100000:0.0:1763343275.733096:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412982016:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343275.733107:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b27100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35266:1848998412982400:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343275.733113:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7323 00000100:00100000:3.0:1763343275.733125:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+32:3661:x1848998412981888:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763343275.733144:0:35281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:707 count 1 00010000:00010000:3.0:1763343275.733163:0:35281:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3b0f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.733176:0:35281:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a3956 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4978e expref: 21 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343275.733179:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c7ec33c0 going to sleep for 11 seconds 00010000:00010000:3.0:1763343275.733188:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343275.733190:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343275.733193:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3b0f lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.733220:0:35281:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a3956 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4978e expref: 21 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.733234:0:35281:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a3956 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4978e expref: 21 pid: 35266 timeout: 1168 lvb_type: 0 00000100:00100000:3.0:1763343275.733244:0:35281:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6275880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35281:1848998412982528:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343275.733283:0:35281:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c8284600 going to sleep for 11 seconds 00000004:00080000:2.0:1763343275.733302:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c7918a80/2, rc 0, transno 21474839231 00010000:00010000:3.0:1763343275.733310:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343275.733310:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412981760:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763343275.733323:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5dc8700/2, rc 0, transno 17179871961 00000100:00100000:2.0:1763343275.733327:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412982272:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1763343275.733335:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5dc8a80/2, rc 0, transno 17179871960 00000100:00100000:2.0:1763343275.733339:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412982144:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1763343275.733351:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401efc70700/2, rc 0, transno 21474839230 00000100:00100000:2.0:1763343275.733355:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412981632:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343275.733359:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399894144 00000100:00100000:0.0:1763343275.733367:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399894144 00000100:00100000:0.0:1763343275.733412:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10750 00000100:00100000:0.0:1763343275.733420:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57145:x1848998399894144:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343275.733434:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.733451:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3b16 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49821 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.733530:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3b1d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343275.733543:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3b1d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.733554:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3b1d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.733565:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a3b24 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343275.733571:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a3b24 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.733578:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a3b24 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.733677:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a3b2b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343275.733687:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a3b2b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.733694:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a3b2b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:0.0:1763343275.733705:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x20e:0x0]: returning size 2 00010000:00010000:0.0:1763343275.733773:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3b1d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.733780:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3b1d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.733785:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3b1d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.733790:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3b1d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.733795:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121e200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.733799:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3b1d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.733805:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3b1d lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.733815:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695200) 00010000:00010000:0.0:1763343275.733818:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.733822:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3b1d lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.733827:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a3b1d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.733837:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a3b24 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.733846:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a3b24 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.733851:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a3b24 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.733856:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.733858:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a3b24 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.733863:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a3b24 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.733869:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695000) 00010000:00010000:0.0:1763343275.733872:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.733874:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a3b24 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.733879:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a3b24 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.733917:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a3b16 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49821 expref: 297 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.733932:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a3b2b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49821 expref: 296 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.733939:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:0.0:1763343275.733941:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343275.733944:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c7ec0600, rc 0) 00000100:00100000:0.0:1763343275.733992:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57145:x1848998399894144:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 572us (975us total) trans 4294973688 rc 0/0 00000100:00100000:0.0:1763343275.733999:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10750 00000100:00100000:3.0:1763343275.737367:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.738144:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.738211:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399894400 00000100:00100000:0.0:1763343275.738221:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399894400 00000100:00100000:1.0:1763343275.738229:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399894272 00000100:00100000:1.0:1763343275.738235:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399894272 00010000:00010000:0.0:1763343275.738276:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a3980 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4979c expref: 15 pid: 35266 timeout: 1168 lvb_type: 0 00000100:00100000:0.0:1763343275.738324:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3492 00000100:00100000:0.0:1763343275.738337:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998399894400:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343275.738358:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343275.738365:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a3980 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4979c expref: 15 pid: 35266 timeout: 1168 lvb_type: 0 00000100:00100000:2.0:1763343275.738370:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b27100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35266:1848998412982400:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343275.738384:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a3980 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4979c expref: 15 pid: 35266 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343275.738596:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a3980 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4979c expref: 15 pid: 35266 timeout: 1168 lvb_type: 0 00000100:00100000:1.0:1763343275.738618:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.738781:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399894656 00000100:00100000:3.0:1763343275.738786:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399894656 00010000:00010000:2.0:1763343275.738801:0:35266:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3de00/0x9104b1ba770a3b08 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343275.738828:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3790 00010000:00010000:0.0:1763343275.738947:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.738950:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.738955:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3de00/0x9104b1ba770a3b08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.738965:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3de00/0x9104b1ba770a3b08 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.738998:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343275.739020:0:35266:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3de00/0x9104b1ba770a3b08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.739049:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3de00/0x9104b1ba770a3b08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.739060:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3de00/0x9104b1ba770a3b08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.739067:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3de00/0x9104b1ba770a3b08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.739084:0:35266:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343275.739723:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+17:3661:x1848998412981376:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8071us (10250us total) trans 21474839233 rc 0/0 00000100:00100000:1.0:1763343275.739733:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7322 00000100:00100000:2.0:1763343275.739941:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8442050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57145:x1848998399894656:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:1.0:1763343275.740114:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401efc71500/2, rc 0, transno 21474839233 00000100:00100000:1.0:1763343275.740121:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412981376:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343275.740169:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7324 00000100:00100000:0.0:1763343275.740176:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399894400:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1838us (2031us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343275.740181:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:55884:x1848998399894272:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343275.740193:0:28561:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1763343275.740208:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3492 00010000:00010000:1.0:1763343275.740213:0:28561:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a3b39 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49828 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343275.740235:0:28561:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343275.740259:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.740262:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.740271:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a3b39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49828 expref: 14 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.740285:0:28561:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a3b39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49828 expref: 14 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.740296:0:28561:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177a00, rc 0) 00000100:00100000:1.0:1763343275.740323:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:55884:x1848998399894272:12345-192.168.201.40@tcp:101:bash.0 Request processed in 145us (2967us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343275.740330:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7324 00010000:00010000:3.0:1763343275.740379:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343275.740387:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3de00/0x9104b1ba770a3b08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.740395:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5b3de00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343275.740399:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3de00/0x9104b1ba770a3b08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.740408:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3de00/0x9104b1ba770a3b08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.740421:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3de00/0x9104b1ba770a3b08 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.740429:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3de00/0x9104b1ba770a3b08 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.740446:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343275.740448:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343275.740449:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343275.740619:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.740661:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399894784 00000100:00100000:1.0:1763343275.740668:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399894784 00010000:00010000:1.0:1763343275.740687:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a3956 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4978e expref: 22 pid: 35266 timeout: 1168 lvb_type: 0 00000100:00100000:1.0:1763343275.740713:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3493 00000100:00100000:1.0:1763343275.740720:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399894784:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343275.740727:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343275.740731:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a3956 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4978e expref: 22 pid: 35266 timeout: 1168 lvb_type: 0 00010000:00010000:1.0:1763343275.740742:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a3956 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4978e expref: 22 pid: 35266 timeout: 1168 lvb_type: 0 00010000:00010000:1.0:1763343275.740756:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.740757:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.740760:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3b0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.740768:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3b0f lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.740780:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343275.740802:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399894784:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 82us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343275.740807:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3493 00010000:00010000:3.0:1763343275.741592:0:35281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a3956 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4978e expref: 21 pid: 35266 timeout: 1168 lvb_type: 0 00000100:00100000:3.0:1763343275.741606:0:35281:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6275880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35281:1848998412982528:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343275.741626:0:35281:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3b0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.741636:0:35281:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3b0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.741643:0:35281:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3b0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.741653:0:35281:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3b0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.741661:0:35281:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3b0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.741683:0:35281:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343275.741891:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+33:3661:x1848998412981888:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8768us (12377us total) trans 17179871963 rc 0/0 00000100:00100000:3.0:1763343275.741901:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7323 00000004:00080000:1.0:1763343275.741929:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5dcb480/2, rc 0, transno 17179871963 00000100:00100000:1.0:1763343275.741937:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412981888:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1763343275.742486:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343275.742495:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3b0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.742505:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3a00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343275.742509:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3b0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.742518:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3b0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.742536:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3b0f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.742543:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3b0f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.742561:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.742563:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.742565:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343275.743998:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8442050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57145:x1848998399894656:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 5148us (5368us total) trans 4294973689 rc 0/0 00000100:00100000:2.0:1763343275.744017:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3790 00000100:00100000:1.0:1763343275.752180:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.752483:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399894912 00000100:00100000:3.0:1763343275.752493:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399894912 00000100:00100000:3.0:1763343275.752541:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7325 00000100:00100000:3.0:1763343275.752549:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:55884:x1848998399894912:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343275.752566:0:35281:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343275.752587:0:35281:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3b40 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4982f expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343275.752610:0:35281:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343275.752633:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343275.752636:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343275.752645:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3b40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4982f expref: 22 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.752662:0:35281:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3b40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4982f expref: 22 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.752675:0:35281:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3c00, rc 0) 00000100:00100000:3.0:1763343275.752743:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:55884:x1848998399894912:12345-192.168.201.40@tcp:101:bash.0 Request processed in 193us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343275.752751:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7325 00000100:00100000:1.0:1763343275.753930:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.754259:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399895040 00000100:00100000:2.0:1763343275.754268:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399895040 00000100:00100000:2.0:1763343275.754363:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3791 00000100:00100000:2.0:1763343275.754372:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57145:x1848998399895040:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:2.0:1763343275.756791:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57145:x1848998399895040:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 2408us (2855us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.756805:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3791 00000100:00100000:2.0:1763343275.758613:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.758663:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.759329:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399895296 00000100:00100000:3.0:1763343275.759340:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399895296 00002000:00010000:3.0:1763343275.759377:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/709 (0->18446744073709551615) 00002000:00100000:3.0:1763343275.759383:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b27100 with x1848998399895296 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343275.759396:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5b27100. 00000100:00100000:3.0:1763343275.759427:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399895168 00000100:00100000:3.0:1763343275.759430:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399895168 00002000:00010000:3.0:1763343275.759445:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/708 (0->18446744073709551615) 00002000:00100000:3.0:1763343275.759449:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b24700 with x1848998399895168 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343275.759455:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5b24700. 00000100:00100000:2.0:1763343275.759463:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1743 00000100:00100000:2.0:1763343275.759475:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2409:x1848998399895296:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:2.0:1763343275.759646:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2c5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343275.759650:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2c5:0x0] updating lvb mtime from disk: 0 -> 1763343275 00002000:00010000:2.0:1763343275.759652:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2c5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343275.759654:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2c5:0x0] updating lvb ctime from disk: 0 -> 1763343275 00002000:00010000:2.0:1763343275.759657:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2c5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343275.759706:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2409:x1848998399895296:12345-192.168.201.40@tcp:10:bash.0 Request processed in 235us (1104us total) trans 17179871964 rc 0/0 00000100:00100000:2.0:1763343275.760608:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1743 00002000:00010000:2.0:1763343275.760615:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/709 (0->18446744073709551615) 00002000:00100000:2.0:1763343275.760619:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b27100 with x1848998399895296 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343275.760626:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5b27100. 00000100:00100000:3.0:1763343275.760631:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1744 00000100:00100000:3.0:1763343275.760645:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2409:x1848998399895168:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:2.0:1763343275.760797:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2c4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343275.760801:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2c4:0x0] updating lvb mtime from disk: 0 -> 1763343275 00002000:00010000:2.0:1763343275.760803:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2c4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343275.760805:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2c4:0x0] updating lvb ctime from disk: 0 -> 1763343275 00002000:00010000:2.0:1763343275.760807:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2c4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343275.760839:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2409:x1848998399895168:12345-192.168.201.40@tcp:10:bash.0 Request processed in 199us (2177us total) trans 21474839234 rc 0/0 00000100:00100000:2.0:1763343275.760845:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1744 00002000:00010000:2.0:1763343275.760849:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/708 (0->18446744073709551615) 00002000:00100000:2.0:1763343275.760851:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b24700 with x1848998399895168 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343275.760856:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5b24700. 00000100:00100000:3.0:1763343275.765719:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.766416:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399895552 00000100:00100000:1.0:1763343275.766428:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399895552 00000100:00100000:1.0:1763343275.766494:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3792 00000100:00100000:1.0:1763343275.766513:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:55884:x1848998399895552:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:1.0:1763343275.766860:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:55884:x1848998399895552:12345-192.168.201.40@tcp:35:bash.0 Request processed in 355us (1149us total) trans 4294973690 rc 0/0 00000100:00100000:1.0:1763343275.766868:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3792 00000100:00100000:3.0:1763343275.766976:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.767131:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399895808 00000100:00100000:1.0:1763343275.767137:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399895808 00000100:00100000:1.0:1763343275.767441:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10751 00000100:00100000:1.0:1763343275.767450:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57146:x1848998399895808:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343275.767461:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343275.767481:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a3b47 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49836 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.767551:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3b4e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343275.767564:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3b4e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x20e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.767573:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3b4e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x20e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343275.767583:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x20e:0x0]: returning size 5 00010000:00010000:1.0:1763343275.767652:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a3b47 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49836 expref: 301 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.767667:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3b4e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x20e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49836 expref: 300 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.767675:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:1.0:1763343275.767678:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1763343275.767680:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176a00, rc 0) 00000100:00100000:1.0:1763343275.767720:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57146:x1848998399895808:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 273us (745us total) trans 4294973691 rc 0/0 00000100:00100000:1.0:1763343275.767726:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10751 00010000:00010000:3.0:1763343275.776379:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343275.777555:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.777663:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.777737:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399896320 00000100:00100000:2.0:1763343275.777748:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399896320 00000100:00100000:2.0:1763343275.777810:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3793 00000100:00100000:2.0:1763343275.777820:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57147:x1848998399896320:12345-192.168.201.40@tcp:35:rm.0 00000100:00100000:2.0:1763343275.778193:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57147:x1848998399896320:12345-192.168.201.40@tcp:35:rm.0 Request processed in 373us (530us total) trans 4294973692 rc 0/0 00000100:00100000:2.0:1763343275.778201:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3793 00000100:00100000:1.0:1763343275.779012:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399896064 00000100:00100000:1.0:1763343275.779044:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399896064 00000100:00100000:0.0:1763343275.779334:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10752 00000100:00100000:0.0:1763343275.779344:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57146:x1848998399896064:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343275.779362:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.779385:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3b5c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4983d expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.779479:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3b63 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343275.779493:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a3b2b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49821 expref: 302 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.779501:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3b63 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x20e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.779536:0:9827:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a3b2b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49821 expref: 302 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.779548:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a3b2b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49821 expref: 302 pid: 9827 timeout: 1168 lvb_type: 0 00000100:00100000:0.0:1763343275.779560:0:9827:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b29500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412982656:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343275.779638:0:9827:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9180 going to sleep for 11 seconds 00000100:00100000:0.0:1763343275.785797:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b29500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412982656:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343275.786120:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.786187:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399896448 00010000:00010000:0.0:1763343275.786192:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3b63 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x20e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:1.0:1763343275.786195:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399896448 00010000:00010000:1.0:1763343275.786234:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a3b2b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49821 expref: 303 pid: 9827 timeout: 1168 lvb_type: 0 00000100:00100000:1.0:1763343275.786293:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3494 00000100:00100000:1.0:1763343275.786304:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:2408:x1848998399896448:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343275.786320:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343275.786327:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a3b2b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49821 expref: 303 pid: 9827 timeout: 1168 lvb_type: 0 00010000:00010000:1.0:1763343275.786339:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a3b2b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49821 expref: 303 pid: 9827 timeout: 1168 lvb_type: 0 00010000:00010000:1.0:1763343275.786364:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a3b2b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49821 expref: 303 pid: 9827 timeout: 1168 lvb_type: 0 00010000:00010000:1.0:1763343275.786383:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:1.0:1763343275.786387:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3b63 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x20e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.786397:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3b63 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x20e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.786404:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3b63 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x20e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.786441:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343275.786506:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:2408:x1848998399896448:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 204us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343275.786514:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3494 00010000:00010000:0.0:1763343275.786811:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3b63 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x20e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.786819:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3b63 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x20e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:0.0:1763343275.786953:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x20e:0x0]: returning size 5 00010000:00010000:0.0:1763343275.787117:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3b5c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4983d expref: 303 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.787133:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3b63 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x20e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4983d expref: 302 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.787141:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:0.0:1763343275.787144:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1763343275.787146:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fd600, rc 0) 00000100:00100000:0.0:1763343275.787380:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57146:x1848998399896064:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 8037us (9831us total) trans 4294973693 rc 0/0 00000100:00100000:0.0:1763343275.787388:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10752 00000100:00100000:0.0:1763343275.787895:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.788071:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399896832 00000100:00100000:2.0:1763343275.788080:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399896832 00000100:00100000:2.0:1763343275.788128:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10753 00000100:00100000:2.0:1763343275.788137:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57147:x1848998399896832:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:2.0:1763343275.788373:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763343275.788398:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3b4e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x20e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49836 expref: 302 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.788417:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3af3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x20e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4981a expref: 301 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.788435:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3aad lrc: 0/0,0 mode: --/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49805 expref: 300 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.788445:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:2.0:1763343275.788449:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343275.788479:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3b71 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343275.788490:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3b71 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.788498:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3b71 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.788510:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3b78 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343275.788517:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3b78 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.788523:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3b78 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.788602:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3b7f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343275.788612:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3b63 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x20e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4983d expref: 299 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.788619:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3b7f lrc: 4/0,1 mode: --/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.788645:0:9827:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3b63 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x20e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4983d expref: 299 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.788658:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3b63 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x20e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4983d expref: 299 pid: 9827 timeout: 1168 lvb_type: 0 00000100:00100000:2.0:1763343275.788670:0:9827:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b27b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412982784:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343275.788741:0:9827:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c7ec3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1763343275.790683:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.790974:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b27b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412982784:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343275.790988:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399896960 00000100:00100000:3.0:1763343275.790995:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399896960 00010000:00010000:0.0:1763343275.791002:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3b7f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:2.0:1763343275.791106:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.791150:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399897088 00000100:00100000:1.0:1763343275.791155:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399897088 00010000:00010000:1.0:1763343275.791183:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3b63 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x20e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4983d expref: 301 pid: 9827 timeout: 1168 lvb_type: 0 00000100:00100000:1.0:1763343275.791338:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3495 00000100:00100000:2.0:1763343275.791340:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10754 00000100:00100000:2.0:1763343275.791349:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57146:x1848998399896960:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:1.0:1763343275.791349:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c32b2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:2408:x1848998399897088:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343275.791363:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343275.791368:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343275.791369:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3b63 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x20e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4983d expref: 301 pid: 9827 timeout: 1168 lvb_type: 0 00010000:00010000:1.0:1763343275.791380:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3b63 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x20e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4983d expref: 301 pid: 9827 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343275.791385:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a3b86 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49844 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.791400:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3b63 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x20e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4983d expref: 302 pid: 9827 timeout: 1168 lvb_type: 0 00010000:00010000:1.0:1763343275.791415:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:1.0:1763343275.791420:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3b7f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.791428:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3b7f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.791435:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3b7f lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.791469:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343275.791490:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3b7f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.791497:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3b7f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:1.0:1763343275.791516:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c32b2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:2408:x1848998399897088:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 170us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343275.791527:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3495 00010000:00010000:2.0:1763343275.791675:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a3b8d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343275.791688:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3b7f lrc: 2/0,1 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.791695:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a3b8d lrc: 4/1,0 mode: --/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.791708:0:7641:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3b7f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.791716:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a3b8d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00080000:2.0:1763343275.792416:0:9827:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x20e:0x0] is inserted into orphan list, open count = 1 00010000:00010000:2.0:1763343275.792502:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3b7f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.792510:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3b7f lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.792516:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3b7f lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.792522:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c0030200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.792525:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3b7f lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.792532:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3b7f lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.792545:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:2.0:1763343275.792548:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763343275.792550:0:9827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a3b8d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.792562:0:9827:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a3b8d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.792568:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a3b8d lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.792645:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3b7f lrc: 2/0,0 mode: --/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.792652:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3b7f lrc: 0/0,0 mode: --/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.792669:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3b71 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.792674:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3b71 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.792679:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3b71 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.792683:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3b71 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.792688:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd9a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.792690:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3b71 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.792694:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3b71 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.792701:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758800) 00010000:00010000:2.0:1763343275.792703:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.792707:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3b71 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.792711:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3b71 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000004:00010000:2.0:1763343275.792723:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000008ad0cae reply state 00000000b9bedabc transno 4294973694 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3b78 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.792733:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3b78 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.792739:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758e00) 00010000:00010000:2.0:1763343275.792741:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343275.792743:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343275.792843:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a3b8d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.792850:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a3b8d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343275.792875:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x20e:0x0]: returning size 5 00000004:00200000:0.0:1763343275.792879:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343275.792893:0:7641:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a3b8d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.792922:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a3b86 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49844 expref: 303 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.792940:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a3b8d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49844 expref: 302 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.792948:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:0.0:1763343275.792950:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343275.792953:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4514400, rc 0) 00000100:00100000:2.0:1763343275.793138:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57147:x1848998399896832:12345-192.168.201.40@tcp:36:rm.0 Request processed in 5001us (5245us total) trans 4294973694 rc 0/0 00000100:00100000:2.0:1763343275.793147:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10753 00000100:00100000:0.0:1763343275.793265:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57146:x1848998399896960:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1917us (2593us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.793281:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10754 00000100:00100000:0.0:1763343275.795878:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.796186:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399897344 00000100:00100000:2.0:1763343275.796196:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399897344 00000100:00100000:2.0:1763343275.796260:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10755 00000100:00100000:2.0:1763343275.796270:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57146:x1848998399897344:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343275.796292:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.796312:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a3b94 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4984b expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.796415:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a3b9b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343275.796429:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a3b9b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.796440:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a3b9b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343275.796453:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x20e:0x0]: returning size 5 00010000:00010000:2.0:1763343275.796555:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a3b94 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4984b expref: 304 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.796570:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a3b9b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4984b expref: 303 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.796578:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:2.0:1763343275.796580:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343275.796584:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c589ba00, rc 0) 00000100:00100000:2.0:1763343275.796640:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57146:x1848998399897344:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 372us (772us total) trans 4294973695 rc 0/0 00000100:00100000:2.0:1763343275.796646:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10755 00000100:00100000:2.0:1763343275.805448:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.805731:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399897472 00000100:00100000:1.0:1763343275.805741:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399897472 00000100:00100000:1.0:1763343275.806052:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7326 00000100:00100000:1.0:1763343275.806064:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998399897472:12345-192.168.201.40@tcp:1:lfs.0 00010000:00010000:1.0:1763343275.806117:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a3ba9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.806136:0:35266:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a3b39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49828 expref: 15 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.806143:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343275.806145:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343275.806148:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a3ba9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.806402:0:35266:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a3b39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49828 expref: 15 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.806417:0:35266:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a3b39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49828 expref: 15 pid: 28561 timeout: 1168 lvb_type: 0 00000100:00100000:1.0:1763343275.806432:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c7ef7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35266:1848998412982912:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343275.806617:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c4532a80 going to sleep for 11 seconds 00000100:00100000:2.0:1763343275.815332:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c7ef7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35266:1848998412982912:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343275.815366:0:35266:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a3ba9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343275.817363:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.817536:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.817611:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399897728 00000100:00100000:1.0:1763343275.817622:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399897728 00000100:00100000:1.0:1763343275.817676:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10756 00000100:00100000:1.0:1763343275.817686:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57148:x1848998399897728:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343275.817711:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343275.817738:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3bb0 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49852 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343275.817880:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399897600 00000100:00100000:0.0:1763343275.817886:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399897600 00002000:00100000:0.0:1763343275.817919:0:28390:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2c4:0x0] (0->4) req@ffff9400c5b24e00 x1848998399897600/t0(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:16/0 lens 496/0 e 0 to 0 dl 1763343286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1763343275.817921:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3bb7 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00002000:00100000:0.0:1763343275.817940:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b24e00 with x1848998399897600 ext(0->4) 00010000:00010000:1.0:1763343275.817946:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3bb7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.817950:0:28390:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a3b39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49828 expref: 16 pid: 28561 timeout: 1168 lvb_type: 0 00010000:00010000:1.0:1763343275.817963:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3bb7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.817970:0:28390:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a3b39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49828 expref: 16 pid: 28561 timeout: 1168 lvb_type: 0 00010000:00010000:1.0:1763343275.817977:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3bbe lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00002000:00010000:0.0:1763343275.817980:0:28390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9400c5b24e00 00010000:00010000:1.0:1763343275.817990:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3bbe lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.817996:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3bbe lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:0.0:1763343275.818015:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 121 00000100:00100000:0.0:1763343275.818057:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399897600:12345-192.168.201.40@tcp:4:bash.0 00010000:00010000:1.0:1763343275.818079:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3bb7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.818087:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3bb7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.818093:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3bb7 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.818099:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3bb7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.818109:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343275.818113:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3bb7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.818120:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3bb7 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.818133:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:1.0:1763343275.818136:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343275.818140:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3bb7 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.818145:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a3bb7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.818157:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3bbe lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.818162:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3bbe lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.818166:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3bbe lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.818172:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343275.818174:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3bbe lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.818179:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3bbe lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.818186:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758e00) 00010000:00010000:1.0:1763343275.818189:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343275.818191:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3bbe lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.818196:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3bbe lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.818222:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3bb0 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49852 expref: 304 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.818230:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:1.0:1763343275.818232:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343275.818236:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3bb0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49852 expref: 304 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.818264:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176200, rc 0) 00000100:00100000:1.0:1763343275.818324:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57148:x1848998399897728:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 639us (789us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343275.818332:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10756 00000100:00100000:0.0:1763343275.819496:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998399897600:12345-192.168.201.40@tcp:4:bash.0 Request processed in 1467us (2139us total) trans 21474839235 rc 0/0 00000100:00100000:0.0:1763343275.819507:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 121 00002000:00100000:0.0:1763343275.819518:0:28390:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2c4:0x0] (0->4) req@ffff9400c5b24e00 x1848998399897600/t21474839235(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:16/0 lens 496/448 e 0 to 0 dl 1763343286 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763343275.819527:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b24e00 with x1848998399897600 ext(0->4) 00010000:00010000:0.0:1763343275.819533:0:28390:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a3b39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49828 expref: 18 pid: 28561 timeout: 1168 lvb_type: 0 00010000:00010000:0.0:1763343275.819547:0:28390:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a3b39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49828 expref: 18 pid: 28561 timeout: 1168 lvb_type: 0 00002000:00010000:0.0:1763343275.819554:0:28390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9400c5b24e00 00000100:00100000:2.0:1763343275.824265:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.824319:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.824322:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399897984 00000100:00100000:1.0:1763343275.824333:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399897984 00010000:00010000:1.0:1763343275.824375:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a3b39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49828 expref: 18 pid: 28561 timeout: 1168 lvb_type: 0 00000100:00100000:1.0:1763343275.824426:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3496 00000100:00100000:1.0:1763343275.824437:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2410:x1848998399897984:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343275.824454:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1763343275.824471:0:14071:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2c4:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:1.0:1763343275.824475:0:14071:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2c4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1763343275.824481:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a3b39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49828 expref: 18 pid: 28561 timeout: 1168 lvb_type: 0 00010000:00010000:1.0:1763343275.824499:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a3b39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49828 expref: 18 pid: 28561 timeout: 1168 lvb_type: 0 00000100:00100000:0.0:1763343275.824519:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399897856 00010000:00010000:1.0:1763343275.824524:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a3b39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49828 expref: 18 pid: 28561 timeout: 1168 lvb_type: 0 00000100:00100000:0.0:1763343275.824526:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399897856 00010000:00010000:1.0:1763343275.824544:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.824546:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.824551:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a3ba9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.824562:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a3ba9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343275.824570:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10757 00000100:00100000:0.0:1763343275.824579:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57148:x1848998399897856:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343275.824588:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343275.824596:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.824617:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3bc5 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49859 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343275.824632:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2410:x1848998399897984:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 197us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343275.824640:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3496 00010000:00010000:0.0:1763343275.824678:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3bcc lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343275.824691:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3bcc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.824701:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3bcc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.824715:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3bd3 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343275.824722:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3bd3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.824727:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3bd3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.824763:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3bcc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.824770:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3bcc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.824776:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3bcc lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.824787:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3bcc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.824792:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fd800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.824796:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3bcc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.824802:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3bcc lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.824811:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695200) 00010000:00010000:0.0:1763343275.824815:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.824819:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3bcc lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.824824:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3bcc lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.824836:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3bd3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.824840:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3bd3 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.824845:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3bd3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.824849:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fca00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.824852:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3bd3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.824857:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3bd3 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.824863:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758e00) 00010000:00010000:0.0:1763343275.824865:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.824868:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3bd3 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.824873:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3bd3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.824895:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3bc5 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49859 expref: 304 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.824904:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695200) 00010000:00010000:0.0:1763343275.824906:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.824909:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3bc5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49859 expref: 304 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.824924:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fd600, rc 0) 00000100:00100000:0.0:1763343275.824953:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57148:x1848998399897856:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 376us (635us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343275.824958:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10757 00010000:00010000:2.0:1763343275.825145:0:35266:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a3ba9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.825154:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a3ba9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.825172:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a3ba9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.825179:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a3ba9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.825186:0:35266:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a3ba9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.825191:0:35266:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343275.825194:0:35266:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a3ba9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.825201:0:35266:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a3ba9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.825213:0:35266:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a3ba9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.825220:0:35266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a3ba9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343275.825288:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399897472:12345-192.168.201.40@tcp:1:lfs.0 Request processed in 19226us (19850us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.825296:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7326 00000100:00100000:2.0:1763343275.827871:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.827929:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399898112 00000100:00100000:2.0:1763343275.827935:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.827937:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399898112 00000100:00100000:1.0:1763343275.827985:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399898368 00000100:00100000:1.0:1763343275.827992:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399898368 00000100:00100000:0.0:1763343275.827992:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10758 00000100:00100000:0.0:1763343275.828006:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7f56050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57148:x1848998399898112:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343275.828052:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1763343275.828057:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10759 00000100:00100000:1.0:1763343275.828067:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57146:x1848998399898368:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:0.0:1763343275.828079:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3bda lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49860 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.828107:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343275.828130:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514400/0x9104b1ba770a3b8d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49844 expref: 305 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.828152:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:0.0:1763343275.828155:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a3be1 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343275.828157:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343275.828169:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a3be1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.828178:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a3be1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343275.828217:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343275.828222:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343275.828263:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3bda lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49860 expref: 305 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.828286:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a3be1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49860 expref: 304 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.828297:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695000) 00010000:00010000:0.0:1763343275.828301:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343275.828303:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4515600, rc 0) 00000100:00100000:0.0:1763343275.828366:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7f56050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57148:x1848998399898112:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 363us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.828378:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10758 00010000:00010000:1.0:1763343275.829159:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3be8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343275.829173:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3be8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.829181:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3be8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000040:00080000:1.0:1763343275.829392:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1746, 88 off145256 00000004:00080000:1.0:1763343275.829401:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1068953375593ns, next at 1069016426495ns, rc = 0 00000040:00080000:1.0:1763343275.829432:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1754, 88 off145912 00000004:00080000:1.0:1763343275.829437:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1068953412317ns, next at 1069016397451ns, rc = 0 00000040:00080000:1.0:1763343275.829919:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1755, 88 off146000 00000004:00080000:1.0:1763343275.829925:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1068953900666ns, next at 1069016397451ns, rc = 0 00000040:00080000:1.0:1763343275.830065:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1747, 88 off145344 00000004:00080000:1.0:1763343275.830071:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1068954046233ns, next at 1069016426495ns, rc = 0 00000100:00100000:1.0:1763343275.832745:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000001:00080000:3.0:1763343275.833602:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973696 is committed 00000004:00080000:3.0:1763343275.833612:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1119 committed 00000004:00080000:3.0:1763343275.833621:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1127 committed 00000004:00080000:3.0:1763343275.833629:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1126 committed 00000004:00080000:3.0:1763343275.833631:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1118 committed 00000100:00100000:3.0:1763343275.833737:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6e8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412983040:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1763343275.833841:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3b78 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.833852:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3b78 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.833858:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3b78 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.833864:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd8e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.833868:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3b78 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.833874:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3b78 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.833890:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758e00) 00010000:00010000:2.0:1763343275.833893:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.833897:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3b78 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343275.833903:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3b78 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000100:00100000:3.0:1763343275.834021:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343275.834084:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343275.834090:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6e8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412983168:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343275.834112:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343275.834189:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412983296:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343275.834210:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343275.834224:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343275.834228:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6e8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412983424:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343275.834242:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343275.834361:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412983040 00000100:00100000:2.0:1763343275.834368:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412983040 00000100:00100000:2.0:1763343275.834408:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412983168 00000100:00100000:2.0:1763343275.834410:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412983168 00000100:00100000:2.0:1763343275.834424:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412983296 00000100:00100000:2.0:1763343275.834427:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412983296 00000100:00100000:2.0:1763343275.834441:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412983424 00000100:00100000:2.0:1763343275.834448:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412983424 00000100:00100000:2.0:1763343275.834467:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7327 00000100:00100000:2.0:1763343275.834476:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+34:3661:x1848998412983040:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1763343275.834608:0:35266:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2c5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343275.834612:0:35266:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2c5:0x0] updating lvb mtime from disk: 1763343275 -> 1763343275 00002000:00010000:2.0:1763343275.834615:0:35266:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2c5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343275.834617:0:35266:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2c5:0x0] updating lvb ctime from disk: 1763343275 -> 1763343275 00002000:00010000:2.0:1763343275.834619:0:35266:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2c5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343275.834658:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+35:3661:x1848998412983040:12345-0@lo:2:osp-syn-1-1.0 Request processed in 183us (638us total) trans 17179871965 rc 0/0 00000100:00100000:2.0:1763343275.834665:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7327 00000100:00100000:2.0:1763343275.834680:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7328 00000100:00100000:2.0:1763343275.834686:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+34:3661:x1848998412983168:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1763343275.834734:0:35266:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2c6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343275.834736:0:35266:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2c6:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763343275.834738:0:35266:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2c6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343275.834740:0:35266:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2c6:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763343275.834741:0:35266:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2c6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343275.834785:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+35:3661:x1848998412983168:12345-0@lo:2:osp-syn-1-1.0 Request processed in 98us (671us total) trans 17179871966 rc 0/0 00000100:00100000:2.0:1763343275.834791:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7328 00000100:00100000:2.0:1763343275.834803:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7329 00000100:00100000:2.0:1763343275.834811:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+18:3659:x1848998412983296:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343275.834892:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+19:3659:x1848998412983296:12345-0@lo:2:osp-syn-0-1.0 Request processed in 83us (681us total) trans 21474839236 rc 0/0 00000100:00100000:2.0:1763343275.834897:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7329 00000100:00100000:2.0:1763343275.834908:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7330 00000100:00100000:2.0:1763343275.834914:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+18:3659:x1848998412983424:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1763343275.834958:0:35266:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2c5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343275.834961:0:35266:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2c5:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763343275.834962:0:35266:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2c5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343275.834964:0:35266:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2c5:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763343275.834965:0:35266:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2c5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343275.834988:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+19:3659:x1848998412983424:12345-0@lo:2:osp-syn-0-1.0 Request processed in 73us (744us total) trans 21474839237 rc 0/0 00000100:00100000:2.0:1763343275.834993:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7330 00000004:00080000:3.0:1763343275.835144:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6e8d880/2, rc 0, transno 17179871966 00000100:00100000:3.0:1763343275.835150:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6e8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412983168:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763343275.835160:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6e8e300/2, rc 0, transno 17179871965 00000100:00100000:3.0:1763343275.835162:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6e8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412983040:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763343275.835181:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6e8e680/2, rc 0, transno 21474839237 00000100:00100000:3.0:1763343275.835185:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6e8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412983424:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763343275.835192:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6e8ea00/2, rc 0, transno 21474839236 00000100:00100000:3.0:1763343275.835195:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412983296:0@lo:2:osp-syn-0-1.0 00000004:00010000:1.0:1763343275.836746:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f03b6f41 reply state 000000001bf67b3d transno 4294973696 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3be8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.836774:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3be8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343275.836783:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:1.0:1763343275.836787:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1763343275.836791:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1763343275.837051:0:9827:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763343275.837074:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57146:x1848998399898368:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 9005us (9134us total) trans 4294973696 rc 0/0 00000100:00100000:1.0:1763343275.837085:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10759 00000100:00100000:1.0:1763343275.837115:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399898496 00000100:00100000:1.0:1763343275.837122:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399898496 00000100:00100000:0.0:1763343275.837245:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10760 00000100:00100000:0.0:1763343275.837267:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57148:x1848998399898496:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343275.837285:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.837303:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a3bef lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49867 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.837363:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3bf6 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343275.837375:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3bf6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.837385:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3bf6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343275.837396:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3be8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.837400:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3bfd lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343275.837415:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3be8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.837416:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3bfd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.837434:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3bfd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343275.837435:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3be8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.837453:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343275.837459:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3be8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.837467:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3be8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343275.837478:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:3.0:1763343275.837482:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343275.837486:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3be8 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.837486:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3bf6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343275.837504:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a3be8 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343275.837505:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3bf6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.837520:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3bf6 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.837526:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3bf6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.837532:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.837535:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3bf6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.837540:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3bf6 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.837548:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695000) 00010000:00010000:0.0:1763343275.837551:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.837554:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3bf6 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.837559:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3bf6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.837568:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3bfd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.837574:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3bfd lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.837579:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3bfd lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.837584:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.837586:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3bfd lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.837591:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3bfd lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.837597:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695c00) 00010000:00010000:0.0:1763343275.837599:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.837602:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3bfd lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.837606:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3bfd lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.837634:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a3bef lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49867 expref: 295 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.837644:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695000) 00010000:00010000:0.0:1763343275.837646:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.837649:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4514200/0x9104b1ba770a3bef lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49867 expref: 295 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.837657:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4514200, rc 0) 00000100:00100000:0.0:1763343275.837702:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+294:57148:x1848998399898496:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 439us (4967us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343275.837708:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10760 00000100:00100000:1.0:1763343275.842375:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.842472:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.842632:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399898624 00000100:00100000:0.0:1763343275.842633:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399898880 00000100:00100000:2.0:1763343275.842644:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399898624 00000100:00100000:0.0:1763343275.842644:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399898880 00000100:00100000:2.0:1763343275.842830:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10761 00000100:00100000:2.0:1763343275.842846:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+295:57146:x1848998399898624:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343275.842869:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.842891:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a3c04 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4986e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343275.842909:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10762 00000100:00100000:0.0:1763343275.842920:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+296:57148:x1848998399898880:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343275.842929:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.842932:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343275.842954:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a3c04 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4986e expref: 296 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.842956:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c4515600/0x9104b1ba770a3be1 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49860 expref: 296 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.842982:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a3c04 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4986e expref: 295 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.842986:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695000) 00010000:00010000:0.0:1763343275.843000:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343275.843006:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:2.0:1763343275.843011:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343275.843012:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3c0b lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49875 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.843014:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c589be00, rc 0) 00010000:00010000:0.0:1763343275.843137:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3c12 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343275.843147:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3c12 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.843155:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3c12 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.843168:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3c19 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343275.843189:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3c19 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.843195:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3c19 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.843636:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3c20 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343275.843650:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3c20 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.843657:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3c20 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343275.843667:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x20f:0x0]: returning size 0 00010000:00010000:0.0:1763343275.843693:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3c12 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.843699:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3c12 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.843704:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3c12 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.843709:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3c12 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.843714:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.843718:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3c12 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.843725:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3c12 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.843733:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695200) 00010000:00010000:0.0:1763343275.843736:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.843739:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3c12 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.843744:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3c12 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00010000:0.0:1763343275.843758:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a09b66d0 reply state 00000000f5f73a38 transno 4294973697 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3c19 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.843768:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3c19 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.843774:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695300) 00010000:00010000:0.0:1763343275.843775:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343275.843778:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343275.843804:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3c0b lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49875 expref: 298 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.843820:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3c20 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49875 expref: 297 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.843826:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20f:0x0].0x0 (ffff9401f6695700) 00010000:00010000:0.0:1763343275.843840:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343275.843844:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fd600, rc 0) 00000100:00100000:2.0:1763343275.843846:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57146:x1848998399898624:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 999us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.843859:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10761 00000100:00100000:0.0:1763343275.843877:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57148:x1848998399898880:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 958us (1404us total) trans 4294973697 rc 0/0 00000100:00100000:0.0:1763343275.843885:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10762 00000100:00100000:3.0:1763343275.846877:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.846949:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399899008 00000100:00100000:2.0:1763343275.846960:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399899008 00000100:00100000:2.0:1763343275.847017:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10763 00000100:00100000:2.0:1763343275.847055:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57146:x1848998399899008:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343275.847077:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.847099:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3c2e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4987c expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.847168:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3c35 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343275.847182:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3c35 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.847192:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3c35 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:2.0:1763343275.847233:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x20e:0x0]: returning size 5 00000004:00200000:2.0:1763343275.847237:0:33856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343275.847266:0:33856:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3c35 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.847291:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3c2e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4987c expref: 299 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.847310:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3c35 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4987c expref: 298 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.847318:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:2.0:1763343275.847322:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1763343275.847326:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5bd9a00, rc 0) 00000100:00100000:1.0:1763343275.847427:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.847472:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399899264 00000100:00100000:0.0:1763343275.847478:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399899264 00000100:00100000:0.0:1763343275.847510:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10764 00000100:00100000:0.0:1763343275.847518:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57148:x1848998399899264:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343275.847527:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.847537:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3c3c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x20f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49883 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.847600:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3c43 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343275.847610:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3c20 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49875 expref: 300 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.847618:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3c43 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.847648:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3c20 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49875 expref: 300 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.847660:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3c20 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49875 expref: 300 pid: 7641 timeout: 1168 lvb_type: 0 00000100:00100000:0.0:1763343275.847672:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b2a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412983552:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343275.848227:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57146:x1848998399899008:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1195us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.848236:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10763 00000100:00100000:0.0:1763343275.851188:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c546e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343275.851432:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.851961:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399899392 00000100:00100000:2.0:1763343275.851971:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399899392 00000100:00100000:2.0:1763343275.852061:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7331 00000100:00100000:2.0:1763343275.852071:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edde4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2410:x1848998399899392:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343275.852088:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.852112:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401c0030200/0x9104b1ba770a3c4a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4988a expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343275.852136:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2c4:0x0] initial LVB size: 5, mtime: 0x691a7bab, atime: 0x0, ctime: 0x691a7bab, blocks: 0x8 00010000:00010000:2.0:1763343275.852155:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.852158:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.852167:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401c0030200/0x9104b1ba770a3c4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4988a expref: 17 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343275.852184:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9401c0030200/0x9104b1ba770a3c4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4988a expref: 17 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343275.852196:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c0030200, rc 0) 00000100:00100000:2.0:1763343275.852262:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edde4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2410:x1848998399899392:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 191us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.852268:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7331 00000100:00100000:0.0:1763343275.854089:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412983552:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343275.854119:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3c43 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:1.0:1763343275.856329:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.856416:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399899520 00000100:00100000:2.0:1763343275.856427:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399899520 00010000:00010000:2.0:1763343275.856470:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3c20 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49875 expref: 300 pid: 7641 timeout: 1168 lvb_type: 0 00000100:00100000:2.0:1763343275.856509:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3497 00000100:00100000:2.0:1763343275.856520:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:2408:x1848998399899520:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343275.856533:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343275.856540:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3c20 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49875 expref: 300 pid: 7641 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343275.856552:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3c20 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49875 expref: 300 pid: 7641 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343275.856574:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3c20 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49875 expref: 300 pid: 7641 timeout: 1168 lvb_type: 0 00010000:00010000:2.0:1763343275.856590:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20f:0x0].0x0 (ffff9401f6695700) 00010000:00010000:2.0:1763343275.856595:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3c43 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.856604:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3c43 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.856611:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3c43 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.856631:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343275.856689:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:2408:x1848998399899520:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 171us (1910us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.856697:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3497 00010000:00010000:0.0:1763343275.856796:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3c43 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.856804:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3c43 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343275.856831:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x20f:0x0]: returning size 0 00000004:00080000:0.0:1763343275.857174:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2c7:0x0], index 1: 0 00000004:00080000:0.0:1763343275.857182:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2c6:0x0], index 0: 0 00000004:00080000:0.0:1763343275.857187:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2c7:0x0], index 0: 0 00000004:00080000:0.0:1763343275.857191:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2c8:0x0], index 1: 0 00010000:00010000:0.0:1763343275.857309:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3c43 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.857317:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3c43 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.857323:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3c43 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.857329:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fd800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.857333:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3c43 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.857339:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3c43 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.857350:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20f:0x0].0x0 (ffff9401f6695700) 00010000:00010000:0.0:1763343275.857353:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343275.857356:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3c43 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.857361:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3c43 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.857414:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3c3c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x20f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49883 expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.857424:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20f:0x0].0x0 (ffff9401f6695700) 00010000:00010000:0.0:1763343275.857426:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343275.857430:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3c3c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x20f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49883 expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.857445:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fca00, rc 0) 00000100:00100000:0.0:1763343275.857500:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57148:x1848998399899264:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 9978us (10068us total) trans 4294973698 rc 301/301 00000100:00100000:0.0:1763343275.857507:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10764 00000100:00100000:1.0:1763343275.859312:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.859803:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399899776 00000100:00100000:2.0:1763343275.859813:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399899776 00000100:00100000:2.0:1763343275.859876:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3794 00000100:00100000:2.0:1763343275.859886:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57148:x1848998399899776:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343275.860305:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57148:x1848998399899776:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 417us (999us total) trans 4294973699 rc 0/0 00000100:00100000:2.0:1763343275.860314:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3794 00000100:00100000:3.0:1763343275.862178:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.862300:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399900032 00000100:00100000:2.0:1763343275.862312:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399900032 00000100:00100000:2.0:1763343275.862356:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3795 00000100:00100000:2.0:1763343275.862366:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57148:x1848998399900032:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343275.862562:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57148:x1848998399900032:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 197us (392us total) trans 4294973700 rc 0/0 00000100:00100000:2.0:1763343275.862570:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3795 00000100:00100000:3.0:1763343275.866850:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.867336:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399900288 00000100:00100000:0.0:1763343275.867347:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399900288 00000100:00100000:0.0:1763343275.867409:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10765 00000100:00100000:0.0:1763343275.867419:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:55884:x1848998399900288:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343275.867444:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.867471:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3c58 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49891 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.867619:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3c5f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343275.867633:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3c5f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.867643:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3c5f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.867654:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3c66 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343275.867661:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3c66 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.867667:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3c66 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.867727:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3c6d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343275.867735:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3c6d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.867742:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3c6d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343275.867751:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x20f:0x0]: returning size 0 00010000:00010000:0.0:1763343275.867850:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3c5f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.867857:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3c5f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.867862:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3c5f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.867868:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3c5f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.867873:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fd800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.867876:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3c5f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.867882:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3c5f lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.867893:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695700) 00010000:00010000:0.0:1763343275.867896:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.867900:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3c5f lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.867909:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3c5f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.867922:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3c66 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.867926:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3c66 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.867931:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3c66 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.867936:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3916200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.867938:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3c66 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.867943:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3c66 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.867947:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695300) 00010000:00010000:0.0:1763343275.867949:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.867952:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3c66 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.867956:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3c66 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.869553:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3c58 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49891 expref: 303 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.869584:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3c6d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49891 expref: 302 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.869599:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20f:0x0].0x0 (ffff9401f6695200) 00010000:00010000:0.0:1763343275.869602:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343275.869605:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917e00, rc 0) 00000100:00100000:0.0:1763343275.869682:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:55884:x1848998399900288:12345-192.168.201.40@tcp:101:bash.0 Request processed in 2264us (2843us total) trans 4294973701 rc 0/0 00000100:00100000:0.0:1763343275.869692:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10765 00000100:00100000:3.0:1763343275.873514:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.873600:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399900416 00000100:00100000:0.0:1763343275.873610:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399900416 00000100:00100000:0.0:1763343275.873671:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10766 00000100:00100000:0.0:1763343275.873681:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:55884:x1848998399900416:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343275.873703:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.873723:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3c7b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49898 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.873755:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3c82 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343275.873767:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3c82 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.873779:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3c82 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.873893:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3c7b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49898 expref: 304 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.873912:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3c82 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49898 expref: 303 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.873926:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20f:0x0].0x0 (ffff9401f6695200) 00010000:00010000:0.0:1763343275.873929:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343275.873932:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917a00, rc 0) 00000100:00100000:0.0:1763343275.874502:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:55884:x1848998399900416:12345-192.168.201.40@tcp:101:bash.0 Request processed in 821us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.874511:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10766 00000100:00100000:3.0:1763343275.877120:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.877235:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399900672 00000100:00100000:0.0:1763343275.877260:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399900672 00000100:00100000:0.0:1763343275.877734:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10767 00000100:00100000:0.0:1763343275.877747:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:55884:x1848998399900672:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:0.0:1763343275.877800:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343275.877828:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3c6d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49891 expref: 303 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.877846:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20f:0x0].0x0 (ffff9401f6695200) 00010000:00010000:0.0:1763343275.877851:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343275.878063:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3c89 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x20f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343275.878078:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3c89 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.878086:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3c89 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000001:00080000:0.0:1763343275.878128:0:7641:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973702 00000004:00010000:0.0:1763343275.878150:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001e47bafa reply state 000000009b0df3bd transno 4294973703 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3c89 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.878165:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3c89 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.878170:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20f:0x0].0x0 (ffff9401f6695200) 00010000:00010000:0.0:1763343275.878172:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343275.878175:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343275.878284:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:55884:x1848998399900672:12345-192.168.201.40@tcp:36:bash.0 Request processed in 539us (1173us total) trans 4294973703 rc 0/0 00000100:00100000:0.0:1763343275.878291:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10767 00000020:00080000:0.0:1763343275.878296:0:7641:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343275.880730:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.880804:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399900800 00000100:00100000:0.0:1763343275.880816:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399900800 00000100:00100000:0.0:1763343275.881544:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10768 00000100:00100000:0.0:1763343275.881559:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:55884:x1848998399900800:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343275.881584:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.881607:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3c90 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x20f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4989f expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.881667:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3c90 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x20f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4989f expref: 306 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.881682:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3c90 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x20f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4989f expref: 306 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.881701:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20f:0x0].0x0 (ffff9401f6695200) 00010000:00010000:0.0:1763343275.881704:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343275.881707:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917000, rc 0) 00000100:00100000:0.0:1763343275.882500:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:55884:x1848998399900800:12345-192.168.201.40@tcp:101:bash.0 Request processed in 939us (1773us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.882512:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10768 00000100:00100000:3.0:1763343275.885618:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.885769:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399901056 00000100:00100000:0.0:1763343275.885780:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399901056 00000100:00100000:0.0:1763343275.885837:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10769 00000100:00100000:0.0:1763343275.885848:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:55884:x1848998399901056:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343275.885869:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.885872:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343275.885896:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3c90 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x20f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4989f expref: 306 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.885915:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20f:0x0].0x0 (ffff9401f6695200) 00010000:00010000:0.0:1763343275.885920:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343275.885931:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3c97 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b498a6 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.885979:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a3c9e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343275.885992:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a3c9e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.886004:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a3c9e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000040:00080000:0.0:1763343275.886296:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1756, 88 off146088 00000004:00080000:0.0:1763343275.886303:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1069010278555ns, next at 1069016397451ns, rc = 0 00000040:00080000:0.0:1763343275.886341:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1748, 88 off145432 00000004:00080000:0.0:1763343275.886346:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1069010321274ns, next at 1069016426495ns, rc = 0 00000040:00080000:0.0:1763343275.886364:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1749, 88 off145520 00000004:00080000:0.0:1763343275.886369:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1069010344128ns, next at 1069016426495ns, rc = 0 00000040:00080000:0.0:1763343275.886379:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1757, 88 off146176 00000004:00080000:0.0:1763343275.886383:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1069010358573ns, next at 1069016397451ns, rc = 0 00000001:00080000:3.0:1763343275.889912:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973704 is committed 00000004:00080000:3.0:1763343275.889925:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1129 committed 00000004:00080000:3.0:1763343275.890048:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1121 committed 00000004:00080000:3.0:1763343275.890220:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1120 committed 00000100:00100000:1.0:1763343275.890328:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c2f85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412984064:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343275.890407:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343275.890451:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763343275.890457:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c2f85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412983936:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343275.890481:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343275.890513:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412984064 00000100:00100000:1.0:1763343275.890520:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412984064 00000100:00100000:1.0:1763343275.890564:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412983936 00000100:00100000:1.0:1763343275.890567:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412983936 00000100:00100000:1.0:1763343275.890588:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7332 00000100:00100000:1.0:1763343275.890595:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+20:3660:x1848998412984064:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343275.890796:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+21:3660:x1848998412984064:12345-0@lo:2:osp-syn-0-1.0 Request processed in 201us (388us total) trans 21474839238 rc 0/0 00000100:00100000:1.0:1763343275.890804:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7332 00000100:00100000:1.0:1763343275.890820:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7333 00000100:00100000:1.0:1763343275.890826:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+20:3660:x1848998412983936:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343275.890891:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+21:3660:x1848998412983936:12345-0@lo:2:osp-syn-0-1.0 Request processed in 65us (407us total) trans 21474839239 rc 0/0 00000100:00100000:1.0:1763343275.890898:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7333 00000004:00080000:1.0:1763343275.890950:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c2f85880/2, rc 0, transno 21474839239 00000100:00100000:1.0:1763343275.890957:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c2f85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412983936:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763343275.890965:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c2f85f80/2, rc 0, transno 21474839238 00000100:00100000:1.0:1763343275.890968:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c2f85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412984064:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763343275.891148:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1128 committed 00000100:00100000:3.0:1763343275.891187:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412983680:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343275.891221:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343275.891240:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343275.891256:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412983808:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343275.891399:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343275.891436:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412983680 00000100:00100000:3.0:1763343275.891442:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412983680 00000100:00100000:3.0:1763343275.891467:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412983808 00000100:00100000:3.0:1763343275.891469:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412983808 00000100:00100000:3.0:1763343275.891488:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7334 00000100:00100000:3.0:1763343275.891494:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+36:3661:x1848998412983680:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343275.891595:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+37:3661:x1848998412983680:12345-0@lo:2:osp-syn-1-1.0 Request processed in 100us (373us total) trans 17179871967 rc 0/0 00000100:00100000:3.0:1763343275.891602:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7334 00000100:00100000:3.0:1763343275.891614:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7335 00000100:00100000:3.0:1763343275.891619:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+36:3661:x1848998412983808:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343275.891683:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+37:3661:x1848998412983808:12345-0@lo:2:osp-syn-1-1.0 Request processed in 63us (284us total) trans 17179871968 rc 0/0 00000100:00100000:3.0:1763343275.891688:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7335 00000004:00080000:3.0:1763343275.891722:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b29500/2, rc 0, transno 17179871968 00000100:00100000:3.0:1763343275.891727:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412983808:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763343275.891734:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b2a300/2, rc 0, transno 17179871967 00000100:00100000:3.0:1763343275.891738:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412983680:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1763343275.891865:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a3c9e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x20f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498a6 expref: 300 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.891879:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20f:0x0].0x0 (ffff9401f6695200) 00010000:00010000:0.0:1763343275.891882:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343275.891897:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3c97 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498a6 expref: 300 pid: 7641 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763343275.891915:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a3c9e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x20f:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498a6 expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.891939:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20f:0x0].0x0 (ffff9401f6695200) 00010000:00010000:0.0:1763343275.891942:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343275.891944:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d1e9ec00, rc 0) 00000100:00100000:0.0:1763343275.891997:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:55884:x1848998399901056:12345-192.168.201.40@tcp:101:bash.0 Request processed in 6151us (6388us total) trans 4294973704 rc 0/0 00000100:00100000:0.0:1763343275.892004:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10769 00010000:00010000:2.0:1763343275.892115:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3c19 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.892124:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3c19 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.892131:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3c19 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.892137:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fdc00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.892141:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3c19 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.892149:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3c19 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.892163:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695300) 00010000:00010000:2.0:1763343275.892166:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.892170:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3c19 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.892175:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3c19 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.892194:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3c89 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.892200:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3c89 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.892206:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3c89 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.892210:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3916200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.892213:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3c89 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.892219:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3c89 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.892226:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20f:0x0].0x0 (ffff9401f6695200) 00010000:00010000:2.0:1763343275.892228:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.892230:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3c89 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.892236:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3c89 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343275.896472:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.896553:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399901184 00000100:00100000:1.0:1763343275.896564:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399901184 00000100:00100000:1.0:1763343275.896624:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7336 00000100:00100000:1.0:1763343275.896634:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:55884:x1848998399901184:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343275.896651:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343275.896673:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a3ca5 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b498ad expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343275.896695:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343275.896713:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.896715:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.896723:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a3ca5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498ad expref: 24 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.896737:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a3ca5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498ad expref: 24 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.896747:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177e00, rc 0) 00000100:00100000:1.0:1763343275.896805:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:55884:x1848998399901184:12345-192.168.201.40@tcp:101:bash.0 Request processed in 172us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343275.896812:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7336 00000100:00100000:0.0:1763343275.900302:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763343275.900328:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412984192:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1763343275.900463:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343275.900509:0:14179:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412984192 00000100:00100000:1.0:1763343275.900518:0:14179:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412984192 00000100:00100000:1.0:1763343275.900567:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:1.0:1763343275.900582:0:14179:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+21:3662:x1848998412984192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1763343275.900614:0:14179:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484924096 pending 28672 free 3919187968 avail 3687665664 00000100:00100000:1.0:1763343275.900656:0:14179:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+21:3662:x1848998412984192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343275.900665:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00100000:2.0:1763343275.901547:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.901695:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412984192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1763343275.902244:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399901312 00000100:00100000:1.0:1763343275.902362:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399901312 00000100:00100000:1.0:1763343275.902489:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7337 00000100:00100000:1.0:1763343275.902501:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:55884:x1848998399901312:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343275.902519:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343275.902544:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a3cac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b498b4 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343275.902569:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343275.902592:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.902594:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.902604:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a3cac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498b4 expref: 18 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.902623:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a3cac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498b4 expref: 18 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.902636:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176600, rc 0) 00000100:00100000:1.0:1763343275.903151:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:55884:x1848998399901312:12345-192.168.201.40@tcp:101:bash.0 Request processed in 650us (1606us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343275.903170:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7337 00000100:00100000:3.0:1763343275.906662:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.906732:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399901440 00000100:00100000:0.0:1763343275.906743:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399901440 00002000:00010000:0.0:1763343275.906785:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/711 (0->18446744073709551615) 00002000:00100000:0.0:1763343275.906790:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c59b5f80 with x1848998399901440 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343275.906802:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c59b5f80. 00000100:00100000:0.0:1763343275.906836:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1745 00000100:00100000:0.0:1763343275.906845:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2407:x1848998399901440:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:0.0:1763343275.907018:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2c7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343275.907061:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2c7:0x0] updating lvb mtime from disk: 0 -> 1763343275 00002000:00010000:0.0:1763343275.907064:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2c7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343275.907067:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2c7:0x0] updating lvb ctime from disk: 0 -> 1763343275 00002000:00010000:0.0:1763343275.907069:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2c7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343275.907122:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2407:x1848998399901440:12345-192.168.201.40@tcp:10:bash.0 Request processed in 277us (470us total) trans 17179871969 rc 0/0 00000100:00100000:0.0:1763343275.907130:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1745 00002000:00010000:0.0:1763343275.907134:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/711 (0->18446744073709551615) 00002000:00100000:0.0:1763343275.907138:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c59b5f80 with x1848998399901440 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343275.907143:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c59b5f80. 00000100:00100000:2.0:1763343275.907181:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.907543:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.907681:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399901696 00000100:00100000:1.0:1763343275.907687:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399901696 00000100:00100000:1.0:1763343275.907725:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7338 00000100:00100000:1.0:1763343275.907733:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2407:x1848998399901696:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:1.0:1763343275.907813:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2407:x1848998399901696:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 81us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343275.907820:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7338 00000100:00100000:0.0:1763343275.908826:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399901568 00000100:00100000:0.0:1763343275.908833:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399901568 00002000:00010000:0.0:1763343275.908859:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/710 (0->18446744073709551615) 00002000:00100000:0.0:1763343275.908863:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b25880 with x1848998399901568 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343275.908957:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5b25880. 00000100:00100000:0.0:1763343275.908989:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1746 00000100:00100000:0.0:1763343275.908998:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998399901568:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:0.0:1763343275.909180:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2c6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343275.909184:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2c6:0x0] updating lvb mtime from disk: 0 -> 1763343275 00002000:00010000:0.0:1763343275.909186:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2c6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343275.909188:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2c6:0x0] updating lvb ctime from disk: 0 -> 1763343275 00002000:00010000:0.0:1763343275.909192:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2c6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343275.909237:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2408:x1848998399901568:12345-192.168.201.40@tcp:10:bash.0 Request processed in 239us (2056us total) trans 21474839240 rc 0/0 00000100:00100000:0.0:1763343275.909244:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1746 00002000:00010000:0.0:1763343275.909263:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/710 (0->18446744073709551615) 00002000:00100000:0.0:1763343275.909266:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b25880 with x1848998399901568 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343275.909271:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5b25880. 00000100:00100000:2.0:1763343275.909930:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.910053:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399901824 00000100:00100000:3.0:1763343275.910061:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399901824 00000100:00100000:3.0:1763343275.910098:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7339 00000100:00100000:3.0:1763343275.910106:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2408:x1848998399901824:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:3.0:1763343275.910362:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2408:x1848998399901824:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 256us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343275.910369:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7339 00000100:00100000:1.0:1763343275.911949:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.912104:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399902080 00000100:00100000:0.0:1763343275.912114:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399902080 00000100:00100000:0.0:1763343275.912170:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3796 00000100:00100000:0.0:1763343275.912179:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8544c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:55884:x1848998399902080:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:0.0:1763343275.912516:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8544c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:55884:x1848998399902080:12345-192.168.201.40@tcp:35:bash.0 Request processed in 337us (572us total) trans 4294973705 rc 0/0 00000100:00100000:0.0:1763343275.912524:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3796 00000100:00100000:3.0:1763343275.912925:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.913262:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399902208 00000100:00100000:0.0:1763343275.913282:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399902208 00000100:00100000:0.0:1763343275.913332:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1747 00000100:00100000:0.0:1763343275.913341:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2408:x1848998399902208:12345-192.168.201.40@tcp:3:lfs.0 00010000:00010000:0.0:1763343275.913374:0:8419:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3cb3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.913389:0:8419:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.913392:0:8419:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.913398:0:8419:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3cb3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.913413:0:8419:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3cb3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.913506:0:8419:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3cb3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.913513:0:8419:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3cb3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.913520:0:8419:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3cb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.913526:0:8419:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ea00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343275.913530:0:8419:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3cb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.913537:0:8419:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3cb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.913552:0:8419:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3cb3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.913559:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3cb3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343275.913613:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2408:x1848998399902208:12345-192.168.201.40@tcp:3:lfs.0 Request processed in 274us (688us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763343275.913620:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1747 00000100:00100000:2.0:1763343275.919645:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.920074:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399902336 00000100:00100000:0.0:1763343275.920085:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399902336 00000100:00100000:0.0:1763343275.920146:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10770 00000100:00100000:0.0:1763343275.920158:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57149:x1848998399902336:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:0.0:1763343275.920181:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.920207:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3cba lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b498bb expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.920288:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3cc1 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343275.920302:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3cc1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.920313:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3cc1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.920326:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3cc8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343275.920332:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3cc8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.920338:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3cc8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.920401:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a3ccf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343275.920409:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a3ccf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.920415:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a3ccf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343275.920449:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x20f:0x0]: returning size 5 00000004:00200000:0.0:1763343275.920452:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343275.920468:0:7641:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a3ccf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.920479:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a3ccf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.920487:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3cc1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.920494:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3cc1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.920499:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3cc1 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.920505:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3cc1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.920510:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3916200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.920514:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3cc1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.920520:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3cc1 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.920530:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695700) 00010000:00010000:0.0:1763343275.920533:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.920536:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3cc1 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.920542:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3cc1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.920552:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3cc8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.920561:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3cc8 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.920567:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3cc8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.920571:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.920573:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3cc8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.920578:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3cc8 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.920583:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695000) 00010000:00010000:0.0:1763343275.920584:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.920587:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3cc8 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.920591:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3cc8 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.920616:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3cba lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498bb expref: 300 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.920628:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a3ccf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498bb expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.920634:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20f:0x0].0x0 (ffff9401f6695200) 00010000:00010000:0.0:1763343275.920636:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343275.920638:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e90600, rc 0) 00000100:00100000:0.0:1763343275.921081:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57149:x1848998399902336:12345-192.168.201.40@tcp:101:rm.0 Request processed in 865us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.921091:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10770 00000100:00100000:1.0:1763343275.923737:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.924149:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399902464 00000100:00100000:3.0:1763343275.924156:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.924159:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399902464 00000100:00100000:0.0:1763343275.924323:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399902720 00000100:00100000:0.0:1763343275.924328:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399902720 00000100:00100000:0.0:1763343275.924390:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10771 00000100:00100000:0.0:1763343275.924400:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57149:x1848998399902720:12345-192.168.201.40@tcp:36:rm.0 00000100:00100000:2.0:1763343275.924427:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10772 00000100:00100000:2.0:1763343275.924434:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57146:x1848998399902464:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343275.924443:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.924452:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763343275.924462:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3cd6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b498c2 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.924475:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a3c9e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x20f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498a6 expref: 301 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.924492:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a3ccf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498bb expref: 300 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.924495:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3cdd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343275.924503:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3c82 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x20f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49898 expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.924507:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3cdd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.924512:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20f:0x0].0x0 (ffff9401f6695200) 00010000:00010000:2.0:1763343275.924517:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3cdd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.924522:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343275.924540:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a3ce4 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343275.924548:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a3ce4 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.924554:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a3ce4 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.924564:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3ceb lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343275.924570:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3ceb lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.924576:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3ceb lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343275.924616:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3cd6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498c2 expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.924629:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fdc00/0x9104b1ba770a3cdd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498c2 expref: 298 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.924635:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:2.0:1763343275.924638:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343275.924642:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fdc00, rc 0) 00010000:00010000:0.0:1763343275.924647:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3cf2 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343275.924653:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3cf2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.924660:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3cf2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000100:00100000:2.0:1763343275.924699:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57146:x1848998399902464:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 265us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.924706:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10772 00000040:00080000:0.0:1763343275.925135:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1758, 64 off146240 00000004:00080000:0.0:1763343275.925144:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1069049118596ns, next at 1070049115839ns, rc = 0 00000040:00080000:0.0:1763343275.925338:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1750, 64 off145584 00000004:00080000:0.0:1763343275.925345:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1069049320701ns, next at 1070049318579ns, rc = 0 00000040:00080000:0.0:1763343275.925359:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1751, 64 off145648 00000040:00080000:0.0:1763343275.925369:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1759, 64 off146304 00010000:00010000:0.0:1763343275.925432:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3cf9 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x20f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343275.925443:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3cf9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.925452:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3cf9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.925465:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3cf9 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.925471:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3cf9 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.925480:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3cf9 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.925499:0:6524:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343275.926106:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343275.926114:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3cf9 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343275.926122:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508be00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343275.926126:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3cf9 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343275.926133:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3cf9 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343275.926146:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20f:0x0].0x0 (ffff9401f6695300) 00010000:00010000:3.0:1763343275.926149:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343275.926153:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3cf9 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343275.926158:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3cf9 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343275.926170:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343275.926172:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343275.926173:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343275.926617:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3cf2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.926626:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3cf2 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.926632:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3cf2 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.926637:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508b200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.926640:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3cf2 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.926646:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3cf2 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.926655:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20f:0x0].0x0 (ffff9401f6695300) 00010000:00010000:0.0:1763343275.926658:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763343275.926660:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3cf2 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.926665:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3cf2 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.926810:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a3ce4 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.926817:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a3ce4 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.926827:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a3ce4 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.926832:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a3ce4 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.926837:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e91e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.926840:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a3ce4 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.926845:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a3ce4 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.926853:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:0.0:1763343275.926856:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.926859:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a3ce4 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.926864:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a3ce4 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000004:00010000:0.0:1763343275.926877:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000001ce88a reply state 0000000022f78b9e transno 4294973706 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3ceb lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.926888:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3ceb lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.926895:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695800) 00010000:00010000:0.0:1763343275.926897:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343275.926900:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343275.928149:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.928953:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399902848 00000100:00100000:1.0:1763343275.928964:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399902848 00000100:00100000:1.0:1763343275.929046:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1748 00000100:00100000:1.0:1763343275.929056:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2407:x1848998399902848:12345-192.168.201.40@tcp:4:lfs.0 00010000:00010000:1.0:1763343275.929089:0:8419:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3d00 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.929106:0:8419:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a3a7c lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497e9 expref: 25 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343275.929114:0:8419:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.929116:0:8419:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.929120:0:8419:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3d00 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.929150:0:8419:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a3a7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497e9 expref: 25 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343275.929170:0:8419:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a3a7c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497e9 expref: 25 pid: 35266 timeout: 1169 lvb_type: 1 00000100:00100000:1.0:1763343275.929185:0:8419:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c517bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8419:1848998412984320:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343275.929260:0:8419:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c4532840 going to sleep for 11 seconds 00000100:00100000:0.0:1763343275.929321:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57149:x1848998399902720:12345-192.168.201.40@tcp:36:rm.0 Request processed in 4920us (5162us total) trans 4294973706 rc 0/0 00000100:00100000:0.0:1763343275.929333:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10771 00000100:00100000:0.0:1763343275.932146:0:8419:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c517bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8419:1848998412984320:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343275.932177:0:8419:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3d00 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343275.936178:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.937534:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399902976 00000100:00100000:1.0:1763343275.937553:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399902976 00010000:00010000:1.0:1763343275.937615:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a3a7c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497e9 expref: 26 pid: 35266 timeout: 1169 lvb_type: 1 00000100:00100000:1.0:1763343275.938089:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3498 00000100:00100000:1.0:1763343275.938102:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2408:x1848998399902976:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343275.938120:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343275.938145:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a3a7c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497e9 expref: 26 pid: 35266 timeout: 1169 lvb_type: 1 00010000:00010000:1.0:1763343275.938173:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a3a7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497e9 expref: 26 pid: 35266 timeout: 1169 lvb_type: 1 00010000:00010000:1.0:1763343275.938201:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a3a7c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497e9 expref: 26 pid: 35266 timeout: 1169 lvb_type: 1 00010000:00010000:1.0:1763343275.938215:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.938217:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.938222:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3d00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.938232:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3d00 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.938285:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343275.938341:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2408:x1848998399902976:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 242us (2184us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343275.938349:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3498 00010000:00010000:0.0:1763343275.938422:0:8419:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3d00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.938432:0:8419:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3d00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343275.939193:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.939473:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399903104 00000100:00100000:0.0:1763343275.939480:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399903104 00000100:00100000:0.0:1763343275.939527:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10773 00000100:00100000:0.0:1763343275.939535:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57150:x1848998399903104:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343275.939556:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.939577:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a3d07 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b498c9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.939641:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3d0e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343275.939655:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3d0e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.939666:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3d0e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.939677:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3d15 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343275.939685:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3d15 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.939692:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3d15 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.939730:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3d0e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.939737:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3d0e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.939743:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3d0e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.939749:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3d0e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.939755:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508be00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.939760:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3d0e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.939767:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3d0e lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.939778:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695700) 00010000:00010000:0.0:1763343275.939781:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.939785:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3d0e lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.939791:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3d0e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.939803:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3d15 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.939809:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3d15 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.939815:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3d15 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.939819:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.939822:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3d15 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.939828:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3d15 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.939834:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695800) 00010000:00010000:0.0:1763343275.939836:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.939838:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3d15 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.939843:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3d15 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343275.939864:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a3d07 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498c9 expref: 300 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.939872:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695700) 00010000:00010000:0.0:1763343275.939874:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.939877:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a3d07 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498c9 expref: 300 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.939888:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c508aa00, rc 0) 00000100:00100000:0.0:1763343275.939936:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57150:x1848998399903104:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 402us (746us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343275.939943:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10773 00000001:00080000:3.0:1763343275.941686:0:25994:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871970 is committed 00000001:00080000:3.0:1763343275.941705:0:25994:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871968 is committed 00002000:00010000:0.0:1763343275.941884:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2c6:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:0.0:1763343275.941889:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2c6:0x0] updating lvb mtime from disk: 0 -> 1763343275 00002000:00010000:0.0:1763343275.941891:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2c6:0x0] updating lvb ctime from disk: 0 -> 1763343275 00002000:00010000:0.0:1763343275.941894:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2c6:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1763343275.941905:0:8419:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3d00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.941914:0:8419:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3d00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.941923:0:8419:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3d00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.941929:0:8419:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343275.941934:0:8419:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3d00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.941942:0:8419:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3d00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.941958:0:8419:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3d00 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.941964:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3d00 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343275.942071:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2407:x1848998399902848:12345-192.168.201.40@tcp:4:lfs.0 Request processed in 13012us (13923us total) trans 17179871970 rc 0/0 00000100:00100000:0.0:1763343275.942080:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1748 00000100:00100000:1.0:1763343275.943150:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.943216:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399903232 00000100:00100000:2.0:1763343275.943225:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399903232 00000100:00100000:2.0:1763343275.943295:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10774 00000100:00100000:2.0:1763343275.943305:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57150:x1848998399903232:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343275.943327:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.943348:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3d1c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b498d0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.943415:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3d23 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343275.943429:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3d23 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.943440:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3d23 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.943451:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3d2a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343275.943457:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3d2a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.943463:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3d2a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.943499:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3d23 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.943511:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3d23 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.943517:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3d23 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.943524:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3d23 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.943529:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fd800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.943533:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3d23 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.943539:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3d23 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.943550:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48acc00) 00010000:00010000:2.0:1763343275.943553:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.943557:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3d23 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.943563:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a3d23 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.943576:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3d2a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.943581:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3d2a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.943586:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3d2a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.943590:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fca00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343275.943593:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3d2a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.943598:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3d2a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.943605:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695800) 00010000:00010000:2.0:1763343275.943608:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.943612:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3d2a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.943631:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3d2a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343275.943659:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3d1c lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498d0 expref: 300 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.943669:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48acc00) 00010000:00010000:2.0:1763343275.943672:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343275.943675:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a3d1c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498d0 expref: 300 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.943685:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fd600, rc 0) 00000100:00100000:2.0:1763343275.943738:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57150:x1848998399903232:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 434us (592us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343275.943746:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10774 00000100:00100000:2.0:1763343275.946496:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.949127:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399903360 00000100:00100000:0.0:1763343275.949142:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399903360 00000100:00100000:1.0:1763343275.949335:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10775 00000100:00100000:1.0:1763343275.949349:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57150:x1848998399903360:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343275.949373:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343275.949408:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3d31 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b498d7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.949482:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3d38 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343275.949495:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3d38 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343275.949506:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3d38 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:1.0:1763343275.949562:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763343275.949567:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763343275.949603:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3d31 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498d7 expref: 301 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.949638:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3d38 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498d7 expref: 300 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.949647:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fc4f1000) 00010000:00010000:1.0:1763343275.949650:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343275.949653:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176800, rc 0) 00000100:00100000:1.0:1763343275.949744:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57150:x1848998399903360:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 399us (3256us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343275.949751:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10775 00000100:00100000:1.0:1763343275.953892:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.954213:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399903616 00000100:00100000:0.0:1763343275.954223:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399903616 00000100:00100000:0.0:1763343275.954471:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10776 00000100:00100000:0.0:1763343275.954483:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57146:x1848998399903616:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:0.0:1763343275.954536:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343275.954567:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3c35 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x20e:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4987c expref: 300 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.954584:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:0.0:1763343275.954589:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343275.954895:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:0.0:1763343275.954994:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3d3f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343275.955009:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3d3f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.955019:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3d3f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00010000:0.0:1763343275.955161:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e15f40a4 reply state 0000000028373988 transno 4294973707 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3d3f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.955173:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3d3f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343275.955180:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:0.0:1763343275.955182:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343275.955186:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343275.955286:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57146:x1848998399903616:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 805us (1400us total) trans 4294973707 rc 0/0 00000100:00100000:0.0:1763343275.955294:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10776 00000100:00100000:3.0:1763343275.956720:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.956843:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399903744 00000100:00100000:0.0:1763343275.956852:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399903744 00000100:00100000:0.0:1763343275.956910:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10777 00000100:00100000:0.0:1763343275.956920:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57150:x1848998399903744:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343275.956939:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.956993:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3d46 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b498de expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343275.957082:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399903872 00000100:00100000:2.0:1763343275.957087:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399903872 00000100:00100000:2.0:1763343275.957123:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7340 00000100:00100000:2.0:1763343275.957131:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:57146:x1848998399903872:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343275.957138:0:28561:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343275.957152:0:28561:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3d4d lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b498e5 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343275.957172:0:28561:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2c6:0x0] initial LVB size: 4096, mtime: 0x691a7bab, atime: 0x0, ctime: 0x691a7bab, blocks: 0x8 00010000:00010000:2.0:1763343275.957189:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.957191:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.957198:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3d4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498e5 expref: 14 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.957213:0:28561:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3d4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498e5 expref: 14 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.957224:0:28561:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fca00, rc 0) 00010000:00010000:0.0:1763343275.957427:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3d54 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343275.957439:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3d54 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.957447:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3d54 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:2.0:1763343275.957454:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:57146:x1848998399903872:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 323us (740us total) trans 0 rc 0/0 00010000:00010000:0.0:1763343275.957457:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3d5b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00000100:00100000:2.0:1763343275.957461:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7340 00010000:00010000:0.0:1763343275.957464:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3d5b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.957469:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3d5b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.957502:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3d54 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.957513:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3d54 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.957520:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3d54 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.957525:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.957529:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3d54 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.957536:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3d54 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.957546:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fc4f1000) 00010000:00010000:0.0:1763343275.957549:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.957553:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3d54 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.957559:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a3d54 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.957570:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3d5b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.957576:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3d5b lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.957581:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3d5b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.957586:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3916200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343275.957588:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3d5b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.957597:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3d5b lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.957604:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695800) 00010000:00010000:0.0:1763343275.957607:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.957609:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3d5b lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.957629:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3d5b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343275.957659:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3d46 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498de expref: 302 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.957668:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fc4f1000) 00010000:00010000:0.0:1763343275.957670:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343275.957674:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3d46 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498de expref: 302 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.957681:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917a00, rc 0) 00000100:00100000:0.0:1763343275.957706:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57150:x1848998399903744:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 788us (2812us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343275.957712:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10777 00000100:00100000:3.0:1763343275.961150:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.961196:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.961197:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399904000 00000100:00100000:0.0:1763343275.961207:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399904000 00000100:00100000:1.0:1763343275.961343:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399904256 00000100:00100000:1.0:1763343275.961348:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399904256 00000100:00100000:1.0:1763343275.961383:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10778 00000100:00100000:1.0:1763343275.961394:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57150:x1848998399904256:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343275.961418:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343275.961422:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343275.961458:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a3d38 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498d7 expref: 301 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.961475:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fc4f1000) 00010000:00010000:1.0:1763343275.961484:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343275.961498:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3d62 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b498f3 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.961595:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3d69 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343275.961609:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3d69 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.961630:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3d69 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.961640:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3d70 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343275.961646:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3d70 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.961652:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3d70 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:0.0:1763343275.961707:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7341 00000100:00100000:0.0:1763343275.961717:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:57146:x1848998399904000:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343275.961726:0:28561:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343275.961738:0:28561:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c508aa00/0x9104b1ba770a3d77 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b498ec expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.961759:0:28561:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a3a83 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497f0 expref: 20 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343275.961772:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.961774:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343275.961779:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c508aa00/0x9104b1ba770a3d77 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498ec expref: 20 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.961810:0:28561:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a3a83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497f0 expref: 20 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343275.961825:0:28561:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a3a83 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497f0 expref: 20 pid: 35266 timeout: 1169 lvb_type: 1 00000100:00100000:0.0:1763343275.961838:0:28561:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28561:1848998412984448:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343275.961924:0:28561:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9300 going to sleep for 11 seconds 00010000:00010000:1.0:1763343275.962957:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3d7e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x211:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343275.962972:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3d7e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.962981:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3d7e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:1.0:1763343275.962991:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x211:0x0]: returning size 0 00010000:00010000:1.0:1763343275.963015:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3d69 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.963044:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3d69 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.963052:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3d69 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.963057:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343275.963062:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3d69 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.963068:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3d69 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.963078:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fc4f1e00) 00010000:00010000:1.0:1763343275.963081:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343275.963086:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3d69 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.963091:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3d69 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:1.0:1763343275.963101:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000e9e83f0 reply state 0000000066e4b624 transno 4294973708 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3d70 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.963110:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3d70 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.963115:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695800) 00010000:00010000:1.0:1763343275.963117:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343275.963119:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343275.963155:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3d62 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498f3 expref: 303 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.963177:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3d7e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498f3 expref: 302 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.963185:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x211:0x0].0x0 (ffff9401fc4f1100) 00010000:00010000:1.0:1763343275.963188:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343275.963191:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176e00, rc 0) 00000100:00100000:1.0:1763343275.963266:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57150:x1848998399904256:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1874us (2069us total) trans 4294973708 rc 0/0 00000100:00100000:1.0:1763343275.963276:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10778 00000100:00100000:0.0:1763343275.966433:0:28561:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28561:1848998412984448:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343275.966478:0:28561:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c508aa00/0x9104b1ba770a3d77 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498ec expref: 20 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.966497:0:28561:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c508aa00, rc 0) 00000100:00100000:0.0:1763343275.967820:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:57146:x1848998399904000:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 6095us (6789us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.967832:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7341 00000100:00100000:2.0:1763343275.968133:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.968236:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.968334:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399904640 00000100:00100000:1.0:1763343275.968344:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399904640 00000100:00100000:1.0:1763343275.968398:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10779 00000100:00100000:1.0:1763343275.968409:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57150:x1848998399904640:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:3.0:1763343275.968415:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399904384 00000100:00100000:3.0:1763343275.968419:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399904384 00010000:00010000:1.0:1763343275.968432:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343275.968441:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a3a83 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497f0 expref: 20 pid: 35266 timeout: 1169 lvb_type: 1 00010000:00010000:1.0:1763343275.968454:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3d8c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x211:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b498fa expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343275.968483:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3499 00000100:00100000:3.0:1763343275.968490:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2408:x1848998399904384:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343275.968504:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343275.968526:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a3a83 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497f0 expref: 20 pid: 35266 timeout: 1169 lvb_type: 1 00010000:00010000:3.0:1763343275.968538:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a3a83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497f0 expref: 20 pid: 35266 timeout: 1169 lvb_type: 1 00010000:00010000:3.0:1763343275.968564:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d200/0x9104b1ba770a3a83 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b497f0 expref: 20 pid: 35266 timeout: 1169 lvb_type: 1 00010000:00010000:3.0:1763343275.968580:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343275.968583:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343275.968589:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c508aa00/0x9104b1ba770a3d77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498ec expref: 19 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.968599:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c508aa00/0x9104b1ba770a3d77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498ec expref: 19 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343275.968651:0:14071:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9400c508aa00/0x9104b1ba770a3d77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498ec expref: 19 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343275.968665:0:14071:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c8599f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:14071:1848998412984576:192.168.201.40@tcp:105: 00000100:00100000:3.0:1763343275.968742:0:14071:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c82843c0 going to sleep for 11 seconds 00010000:00010000:1.0:1763343275.969702:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3d93 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x211:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343275.969721:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3d7e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498f3 expref: 304 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.969730:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3d93 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x211:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.969761:0:33856:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3d7e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498f3 expref: 304 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.969777:0:33856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3d7e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498f3 expref: 304 pid: 33856 timeout: 1169 lvb_type: 0 00000100:00100000:1.0:1763343275.969789:0:33856:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c517ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412984704:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343275.969842:0:33856:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c4532a80 going to sleep for 11 seconds 00000100:00100000:3.0:1763343275.971440:0:14071:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c8599f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:14071:1848998412984576:192.168.201.40@tcp:105: 00010000:00010000:3.0:1763343275.971463:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343275.971680:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2408:x1848998399904384:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 3187us (3545us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343275.971691:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3499 00000100:00100000:2.0:1763343275.972236:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.972272:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343275.972330:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399904768 00000100:00100000:3.0:1763343275.972338:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399904768 00002000:00010000:3.0:1763343275.972369:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/710 (5->18446744073709551615) 00002000:00100000:3.0:1763343275.972374:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c514f100 with x1848998399904768 ext(5->18446744073709551615) 00002000:00010000:3.0:1763343275.972385:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c514f100. 00000100:00100000:3.0:1763343275.972410:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399904896 00000100:00100000:3.0:1763343275.972413:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399904896 00002000:00010000:3.0:1763343275.972426:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/709 (0->18446744073709551615) 00002000:00100000:3.0:1763343275.972429:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c514ea00 with x1848998399904896 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343275.972434:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c514ea00. 00000100:00100000:3.0:1763343275.972463:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1749 00000100:00100000:3.0:1763343275.972471:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399904768:12345-192.168.201.40@tcp:10:lfs.0 00002000:00010000:3.0:1763343275.972808:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2c6:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:3.0:1763343275.972813:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2c6:0x0] updating lvb mtime from disk: 1763343275 -> 1763343275 00002000:00010000:3.0:1763343275.972816:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2c6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343275.972818:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2c6:0x0] updating lvb ctime from disk: 1763343275 -> 1763343275 00002000:00010000:3.0:1763343275.972820:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2c6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343275.972862:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998399904768:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 391us (627us total) trans 17179871971 rc 0/0 00000100:00100000:3.0:1763343275.972869:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1749 00002000:00010000:3.0:1763343275.972874:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/710 (5->18446744073709551615) 00002000:00100000:3.0:1763343275.972876:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c514f100 with x1848998399904768 ext(5->18446744073709551615) 00002000:00010000:3.0:1763343275.972881:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c514f100. 00000100:00100000:3.0:1763343275.972895:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1750 00000100:00100000:3.0:1763343275.972902:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2407:x1848998399904896:12345-192.168.201.40@tcp:10:lfs.0 00002000:00010000:3.0:1763343275.973015:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2c5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343275.973018:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2c5:0x0] updating lvb mtime from disk: 0 -> 1763343275 00002000:00010000:3.0:1763343275.973020:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2c5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343275.973053:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2c5:0x0] updating lvb ctime from disk: 0 -> 1763343275 00002000:00010000:3.0:1763343275.973056:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2c5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343275.973080:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399904896:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 178us (808us total) trans 21474839241 rc 0/0 00000100:00100000:3.0:1763343275.973088:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1750 00002000:00010000:3.0:1763343275.973091:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/709 (0->18446744073709551615) 00002000:00100000:3.0:1763343275.973093:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c514ea00 with x1848998399904896 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343275.973097:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c514ea00. 00000100:00100000:1.0:1763343275.975093:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.975341:0:33856:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c517ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412984704:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343275.975369:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3d93 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x211:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:3.0:1763343275.975593:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399905024 00000100:00100000:3.0:1763343275.975600:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399905024 00010000:00010000:3.0:1763343275.975631:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3d7e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498f3 expref: 305 pid: 33856 timeout: 1169 lvb_type: 0 00000100:00100000:3.0:1763343275.975667:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3500 00000100:00100000:3.0:1763343275.975676:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:2408:x1848998399905024:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343275.975694:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343275.975700:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3d7e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498f3 expref: 305 pid: 33856 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343275.975717:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3d7e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498f3 expref: 305 pid: 33856 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343275.975740:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3d7e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498f3 expref: 305 pid: 33856 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343275.975755:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x211:0x0].0x0 (ffff9401fc4f1100) 00010000:00010000:3.0:1763343275.975759:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3d93 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x211:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.975770:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3d93 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x211:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.975776:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3d93 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x211:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343275.975805:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343275.975847:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:2408:x1848998399905024:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 172us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343275.975854:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3500 00010000:00010000:1.0:1763343275.975986:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3d93 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x211:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.975994:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3d93 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x211:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:1.0:1763343275.976049:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x211:0x0]: returning size 0 00000004:00080000:1.0:1763343275.976215:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2c8:0x0], index 0: 0 00000004:00080000:1.0:1763343275.976221:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2c9:0x0], index 1: 0 00000004:00080000:1.0:1763343275.976225:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2ca:0x0], index 1: 0 00000004:00080000:1.0:1763343275.976228:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2c9:0x0], index 0: 0 00010000:00010000:1.0:1763343275.976351:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3d93 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x211:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.976359:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3d93 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x211:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.976365:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3d93 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x211:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.976371:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343275.976375:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3d93 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x211:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.976381:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3d93 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x211:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.976391:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x211:0x0].0x0 (ffff9401fc4f1100) 00010000:00010000:1.0:1763343275.976394:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343275.976398:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3d93 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x211:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.976403:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a3d93 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x211:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343275.976454:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3d8c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x211:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498fa expref: 304 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.976464:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x211:0x0].0x0 (ffff9401fc4f1100) 00010000:00010000:1.0:1763343275.976466:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343275.976469:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a3d8c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x211:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498fa expref: 304 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.976483:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176a00, rc 0) 00000100:00100000:1.0:1763343275.976532:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57150:x1848998399904640:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 8125us (8295us total) trans 4294973709 rc 301/301 00000100:00100000:1.0:1763343275.976540:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10779 00000100:00100000:3.0:1763343275.977090:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.977639:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399905280 00000100:00100000:2.0:1763343275.977648:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399905280 00000100:00100000:2.0:1763343275.977697:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10780 00000100:00100000:2.0:1763343275.977706:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57146:x1848998399905280:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:2.0:1763343275.977788:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3da1 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343275.977804:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3da1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.977815:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3da1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00010000:2.0:1763343275.977916:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000063b58c28 reply state 0000000011652dba transno 4294973710 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3da1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.977929:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3da1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343275.977936:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:2.0:1763343275.977939:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343275.977942:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343275.978046:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57146:x1848998399905280:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 318us (934us total) trans 4294973710 rc 0/0 00000100:00100000:2.0:1763343275.978054:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10780 00000100:00100000:2.0:1763343275.981441:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.982064:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343275.982331:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399905664 00000100:00100000:1.0:1763343275.982343:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399905664 00000100:00100000:1.0:1763343275.982408:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7342 00000100:00100000:1.0:1763343275.982418:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:57146:x1848998399905664:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343275.982439:0:28561:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343275.982461:0:28561:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a3da8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49901 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.982491:0:28561:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9401c0030200/0x9104b1ba770a3c4a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4988a expref: 21 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343275.982498:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.982500:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343275.982505:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a3da8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49901 expref: 21 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343275.982544:0:28561:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9401c0030200/0x9104b1ba770a3c4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4988a expref: 21 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343275.982558:0:28561:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9401c0030200/0x9104b1ba770a3c4a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4988a expref: 21 pid: 8412 timeout: 1169 lvb_type: 1 00000100:00100000:1.0:1763343275.982574:0:28561:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c517ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28561:1848998412984832:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343275.982666:0:28561:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c4532a80 going to sleep for 11 seconds 00000100:00100000:0.0:1763343275.983565:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399905536 00000100:00100000:0.0:1763343275.983574:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399905536 00000100:00100000:0.0:1763343275.983626:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3797 00000100:00100000:0.0:1763343275.983634:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57150:x1848998399905536:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343275.983936:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57150:x1848998399905536:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 301us (2507us total) trans 4294973711 rc 0/0 00000100:00100000:0.0:1763343275.983944:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3797 00000100:00100000:0.0:1763343275.985412:0:28561:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c517ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28561:1848998412984832:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343275.985445:0:28561:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a3da8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49901 expref: 21 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343275.985465:0:28561:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176800, rc 0) 00000100:00100000:0.0:1763343275.985519:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:57146:x1848998399905664:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3101us (3455us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343275.985529:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7342 00000100:00100000:1.0:1763343275.986593:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.986737:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399905792 00000100:00100000:2.0:1763343275.986747:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399905792 00010000:00010000:2.0:1763343275.986789:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9401c0030200/0x9104b1ba770a3c4a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4988a expref: 21 pid: 8412 timeout: 1169 lvb_type: 1 00000100:00100000:2.0:1763343275.986828:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3501 00000100:00100000:2.0:1763343275.986839:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399905792:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343275.986853:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343275.986874:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9401c0030200/0x9104b1ba770a3c4a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4988a expref: 21 pid: 8412 timeout: 1169 lvb_type: 1 00010000:00010000:2.0:1763343275.986887:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9401c0030200/0x9104b1ba770a3c4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4988a expref: 21 pid: 8412 timeout: 1169 lvb_type: 1 00010000:00010000:2.0:1763343275.986911:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401c0030200/0x9104b1ba770a3c4a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4988a expref: 21 pid: 8412 timeout: 1169 lvb_type: 1 00010000:00010000:2.0:1763343275.986927:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.986929:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343275.986937:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a3da8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49901 expref: 20 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.986948:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a3da8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49901 expref: 20 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343275.986991:0:6510:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a3da8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49901 expref: 20 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343275.987006:0:6510:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b18000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6510:1848998412984960:192.168.201.40@tcp:105: 00000100:00100000:2.0:1763343275.987127:0:6510:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c7ec3480 going to sleep for 11 seconds 00000100:00100000:2.0:1763343275.988415:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.988910:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399906048 00000100:00100000:0.0:1763343275.988924:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399906048 00000100:00100000:0.0:1763343275.988985:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3798 00000100:00100000:0.0:1763343275.988996:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57150:x1848998399906048:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343275.989311:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57150:x1848998399906048:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 315us (900us total) trans 4294973712 rc 0/0 00000100:00100000:0.0:1763343275.989319:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3798 00000100:00100000:2.0:1763343275.991240:0:6510:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b18000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6510:1848998412984960:192.168.201.40@tcp:105: 00000100:00100000:1.0:1763343275.991564:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343275.991717:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399906176 00000100:00100000:0.0:1763343275.991725:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399906176 00000100:00100000:0.0:1763343275.991763:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7343 00000100:00100000:0.0:1763343275.991770:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2410:x1848998399906176:12345-192.168.201.40@tcp:2:lfs.0 00002000:00010000:0.0:1763343275.991902:0:28561:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2c4:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763343275.991906:0:28561:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2c4:0x0] updating lvb mtime from disk: 1763343275 -> 1763343275 00002000:00010000:0.0:1763343275.991909:0:28561:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2c4:0x0] updating lvb atime from disk: 0 -> 1763343274 00002000:00010000:0.0:1763343275.991911:0:28561:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2c4:0x0] updating lvb ctime from disk: 1763343275 -> 1763343275 00002000:00010000:0.0:1763343275.991913:0:28561:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2c4:0x0] updating lvb blocks from disk: 8 -> 8 00010000:00010000:2.0:1763343275.992155:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343275.992648:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2410:x1848998399906176:12345-192.168.201.40@tcp:2:lfs.0 Request processed in 874us (1082us total) trans 21474839242 rc 0/0 00000100:00100000:0.0:1763343275.992658:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7343 00000100:00100000:2.0:1763343275.992783:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399905792:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 5944us (6197us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343275.992791:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3501 00000100:00100000:1.0:1763343275.997764:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343275.997875:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399906432 00000100:00100000:2.0:1763343275.997891:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399906432 00000100:00100000:2.0:1763343276.002291:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3799 00000100:00100000:2.0:1763343276.002318:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57146:x1848998399906432:12345-192.168.201.40@tcp:35:lfs.0 00000004:00010000:2.0:1763343276.002385:0:6528:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x20e:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a3b9b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4984b expref: 307 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.002441:0:6528:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3daf lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343276.002455:0:6528:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a3c04 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4986e expref: 307 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.002465:0:6528:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3daf lrc: 4/0,1 mode: --/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343276.002502:0:6528:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a3c04 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4986e expref: 307 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.002516:0:6528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a3c04 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4986e expref: 307 pid: 6524 timeout: 1169 lvb_type: 0 00000100:00100000:2.0:1763343276.002529:0:6528:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b18000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6528:1848998412985088:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343276.002619:0:6528:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c7ec3480 going to sleep for 11 seconds 00000100:00100000:1.0:1763343276.007352:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.010616:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399906688 00000100:00100000:0.0:1763343276.010633:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399906688 00000100:00100000:0.0:1763343276.010705:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10781 00000100:00100000:0.0:1763343276.010714:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:55884:x1848998399906688:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343276.010735:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.010759:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3db6 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49908 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.010894:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3dbd lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343276.010908:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3dbd lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.010919:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3dbd lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.010928:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3dc4 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343276.010935:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3dc4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.010940:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3dc4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.010995:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3dcb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x211:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343276.011002:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3dcb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.011008:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3dcb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343276.011017:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x211:0x0]: returning size 0 00010000:00010000:0.0:1763343276.011116:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3dbd lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.011124:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3dbd lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.011129:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3dbd lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.011135:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3dbd lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.011141:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508b200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.011146:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3dbd lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.011153:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3dbd lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.011166:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695700) 00010000:00010000:0.0:1763343276.011169:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.011174:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3dbd lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.011181:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3dbd lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.011193:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3dc4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.011199:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3dc4 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.011204:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3dc4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.011208:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.011211:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3dc4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.011217:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3dc4 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.011223:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695800) 00010000:00010000:0.0:1763343276.011225:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.011228:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3dc4 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.011233:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3dc4 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.011279:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3db6 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49908 expref: 311 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.011297:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3dcb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49908 expref: 310 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.011305:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x211:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:0.0:1763343276.011307:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343276.011309:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3916200, rc 0) 00000100:00100000:0.0:1763343276.011376:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:55884:x1848998399906688:12345-192.168.201.40@tcp:101:bash.0 Request processed in 662us (4033us total) trans 4294973713 rc 0/0 00000100:00100000:0.0:1763343276.011383:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10781 00000100:00100000:2.0:1763343276.012214:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.012309:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399906816 00000100:00100000:3.0:1763343276.012318:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399906816 00010000:00010000:3.0:1763343276.012344:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a3c04 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4986e expref: 310 pid: 6524 timeout: 1169 lvb_type: 0 00000100:00100000:3.0:1763343276.012383:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3502 00000100:00100000:3.0:1763343276.012392:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c32b3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:2407:x1848998399906816:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343276.012406:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343276.012412:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a3c04 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4986e expref: 310 pid: 6524 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343276.012422:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a3c04 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4986e expref: 310 pid: 6524 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343276.012441:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:3.0:1763343276.012445:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3daf lrc: 3/0,1 mode: --/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343276.012454:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3daf lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343276.012460:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3daf lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343276.012477:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343276.012513:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c32b3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:2407:x1848998399906816:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 123us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343276.012520:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3502 00010000:00010000:0.0:1763343276.013809:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a3c04 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4986e expref: 309 pid: 6524 timeout: 1169 lvb_type: 0 00000100:00100000:0.0:1763343276.013832:0:6528:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b18000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6528:1848998412985088:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343276.013855:0:6528:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3daf lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.014082:0:6528:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3daf lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.014088:0:6528:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3daf lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT1 00000040:00080000:0.0:1763343276.014376:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1752, 88 off145736 00000004:00080000:0.0:1763343276.014386:0:6528:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1069138361498ns, next at 1070049318579ns, rc = 0 00000040:00080000:0.0:1763343276.014464:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1760, 88 off146392 00000004:00080000:0.0:1763343276.014471:0:6528:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1069138446521ns, next at 1070049115839ns, rc = 0 00000040:00080000:0.0:1763343276.014606:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1761, 88 off146480 00000004:00080000:0.0:1763343276.014612:0:6528:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1069138587051ns, next at 1070049115839ns, rc = 0 00000040:00080000:0.0:1763343276.014728:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1753, 88 off145824 00000004:00080000:0.0:1763343276.014733:0:6528:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1069138708894ns, next at 1070049318579ns, rc = 0 00000100:00100000:1.0:1763343276.015643:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.016006:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399906944 00000100:00100000:3.0:1763343276.016018:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399906944 00000100:00100000:3.0:1763343276.016096:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10782 00000100:00100000:3.0:1763343276.016106:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:55884:x1848998399906944:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343276.016125:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343276.016145:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3dd9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x211:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4990f expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.016179:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3de0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x211:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343276.016193:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3de0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.016205:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3de0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.016310:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3dd9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x211:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4990f expref: 312 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.016327:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3de0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4990f expref: 311 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.016336:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x211:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:3.0:1763343276.016339:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343276.016343:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3a00, rc 0) 00000100:00100000:3.0:1763343276.016402:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:55884:x1848998399906944:12345-192.168.201.40@tcp:101:bash.0 Request processed in 297us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343276.016410:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10782 00000001:00080000:3.0:1763343276.019237:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973714 is committed 00000004:00080000:3.0:1763343276.019259:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1124 committed 00000004:00080000:3.0:1763343276.019266:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1132 committed 00000004:00080000:3.0:1763343276.019282:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1131 committed 00000004:00080000:3.0:1763343276.019284:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1123 committed 00000004:00080000:3.0:1763343276.019303:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1122 committed 00000004:00080000:3.0:1763343276.019306:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1130 committed 00000100:00100000:1.0:1763343276.019617:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412985600:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343276.019689:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.019725:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763343276.019731:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412985216:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343276.019749:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.019778:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412985472:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343276.019797:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.019814:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763343276.019819:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412985344:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343276.019837:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763343276.019980:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3ceb lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343276.019992:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3ceb lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343276.020000:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3ceb lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343276.020007:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.020012:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3ceb lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343276.020019:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3ceb lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343276.020063:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695800) 00010000:00010000:0.0:1763343276.020066:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.020072:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3ceb lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343276.020078:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3ceb lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343276.020098:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3d3f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.020103:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3d3f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.020108:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3d3f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.020112:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.020116:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3d3f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.020121:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3d3f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.020128:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:0.0:1763343276.020131:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.020134:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3d3f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.020139:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a3d3f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.020148:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3d70 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.020153:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3d70 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.020159:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3d70 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.020163:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.020166:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3d70 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.020171:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3d70 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.020178:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695800) 00010000:00010000:0.0:1763343276.020180:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.020183:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3d70 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.020193:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a3d70 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.020210:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3da1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.020216:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3da1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.020222:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3da1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.020227:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd8e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.020230:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3da1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.020235:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3da1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.020241:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:0.0:1763343276.020254:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.020257:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3da1 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.020262:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3da1 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000100:00100000:0.0:1763343276.020291:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412985600 00000100:00100000:0.0:1763343276.020299:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412985600 00000100:00100000:0.0:1763343276.020342:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412985216 00000100:00100000:0.0:1763343276.020345:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412985216 00000100:00100000:0.0:1763343276.020360:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412985472 00000100:00100000:0.0:1763343276.020363:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412985472 00000100:00100000:0.0:1763343276.020375:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412985344 00000100:00100000:0.0:1763343276.020378:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412985344 00000100:00100000:0.0:1763343276.020393:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7344 00000100:00100000:0.0:1763343276.020401:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+24:3661:x1848998412985600:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763343276.020548:0:28561:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2c5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343276.020551:0:28561:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2c5:0x0] updating lvb mtime from disk: 1763343275 -> 1763343275 00002000:00010000:0.0:1763343276.020554:0:28561:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2c5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343276.020556:0:28561:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2c5:0x0] updating lvb ctime from disk: 1763343275 -> 1763343275 00002000:00010000:0.0:1763343276.020558:0:28561:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2c5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343276.020612:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+25:3661:x1848998412985600:12345-0@lo:2:osp-syn-0-1.0 Request processed in 211us (922us total) trans 21474839243 rc 0/0 00000100:00100000:0.0:1763343276.020620:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7344 00000100:00100000:0.0:1763343276.020637:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7345 00000100:00100000:0.0:1763343276.020643:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+24:3661:x1848998412985216:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763343276.020656:0:28561:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:710 count 1 00000100:00100000:1.0:1763343276.021099:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7346 00000100:00100000:1.0:1763343276.021111:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+24:3660:x1848998412985472:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1763343276.021181:0:8626:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2c4:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763343276.021184:0:8626:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2c4:0x0] updating lvb mtime from disk: 1763343275 -> 1763343275 00002000:00010000:1.0:1763343276.021186:0:8626:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2c4:0x0] updating lvb atime from disk: 1763343274 -> 1763343274 00002000:00010000:1.0:1763343276.021188:0:8626:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2c4:0x0] updating lvb ctime from disk: 1763343275 -> 1763343275 00002000:00010000:1.0:1763343276.021190:0:8626:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2c4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343276.021268:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412985728:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343276.021305:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343276.021358:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412985728 00000100:00100000:3.0:1763343276.021363:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412985728 00000100:00100000:3.0:1763343276.021390:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7347 00000100:00100000:3.0:1763343276.021396:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+25:3660:x1848998412985344:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343276.021409:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:711 count 1 00002000:00010000:3.0:1763343276.021433:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343276.021439:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3de7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.021451:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343276.021453:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343276.021459:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3de7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.021472:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3de7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.021479:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3de7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.021485:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3de7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.021502:0:35266:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343276.022163:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+26:3660:x1848998412985472:12345-0@lo:2:osp-syn-0-1.0 Request processed in 1055us (2363us total) trans 21474839244 rc 0/0 00000100:00100000:1.0:1763343276.022172:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7346 00000100:00100000:1.0:1763343276.022192:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7348 00000100:00100000:1.0:1763343276.022199:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1848998412985728:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343276.022214:0:8626:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:711 count 1 00010000:00010000:1.0:1763343276.022231:0:8626:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3dee lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.022354:0:8626:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a3ca5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498ad expref: 14 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.022362:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343276.022363:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343276.022366:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3dee lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.022395:0:8626:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a3ca5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498ad expref: 14 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.022409:0:8626:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a3ca5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498ad expref: 14 pid: 8412 timeout: 1169 lvb_type: 0 00000100:00100000:1.0:1763343276.022427:0:8626:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9dc9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998412986112:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343276.023224:0:28561:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c3917000/0x9104b1ba770a3df5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.023241:0:28561:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a3cac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498b4 expref: 20 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.023259:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343276.023261:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343276.023264:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3917000/0x9104b1ba770a3df5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.023291:0:28561:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a3cac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498b4 expref: 20 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.023307:0:28561:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a3cac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498b4 expref: 20 pid: 8412 timeout: 1169 lvb_type: 0 00000100:00100000:0.0:1763343276.023318:0:28561:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28561:1848998412986240:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343276.023547:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+25:3660:x1848998412985344:12345-0@lo:6:osp-syn-0-1.0 Request processed in 2149us (3706us total) trans 21474839245 rc 0/0 00000100:00100000:3.0:1763343276.023556:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7347 00000100:00100000:3.0:1763343276.023625:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412985856:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343276.023974:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763343276.023987:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412986368:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343276.024098:0:8626:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c4532cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343276.024127:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412985984:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343276.024186:0:28561:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c926a180 going to sleep for 11 seconds 00010000:00010000:0.0:1763343276.024200:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343276.024207:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3de7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.024216:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343276.024220:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3de7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.024230:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3de7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.024258:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3de7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.024265:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3de7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.024285:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343276.024286:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343276.024288:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343276.024331:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c390d880/2, rc 0, transno 21474839243 00000100:00100000:0.0:1763343276.024337:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412985600:0@lo:2:osp-syn-0-1.0 00000004:00010000:0.0:1763343276.024380:0:6528:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004b2057f3 reply state 00000000be319d7e transno 4294973714 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3daf lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.024395:0:6528:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3daf lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.024404:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:0.0:1763343276.024407:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763343276.024411:0:6528:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343276.024416:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:0.0:1763343276.024419:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343276.024425:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a3b9b lrc: 0/0,0 mode: --/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4984b expref: 296 pid: 7641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343276.024637:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.024807:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1763343276.024846:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c390c700/2, rc 0, transno 21474839245 00000100:00100000:1.0:1763343276.024851:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412985344:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1763343276.024873:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c390f800/2, rc 0, transno 21474839244 00000100:00100000:1.0:1763343276.024876:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412985472:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343276.024943:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.025088:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399907200 00000100:00100000:1.0:1763343276.025094:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399907200 00000100:00100000:1.0:1763343276.025138:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10783 00000100:00100000:1.0:1763343276.025146:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:55884:x1848998399907200:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:1.0:1763343276.025191:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343276.025210:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a3dcb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49908 expref: 297 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.025223:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x211:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:1.0:1763343276.025228:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343276.025414:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3dfc lrc: 3/0,1 mode: --/PW res: [0x240000404:0x211:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343276.025425:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3dfc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x211:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343276.025436:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3dfc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x211:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000001:00080000:1.0:1763343276.025484:0:7641:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973715 00000004:00010000:1.0:1763343276.025503:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000fde5d24 reply state 00000000b61a5a32 transno 4294973716 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3dfc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x211:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343276.025513:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3dfc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x211:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343276.025519:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x211:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:1.0:1763343276.025522:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343276.025524:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343276.025586:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:55884:x1848998399907200:12345-192.168.201.40@tcp:36:bash.0 Request processed in 439us (642us total) trans 4294973716 rc 0/0 00000100:00100000:1.0:1763343276.025592:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10783 00000020:00080000:1.0:1763343276.025596:0:7641:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763343276.025698:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412986368 00000100:00100000:2.0:1763343276.025703:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412986368 00000100:00100000:2.0:1763343276.025735:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412985984 00000100:00100000:2.0:1763343276.025739:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412985984 00000100:00100000:2.0:1763343276.025757:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7349 00000100:00100000:2.0:1763343276.025763:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3662:x1848998412986368:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1763343276.025846:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2c6:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763343276.025849:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2c6:0x0] updating lvb mtime from disk: 1763343275 -> 1763343275 00002000:00010000:2.0:1763343276.025852:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2c6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343276.025853:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2c6:0x0] updating lvb ctime from disk: 1763343275 -> 1763343275 00002000:00010000:2.0:1763343276.025856:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2c6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763343276.025891:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+8:3662:x1848998412986368:12345-0@lo:2:osp-syn-1-1.0 Request processed in 127us (1253us total) trans 17179871972 rc 0/0 00000100:00100000:2.0:1763343276.025898:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7349 00000100:00100000:2.0:1763343276.025910:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7350 00000100:00100000:2.0:1763343276.025915:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3660:x1848998412985984:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1763343276.025961:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2c5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343276.025965:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2c5:0x0] updating lvb mtime from disk: 1763343275 -> 1763343275 00002000:00010000:2.0:1763343276.025967:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2c5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343276.025968:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2c5:0x0] updating lvb ctime from disk: 1763343275 -> 1763343275 00002000:00010000:2.0:1763343276.025970:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2c5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343276.026000:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+8:3660:x1848998412985984:12345-0@lo:2:osp-syn-1-1.0 Request processed in 84us (1193us total) trans 17179871973 rc 0/0 00000100:00100000:2.0:1763343276.026006:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7350 00000100:00100000:2.0:1763343276.026067:0:3662:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179871968 gen 2 00000004:00080000:2.0:1763343276.026073:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bfe680, transno 17179871929 00000004:00080000:2.0:1763343276.026081:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bff800, transno 17179871930 00000004:00080000:2.0:1763343276.026083:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bfc380, transno 17179871931 00000004:00080000:2.0:1763343276.026086:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bfce00, transno 17179871932 00000004:00080000:2.0:1763343276.026088:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6b56a00, transno 17179871933 00000004:00080000:2.0:1763343276.026091:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c2f84380, transno 17179871934 00000004:00080000:2.0:1763343276.026093:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c2f85180, transno 17179871935 00000004:00080000:2.0:1763343276.026095:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c2f84700, transno 17179871936 00000004:00080000:2.0:1763343276.026097:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c2f84a80, transno 17179871938 00000004:00080000:2.0:1763343276.026101:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc2ce00, transno 17179871939 00000004:00080000:2.0:1763343276.026103:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9dc8700, transno 17179871940 00000004:00080000:2.0:1763343276.026106:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9dc9500, transno 17179871941 00000004:00080000:2.0:1763343276.026108:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c4789180, transno 17179871944 00000004:00080000:2.0:1763343276.026110:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c4789880, transno 17179871945 00000004:00080000:2.0:1763343276.026113:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c511ed80, transno 17179871946 00000004:00080000:2.0:1763343276.026115:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c511d500, transno 17179871947 00000004:00080000:2.0:1763343276.026117:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b2d500, transno 17179871951 00000004:00080000:2.0:1763343276.026120:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c514d880, transno 17179871952 00000004:00080000:2.0:1763343276.026122:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b2e300, transno 17179871953 00000004:00080000:2.0:1763343276.026124:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b2dc00, transno 17179871954 00000004:00080000:2.0:1763343276.026126:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6506680, transno 17179871955 00000004:00080000:2.0:1763343276.026128:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c4b21f80, transno 17179871956 00000004:00080000:2.0:1763343276.026130:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6504000, transno 17179871957 00000004:00080000:2.0:1763343276.026133:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6507b80, transno 17179871958 00000004:00080000:2.0:1763343276.026135:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5dc8a80, transno 17179871960 00000004:00080000:2.0:1763343276.026137:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5dc8700, transno 17179871961 00000004:00080000:2.0:1763343276.026139:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5dcb100, transno 17179871962 00000004:00080000:2.0:1763343276.026141:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5dcb480, transno 17179871963 00000004:00080000:2.0:1763343276.026144:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6e8e300, transno 17179871965 00000004:00080000:2.0:1763343276.026146:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6e8d880, transno 17179871966 00000004:00080000:2.0:1763343276.026149:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b2a300, transno 17179871967 00000004:00080000:2.0:1763343276.026151:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b29500, transno 17179871968 00000100:00100000:2.0:1763343276.026157:0:3662:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9400c5b19180 x1848998412986368/t17179871972(17179871972) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763343292 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1763343276.026166:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b19180/2, rc 0, transno 17179871972 00000100:00100000:2.0:1763343276.026170:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412986368:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1763343276.026191:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b19c00/2, rc 0, transno 17179871973 00000100:00100000:2.0:1763343276.026194:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412985984:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1763343276.026382:0:9930:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 4 in progress, 2 in flight, 32 done 00010000:00080000:0.0:1763343276.027957:0:6528:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763343276.027983:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57146:x1848998399906432:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 25674us (30224us total) trans 4294973714 rc 0/0 00000100:00100000:0.0:1763343276.027995:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3799 00010000:00010000:0.0:1763343276.028056:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3daf lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.028067:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3daf lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.028074:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3daf lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.028081:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd9a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.028085:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3daf lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.028098:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3daf lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.028114:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:0.0:1763343276.028117:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343276.028121:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3daf lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.028127:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a3daf lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT1 00000100:00100000:3.0:1763343276.030111:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.030111:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9dc9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998412986112:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343276.030143:0:8626:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3dee lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343276.030216:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412985856 00000100:00100000:0.0:1763343276.030225:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412985856 00000100:00100000:0.0:1763343276.030289:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7351 00000100:00100000:0.0:1763343276.030299:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:3659:x1848998412985856:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763343276.030325:0:27798:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:712 count 1 00002000:00010000:0.0:1763343276.030432:0:27798:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343276.030441:0:27798:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3e03 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.030456:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.030459:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.030466:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3e03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.030480:0:27798:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3e03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.030495:0:27798:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3e03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.030504:0:27798:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3e03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.030527:0:27798:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343276.030537:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343276.030546:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3e03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.030554:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917a00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343276.030558:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3e03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.030567:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3e03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.030583:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3e03 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.030591:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a3e03 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.030612:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343276.030614:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343276.030616:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343276.030777:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+9:3659:x1848998412985856:12345-0@lo:6:osp-syn-1-1.0 Request processed in 478us (668us total) trans 17179871974 rc 0/0 00000100:00100000:0.0:1763343276.030784:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7351 00000004:00080000:3.0:1763343276.031077:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b1a680/2, rc 0, transno 17179871974 00000100:00100000:3.0:1763343276.031085:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412985856:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343276.032468:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.032502:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.032636:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399907328 00000100:00100000:2.0:1763343276.032645:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399907328 00010000:00010000:2.0:1763343276.032679:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a3ca5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498ad expref: 15 pid: 8412 timeout: 1169 lvb_type: 0 00000100:00100000:2.0:1763343276.032719:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399907456 00000100:00100000:2.0:1763343276.032723:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399907456 00000100:00100000:0.0:1763343276.032737:0:28561:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28561:1848998412986240:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343276.032740:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a3cac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498b4 expref: 21 pid: 8412 timeout: 1169 lvb_type: 0 00000100:00100000:2.0:1763343276.032767:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3503 00000100:00100000:2.0:1763343276.032777:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998399907328:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343276.032786:0:28561:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c3917000/0x9104b1ba770a3df5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.032793:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343276.032801:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a3ca5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498ad expref: 15 pid: 8412 timeout: 1169 lvb_type: 0 00010000:00010000:2.0:1763343276.032817:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a3ca5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498ad expref: 15 pid: 8412 timeout: 1169 lvb_type: 0 00000100:00100000:3.0:1763343276.032818:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3504 00000100:00100000:3.0:1763343276.032833:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399907456:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343276.032845:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343276.032846:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a3ca5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498ad expref: 15 pid: 8412 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343276.032855:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a3cac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498b4 expref: 21 pid: 8412 timeout: 1169 lvb_type: 0 00010000:00010000:2.0:1763343276.032878:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.032881:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.032886:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3dee lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.032896:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3dee lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.032924:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a3cac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498b4 expref: 21 pid: 8412 timeout: 1169 lvb_type: 0 00010000:00010000:2.0:1763343276.032927:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343276.032944:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a3cac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498b4 expref: 21 pid: 8412 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343276.032955:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343276.032957:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343276.032960:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c3917000/0x9104b1ba770a3df5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.032969:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3917000/0x9104b1ba770a3df5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343276.032980:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399907328:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 203us (516us total) trans 0 rc 0/0 00010000:00010000:0.0:1763343276.032981:0:8626:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3dee lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.032988:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343276.032995:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3503 00010000:00010000:0.0:1763343276.032995:0:8626:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3dee lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.033007:0:8626:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3dee lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343276.033012:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2408:x1848998399907456:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 183us (508us total) trans 0 rc 0/0 00010000:00010000:0.0:1763343276.033016:0:8626:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3dee lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343276.033019:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3504 00010000:00010000:0.0:1763343276.033057:0:8626:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343276.033086:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343276.033093:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3dee lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.033101:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343276.033105:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3dee lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.033114:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3dee lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.033125:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3dee lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.033133:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a3dee lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.033149:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343276.033151:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343276.033152:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343276.033307:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3662:x1848998412985728:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11107us (11999us total) trans 17179871975 rc 0/0 00000100:00100000:0.0:1763343276.033319:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7348 00010000:00010000:0.0:1763343276.033343:0:28561:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c3917000/0x9104b1ba770a3df5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.033351:0:28561:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c3917000/0x9104b1ba770a3df5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.033360:0:28561:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c3917000/0x9104b1ba770a3df5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.033367:0:28561:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3917000/0x9104b1ba770a3df5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.033388:0:28561:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343276.033508:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343276.033515:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c3917000/0x9104b1ba770a3df5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343276.033515:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+25:3661:x1848998412985216:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12871us (13763us total) trans 21474839246 rc 0/0 00000100:00100000:0.0:1763343276.033522:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7345 00010000:00010000:3.0:1763343276.033523:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343276.033526:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c3917000/0x9104b1ba770a3df5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.033539:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c3917000/0x9104b1ba770a3df5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.033549:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c3917000/0x9104b1ba770a3df5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.033555:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c3917000/0x9104b1ba770a3df5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1763343276.033561:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c390ea00/2, rc 0, transno 21474839246 00000100:00100000:0.0:1763343276.033566:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412985216:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1763343276.033567:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343276.033569:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343276.033571:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763343276.034679:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b1a300/2, rc 0, transno 17179871975 00000100:00100000:2.0:1763343276.034691:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412985728:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343276.038978:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.039118:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.039589:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399907584 00000100:00100000:1.0:1763343276.039601:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399907584 00000100:00100000:0.0:1763343276.040431:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399907712 00000100:00100000:0.0:1763343276.040438:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399907712 00000100:00100000:3.0:1763343276.040447:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10784 00000100:00100000:0.0:1763343276.040485:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10785 00000100:00100000:0.0:1763343276.040493:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:55884:x1848998399907712:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343276.040517:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.040537:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a3e0a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x211:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4991d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.040598:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a3e0a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x211:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4991d expref: 299 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.040612:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a3e0a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x211:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4991d expref: 299 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.040629:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x211:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:0.0:1763343276.040633:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343276.040636:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c589ba00, rc 0) 00000100:00100000:0.0:1763343276.040703:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:55884:x1848998399907712:12345-192.168.201.40@tcp:101:bash.0 Request processed in 211us (1585us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.040710:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10785 00000100:00100000:2.0:1763343276.040785:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57146:x1848998399907584:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343276.040794:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.040803:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3e11 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49916 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.040829:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3e11 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49916 expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.040838:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c0030200/0x9104b1ba770a3e11 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x20e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49916 expref: 299 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.040848:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:2.0:1763343276.040850:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343276.040853:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c0030200, rc 0) 00000100:00100000:2.0:1763343276.040950:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57146:x1848998399907584:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 491us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.040959:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10784 00000100:00100000:0.0:1763343276.051921:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.052058:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.052152:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399908224 00000100:00100000:1.0:1763343276.052163:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399908224 00000100:00100000:1.0:1763343276.054009:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10786 00000100:00100000:1.0:1763343276.054050:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:55884:x1848998399908224:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343276.054073:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343276.054076:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343276.054105:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589ba00/0x9104b1ba770a3e0a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x211:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4991d expref: 299 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.054126:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x211:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:1.0:1763343276.054132:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343276.054147:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a3e18 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x211:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49924 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.054197:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a3e1f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x211:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343276.054212:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a3e1f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x211:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.054221:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a3e1f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x211:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000040:00080000:1.0:1763343276.054456:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1754, 88 off145912 00000004:00080000:1.0:1763343276.054464:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1069178438733ns, next at 1070049318579ns, rc = 0 00000040:00080000:1.0:1763343276.054507:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1762, 88 off146568 00000004:00080000:1.0:1763343276.054513:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1069178487855ns, next at 1070049115839ns, rc = 0 00000040:00080000:1.0:1763343276.054568:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1763, 88 off146656 00000004:00080000:1.0:1763343276.054573:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1069178548304ns, next at 1070049115839ns, rc = 0 00000040:00080000:1.0:1763343276.054590:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1755, 88 off146000 00000004:00080000:1.0:1763343276.054596:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1069178571079ns, next at 1070049318579ns, rc = 0 00000100:00100000:2.0:1763343276.054912:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399907968 00000100:00100000:2.0:1763343276.054922:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399907968 00000100:00100000:2.0:1763343276.054968:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3800 00000100:00100000:2.0:1763343276.054977:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57146:x1848998399907968:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:0.0:1763343276.057219:0:6528:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x20e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763343276.057318:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1756, 64 off146064 00000040:00080000:0.0:1763343276.057342:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1764, 64 off146720 00000040:00080000:0.0:1763343276.057353:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1765, 64 off146784 00000040:00080000:0.0:1763343276.057361:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1757, 64 off146128 00010000:00010000:0.0:1763343276.057436:0:6528:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a3e26 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 00010000:00010000:0.0:1763343276.057454:0:6528:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a3e26 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.057469:0:6528:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a3e26 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.057477:0:6528:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a3e26 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.057484:0:6528:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a3e26 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.057489:0:6528:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a3e26 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.057517:0:6528:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343276.057727:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57146:x1848998399907968:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 2745us (5810us total) trans 4294973718 rc 0/0 00000100:00100000:0.0:1763343276.057737:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3800 00010000:00010000:2.0:1763343276.058108:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343276.058115:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a3e26 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343276.058122:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c589be00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343276.058125:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a3e26 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343276.058132:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a3e26 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343276.058144:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x20e:0x0].0x0 (ffff9401f6696f00) 00010000:00010000:2.0:1763343276.058146:0:7451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763343276.058151:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a3e26 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343276.058157:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c589be00/0x9104b1ba770a3e26 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343276.058168:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343276.058170:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343276.058171:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1763343276.059916:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973717 is committed 00000004:00080000:2.0:1763343276.059928:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1126 committed 00000004:00080000:2.0:1763343276.059939:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1134 committed 00000004:00080000:2.0:1763343276.059950:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1133 committed 00000004:00080000:2.0:1763343276.059952:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1125 committed 00000100:00100000:2.0:1763343276.060080:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763343276.060098:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412986496:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343276.060156:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343276.060191:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c514d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412986624:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343276.060209:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.060350:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763343276.060357:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9dc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412986752:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343276.060383:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.060407:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6280380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412986880:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343276.060426:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.060457:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412986496 00000100:00100000:1.0:1763343276.060465:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412986496 00000100:00100000:1.0:1763343276.060511:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412986624 00000100:00100000:1.0:1763343276.060514:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412986624 00000100:00100000:1.0:1763343276.060531:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412986752 00000100:00100000:1.0:1763343276.060534:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412986752 00000100:00100000:1.0:1763343276.060550:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412986880 00000100:00100000:1.0:1763343276.060554:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412986880 00000100:00100000:1.0:1763343276.060573:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7352 00000100:00100000:1.0:1763343276.060581:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+10:3661:x1848998412986496:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343276.060760:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+11:3661:x1848998412986496:12345-0@lo:2:osp-syn-1-1.0 Request processed in 179us (602us total) trans 17179871976 rc 0/0 00000100:00100000:1.0:1763343276.060767:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7352 00000100:00100000:1.0:1763343276.060785:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7353 00000100:00100000:1.0:1763343276.060791:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+10:3659:x1848998412986624:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343276.060866:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+11:3659:x1848998412986624:12345-0@lo:2:osp-syn-1-1.0 Request processed in 74us (655us total) trans 17179871977 rc 0/0 00000100:00100000:1.0:1763343276.060871:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7353 00000100:00100000:1.0:1763343276.060885:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7354 00000100:00100000:1.0:1763343276.060890:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+26:3659:x1848998412986752:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343276.060977:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+27:3659:x1848998412986752:12345-0@lo:2:osp-syn-0-1.0 Request processed in 86us (591us total) trans 21474839247 rc 0/0 00000100:00100000:1.0:1763343276.060983:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7354 00000100:00100000:1.0:1763343276.060995:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7355 00000100:00100000:1.0:1763343276.061002:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+26:3661:x1848998412986880:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343276.061093:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+27:3661:x1848998412986880:12345-0@lo:2:osp-syn-0-1.0 Request processed in 91us (665us total) trans 21474839248 rc 0/0 00000100:00100000:1.0:1763343276.061099:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7355 00000004:00080000:1.0:1763343276.061148:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c9dc9500/2, rc 0, transno 21474839247 00000100:00100000:1.0:1763343276.061157:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9dc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412986752:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763343276.061167:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c514d880/2, rc 0, transno 17179871977 00000100:00100000:1.0:1763343276.061174:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c514d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412986624:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763343276.061198:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6280380/2, rc 0, transno 21474839248 00000100:00100000:1.0:1763343276.061205:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6280380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412986880:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763343276.061215:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b18000/2, rc 0, transno 17179871976 00000100:00100000:1.0:1763343276.061218:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412986496:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1763343276.061296:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a3e1f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x211:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49924 expref: 299 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.061311:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x211:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:1.0:1763343276.061314:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343276.061332:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a3e18 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x211:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49924 expref: 299 pid: 33856 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343276.061350:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a3e1f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x211:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49924 expref: 298 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.061374:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x211:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:1.0:1763343276.061377:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343276.061380:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177a00, rc 0) 00000100:00100000:1.0:1763343276.061422:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:55884:x1848998399908224:12345-192.168.201.40@tcp:101:bash.0 Request processed in 7403us (9400us total) trans 4294973717 rc 0/0 00000100:00100000:1.0:1763343276.061429:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10786 00010000:00010000:3.0:1763343276.062312:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3dfc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x211:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.062324:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3dfc lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x211:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.062330:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3dfc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x211:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.062336:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343276.062340:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3dfc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x211:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.062347:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3dfc lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x211:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.062360:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x211:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:3.0:1763343276.062364:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343276.062368:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3dfc lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x211:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.062374:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a3dfc lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x211:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343276.062585:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.062651:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399908480 00000100:00100000:0.0:1763343276.062660:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399908480 00000100:00100000:0.0:1763343276.062713:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10787 00000100:00100000:0.0:1763343276.062723:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57146:x1848998399908480:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343276.062747:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.062770:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3e2d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4992b expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.062863:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3e34 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343276.062875:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3e34 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.062885:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3e34 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.062897:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3e3b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343276.062903:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3e3b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.062909:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3e3b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.063064:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a3e42 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x211:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343276.063073:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a3e42 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.063080:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a3e42 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:0.0:1763343276.063090:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x211:0x0]: returning size 2 00010000:00010000:0.0:1763343276.063157:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3e34 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.063168:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3e34 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.063174:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3e34 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.063179:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508be00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.063182:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3e34 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.063188:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3e34 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.063197:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695800) 00010000:00010000:0.0:1763343276.063199:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.063203:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3e34 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.063213:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3e34 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.063224:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3e3b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.063229:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3e3b lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.063234:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3e3b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.063238:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508b200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.063241:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3e3b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.063256:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3e3b lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.063263:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695200) 00010000:00010000:0.0:1763343276.063265:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.063267:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3e3b lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.063273:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3e3b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.063312:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3e2d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4992b expref: 300 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.063327:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a3e42 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4992b expref: 299 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.063345:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x211:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:0.0:1763343276.063348:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343276.063350:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e91e00, rc 0) 00000100:00100000:0.0:1763343276.063401:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57146:x1848998399908480:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 680us (820us total) trans 4294973719 rc 0/0 00000100:00100000:0.0:1763343276.063407:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10787 00000100:00100000:1.0:1763343276.079370:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.079417:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.080349:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399908608 00000100:00100000:2.0:1763343276.080360:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399908608 00000100:00100000:2.0:1763343276.080414:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399908736 00000100:00100000:2.0:1763343276.080417:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399908736 00000100:00100000:2.0:1763343276.080443:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7356 00000100:00100000:2.0:1763343276.080452:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:55884:x1848998399908608:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343276.080470:0:8626:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.080492:0:8626:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a3e50 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49932 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343276.080515:0:8626:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343276.080537:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.080539:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.080548:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a3e50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49932 expref: 22 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.080564:0:8626:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a3e50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49932 expref: 22 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.080577:0:8626:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a7200, rc 0) 00000100:00100000:2.0:1763343276.080633:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:55884:x1848998399908608:12345-192.168.201.40@tcp:101:bash.0 Request processed in 181us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.080641:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7356 00000100:00100000:2.0:1763343276.080659:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7357 00000100:00100000:2.0:1763343276.080666:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399908736:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343276.080672:0:8626:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.080680:0:8626:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a3e57 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49939 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343276.080726:0:8626:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8626:1848998412987008:192.168.201.40@tcp:106: 00000100:00100000:2.0:1763343276.080778:0:8626:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c7ec3480 going to sleep for 11 seconds 00000100:00100000:3.0:1763343276.086258:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.086708:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399908864 00000100:00100000:1.0:1763343276.086718:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399908864 00000100:00100000:1.0:1763343276.086782:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7358 00000100:00100000:1.0:1763343276.086793:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:55884:x1848998399908864:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343276.086812:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343276.086834:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a3e5e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49940 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343276.086858:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343276.086880:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.086882:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.086891:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a3e5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49940 expref: 15 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.086907:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a3e5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49940 expref: 15 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.086919:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177200, rc 0) 00000100:00100000:1.0:1763343276.086984:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:55884:x1848998399908864:12345-192.168.201.40@tcp:101:bash.0 Request processed in 192us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.086992:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7358 00002000:00010000:2.0:1763343276.087152:0:8626:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x2c8:0x0] updating lvb mtime: 0 -> 1763343275 00002000:00010000:2.0:1763343276.087156:0:8626:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x2c8:0x0] updating lvb atime: 0 -> 1763343275 00002000:00010000:2.0:1763343276.087158:0:8626:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x2c8:0x0] updating lvb ctime: 0 -> 1763343275 00000100:00100000:2.0:1763343276.087278:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8626:1848998412987008:192.168.201.40@tcp:106: 00010000:00010000:2.0:1763343276.087315:0:8626:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a3e57 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x2c8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49939 expref: 22 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343276.087338:0:8626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a3e57 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2c8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49939 expref: 22 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343276.087352:0:8626:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a6a00, rc 0) 00000100:00100000:2.0:1763343276.087392:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399908736:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 6727us (7974us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343276.087399:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7357 00000100:00100000:3.0:1763343276.093436:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.093614:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399908992 00000100:00100000:1.0:1763343276.093625:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399908992 00002000:00010000:1.0:1763343276.093666:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/712 (0->18446744073709551615) 00002000:00100000:1.0:1763343276.093672:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c8599880 with x1848998399908992 ext(0->18446744073709551615) 00000100:00100000:3.0:1763343276.093673:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00002000:00010000:1.0:1763343276.093687:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9401c8599880. 00000100:00100000:1.0:1763343276.094012:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399909120 00000100:00100000:1.0:1763343276.094017:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399909120 00000100:00100000:0.0:1763343276.094065:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1751 00002000:00010000:1.0:1763343276.094070:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/713 (0->18446744073709551615) 00002000:00100000:1.0:1763343276.094074:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c859a680 with x1848998399909120 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343276.094082:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401c859a680. 00000100:00100000:0.0:1763343276.094344:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399908992:12345-192.168.201.40@tcp:10:bash.0 00000100:00100000:1.0:1763343276.094505:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1752 00002000:00010000:0.0:1763343276.094512:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2c8:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1763343276.094518:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998399909120:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:0.0:1763343276.094519:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2c8:0x0] updating lvb mtime from disk: 1763343275 -> 1763343275 00002000:00010000:1.0:1763343276.094617:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2c9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343276.094620:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2c9:0x0] updating lvb mtime from disk: 0 -> 1763343275 00002000:00010000:1.0:1763343276.094622:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2c9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343276.094624:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2c9:0x0] updating lvb ctime from disk: 0 -> 1763343275 00002000:00010000:1.0:1763343276.094627:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2c9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343276.094688:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399909120:12345-192.168.201.40@tcp:10:bash.0 Request processed in 174us (1016us total) trans 17179871978 rc 0/0 00000100:00100000:1.0:1763343276.094696:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1752 00002000:00010000:1.0:1763343276.094701:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/713 (0->18446744073709551615) 00002000:00100000:1.0:1763343276.094703:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c859a680 with x1848998399909120 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343276.094707:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401c859a680. 00002000:00010000:0.0:1763343276.095135:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2c8:0x0] updating lvb atime from disk: 1763343275 -> 0 00002000:00010000:0.0:1763343276.095141:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2c8:0x0] updating lvb ctime from disk: 1763343275 -> 1763343275 00002000:00010000:0.0:1763343276.095144:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2c8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343276.095292:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.095342:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399909376 00000100:00100000:1.0:1763343276.095350:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399909376 00000100:00100000:1.0:1763343276.095396:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3801 00000100:00100000:1.0:1763343276.095404:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8546850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57146:x1848998399909376:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343276.096010:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399908992:12345-192.168.201.40@tcp:10:bash.0 Request processed in 1668us (2580us total) trans 21474839249 rc 0/0 00000100:00100000:0.0:1763343276.096020:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1751 00002000:00010000:0.0:1763343276.096051:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/712 (0->18446744073709551615) 00002000:00100000:0.0:1763343276.096055:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c8599880 with x1848998399908992 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343276.096063:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9401c8599880. 00000100:00100000:1.0:1763343276.096883:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8546850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57146:x1848998399909376:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1476us (1588us total) trans 4294973720 rc 0/0 00000100:00100000:1.0:1763343276.096893:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3801 00000100:00100000:3.0:1763343276.111232:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.111290:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.111958:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399909888 00000100:00100000:0.0:1763343276.111969:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399909888 00000100:00100000:0.0:1763343276.112058:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10788 00000100:00100000:0.0:1763343276.112070:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57146:x1848998399909888:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343276.112093:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.112114:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a3e65 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x211:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49947 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.112227:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3e6c lrc: 3/0,1 mode: --/CW res: [0x240000404:0x211:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343276.112253:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a3e42 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4992b expref: 301 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.112263:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3e6c lrc: 4/0,1 mode: --/CW res: [0x240000404:0x211:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.112295:0:9827:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a3e42 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4992b expref: 301 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.112307:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a3e42 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4992b expref: 301 pid: 33856 timeout: 1169 lvb_type: 0 00000100:00100000:0.0:1763343276.112321:0:9827:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b29500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412987136:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343276.112469:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399909632 00000100:00100000:1.0:1763343276.112475:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399909632 00000100:00100000:1.0:1763343276.112506:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3802 00000100:00100000:1.0:1763343276.112514:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:55884:x1848998399909632:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:0.0:1763343276.112815:0:9827:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc440a80 going to sleep for 11 seconds 00000100:00100000:1.0:1763343276.113012:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:55884:x1848998399909632:12345-192.168.201.40@tcp:35:bash.0 Request processed in 497us (1720us total) trans 4294973721 rc 0/0 00000100:00100000:1.0:1763343276.113019:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3802 00000100:00100000:3.0:1763343276.115737:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.115872:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399910016 00000100:00100000:1.0:1763343276.115882:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399910016 00010000:00010000:1.0:1763343276.115924:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a3e42 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4992b expref: 303 pid: 33856 timeout: 1169 lvb_type: 0 00000100:00100000:1.0:1763343276.115976:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3505 00000100:00100000:1.0:1763343276.115987:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:2409:x1848998399910016:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343276.116003:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343276.116010:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a3e42 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4992b expref: 303 pid: 33856 timeout: 1169 lvb_type: 0 00010000:00010000:1.0:1763343276.116077:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a3e42 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4992b expref: 303 pid: 33856 timeout: 1169 lvb_type: 0 00010000:00010000:1.0:1763343276.116204:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x211:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:1.0:1763343276.116210:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3e6c lrc: 3/0,1 mode: --/CW res: [0x240000404:0x211:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.116221:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3e6c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x211:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.116229:0:7904:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3e6c lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x211:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.116260:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343276.116427:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a3e42 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4992b expref: 303 pid: 33856 timeout: 1169 lvb_type: 0 00000100:00100000:0.0:1763343276.116445:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b29500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412987136:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343276.116466:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3e6c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x211:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.116475:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3e6c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x211:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.116481:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3e6c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x211:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:0.0:1763343276.116506:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x211:0x0]: returning size 2 00010000:00010000:0.0:1763343276.116722:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a3e65 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x211:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49947 expref: 304 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.116739:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3e6c lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x211:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49947 expref: 303 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.116746:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x211:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:0.0:1763343276.116749:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1763343276.116752:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c508b200, rc 0) 00000100:00100000:1.0:1763343276.116949:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:2409:x1848998399910016:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 962us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.116958:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3505 00000100:00100000:0.0:1763343276.118323:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57146:x1848998399909888:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 6248us (7093us total) trans 4294973722 rc 0/0 00000100:00100000:0.0:1763343276.118334:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10788 00000100:00100000:3.0:1763343276.123429:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.123884:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399910144 00000100:00100000:1.0:1763343276.123896:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399910144 00000100:00100000:1.0:1763343276.123958:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3803 00000100:00100000:1.0:1763343276.123969:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57146:x1848998399910144:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:1.0:1763343276.124172:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57146:x1848998399910144:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 204us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.124181:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3803 00000100:00100000:2.0:1763343276.125067:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.125141:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399910272 00000100:00100000:0.0:1763343276.125149:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399910272 00000100:00100000:0.0:1763343276.125192:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10789 00000100:00100000:0.0:1763343276.125201:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57151:x1848998399910272:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:0.0:1763343276.125214:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.125237:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3e7a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4994e expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.125321:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3e81 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343276.125336:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3e81 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.125347:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3e81 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.125360:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a3e88 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343276.125367:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a3e88 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.125374:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a3e88 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.125442:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a3e8f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x211:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343276.125453:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3e6c lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x211:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49947 expref: 303 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.125461:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a3e8f lrc: 4/1,0 mode: --/PR res: [0x240000404:0x211:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.125492:0:9827:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3e6c lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x211:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49947 expref: 303 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.125505:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3e6c lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x211:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49947 expref: 303 pid: 9827 timeout: 1169 lvb_type: 0 00000100:00100000:0.0:1763343276.125517:0:9827:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b29500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412987264:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343276.125585:0:9827:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c926a180 going to sleep for 11 seconds 00000100:00100000:0.0:1763343276.129143:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b29500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412987264:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343276.129176:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a3e8f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x211:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:2.0:1763343276.130544:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.130724:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399910400 00000100:00100000:1.0:1763343276.130733:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399910400 00010000:00010000:1.0:1763343276.130774:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3e6c lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x211:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49947 expref: 304 pid: 9827 timeout: 1169 lvb_type: 0 00000100:00100000:1.0:1763343276.130810:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3506 00000100:00100000:1.0:1763343276.130820:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:2407:x1848998399910400:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343276.130838:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343276.130844:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3e6c lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x211:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49947 expref: 304 pid: 9827 timeout: 1169 lvb_type: 0 00010000:00010000:1.0:1763343276.130861:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3e6c lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x211:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49947 expref: 304 pid: 9827 timeout: 1169 lvb_type: 0 00010000:00010000:1.0:1763343276.130884:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a3e6c lrc: 0/0,0 mode: --/CW res: [0x240000404:0x211:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49947 expref: 304 pid: 9827 timeout: 1169 lvb_type: 0 00010000:00010000:1.0:1763343276.130902:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x211:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:1.0:1763343276.130907:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a3e8f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x211:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.130917:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a3e8f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.130924:0:7904:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a3e8f lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.130959:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343276.131020:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:2407:x1848998399910400:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 200us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.131064:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3506 00000100:00100000:2.0:1763343276.131384:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:0.0:1763343276.131525:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a3e8f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.131533:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a3e8f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:0.0:1763343276.131583:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x211:0x0]: returning size 5 00000004:00200000:0.0:1763343276.131587:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343276.131605:0:9827:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a3e8f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.131617:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a3e8f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.131628:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3e81 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.131634:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3e81 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.131641:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3e81 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.131647:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3e81 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.131653:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.131657:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3e81 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.131665:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3e81 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.131675:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695800) 00010000:00010000:0.0:1763343276.131679:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.131683:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3e81 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.131689:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a3e81 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.131702:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a3e88 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.131709:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a3e88 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.131714:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a3e88 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.131719:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d1e9ec00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.131722:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a3e88 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.131728:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a3e88 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.131735:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695200) 00010000:00010000:0.0:1763343276.131737:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.131740:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a3e88 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.131746:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a3e88 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.131787:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a3e7a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4994e expref: 303 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.131807:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a3e8f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4994e expref: 302 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.131814:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x211:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:0.0:1763343276.131817:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343276.131819:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5088a00, rc 0) 00000100:00100000:0.0:1763343276.131865:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57151:x1848998399910272:12345-192.168.201.40@tcp:101:rm.0 Request processed in 6665us (6800us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.131872:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10789 00000100:00100000:0.0:1763343276.131888:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399910656 00000100:00100000:0.0:1763343276.131893:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399910656 00000100:00100000:0.0:1763343276.131918:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10790 00000100:00100000:0.0:1763343276.131924:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57146:x1848998399910656:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343276.131940:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.131956:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a3e96 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x211:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49955 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.132062:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a3e9d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x211:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343276.132073:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a3e9d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x211:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.132082:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a3e9d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x211:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:0.0:1763343276.132092:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x211:0x0]: returning size 5 00010000:00010000:0.0:1763343276.132184:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a3e96 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x211:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49955 expref: 305 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.132195:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a3e9d lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x211:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49955 expref: 304 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.132201:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x211:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:0.0:1763343276.132203:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343276.132206:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089600, rc 0) 00000100:00100000:0.0:1763343276.132225:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57146:x1848998399910656:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 301us (843us total) trans 4294973723 rc 0/0 00000100:00100000:0.0:1763343276.132231:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10790 00000100:00100000:2.0:1763343276.135413:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.136418:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399910912 00000100:00100000:0.0:1763343276.136431:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399910912 00000100:00100000:0.0:1763343276.136487:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3804 00000100:00100000:0.0:1763343276.136498:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57146:x1848998399910912:12345-192.168.201.40@tcp:35:lfs.0 00000004:00010000:0.0:1763343276.136568:0:6528:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x211:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a3e9d lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x211:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49955 expref: 304 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.136608:0:6528:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a3eab lrc: 3/0,1 mode: --/EX res: [0x240000404:0x211:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 00000100:00100000:2.0:1763343276.136672:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.136700:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399911168 00000100:00100000:2.0:1763343276.136704:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399911168 00000100:00100000:2.0:1763343276.136736:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10791 00000100:00100000:2.0:1763343276.136743:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57151:x1848998399911168:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:2.0:1763343276.136772:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763343276.136785:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a3e1f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x211:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49924 expref: 305 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.136802:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a3e8f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x211:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4994e expref: 304 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.136813:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3de0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x211:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4990f expref: 303 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.136823:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x211:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:2.0:1763343276.136827:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343276.136846:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a3eb2 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343276.136857:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a3eb2 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.136865:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a3eb2 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.136878:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcca00/0x9104b1ba770a3eb9 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343276.136884:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcca00/0x9104b1ba770a3eb9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.136890:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcca00/0x9104b1ba770a3eb9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.136963:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a3ec0 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x211:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343276.136983:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a3ec0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x211:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.136990:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a3ec0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x211:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.137132:0:6528:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a3eab lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x211:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.137139:0:6528:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a3eab lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x211:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT1 00000004:00020000:0.0:1763343276.137228:0:6528:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0001-mdtlov: can not set all stale mirrors for [0x240000404:0x211:0x0]: rc = -1 00000004:00080000:2.0:1763343276.137237:0:7641:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x211:0x0] is inserted into orphan list, open count = 2 00010000:00010000:0.0:1763343276.137266:0:6528:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a3eab lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x211:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.137274:0:6528:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a3eab lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x211:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.137280:0:6528:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a3eab lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x211:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.137286:0:6528:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.137290:0:6528:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a3eab lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x211:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.137297:0:6528:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a3eab lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x211:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.137305:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x211:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:0.0:1763343276.137307:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1763343276.137311:0:6528:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a3eab lrc: 2/0,0 mode: --/EX res: [0x240000404:0x211:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.137316:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a3eab lrc: 0/0,0 mode: --/EX res: [0x240000404:0x211:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.137324:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x211:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:0.0:1763343276.137326:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343276.137330:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a3ec0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x211:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.137330:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a3e9d lrc: 0/0,0 mode: --/PW res: [0x240000404:0x211:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49955 expref: 303 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.137337:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a3ec0 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x211:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.137342:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a3ec0 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x211:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.137346:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fd2dea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.137348:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a3ec0 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x211:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.137354:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a3ec0 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x211:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.137361:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x211:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:2.0:1763343276.137364:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763343276.137367:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a3ec0 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x211:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.137372:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a3ec0 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x211:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.137388:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a3eb2 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.137393:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a3eb2 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.137397:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a3eb2 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.137401:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a3eb2 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.137405:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3bcc200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.137408:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a3eb2 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.137412:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a3eb2 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.137418:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758c00) 00010000:00010000:2.0:1763343276.137421:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.137423:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a3eb2 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.137429:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a3eb2 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00010000:2.0:1763343276.137441:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009bb308a7 reply state 000000003b2348cc transno 4294973724 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcca00/0x9104b1ba770a3eb9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.137450:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcca00/0x9104b1ba770a3eb9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.137456:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758800) 00010000:00010000:2.0:1763343276.137459:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343276.137461:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343276.137801:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57146:x1848998399910912:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1303us (2397us total) trans 4294973725 rc -1/-1 00000100:00100000:0.0:1763343276.137809:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3804 00000100:00100000:2.0:1763343276.137834:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57151:x1848998399911168:12345-192.168.201.40@tcp:36:rm.0 Request processed in 1091us (1163us total) trans 4294973724 rc 0/0 00000100:00100000:2.0:1763343276.137841:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10791 00000100:00100000:2.0:1763343276.142227:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.142789:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399911296 00000100:00100000:0.0:1763343276.142800:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399911296 00000100:00100000:0.0:1763343276.142862:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10792 00000100:00100000:0.0:1763343276.142872:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57146:x1848998399911296:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343276.142898:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.142923:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a3ec7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x211:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4995c expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.142978:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a3ec7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x211:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4995c expref: 304 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.142994:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088800/0x9104b1ba770a3ec7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x211:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4995c expref: 304 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.143011:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x211:0x0].0x0 (ffff9401f6695800) 00010000:00010000:0.0:1763343276.143015:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343276.143019:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5088800, rc 0) 00000100:00100000:0.0:1763343276.143106:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57146:x1848998399911296:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 235us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.143113:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10792 00000100:00100000:1.0:1763343276.145634:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.145703:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399911552 00000100:00100000:0.0:1763343276.145713:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399911552 00000100:00100000:0.0:1763343276.145768:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3805 00000100:00100000:0.0:1763343276.145778:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57146:x1848998399911552:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:0.0:1763343276.146166:0:6528:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x211:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763343276.146223:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1758, 64 off146192 00000040:00080000:0.0:1763343276.146267:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1766, 64 off146848 00000040:00080000:0.0:1763343276.146280:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1767, 64 off146912 00000040:00080000:0.0:1763343276.146289:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1759, 64 off146256 00010000:00010000:0.0:1763343276.146349:0:6528:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a3ece lrc: 3/0,1 mode: --/PW res: [0x240000404:0x211:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 00010000:00010000:0.0:1763343276.146528:0:6528:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a3ece lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x211:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.146540:0:6528:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a3ece lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x211:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.146549:0:6528:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a3ece lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x211:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.146554:0:6528:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a3ece lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x211:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.146560:0:6528:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a3ece lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x211:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.146633:0:6528:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343276.146828:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57146:x1848998399911552:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1050us (1200us total) trans 4294973726 rc 0/0 00000100:00100000:0.0:1763343276.146837:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3805 00010000:00010000:2.0:1763343276.147404:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343276.147412:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a3ece lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x211:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343276.147420:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343276.147424:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a3ece lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x211:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343276.147432:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a3ece lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x211:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343276.147755:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x211:0x0].0x0 (ffff9401f6695800) 00010000:00010000:2.0:1763343276.147759:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763343276.147766:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a3ece lrc: 1/0,0 mode: --/PW res: [0x240000404:0x211:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343276.147772:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a3ece lrc: 0/0,0 mode: --/PW res: [0x240000404:0x211:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343276.147791:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343276.147792:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343276.147794:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343276.152428:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.152807:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399911680 00000100:00100000:3.0:1763343276.152817:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399911680 00000100:00100000:2.0:1763343276.153288:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10793 00000100:00100000:2.0:1763343276.153301:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57152:x1848998399911680:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343276.153328:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.153353:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a3ed5 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49963 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.153424:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a3edc lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343276.153437:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a3edc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.153449:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a3edc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.153460:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a3ee3 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343276.153467:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a3ee3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.153473:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a3ee3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.153511:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a3edc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.153518:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a3edc lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.153525:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a3edc lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.153531:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fd2df600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.153535:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a3edc lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.153542:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a3edc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.153554:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758c00) 00010000:00010000:2.0:1763343276.153558:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.153562:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a3edc lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.153567:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a3edc lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.153578:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a3ee3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.153584:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a3ee3 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.153590:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a3ee3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.153595:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fd2dfa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.153599:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a3ee3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.153605:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a3ee3 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.153616:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758800) 00010000:00010000:2.0:1763343276.153618:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.153621:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a3ee3 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.153627:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a3ee3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.153655:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a3ed5 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49963 expref: 306 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.153665:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758c00) 00010000:00010000:2.0:1763343276.153668:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.153671:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a3ed5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49963 expref: 306 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.153683:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fd2dea00, rc 0) 00000100:00100000:2.0:1763343276.153736:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57152:x1848998399911680:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 439us (1321us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343276.153743:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10793 00000100:00100000:3.0:1763343276.157385:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.157819:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399911808 00000100:00100000:2.0:1763343276.157831:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399911808 00000100:00100000:2.0:1763343276.157986:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10794 00000100:00100000:2.0:1763343276.157997:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57152:x1848998399911808:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343276.158016:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.158138:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a3eea lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4996a expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.158233:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3ef1 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343276.158258:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3ef1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.158332:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3ef1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.158347:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a3ef8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343276.158356:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a3ef8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.158363:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a3ef8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.158403:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3ef1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.158409:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3ef1 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.158415:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3ef1 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.158421:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583e600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.158425:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3ef1 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.158432:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3ef1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.158445:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758900) 00010000:00010000:2.0:1763343276.158448:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.158452:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3ef1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.158457:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3ef1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.158466:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a3ef8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.158470:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a3ef8 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.158475:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a3ef8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.158479:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583ee00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.158482:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a3ef8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.158486:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a3ef8 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.158492:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758800) 00010000:00010000:2.0:1763343276.158494:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.158496:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a3ef8 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.158502:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a3ef8 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.158530:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a3eea lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4996a expref: 306 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.158539:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758900) 00010000:00010000:2.0:1763343276.158541:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.158545:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a3eea lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4996a expref: 306 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.158560:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3bcc200, rc 0) 00000100:00100000:2.0:1763343276.158632:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57152:x1848998399911808:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 637us (1257us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343276.158640:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10794 00000100:00100000:1.0:1763343276.162103:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.162146:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399912064 00000100:00100000:2.0:1763343276.162157:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399912064 00000100:00100000:3.0:1763343276.162204:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.162220:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399912192 00000100:00100000:2.0:1763343276.162224:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399912192 00000100:00100000:2.0:1763343276.162253:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10795 00000100:00100000:2.0:1763343276.162263:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6282300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57153:x1848998399912064:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:3.0:1763343276.162279:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10796 00000100:00100000:3.0:1763343276.162287:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57152:x1848998399912192:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343276.162291:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343276.162294:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.162314:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a3eff lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49971 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.162315:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3f06 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49978 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.162374:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3f0d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343276.162378:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a3f14 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343276.162388:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3f0d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.162600:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3f0d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.162600:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a3f14 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.162609:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a3f14 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.162630:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e200/0x9104b1ba770a3f1b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343276.162637:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e200/0x9104b1ba770a3f1b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.162643:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e200/0x9104b1ba770a3f1b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:3.0:1763343276.162647:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763343276.162651:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763343276.162671:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a3f14 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.162677:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a3f14 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.162684:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a3f14 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.162689:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343276.162690:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3f06 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49978 expref: 309 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.162693:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a3f14 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.162699:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a3f14 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.162704:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3f0d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49978 expref: 308 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.162709:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758600) 00010000:00010000:2.0:1763343276.162711:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343276.162714:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758600) 00010000:00010000:2.0:1763343276.162715:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a3f14 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.162716:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763343276.162718:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3000, rc 0) 00010000:00010000:2.0:1763343276.162721:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a3f14 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.162728:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e200/0x9104b1ba770a3f1b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.162732:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e200/0x9104b1ba770a3f1b lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.162738:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e200/0x9104b1ba770a3f1b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.162742:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583e200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.162744:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e200/0x9104b1ba770a3f1b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.162749:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e200/0x9104b1ba770a3f1b lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.162754:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758800) 00010000:00010000:2.0:1763343276.162757:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.162759:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e200/0x9104b1ba770a3f1b lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.162764:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e200/0x9104b1ba770a3f1b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.162786:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a3eff lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49971 expref: 308 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.162795:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758600) 00010000:00010000:2.0:1763343276.162798:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343276.162801:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a3eff lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49971 expref: 308 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.162807:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f000, rc 0) 00000100:00100000:3.0:1763343276.162957:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57152:x1848998399912192:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 670us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.162957:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6282300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57153:x1848998399912064:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 694us (863us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343276.162966:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10795 00000100:00100000:3.0:1763343276.162971:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10796 00000100:00100000:1.0:1763343276.168311:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.168493:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399912448 00000100:00100000:2.0:1763343276.168505:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399912448 00000100:00100000:2.0:1763343276.168565:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10797 00000100:00100000:2.0:1763343276.168575:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57152:x1848998399912448:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343276.168597:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.168600:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343276.168627:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3f0d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49978 expref: 306 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.168647:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758600) 00010000:00010000:2.0:1763343276.168658:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343276.168674:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a3f22 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4997f expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.168775:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3f29 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343276.168787:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3f29 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.168796:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3f29 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.168805:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a3f30 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343276.168812:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a3f30 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.168817:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a3f30 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.169232:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a3f37 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343276.169253:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a3f37 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.169261:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a3f37 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:2.0:1763343276.169279:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x213:0x0]: returning size 0 00010000:00010000:2.0:1763343276.169303:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3f29 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.169310:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3f29 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.169316:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3f29 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.169320:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583e600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.169324:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3f29 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.169330:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3f29 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.169338:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758900) 00010000:00010000:2.0:1763343276.169340:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.169344:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3f29 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.169350:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3f29 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:2.0:1763343276.169364:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a3bbecb6 reply state 00000000ed84994c transno 4294973727 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a3f30 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.169373:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a3f30 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.169379:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758800) 00010000:00010000:2.0:1763343276.169381:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343276.169384:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343276.169406:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a3f22 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4997f expref: 308 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.169421:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a3f37 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4997f expref: 307 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.169428:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758c00) 00010000:00010000:2.0:1763343276.169430:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343276.169433:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f400, rc 0) 00000100:00100000:2.0:1763343276.169494:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57152:x1848998399912448:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 920us (1196us total) trans 4294973727 rc 0/0 00000100:00100000:2.0:1763343276.169503:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10797 00000100:00100000:0.0:1763343276.172063:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.172147:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399912704 00000100:00100000:3.0:1763343276.172157:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399912704 00000100:00100000:3.0:1763343276.172207:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10798 00000100:00100000:3.0:1763343276.172218:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57152:x1848998399912704:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343276.172254:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.172520:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3f45 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49986 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.172626:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a3f4c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343276.172641:0:6524:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a3f37 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4997f expref: 309 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.172650:0:6524:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a3f4c lrc: 4/0,1 mode: --/EX res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343276.172687:0:6524:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a3f37 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4997f expref: 309 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.172702:0:6524:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a3f37 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4997f expref: 309 pid: 33856 timeout: 1169 lvb_type: 0 00000100:00100000:0.0:1763343276.172716:0:6524:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b28e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412987392:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343276.172798:0:6524:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc440a80 going to sleep for 11 seconds 00000100:00100000:2.0:1763343276.176278:0:6524:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b28e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6524:1848998412987392:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343276.176312:0:6524:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a3f4c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000100:00100000:0.0:1763343276.177460:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.177566:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399912832 00000100:00100000:3.0:1763343276.177575:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399912832 00010000:00010000:3.0:1763343276.177611:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a3f37 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4997f expref: 310 pid: 33856 timeout: 1169 lvb_type: 0 00000100:00100000:3.0:1763343276.177706:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3507 00000100:00100000:3.0:1763343276.177717:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:2407:x1848998399912832:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343276.177733:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343276.177740:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a3f37 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4997f expref: 310 pid: 33856 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343276.177753:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a3f37 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4997f expref: 310 pid: 33856 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343276.177775:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a3f37 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4997f expref: 310 pid: 33856 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343276.177791:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758c00) 00010000:00010000:3.0:1763343276.177797:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a3f4c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.177807:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a3f4c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.177814:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a3f4c lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.177944:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343276.178103:0:6524:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a3f4c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.178111:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a3f4c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:2.0:1763343276.178136:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x213:0x0]: returning size 0 00000100:00100000:3.0:1763343276.178353:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:2407:x1848998399912832:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 637us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343276.178362:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3507 00000004:00080000:2.0:1763343276.178814:0:6524:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2cb:0x0], index 1: 0 00000004:00080000:2.0:1763343276.178823:0:6524:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2ca:0x0], index 0: 0 00000004:00080000:2.0:1763343276.178828:0:6524:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2cb:0x0], index 0: 0 00000004:00080000:2.0:1763343276.178832:0:6524:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2cc:0x0], index 1: 0 00010000:00010000:2.0:1763343276.178932:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a3f4c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.178941:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a3f4c lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.178948:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a3f4c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.178954:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.178958:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a3f4c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.178966:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a3f4c lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.178977:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758c00) 00010000:00010000:2.0:1763343276.178980:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343276.178983:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a3f4c lrc: 2/0,0 mode: --/EX res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.178989:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a3f4c lrc: 0/0,0 mode: --/EX res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.179083:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3f45 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x213:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49986 expref: 309 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.179097:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758c00) 00010000:00010000:2.0:1763343276.179100:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343276.179103:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3f45 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x213:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49986 expref: 309 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.179118:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3200, rc 0) 00000100:00100000:2.0:1763343276.179155:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57152:x1848998399912704:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 6940us (7144us total) trans 4294973728 rc 301/301 00000100:00100000:2.0:1763343276.179163:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10798 00000100:00100000:0.0:1763343276.181954:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.182088:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399913088 00000100:00100000:2.0:1763343276.182098:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399913088 00000100:00100000:2.0:1763343276.182156:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10799 00000100:00100000:2.0:1763343276.182167:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57154:x1848998399913088:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343276.182186:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.182209:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a3f5a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4998d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.182302:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e200/0x9104b1ba770a3f61 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343276.182316:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e200/0x9104b1ba770a3f61 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.182327:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e200/0x9104b1ba770a3f61 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.182337:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a3f68 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343276.182349:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a3f68 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.182355:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a3f68 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.182469:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a3f6f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343276.182477:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a3f6f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.182484:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a3f6f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.182566:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e200/0x9104b1ba770a3f61 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.182572:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e200/0x9104b1ba770a3f61 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.182578:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e200/0x9104b1ba770a3f61 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.182584:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e200/0x9104b1ba770a3f61 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.182588:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583e200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.182592:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e200/0x9104b1ba770a3f61 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.182598:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e200/0x9104b1ba770a3f61 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.182612:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758600) 00010000:00010000:2.0:1763343276.182614:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.182618:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e200/0x9104b1ba770a3f61 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.182624:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e200/0x9104b1ba770a3f61 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.182636:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a3f68 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.182641:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a3f68 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.182646:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a3f68 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.182650:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.182652:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a3f68 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.182657:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a3f68 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.182662:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758800) 00010000:00010000:2.0:1763343276.182664:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.182666:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a3f68 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.182671:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a3f68 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.182699:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a3f5a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4998d expref: 311 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.182713:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a3f6f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4998d expref: 310 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.182719:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:2.0:1763343276.182721:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343276.182723:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583e800, rc 0) 00000100:00100000:2.0:1763343276.182782:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57154:x1848998399913088:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 618us (839us total) trans 4294973729 rc 0/0 00000100:00100000:2.0:1763343276.182789:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10799 00000100:00100000:0.0:1763343276.185996:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.186138:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399913344 00000100:00100000:2.0:1763343276.186148:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399913344 00000100:00100000:2.0:1763343276.186198:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3806 00000100:00100000:2.0:1763343276.186207:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8544050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57152:x1848998399913344:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343276.186394:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.186444:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399913472 00000100:00100000:1.0:1763343276.186449:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399913472 00000100:00100000:1.0:1763343276.186490:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7359 00000100:00100000:1.0:1763343276.186498:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2410:x1848998399913472:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343276.186509:0:28561:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343276.186534:0:28561:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a3f7d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49994 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343276.186557:0:28561:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343276.186577:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.186579:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.186588:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a3f7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49994 expref: 23 pid: 28561 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343276.186603:0:28561:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a3f7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49994 expref: 23 pid: 28561 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343276.186615:0:28561:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176600, rc 0) 00000100:00100000:1.0:1763343276.186666:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2410:x1848998399913472:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 169us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.186673:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7359 00000100:00100000:2.0:1763343276.186707:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8544050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57152:x1848998399913344:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 500us (721us total) trans 4294973730 rc 0/0 00000100:00100000:2.0:1763343276.186718:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3806 00000100:00100000:3.0:1763343276.186960:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.187113:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399913600 00000100:00100000:2.0:1763343276.187118:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399913600 00000100:00100000:2.0:1763343276.187140:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7360 00000100:00100000:2.0:1763343276.187147:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2410:x1848998399913600:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343276.187155:0:8626:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.187167:0:8626:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a3f84 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4999b expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343276.187182:0:8626:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343276.187193:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.187195:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.187200:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a3f84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4999b expref: 17 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343276.187212:0:8626:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a3f84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4999b expref: 17 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343276.187222:0:8626:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583ee00, rc 0) 00000100:00100000:2.0:1763343276.187721:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2410:x1848998399913600:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 122us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.187733:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7360 00000100:00100000:3.0:1763343276.190659:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.190787:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.191062:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399913856 00000100:00100000:1.0:1763343276.191073:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399913856 00000100:00100000:1.0:1763343276.191126:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399914112 00000100:00100000:1.0:1763343276.191129:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399914112 00000100:00100000:1.0:1763343276.191146:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3807 00000100:00100000:1.0:1763343276.191154:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57152:x1848998399913856:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343276.191382:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57152:x1848998399913856:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 226us (2150us total) trans 4294973731 rc 0/0 00000100:00100000:1.0:1763343276.191390:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3807 00000100:00100000:1.0:1763343276.191410:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3808 00000100:00100000:1.0:1763343276.191416:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57154:x1848998399914112:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343276.191487:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57154:x1848998399914112:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 71us (700us total) trans 4294973732 rc 0/0 00000100:00100000:1.0:1763343276.191494:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3808 00000100:00100000:0.0:1763343276.194575:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.194857:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399914368 00000100:00100000:3.0:1763343276.194868:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399914368 00000100:00100000:2.0:1763343276.195675:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10800 00000100:00100000:2.0:1763343276.195690:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57154:x1848998399914368:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343276.195717:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.195737:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a3f8b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b499a2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.195852:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a3f92 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343276.195866:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a3f92 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x213:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.195878:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a3f92 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x213:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:2.0:1763343276.195889:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x213:0x0]: returning size 0 00010000:00010000:2.0:1763343276.195998:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a3f8b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x213:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499a2 expref: 316 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.196016:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a3f92 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x213:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499a2 expref: 315 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.196051:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:2.0:1763343276.196055:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1763343276.196059:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f600, rc 0) 00000100:00100000:2.0:1763343276.196154:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57154:x1848998399914368:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 469us (1588us total) trans 4294973733 rc 0/0 00000100:00100000:2.0:1763343276.196162:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10800 00000100:00100000:0.0:1763343276.196212:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.196495:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399914624 00000100:00100000:2.0:1763343276.196502:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399914624 00000100:00100000:2.0:1763343276.196540:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10801 00000100:00100000:2.0:1763343276.196548:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:55884:x1848998399914624:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343276.196559:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.196561:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343276.196575:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a3f6f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4998d expref: 315 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.196587:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:2.0:1763343276.196590:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343276.196597:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e200/0x9104b1ba770a3fa0 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b499a9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.196653:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3fa7 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343276.196663:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3fa7 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x213:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.196671:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3fa7 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x213:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:2.0:1763343276.196681:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x213:0x0]: returning size 0 00010000:00010000:2.0:1763343276.196742:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e200/0x9104b1ba770a3fa0 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499a9 expref: 317 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.196755:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3fa7 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x213:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499a9 expref: 316 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.196761:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:2.0:1763343276.196764:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:2.0:1763343276.196766:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583e600, rc 0) 00000100:00100000:2.0:1763343276.196803:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:55884:x1848998399914624:12345-192.168.201.40@tcp:101:bash.0 Request processed in 255us (592us total) trans 4294973734 rc 0/0 00000100:00100000:2.0:1763343276.196810:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10801 00000100:00100000:1.0:1763343276.199441:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.199482:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.199611:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399914752 00000100:00100000:2.0:1763343276.199620:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399914752 00000100:00100000:2.0:1763343276.199663:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399914880 00000100:00100000:2.0:1763343276.199665:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399914880 00000100:00100000:2.0:1763343276.199691:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10802 00000100:00100000:2.0:1763343276.199698:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57154:x1848998399914752:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343276.199717:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.199736:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f800/0x9104b1ba770a3fb5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b499b0 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.199822:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a3fbc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343276.199840:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3fa7 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x213:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499a9 expref: 318 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.199848:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a3fbc lrc: 4/1,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.199876:0:33856:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3fa7 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x213:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499a9 expref: 318 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.199889:0:33856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3fa7 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x213:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499a9 expref: 318 pid: 6524 timeout: 1169 lvb_type: 0 00000100:00100000:2.0:1763343276.199901:0:33856:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412987520:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343276.199965:0:33856:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c7ec3000 going to sleep for 11 seconds 00000100:00100000:3.0:1763343276.200047:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10803 00000100:00100000:3.0:1763343276.200057:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+318:55884:x1848998399914880:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343276.200066:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343276.200073:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3fc3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b499b7 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.200089:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3fca lrc: 3/1,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343276.200099:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3fca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.200110:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3fca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.200184:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a3fc3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499b7 expref: 320 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.200198:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3fca lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499b7 expref: 319 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.200206:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:3.0:1763343276.200209:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343276.200212:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3a00, rc 0) 00000100:00100000:3.0:1763343276.200256:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:55884:x1848998399914880:12345-192.168.201.40@tcp:101:bash.0 Request processed in 201us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343276.200262:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10803 00000100:00100000:1.0:1763343276.203600:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.203669:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.203737:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399915008 00000100:00100000:3.0:1763343276.203745:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399915008 00010000:00010000:3.0:1763343276.203781:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3fa7 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x213:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499a9 expref: 319 pid: 6524 timeout: 1169 lvb_type: 0 00000100:00100000:3.0:1763343276.203826:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3508 00000100:00100000:3.0:1763343276.203836:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:2408:x1848998399915008:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343276.203850:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343276.203856:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3fa7 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x213:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499a9 expref: 319 pid: 6524 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343276.203868:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3fa7 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x213:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499a9 expref: 319 pid: 6524 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343276.203890:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:3.0:1763343276.203895:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a3fbc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.203905:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a3fbc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.203913:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a3fbc lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.203932:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343276.203974:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:2408:x1848998399915008:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 140us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343276.203981:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3508 00010000:00010000:2.0:1763343276.204080:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a3fa7 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x213:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499a9 expref: 318 pid: 6524 timeout: 1169 lvb_type: 0 00000100:00100000:2.0:1763343276.204098:0:33856:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412987520:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343276.204116:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a3fbc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.204123:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a3fbc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.204128:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a3fbc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:2.0:1763343276.204173:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x213:0x0]: returning size 0 00000004:00200000:2.0:1763343276.204177:0:33856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343276.204195:0:33856:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a3fbc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.204223:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f800/0x9104b1ba770a3fb5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499b0 expref: 318 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.204237:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a3fbc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499b0 expref: 317 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.204257:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:2.0:1763343276.204259:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1763343276.204262:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f200, rc 0) 00000100:00100000:2.0:1763343276.204308:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57154:x1848998399914752:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 4609us (4875us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.204314:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10802 00000100:00100000:2.0:1763343276.204331:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399915264 00000100:00100000:2.0:1763343276.204334:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399915264 00000100:00100000:2.0:1763343276.204355:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10804 00000100:00100000:2.0:1763343276.204361:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:55884:x1848998399915264:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:2.0:1763343276.204537:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a3fd1 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343276.204548:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a3fbc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499b0 expref: 318 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.204556:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a3fd1 lrc: 4/0,1 mode: --/PW res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.204582:0:33856:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a3fbc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499b0 expref: 318 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.204599:0:33856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a3fbc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499b0 expref: 318 pid: 33856 timeout: 1169 lvb_type: 0 00000100:00100000:2.0:1763343276.204610:0:33856:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412987648:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343276.204657:0:33856:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c7ec3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1763343276.209935:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.210000:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.210104:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399915648 00000100:00100000:1.0:1763343276.210113:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399915648 00000100:00100000:2.0:1763343276.210140:0:33856:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412987648:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343276.210148:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a3fbc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499b0 expref: 319 pid: 33856 timeout: 1169 lvb_type: 0 00010000:00010000:2.0:1763343276.210163:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a3fd1 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:1.0:1763343276.210182:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3509 00000100:00100000:1.0:1763343276.210190:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c32b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:2410:x1848998399915648:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343276.210205:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343276.210212:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a3fbc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499b0 expref: 319 pid: 33856 timeout: 1169 lvb_type: 0 00010000:00010000:1.0:1763343276.210224:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a3fbc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499b0 expref: 319 pid: 33856 timeout: 1169 lvb_type: 0 00000100:00100000:3.0:1763343276.210400:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399915520 00000100:00100000:3.0:1763343276.210405:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399915520 00000100:00100000:3.0:1763343276.210447:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10805 00000100:00100000:3.0:1763343276.210456:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+320:57154:x1848998399915520:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343276.210475:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343276.210494:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3fd8 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b499be expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.210563:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a3fdf lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343276.210575:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a3fdf lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.210585:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a3fdf lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.210594:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a3fe6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343276.210601:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a3fe6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.210607:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a3fe6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.210709:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3fed lrc: 3/1,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343276.210740:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a3fbc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499b0 expref: 321 pid: 33856 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343276.211568:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3fed lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.211581:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3fed lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:3.0:1763343276.211591:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x213:0x0]: returning size 0 00010000:00010000:1.0:1763343276.211644:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:1.0:1763343276.211650:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a3fd1 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.211661:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a3fd1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.211666:0:7904:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a3fd1 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.211694:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343276.211713:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a3fdf lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.211720:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a3fdf lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.211725:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a3fdf lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.211730:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a3fdf lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.211735:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a6a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.211739:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a3fdf lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.211746:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a3fdf lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.211755:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b300) 00010000:00010000:2.0:1763343276.211758:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.211763:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a3fdf lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.211769:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a3fdf lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.211781:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a3fe6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.211787:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a3fe6 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.211792:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a3fe6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.211796:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a7e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.211799:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a3fe6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00000100:00100000:1.0:1763343276.211802:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c32b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:2410:x1848998399915648:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1611us (1800us total) trans 0 rc 0/0 00010000:00010000:2.0:1763343276.211804:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a3fe6 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00000100:00100000:1.0:1763343276.211810:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3509 00010000:00010000:2.0:1763343276.211811:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758800) 00010000:00010000:2.0:1763343276.211813:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.211816:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a3fe6 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.211820:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a3fe6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:2.0:1763343276.211856:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a3fd8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499be expref: 321 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.211871:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3fed lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x19/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499be expref: 320 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.211878:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:2.0:1763343276.211880:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 19 00010000:00010000:2.0:1763343276.211883:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5bd8e00, rc 0) 00010000:00010000:3.0:1763343276.211900:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a3fd1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.211910:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a3fd1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000001:00080000:3.0:1763343276.212104:0:33856:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973735 00000004:00010000:3.0:1763343276.212132:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b99ccb3d reply state 0000000005df850c transno 4294973737 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a3fd1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.212145:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a3fd1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.212151:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:3.0:1763343276.212154:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343276.212156:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343276.212433:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+322:57154:x1848998399915520:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1977us (2508us total) trans 4294973736 rc 0/0 00000100:00100000:2.0:1763343276.212440:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10805 00000100:00100000:3.0:1763343276.213250:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:55884:x1848998399915264:12345-192.168.201.40@tcp:36:bash.0 Request processed in 8875us (9567us total) trans 4294973737 rc 0/0 00000100:00100000:3.0:1763343276.213259:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10804 00000020:00080000:3.0:1763343276.213263:0:33856:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343276.215972:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.216065:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399915904 00000100:00100000:2.0:1763343276.216075:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399915904 00000100:00100000:2.0:1763343276.216125:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3809 00000100:00100000:2.0:1763343276.216134:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:57154:x1848998399915904:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343276.216542:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+322:57154:x1848998399915904:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 409us (579us total) trans 4294973738 rc 0/0 00000100:00100000:2.0:1763343276.216550:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3809 00000100:00100000:0.0:1763343276.218218:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.218267:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.218336:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399916160 00000100:00100000:2.0:1763343276.218346:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399916160 00000100:00100000:2.0:1763343276.218394:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399916288 00000100:00100000:2.0:1763343276.218398:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399916288 00000100:00100000:2.0:1763343276.218419:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3810 00000100:00100000:2.0:1763343276.218427:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:55884:x1848998399916160:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:3.0:1763343276.218479:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3811 00000100:00100000:3.0:1763343276.218491:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:57154:x1848998399916288:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:3.0:1763343276.218630:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:57154:x1848998399916288:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 142us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343276.218637:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3811 00000100:00100000:2.0:1763343276.218828:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:55884:x1848998399916160:12345-192.168.201.40@tcp:35:bash.0 Request processed in 400us (618us total) trans 4294973739 rc 0/0 00000100:00100000:2.0:1763343276.218836:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3810 00000100:00100000:0.0:1763343276.223564:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.223706:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399916544 00000100:00100000:1.0:1763343276.223716:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399916544 00000100:00100000:1.0:1763343276.223850:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10806 00000100:00100000:1.0:1763343276.223862:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:55884:x1848998399916544:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343276.223893:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343276.223897:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343276.223928:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a3f92 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x213:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499a2 expref: 323 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.223951:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:1.0:1763343276.223957:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343276.223973:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3ffb lrc: 2/0,0 mode: --/EX res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b499c5 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.224251:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a4002 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343276.224265:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3fed lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499be expref: 323 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.224386:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a4002 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x213:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.224423:0:33856:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3fed lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499be expref: 323 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.224436:0:33856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3fed lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499be expref: 323 pid: 6524 timeout: 1169 lvb_type: 0 00000100:00100000:1.0:1763343276.224450:0:33856:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9dc9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412987776:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343276.224532:0:33856:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c4532840 going to sleep for 11 seconds 00000100:00100000:1.0:1763343276.231859:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.231950:0:33856:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9dc9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412987776:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343276.231977:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a4002 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x213:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:3.0:1763343276.232068:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399916672 00000100:00100000:3.0:1763343276.232075:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399916672 00010000:00010000:3.0:1763343276.232110:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3fed lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499be expref: 324 pid: 6524 timeout: 1169 lvb_type: 0 00000100:00100000:3.0:1763343276.232144:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3510 00000100:00100000:3.0:1763343276.232154:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+324:2407:x1848998399916672:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343276.232170:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343276.232176:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3fed lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499be expref: 324 pid: 6524 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343276.232189:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3fed lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499be expref: 324 pid: 6524 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343276.232216:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a3fed lrc: 0/0,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499be expref: 324 pid: 6524 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343276.232231:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:3.0:1763343276.232236:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a4002 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x213:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.232259:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a4002 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.232267:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a4002 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.232303:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343276.232359:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:2407:x1848998399916672:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 205us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343276.232366:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3510 00010000:00010000:2.0:1763343276.232447:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a4002 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.232455:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a4002 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000040:00080000:2.0:1763343276.232678:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1768, 88 off147000 00000004:00080000:2.0:1763343276.232686:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1069356661007ns, next at 1070049115839ns, rc = 0 00000040:00080000:2.0:1763343276.232715:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1760, 88 off146344 00000004:00080000:2.0:1763343276.232720:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1069356695144ns, next at 1070049318579ns, rc = 0 00000040:00080000:2.0:1763343276.232735:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1761, 88 off146432 00000004:00080000:2.0:1763343276.232739:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1069356714269ns, next at 1070049318579ns, rc = 0 00000040:00080000:2.0:1763343276.232749:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1769, 88 off147088 00000004:00080000:2.0:1763343276.232753:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1069356728339ns, next at 1070049115839ns, rc = 0 00000001:00080000:2.0:1763343276.237720:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973740 is committed 00000004:00080000:2.0:1763343276.237736:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1136 committed 00000004:00080000:2.0:1763343276.237754:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1128 committed 00000004:00080000:2.0:1763343276.237765:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1127 committed 00000004:00080000:2.0:1763343276.237767:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1135 committed 00010000:00010000:2.0:1763343276.237866:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a4002 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x213:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499c5 expref: 301 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.237881:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:2.0:1763343276.237884:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343276.237905:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a3ffb lrc: 0/0,0 mode: --/EX res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499c5 expref: 301 pid: 33856 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1763343276.238143:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412988032:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343276.238210:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343276.238276:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412988544:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343276.238296:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343276.238317:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763343276.238322:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412988160:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343276.238339:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343276.238369:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412988032 00000100:00100000:0.0:1763343276.238376:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412988032 00000100:00100000:0.0:1763343276.238415:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412988544 00000100:00100000:0.0:1763343276.238418:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412988544 00000100:00100000:0.0:1763343276.238431:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412988160 00000100:00100000:0.0:1763343276.238434:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412988160 00000100:00100000:0.0:1763343276.238449:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7361 00000100:00100000:0.0:1763343276.238457:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+29:3659:x1848998412988032:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1763343276.238468:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a4002 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x213:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499c5 expref: 300 pid: 33856 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1763343276.238481:0:8626:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:709 count 1 00010000:00010000:2.0:1763343276.238503:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:0.0:1763343276.238503:0:8626:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a4009 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.238506:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343276.238509:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176a00, rc 0) 00010000:00010000:0.0:1763343276.238519:0:8626:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c508aa00/0x9104b1ba770a3d77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498ec expref: 22 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.238525:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343276.238528:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343276.238531:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a4009 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.238554:0:8626:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c508aa00/0x9104b1ba770a3d77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498ec expref: 22 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343276.238556:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:55884:x1848998399916544:12345-192.168.201.40@tcp:101:bash.0 Request processed in 14697us (15006us total) trans 4294973740 rc 0/0 00000100:00100000:2.0:1763343276.238564:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10806 00010000:00010000:0.0:1763343276.238567:0:8626:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c508aa00/0x9104b1ba770a3d77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498ec expref: 22 pid: 28561 timeout: 1169 lvb_type: 0 00000100:00100000:0.0:1763343276.238578:0:8626:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4b21f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8626:1848998412988672:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343276.238620:0:8626:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc440a80 going to sleep for 11 seconds 00010000:00010000:3.0:1763343276.238722:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcca00/0x9104b1ba770a3eb9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.238733:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcca00/0x9104b1ba770a3eb9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.238740:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcca00/0x9104b1ba770a3eb9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.238747:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3bcca00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343276.238752:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcca00/0x9104b1ba770a3eb9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.238760:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcca00/0x9104b1ba770a3eb9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.238772:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758800) 00010000:00010000:3.0:1763343276.238775:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343276.238779:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcca00/0x9104b1ba770a3eb9 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.238784:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcca00/0x9104b1ba770a3eb9 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.238799:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a3f30 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.238805:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a3f30 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.238810:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a3f30 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.238815:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583fe00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343276.238818:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a3f30 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.238824:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a3f30 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.238831:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758800) 00010000:00010000:3.0:1763343276.238834:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343276.238837:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a3f30 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.238842:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a3f30 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.238856:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a3fd1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.238863:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a3fd1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.238868:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a3fd1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.238872:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583e000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343276.238875:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a3fd1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.238880:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a3fd1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.238887:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:3.0:1763343276.238889:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343276.238891:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a3fd1 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.238896:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a3fd1 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000100:00100000:1.0:1763343276.239429:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6e8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412987904:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343276.239468:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.239499:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412988416:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343276.239518:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.239541:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763343276.239547:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412988288:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343276.239584:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412987904 00000100:00100000:3.0:1763343276.239591:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412987904 00000100:00100000:3.0:1763343276.239619:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412988416 00000100:00100000:3.0:1763343276.239625:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412988416 00000100:00100000:2.0:1763343276.239628:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7362 00000100:00100000:2.0:1763343276.239637:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+31:3659:x1848998412988544:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343276.239640:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7363 00000100:00100000:3.0:1763343276.239645:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+31:3659:x1848998412988160:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343276.239655:0:35281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:712 count 1 00010000:00010000:3.0:1763343276.239668:0:35281:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4010 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.239681:0:35281:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a3e50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49932 expref: 22 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.239688:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343276.239689:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343276.239692:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4010 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.239714:0:35281:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a3e50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49932 expref: 22 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.239723:0:35281:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a3e50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49932 expref: 22 pid: 8626 timeout: 1169 lvb_type: 0 00000100:00100000:3.0:1763343276.239733:0:35281:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c39b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35281:1848998412988800:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343276.239771:0:35281:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c8284540 going to sleep for 11 seconds 00002000:00010000:2.0:1763343276.239772:0:8413:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2cb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343276.239775:0:8413:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2cb:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763343276.239777:0:8413:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2cb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343276.239779:0:8413:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2cb:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763343276.239781:0:8413:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2cb:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343276.239786:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7364 00000100:00100000:3.0:1763343276.239792:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+32:3662:x1848998412987904:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343276.239803:0:8414:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:708 count 1 00000100:00100000:2.0:1763343276.239812:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+32:3659:x1848998412988544:12345-0@lo:2:osp-syn-0-1.0 Request processed in 178us (1515us total) trans 21474839250 rc 0/0 00010000:00010000:3.0:1763343276.239814:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3200/0x9104b1ba770a4017 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343276.239819:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7362 00010000:00010000:3.0:1763343276.239830:0:8414:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a3da8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49901 expref: 22 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343276.239834:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7365 00010000:00010000:3.0:1763343276.239837:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343276.239839:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1763343276.239840:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+31:3662:x1848998412988416:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1763343276.239842:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3200/0x9104b1ba770a4017 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.239859:0:8414:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a3da8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49901 expref: 22 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.239867:0:8414:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a3da8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49901 expref: 22 pid: 28561 timeout: 1169 lvb_type: 0 00000100:00100000:3.0:1763343276.239877:0:8414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c39b4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1848998412988928:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343276.239903:0:8414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c8284480 going to sleep for 11 seconds 00000100:00100000:2.0:1763343276.240345:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+32:3662:x1848998412988416:12345-0@lo:2:osp-syn-0-1.0 Request processed in 505us (825us total) trans 21474839251 rc 0/0 00000100:00100000:2.0:1763343276.240352:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7365 00000100:00100000:1.0:1763343276.240401:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1763343276.240435:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401edc2e300/2, rc 0, transno 21474839251 00000100:00100000:1.0:1763343276.240441:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412988416:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343276.240464:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412988288 00000100:00100000:1.0:1763343276.240468:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412988288 00000100:00100000:1.0:1763343276.240500:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7366 00000100:00100000:1.0:1763343276.240507:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+32:3662:x1848998412988288:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763343276.240522:0:28561:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:713 count 1 00002000:00010000:1.0:1763343276.240542:0:28561:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343276.240547:0:28561:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176400/0x9104b1ba770a401e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.240556:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.240558:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.240563:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176400/0x9104b1ba770a401e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.240574:0:28561:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5176400/0x9104b1ba770a401e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.240583:0:28561:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176400/0x9104b1ba770a401e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.240590:0:28561:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176400/0x9104b1ba770a401e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.240613:0:28561:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343276.240633:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343276.240640:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5176400/0x9104b1ba770a401e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.240647:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176400 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343276.240650:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5176400/0x9104b1ba770a401e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.240658:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5176400/0x9104b1ba770a401e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.240677:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5176400/0x9104b1ba770a401e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.240684:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176400/0x9104b1ba770a401e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.240699:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343276.240701:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343276.240703:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343276.240784:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+33:3662:x1848998412988288:12345-0@lo:6:osp-syn-0-1.0 Request processed in 277us (385us total) trans 21474839252 rc 0/0 00000100:00100000:1.0:1763343276.240789:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7366 00000100:00100000:1.0:1763343276.240917:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412989056:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343276.240944:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.240960:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4788e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412989568:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343276.240978:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.240994:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763343276.240999:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412989440:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343276.241016:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.241059:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412989056 00000100:00100000:1.0:1763343276.241063:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412989056 00000100:00100000:1.0:1763343276.241081:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412989568 00000100:00100000:1.0:1763343276.241084:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412989568 00000100:00100000:1.0:1763343276.241096:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412989440 00000100:00100000:1.0:1763343276.241098:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412989440 00000100:00100000:1.0:1763343276.241112:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7367 00000100:00100000:1.0:1763343276.241118:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edde7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+13:3660:x1848998412989056:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343276.241131:0:11289:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:709 count 1 00010000:00010000:1.0:1763343276.241145:0:11289:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4025 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.241156:0:11289:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3b40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4982f expref: 16 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.241162:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343276.241164:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343276.241166:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4025 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.241185:0:11289:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3b40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4982f expref: 16 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.241197:0:11289:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3b40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4982f expref: 16 pid: 35281 timeout: 1169 lvb_type: 0 00000100:00100000:1.0:1763343276.241207:0:11289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4788a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11289:1848998412989824:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343276.241259:0:11289:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c4532840 going to sleep for 11 seconds 00000100:00100000:2.0:1763343276.241362:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7368 00000100:00100000:2.0:1763343276.241371:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+13:3660:x1848998412989568:12345-0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763343276.241809:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401edc2ed80/2, rc 0, transno 21474839250 00000100:00100000:0.0:1763343276.241816:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412988544:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343276.241868:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.242613:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412989312:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343276.242647:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763343276.242670:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401edc2e680/2, rc 0, transno 21474839252 00000100:00100000:3.0:1763343276.242674:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412988288:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343276.242684:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1763343276.242689:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4789180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412989184:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343276.242704:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343276.242711:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c478aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412989696:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343276.242723:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343276.242752:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399916928 00000100:00100000:3.0:1763343276.242756:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399916928 00000100:00100000:3.0:1763343276.242795:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10807 00000100:00100000:3.0:1763343276.242802:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57155:x1848998399916928:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343276.242816:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343276.242835:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a402c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b499cc expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.242910:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4033 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343276.242922:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4033 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.242934:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4033 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.242946:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a403a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343276.242952:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a403a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.242958:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a403a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.243076:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a4041 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343276.243086:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a4041 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.243093:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a4041 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:3.0:1763343276.243103:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x213:0x0]: returning size 2 00010000:00010000:3.0:1763343276.243181:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4033 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.243189:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4033 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.243199:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4033 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.243205:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343276.243209:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4033 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.243216:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4033 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.243228:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b500) 00010000:00010000:3.0:1763343276.243231:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343276.243236:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4033 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.243254:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4033 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.243265:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a403a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.243279:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a403a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.243285:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a403a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.243290:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3916200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343276.243292:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a403a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.243298:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a403a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.243309:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c488b600) 00010000:00010000:3.0:1763343276.243312:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343276.243315:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a403a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.243320:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a403a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.243359:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a402c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499cc expref: 300 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.243373:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a4041 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499cc expref: 299 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.243380:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:3.0:1763343276.243382:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343276.243385:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917e00, rc 0) 00000100:00100000:1.0:1763343276.243494:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412989312 00000100:00100000:1.0:1763343276.243500:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412989312 00000100:00100000:1.0:1763343276.243524:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412989184 00000100:00100000:1.0:1763343276.243527:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412989184 00000100:00100000:1.0:1763343276.243535:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412989696 00000100:00100000:1.0:1763343276.243538:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412989696 00000100:00100000:1.0:1763343276.243549:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7369 00000100:00100000:1.0:1763343276.243555:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+17:3660:x1848998412989440:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343276.243570:0:28562:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:714 count 1 00002000:00010000:1.0:1763343276.243592:0:28562:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343276.243598:0:28562:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a404f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.243607:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.243609:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.243614:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a404f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.243625:0:28562:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a404f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.243633:0:28562:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a404f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.243639:0:28562:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a404f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.243667:0:28562:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343276.243793:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343276.243800:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a404f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.243807:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343276.243810:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a404f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.243818:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a404f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.244102:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a404f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.244108:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a404f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.244123:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343276.244125:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343276.244127:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343276.246111:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57155:x1848998399916928:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3306us (4240us total) trans 4294973741 rc 0/0 00000100:00100000:2.0:1763343276.246111:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+18:3660:x1848998412989568:12345-0@lo:2:osp-syn-1-1.0 Request processed in 4733us (5122us total) trans 17179871979 rc 0/0 00000100:00100000:3.0:1763343276.246124:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10807 00000100:00100000:2.0:1763343276.246124:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7368 00000100:00100000:2.0:1763343276.246154:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7370 00000100:00100000:2.0:1763343276.246166:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+17:3662:x1848998412989312:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763343276.246191:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:713 count 1 00010000:00010000:2.0:1763343276.246214:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4056 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.246231:0:8413:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a3e5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49940 expref: 16 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.246248:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343276.246251:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343276.246254:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4056 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.246294:0:8413:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a3e5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49940 expref: 16 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.246307:0:8413:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a3e5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49940 expref: 16 pid: 8412 timeout: 1169 lvb_type: 0 00000100:00100000:2.0:1763343276.246320:0:8413:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8413:1848998412989952:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343276.246393:0:8413:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c7ec3480 going to sleep for 11 seconds 00000100:00100000:1.0:1763343276.246513:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+17:3660:x1848998412989440:12345-0@lo:6:osp-syn-1-1.0 Request processed in 2957us (5494us total) trans 17179871980 rc 0/0 00000100:00100000:1.0:1763343276.246522:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7369 00000100:00100000:1.0:1763343276.246538:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7371 00000100:00100000:1.0:1763343276.246546:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+16:3662:x1848998412989184:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343276.246559:0:28562:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:710 count 1 00010000:00010000:1.0:1763343276.246571:0:28562:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a405d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.246582:0:28562:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3d4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498e5 expref: 16 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.246588:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343276.246590:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343276.246592:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a405d lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.246611:0:28562:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3d4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498e5 expref: 16 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.246620:0:28562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3d4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498e5 expref: 16 pid: 28561 timeout: 1169 lvb_type: 0 00000100:00100000:1.0:1763343276.246630:0:28562:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c478b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28562:1848998412990080:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343276.246655:0:28562:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9180 going to sleep for 11 seconds 00000100:00100000:1.0:1763343276.246673:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7372 00000100:00100000:1.0:1763343276.246681:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+16:3662:x1848998412989696:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763343276.246806:0:27798:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2cc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343276.246809:0:27798:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2cc:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343276.246812:0:27798:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2cc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343276.246814:0:27798:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2cc:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763343276.246816:0:27798:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2cc:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343276.246862:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+17:3662:x1848998412989696:12345-0@lo:2:osp-syn-1-1.0 Request processed in 181us (4136us total) trans 17179871981 rc 0/0 00000100:00100000:1.0:1763343276.246868:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7372 00000004:00080000:1.0:1763343276.246927:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c4788380/2, rc 0, transno 17179871980 00000100:00100000:1.0:1763343276.246934:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412989440:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1763343276.246946:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c4788e00/2, rc 0, transno 17179871979 00000100:00100000:1.0:1763343276.246949:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4788e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412989568:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1763343276.247252:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c478aa00/2, rc 0, transno 17179871981 00000100:00100000:2.0:1763343276.247257:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c478aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412989696:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343276.248628:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.248672:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399917056 00000100:00100000:1.0:1763343276.248681:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399917056 00000100:00100000:1.0:1763343276.248721:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7373 00000100:00100000:0.0:1763343276.248721:0:35281:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c39b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35281:1848998412988800:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343276.248740:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:55884:x1848998399917056:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343276.248743:0:35281:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4010 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.248753:0:28561:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343276.248768:0:28561:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4064 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b499d3 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343276.248786:0:28561:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1763343276.248788:0:8414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c39b4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1848998412988928:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343276.248798:0:8414:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3200/0x9104b1ba770a4017 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.248803:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.248805:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.248812:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4064 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499d3 expref: 18 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343276.248822:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:1.0:1763343276.248826:0:28561:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4064 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499d3 expref: 18 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.248838:0:28561:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176e00, rc 0) 00000100:00100000:0.0:1763343276.248839:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399917312 00000100:00100000:0.0:1763343276.248842:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399917312 00010000:00010000:0.0:1763343276.248859:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a3e50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49932 expref: 23 pid: 8626 timeout: 1169 lvb_type: 0 00000100:00100000:1.0:1763343276.248871:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:55884:x1848998399917056:12345-192.168.201.40@tcp:101:bash.0 Request processed in 132us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.248877:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7373 00000100:00100000:0.0:1763343276.248879:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3511 00000100:00100000:0.0:1763343276.248885:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2409:x1848998399917312:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343276.248894:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343276.248899:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a3e50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49932 expref: 23 pid: 8626 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.248908:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a3e50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49932 expref: 23 pid: 8626 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.248926:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a3e50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49932 expref: 23 pid: 8626 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.248938:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.248939:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.248943:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4010 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.248950:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4010 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.248977:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343276.248998:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2409:x1848998399917312:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 113us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.249004:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3511 00000100:00100000:0.0:1763343276.249061:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.249079:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399917440 00000100:00100000:0.0:1763343276.249083:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399917440 00010000:00010000:0.0:1763343276.249098:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a3da8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49901 expref: 22 pid: 28561 timeout: 1169 lvb_type: 0 00000100:00100000:0.0:1763343276.249117:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3512 00000100:00100000:0.0:1763343276.249123:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2408:x1848998399917440:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343276.249132:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343276.249137:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a3da8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49901 expref: 22 pid: 28561 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.249146:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a3da8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49901 expref: 22 pid: 28561 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.249159:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a3da8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49901 expref: 22 pid: 28561 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.249169:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.249171:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.249174:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3200/0x9104b1ba770a4017 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.249181:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3200/0x9104b1ba770a4017 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.249198:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343276.249219:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399917440:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 95us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.249226:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3512 00010000:00010000:0.0:1763343276.249259:0:8414:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3200/0x9104b1ba770a4017 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.249267:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3200/0x9104b1ba770a4017 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343276.249823:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4b21f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8626:1848998412988672:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343276.249841:0:8626:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a4009 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343276.249877:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.249921:0:11289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4788a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11289:1848998412989824:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343276.249934:0:11289:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4025 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343276.249966:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.249983:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399917184 00000100:00100000:2.0:1763343276.249987:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399917184 00010000:00010000:2.0:1763343276.250005:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c508aa00/0x9104b1ba770a3d77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498ec expref: 21 pid: 28561 timeout: 1169 lvb_type: 0 00000100:00100000:2.0:1763343276.250043:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399917568 00000100:00100000:2.0:1763343276.250047:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399917568 00010000:00010000:2.0:1763343276.250060:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3b40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4982f expref: 18 pid: 35281 timeout: 1169 lvb_type: 0 00000100:00100000:2.0:1763343276.250079:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3513 00000100:00100000:2.0:1763343276.250086:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399917184:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343276.250094:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343276.250098:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c508aa00/0x9104b1ba770a3d77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498ec expref: 21 pid: 28561 timeout: 1169 lvb_type: 0 00010000:00010000:2.0:1763343276.250107:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c508aa00/0x9104b1ba770a3d77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498ec expref: 21 pid: 28561 timeout: 1169 lvb_type: 0 00010000:00010000:2.0:1763343276.250123:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c508aa00/0x9104b1ba770a3d77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498ec expref: 21 pid: 28561 timeout: 1169 lvb_type: 0 00010000:00010000:2.0:1763343276.250133:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.250135:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.250138:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a4009 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.250145:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a4009 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.250162:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343276.250184:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2408:x1848998399917184:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 98us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.250191:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3513 00000100:00100000:2.0:1763343276.250204:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3514 00000100:00100000:2.0:1763343276.250210:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2407:x1848998399917568:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343276.250220:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343276.250224:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3b40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4982f expref: 18 pid: 35281 timeout: 1169 lvb_type: 0 00010000:00010000:2.0:1763343276.250234:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3b40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4982f expref: 18 pid: 35281 timeout: 1169 lvb_type: 0 00010000:00010000:2.0:1763343276.250260:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a3b40 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4982f expref: 18 pid: 35281 timeout: 1169 lvb_type: 0 00010000:00010000:2.0:1763343276.250275:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.250277:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.250280:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4025 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.250287:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4025 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.250303:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343276.250322:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998399917568:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 111us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.250328:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3514 00010000:00010000:2.0:1763343276.250348:0:8626:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a4009 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.250355:0:8626:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a4009 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.250364:0:8626:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a4009 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.250372:0:8626:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a4009 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.250388:0:8626:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343276.250615:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+33:3659:x1848998412988032:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12158us (12405us total) trans 21474839253 rc 0/0 00000100:00100000:2.0:1763343276.250626:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7361 00010000:00010000:2.0:1763343276.250644:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343276.250650:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a4009 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.250658:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343276.250662:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a4009 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.250669:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a4009 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.250680:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a4009 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.250687:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a4009 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.250700:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343276.250702:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343276.250704:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763343276.250727:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401edc2ce00/2, rc 0, transno 21474839253 00000100:00100000:2.0:1763343276.250733:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412988032:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1763343276.250747:0:11289:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4025 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.250755:0:11289:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4025 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.250763:0:11289:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4025 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.250770:0:11289:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4025 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343276.250817:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:0.0:1763343276.250874:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3200/0x9104b1ba770a4017 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.250880:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3200/0x9104b1ba770a4017 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.252053:0:35281:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4010 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.252068:0:35281:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4010 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.252076:0:35281:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4010 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.252083:0:35281:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4010 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.253806:0:11289:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1763343276.254093:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edde7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+17:3660:x1848998412989056:12345-0@lo:6:osp-syn-1-1.0 Request processed in 12970us (13143us total) trans 17179871982 rc 0/0 00000100:00100000:2.0:1763343276.254105:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7367 00010000:00010000:0.0:1763343276.254163:0:8414:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1763343276.254382:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+33:3662:x1848998412987904:12345-0@lo:6:osp-syn-0-1.0 Request processed in 14588us (14912us total) trans 21474839254 rc 0/0 00000100:00100000:0.0:1763343276.254389:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7364 00000100:00100000:3.0:1763343276.254795:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.254820:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000004:00080000:3.0:1763343276.254884:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c390ce00/2, rc 0, transno 17179871982 00000100:00100000:3.0:1763343276.254891:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412989056:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763343276.254913:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1763343276.254920:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4025 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.254935:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343276.254940:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4025 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.254950:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4025 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.254971:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4025 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.254979:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4025 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.254998:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763343276.255002:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3200/0x9104b1ba770a4017 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.255009:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343276.255012:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3200/0x9104b1ba770a4017 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.255019:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3200/0x9104b1ba770a4017 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.255047:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3200/0x9104b1ba770a4017 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.255057:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3200/0x9104b1ba770a4017 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.255070:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343276.255075:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4010 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.255080:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd9a00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343276.255084:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4010 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.255091:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4010 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.255100:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4010 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.255107:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343276.255109:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343276.255111:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343276.255729:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399917696 00000100:00100000:0.0:1763343276.255738:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399917696 00000004:00080000:2.0:1763343276.255760:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6e8df80/2, rc 0, transno 21474839254 00000100:00100000:2.0:1763343276.255766:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6e8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412987904:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343276.255779:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7374 00000100:00100000:2.0:1763343276.255780:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399917824 00000100:00100000:2.0:1763343276.255783:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399917824 00000100:00100000:0.0:1763343276.255787:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998399917696:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343276.255800:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.255801:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a3e5e lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49940 expref: 18 pid: 8412 timeout: 1169 lvb_type: 0 00000100:00100000:2.0:1763343276.255814:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399917952 00010000:00010000:0.0:1763343276.255814:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a406b lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b499da expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343276.255816:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399917952 00010000:00010000:2.0:1763343276.255826:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3d4d lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498e5 expref: 20 pid: 28561 timeout: 1169 lvb_type: 0 00000100:00100000:2.0:1763343276.255838:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3515 00000100:00100000:2.0:1763343276.255843:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399917824:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343276.255851:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343276.255855:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a3e5e lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49940 expref: 20 pid: 8412 timeout: 1169 lvb_type: 0 00000100:00100000:0.0:1763343276.255861:0:8414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4b23480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8414:1848998412990208:192.168.201.40@tcp:106: 00010000:00010000:2.0:1763343276.255865:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a3e5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49940 expref: 20 pid: 8412 timeout: 1169 lvb_type: 0 00010000:00010000:2.0:1763343276.255880:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.255882:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.255886:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4056 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.255894:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4056 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.255908:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343276.255919:0:8414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c39a5900 going to sleep for 11 seconds 00000100:00100000:2.0:1763343276.255927:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399917824:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 84us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.255933:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3515 00000100:00100000:0.0:1763343276.255937:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3516 00000100:00100000:0.0:1763343276.255943:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c32b0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2407:x1848998399917952:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343276.255950:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343276.255955:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3d4d lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498e5 expref: 19 pid: 28561 timeout: 1169 lvb_type: 0 00010000:00010000:2.0:1763343276.255963:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a3e5e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49940 expref: 19 pid: 8412 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.255964:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3d4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498e5 expref: 19 pid: 28561 timeout: 1169 lvb_type: 0 00000100:00100000:2.0:1763343276.255974:0:8413:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8413:1848998412989952:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343276.255977:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.255978:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.255981:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a405d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.255988:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a405d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.255989:0:8413:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4056 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.255998:0:8413:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4056 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.256001:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343276.256010:0:8413:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4056 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.256018:0:8413:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4056 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343276.256018:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c32b0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2407:x1848998399917952:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 75us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.256043:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3516 00010000:00010000:2.0:1763343276.256045:0:8413:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4056 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.256072:0:8413:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343276.256082:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343276.256088:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4056 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.256095:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343276.256098:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4056 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.256106:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4056 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.256116:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4056 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.256122:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4056 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.256134:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343276.256136:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343276.256138:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343276.256253:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+17:3662:x1848998412989312:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10074us (13587us total) trans 17179871983 rc 0/0 00000100:00100000:2.0:1763343276.256260:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7370 00000004:00080000:2.0:1763343276.256301:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c4789880/2, rc 0, transno 17179871983 00000100:00100000:2.0:1763343276.256306:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412989312:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1763343276.256315:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343276.257210:0:28562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a3d4d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b498e5 expref: 17 pid: 28561 timeout: 1169 lvb_type: 0 00000100:00100000:0.0:1763343276.257225:0:28562:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c478b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28562:1848998412990080:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343276.257251:0:28562:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a405d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.257261:0:28562:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a405d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.257268:0:28562:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a405d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.257277:0:28562:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a405d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.257285:0:28562:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a405d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.258494:0:28562:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343276.258511:0:35281:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343276.258518:0:35281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4010 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343276.258726:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+33:3659:x1848998412988160:12345-0@lo:6:osp-syn-0-1.0 Request processed in 19079us (20384us total) trans 21474839255 rc 0/0 00000100:00100000:1.0:1763343276.258735:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7363 00000100:00100000:0.0:1763343276.258746:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+17:3662:x1848998412989184:12345-0@lo:6:osp-syn-1-1.0 Request processed in 12202us (16040us total) trans 17179871984 rc 0/0 00000100:00100000:0.0:1763343276.258752:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7371 00010000:00010000:2.0:1763343276.258922:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343276.258930:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a405d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.258938:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343276.258942:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a405d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.258951:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a405d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.258973:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a405d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.258980:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a405d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.258996:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343276.258998:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343276.259000:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343276.259101:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343276.259157:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c4789180/2, rc 0, transno 17179871984 00000100:00100000:3.0:1763343276.259164:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4789180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412989184:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1763343276.259195:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401edc2c000/2, rc 0, transno 21474839255 00000100:00100000:2.0:1763343276.259201:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412988160:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343276.260980:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.261060:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399918080 00000100:00100000:1.0:1763343276.261070:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399918080 00000100:00100000:1.0:1763343276.261125:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7375 00000100:00100000:1.0:1763343276.261135:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:55884:x1848998399918080:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343276.261154:0:35281:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343276.261179:0:35281:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a4072 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b499e1 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343276.261204:0:35281:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343276.261225:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.261227:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.261253:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a4072 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499e1 expref: 21 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.261269:0:35281:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a4072 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499e1 expref: 21 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.261282:0:35281:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176200, rc 0) 00000100:00100000:1.0:1763343276.261337:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:55884:x1848998399918080:12345-192.168.201.40@tcp:101:bash.0 Request processed in 202us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.261344:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7375 00000100:00100000:2.0:1763343276.263544:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.263584:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.263603:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399918208 00000100:00100000:1.0:1763343276.263612:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399918208 00000100:00100000:3.0:1763343276.263632:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399918336 00000100:00100000:3.0:1763343276.263636:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399918336 00002000:00010000:1.0:1763343276.263647:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/715 (0->18446744073709551615) 00002000:00010000:3.0:1763343276.263649:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/714 (0->18446744073709551615) 00002000:00100000:3.0:1763343276.263653:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5a3c380 with x1848998399918336 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343276.263664:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5a3c380. 00002000:00100000:1.0:1763343276.263670:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5a3d500 with x1848998399918208 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343276.263676:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5a3d500. 00000100:00100000:3.0:1763343276.263688:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1753 00000100:00100000:1.0:1763343276.263692:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1754 00000100:00100000:3.0:1763343276.263696:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399918336:12345-192.168.201.40@tcp:10:bash.0 00000100:00100000:1.0:1763343276.263698:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998399918208:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:3.0:1763343276.263839:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2ca:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343276.263839:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2cb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343276.263843:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2ca:0x0] updating lvb mtime from disk: 0 -> 1763343275 00002000:00010000:1.0:1763343276.263843:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2cb:0x0] updating lvb mtime from disk: 0 -> 1763343275 00002000:00010000:3.0:1763343276.263846:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2ca:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343276.263846:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2cb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343276.263849:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2ca:0x0] updating lvb ctime from disk: 0 -> 1763343275 00002000:00010000:1.0:1763343276.263849:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2cb:0x0] updating lvb ctime from disk: 0 -> 1763343275 00002000:00010000:3.0:1763343276.263851:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2ca:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1763343276.263857:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2cb:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1763343276.263979:0:8414:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000400:0x2cb:0x0] updating lvb atime: 0 -> 1763343275 00000100:00100000:0.0:1763343276.263992:0:8414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4b23480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8414:1848998412990208:192.168.201.40@tcp:106: 00010000:00010000:0.0:1763343276.264213:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a406b lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499da expref: 18 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343276.264237:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a406b lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499da expref: 18 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343276.264266:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089600, rc 0) 00000100:00100000:1.0:1763343276.265613:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998399918208:12345-192.168.201.40@tcp:10:bash.0 Request processed in 1908us (2070us total) trans 17179871985 rc 0/0 00000100:00100000:1.0:1763343276.265624:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1754 00002000:00010000:1.0:1763343276.265630:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/715 (0->18446744073709551615) 00002000:00100000:1.0:1763343276.265633:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5a3d500 with x1848998399918208 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343276.265641:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5a3d500. 00000100:00100000:0.0:1763343276.266249:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399917696:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 10451us (15423us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343276.266258:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7374 00000100:00100000:2.0:1763343276.266716:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399918336:12345-192.168.201.40@tcp:10:bash.0 Request processed in 3017us (3127us total) trans 21474839256 rc 0/0 00000100:00100000:2.0:1763343276.266726:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1753 00002000:00010000:2.0:1763343276.266730:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/714 (0->18446744073709551615) 00002000:00100000:2.0:1763343276.266732:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5a3c380 with x1848998399918336 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343276.266739:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5a3c380. 00000100:00100000:2.0:1763343276.270774:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.271249:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399918592 00000100:00100000:0.0:1763343276.271261:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399918592 00000100:00100000:0.0:1763343276.271319:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3812 00000100:00100000:0.0:1763343276.271329:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8547c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:55884:x1848998399918592:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:0.0:1763343276.271615:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8547c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:55884:x1848998399918592:12345-192.168.201.40@tcp:35:bash.0 Request processed in 286us (849us total) trans 4294973742 rc 0/0 00000100:00100000:0.0:1763343276.271622:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3812 00000100:00100000:0.0:1763343276.273312:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.273430:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399918848 00000100:00100000:3.0:1763343276.273439:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399918848 00000100:00100000:3.0:1763343276.273516:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3813 00000100:00100000:3.0:1763343276.273526:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57155:x1848998399918848:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343276.273966:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57155:x1848998399918848:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 441us (660us total) trans 4294973743 rc 0/0 00000100:00100000:3.0:1763343276.273973:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3813 00000100:00100000:1.0:1763343276.280155:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.280256:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399919104 00000100:00100000:3.0:1763343276.280267:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399919104 00000100:00100000:3.0:1763343276.280327:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10808 00000100:00100000:3.0:1763343276.280336:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57155:x1848998399919104:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343276.280361:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343276.280384:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a4079 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b499e8 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.280507:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4080 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343276.280523:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a4041 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499cc expref: 302 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.280532:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4080 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x213:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.280564:0:33856:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a4041 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499cc expref: 302 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.280577:0:33856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a4041 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499cc expref: 302 pid: 33856 timeout: 1169 lvb_type: 0 00000100:00100000:3.0:1763343276.280591:0:33856:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c39b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412990336:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343276.280680:0:33856:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c8284840 going to sleep for 11 seconds 00000100:00100000:2.0:1763343276.283709:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.283774:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399919360 00000100:00100000:0.0:1763343276.283785:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399919360 00000100:00100000:0.0:1763343276.283853:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10809 00000100:00100000:0.0:1763343276.283863:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57156:x1848998399919360:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:0.0:1763343276.283917:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1763343276.283945:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a4002 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x213:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499c5 expref: 303 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.283967:0:6524:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a4041 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499cc expref: 302 pid: 33856 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.283981:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a3fca lrc: 0/0,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499b7 expref: 302 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.283997:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:0.0:1763343276.284001:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4080 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x213:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.284010:0:6524:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4080 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x213:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.284017:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4080 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x213:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.284075:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343276.284103:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a4087 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343276.284112:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a4087 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343276.284119:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a4087 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343276.284131:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a408e lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343276.284137:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a408e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343276.284143:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a408e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343276.284222:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a4095 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343276.284231:0:6524:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4080 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x213:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.284238:0:6524:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a4095 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x213:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343276.284260:0:6524:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4080 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x213:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.284268:0:6524:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a4095 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x213:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.284944:0:33856:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.40@tcp) returned -22 from blocking AST (req@000000009693d5ad x1848998412990336) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a4041 lrc: 1/0,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499cc expref: 301 pid: 33856 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343276.284960:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a4041 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499cc expref: 301 pid: 33856 timeout: 1169 lvb_type: 0 00000100:00100000:3.0:1763343276.284973:0:33856:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c39b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998412990336:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343276.284992:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:3.0:1763343276.284996:0:33856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a4095 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x213:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.285003:0:33856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a4095 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x213:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.285010:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4080 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x213:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.285021:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4080 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x213:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.285054:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4080 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x213:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 33856 initiator: MDT1 00000004:00200000:3.0:1763343276.285070:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x213:0x0]: returning size 5 00010000:00010000:3.0:1763343276.285228:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a4079 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x213:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499e8 expref: 302 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.285255:0:33856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4080 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x213:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499e8 expref: 301 pid: 33856 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343276.285265:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4080 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x213:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499e8 expref: 301 pid: 33856 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343276.286378:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917000, rc 0) 00000100:00100000:0.0:1763343276.286576:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57155:x1848998399919104:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 6236us (6426us total) trans 4294973744 rc 0/0 00000100:00100000:0.0:1763343276.286586:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10808 00000100:00100000:2.0:1763343276.291178:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.291727:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399919488 00000100:00100000:0.0:1763343276.291737:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399919488 00000100:00100000:0.0:1763343276.291799:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10810 00000100:00100000:0.0:1763343276.291808:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57155:x1848998399919488:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343276.291851:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.291872:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a40a3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b499ef expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.291966:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a40aa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343276.291979:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a4095 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x213:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343276.291986:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a40aa lrc: 4/1,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.292001:0:33856:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a4095 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x213:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343276.292010:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a40aa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:1.0:1763343276.292444:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.292804:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399919616 00000100:00100000:0.0:1763343276.292811:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399919616 00010000:00010000:0.0:1763343276.292837:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4080 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x213:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499e8 expref: 303 pid: 33856 timeout: 1169 lvb_type: 0 00000100:00100000:0.0:1763343276.292874:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3517 00000100:00100000:0.0:1763343276.292883:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4789c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:2408:x1848998399919616:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343276.292895:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343276.292901:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4080 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x213:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499e8 expref: 303 pid: 33856 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.292913:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4080 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x213:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499e8 expref: 303 pid: 33856 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.292935:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4080 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x213:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499e8 expref: 303 pid: 33856 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.292951:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:0.0:1763343276.292955:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a4095 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x213:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343276.292962:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a4095 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343276.292969:0:7904:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a4095 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343276.292980:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a40aa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.292986:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a40aa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.292991:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a40aa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.293889:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343276.293949:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4789c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:2408:x1848998399919616:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1065us (1504us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.293958:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3517 00010000:00010000:1.0:1763343276.294821:0:6524:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a4095 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343276.294832:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a4095 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00000004:00080000:1.0:1763343276.295117:0:6524:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x213:0x0] is inserted into orphan list, open count = 1 00010000:00010000:1.0:1763343276.295198:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a4095 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343276.295206:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a4095 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343276.295212:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a4095 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343276.295218:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343276.295223:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a4095 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343276.295233:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a4095 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343276.295258:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:1.0:1763343276.295261:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343276.295265:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a40aa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.295283:0:6524:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a40aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.295289:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a40aa lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.295316:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a4095 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x213:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343276.295323:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089000/0x9104b1ba770a4095 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x213:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343276.295340:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a4087 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343276.295347:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a4087 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343276.295352:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a4087 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343276.295358:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a4087 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343276.295363:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343276.295366:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a4087 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343276.295371:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a4087 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343276.295378:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695200) 00010000:00010000:1.0:1763343276.295380:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.295383:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a4087 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343276.295389:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089600/0x9104b1ba770a4087 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000004:00010000:1.0:1763343276.295405:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000042e59a07 reply state 0000000016e3a99f transno 4294973745 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a408e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343276.295415:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a408e lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343276.295421:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695000) 00010000:00010000:1.0:1763343276.295424:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343276.295426:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343276.295499:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57156:x1848998399919360:12345-192.168.201.40@tcp:36:rm.0 Request processed in 11634us (11797us total) trans 4294973745 rc 0/0 00000100:00100000:1.0:1763343276.295507:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10809 00010000:00010000:0.0:1763343276.295743:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a40aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.295751:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a40aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:0.0:1763343276.295777:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x213:0x0]: returning size 5 00000004:00200000:0.0:1763343276.295782:0:33856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343276.295797:0:33856:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a40aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.295827:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a40a3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499ef expref: 303 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.295841:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a40aa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499ef expref: 302 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.295848:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:0.0:1763343276.295851:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343276.295854:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089200, rc 0) 00000100:00100000:0.0:1763343276.295891:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57155:x1848998399919488:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 4084us (4723us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.295897:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10810 00000100:00100000:2.0:1763343276.301451:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.302225:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399919872 00000100:00100000:0.0:1763343276.302237:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399919872 00000100:00100000:0.0:1763343276.302310:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10811 00000100:00100000:0.0:1763343276.302319:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57155:x1848998399919872:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343276.302344:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.302368:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a40b1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b499f6 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.302474:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a40b8 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343276.302488:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a40b8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x213:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.302498:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a40b8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x213:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:0.0:1763343276.302510:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x213:0x0]: returning size 5 00010000:00010000:0.0:1763343276.302619:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a40b1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x213:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499f6 expref: 305 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.302639:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a40b8 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x213:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499f6 expref: 304 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.302648:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:0.0:1763343276.302651:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343276.302655:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c508b200, rc 0) 00000100:00100000:0.0:1763343276.302708:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57155:x1848998399919872:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 391us (1267us total) trans 4294973746 rc 0/0 00000100:00100000:0.0:1763343276.302716:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10811 00000100:00100000:1.0:1763343276.307845:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.307922:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399920000 00000100:00100000:0.0:1763343276.307932:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399920000 00000100:00100000:0.0:1763343276.308016:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7376 00000100:00100000:0.0:1763343276.308222:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399920000:12345-192.168.201.40@tcp:1:lfs.0 00010000:00010000:0.0:1763343276.308292:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c508be00/0x9104b1ba770a40c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.308311:0:8414:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4064 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499d3 expref: 16 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.308319:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343276.308322:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343276.308325:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c508be00/0x9104b1ba770a40c6 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.308367:0:8414:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4064 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499d3 expref: 16 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.308380:0:8414:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4064 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499d3 expref: 16 pid: 28561 timeout: 1169 lvb_type: 0 00000100:00100000:0.0:1763343276.308395:0:8414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4b20380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8414:1848998412990464:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343276.308483:0:8414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401d84de840 going to sleep for 11 seconds 00000100:00100000:2.0:1763343276.316081:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.316897:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399920128 00000100:00100000:3.0:1763343276.316908:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399920128 00002000:00100000:3.0:1763343276.316965:0:28390:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x2c0000400:0x2cb:0x0] (0->4) req@ffff9400c5b27480 x1848998399920128/t0(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:17/0 lens 496/0 e 0 to 0 dl 1763343287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343276.316977:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b27480 with x1848998399920128 ext(0->4) 00010000:00010000:3.0:1763343276.316987:0:28390:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4064 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499d3 expref: 17 pid: 28561 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343276.317005:0:28390:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4064 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499d3 expref: 17 pid: 28561 timeout: 1169 lvb_type: 0 00002000:00010000:3.0:1763343276.317019:0:28390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9400c5b27480 00000100:00100000:3.0:1763343276.317055:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 122 00000100:00100000:3.0:1763343276.317065:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998399920128:12345-192.168.201.40@tcp:4:bash.0 00000100:00100000:1.0:1763343276.317873:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.318191:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399920256 00000100:00100000:3.0:1763343276.318197:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399920256 00000100:00100000:3.0:1763343276.318234:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10812 00000100:00100000:3.0:1763343276.318250:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57157:x1848998399920256:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343276.318266:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1763343276.318586:0:8414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4b20380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8414:1848998412990464:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343276.318608:0:8414:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c508be00/0x9104b1ba770a40c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.318695:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a40cd lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b499fd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.318749:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a40d4 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343276.318761:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a40d4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.318770:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a40d4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.318778:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a40db lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343276.318785:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a40db lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.318790:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a40db lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.318823:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a40d4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.318829:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a40d4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.318834:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a40d4 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.318840:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a40d4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.318845:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343276.318848:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a40d4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.318854:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a40d4 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.318864:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b500) 00010000:00010000:3.0:1763343276.318866:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343276.318870:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a40d4 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.318875:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a40d4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.318885:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a40db lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.318890:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a40db lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.318895:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a40db lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.318899:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343276.318902:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a40db lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.318907:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a40db lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.318912:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695000) 00010000:00010000:3.0:1763343276.318914:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343276.318916:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a40db lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.318920:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a40db lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.318941:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a40cd lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499fd expref: 305 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.318949:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b500) 00010000:00010000:3.0:1763343276.318951:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343276.318954:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a40cd lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499fd expref: 305 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.318963:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3916200, rc 0) 00000100:00100000:2.0:1763343276.321147:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2407:x1848998399920128:12345-192.168.201.40@tcp:4:bash.0 Request processed in 4071us (5064us total) trans 17179871986 rc 0/0 00000100:00100000:2.0:1763343276.321162:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 122 00002000:00100000:2.0:1763343276.321176:0:28390:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x2c0000400:0x2cb:0x0] (0->4) req@ffff9400c5b27480 x1848998399920128/t17179871986(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:17/0 lens 496/448 e 0 to 0 dl 1763343287 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763343276.321187:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b27480 with x1848998399920128 ext(0->4) 00010000:00010000:2.0:1763343276.321196:0:28390:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4064 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499d3 expref: 19 pid: 28561 timeout: 1169 lvb_type: 0 00010000:00010000:2.0:1763343276.321216:0:28390:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4064 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499d3 expref: 19 pid: 28561 timeout: 1169 lvb_type: 0 00002000:00010000:2.0:1763343276.321224:0:28390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9400c5b27480 00000100:00100000:3.0:1763343276.321390:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57157:x1848998399920256:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3146us (3516us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343276.321398:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10812 00000100:00100000:2.0:1763343276.326172:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.326223:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399920384 00000100:00100000:0.0:1763343276.326233:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399920384 00010000:00010000:0.0:1763343276.326281:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4064 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499d3 expref: 19 pid: 28561 timeout: 1169 lvb_type: 0 00000100:00100000:0.0:1763343276.326326:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3518 00000100:00100000:0.0:1763343276.326336:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2410:x1848998399920384:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343276.326351:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1763343276.326370:0:7904:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2cb:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:0.0:1763343276.326374:0:7904:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2cb:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1763343276.326380:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4064 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499d3 expref: 19 pid: 28561 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.326393:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4064 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499d3 expref: 19 pid: 28561 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.326416:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4064 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499d3 expref: 19 pid: 28561 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.326430:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.326432:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.326436:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c508be00/0x9104b1ba770a40c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.326450:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c508be00/0x9104b1ba770a40c6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.326491:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343276.326547:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2410:x1848998399920384:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 212us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.326556:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3518 00010000:00010000:2.0:1763343276.326745:0:8414:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c508be00/0x9104b1ba770a40c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.326755:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c508be00/0x9104b1ba770a40c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.326775:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c508be00/0x9104b1ba770a40c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.326784:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c508be00/0x9104b1ba770a40c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.326792:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c508be00/0x9104b1ba770a40c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.326803:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508be00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343276.326807:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c508be00/0x9104b1ba770a40c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.326816:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c508be00/0x9104b1ba770a40c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.326829:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c508be00/0x9104b1ba770a40c6 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.326836:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c508be00/0x9104b1ba770a40c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343276.327537:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998399920000:12345-192.168.201.40@tcp:1:lfs.0 Request processed in 19509us (19698us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.327546:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7376 00000100:00100000:2.0:1763343276.328197:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.329824:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399920512 00000100:00100000:1.0:1763343276.329838:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399920512 00000100:00100000:2.0:1763343276.330207:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10813 00000100:00100000:2.0:1763343276.330221:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57157:x1848998399920512:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343276.330253:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.330292:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a40e2 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49a04 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.330369:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a40e9 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343276.330389:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a40e9 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.330400:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a40e9 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.330411:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a40f0 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343276.330418:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a40f0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.330424:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a40f0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.330467:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a40e9 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.330475:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a40e9 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.330481:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a40e9 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.330488:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583e400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.330492:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a40e9 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.330500:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a40e9 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.330512:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48acc00) 00010000:00010000:2.0:1763343276.330515:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.330521:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a40e9 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.330527:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a40e9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.330540:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a40f0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.330545:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a40f0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.330551:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a40f0 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.330556:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583fa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.330559:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a40f0 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.330564:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a40f0 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.330571:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695000) 00010000:00010000:2.0:1763343276.330574:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.330577:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a40f0 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.330583:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a40f0 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.330613:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a40e2 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a04 expref: 305 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.330624:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48acc00) 00010000:00010000:2.0:1763343276.330627:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.330631:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a40e2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a04 expref: 305 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.330644:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583ea00, rc 0) 00000100:00100000:2.0:1763343276.333153:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57157:x1848998399920512:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2921us (4943us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343276.333169:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10813 00000100:00100000:0.0:1763343276.333588:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.333706:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399920768 00000100:00100000:2.0:1763343276.333715:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399920768 00000100:00100000:2.0:1763343276.334391:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10814 00000100:00100000:2.0:1763343276.334404:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57155:x1848998399920768:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:2.0:1763343276.334452:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343276.334479:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089200/0x9104b1ba770a40aa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499ef expref: 304 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.334498:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:2.0:1763343276.334502:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343276.334530:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a40f7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343276.334542:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a40f7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.334551:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a40f7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000040:00080000:2.0:1763343276.334759:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1770, 88 off147176 00000004:00080000:2.0:1763343276.334766:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1069458741282ns, next at 1070049115839ns, rc = 0 00000040:00080000:2.0:1763343276.334808:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1762, 88 off146520 00000004:00080000:2.0:1763343276.334813:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1069458788096ns, next at 1070049318579ns, rc = 0 00000040:00080000:2.0:1763343276.334825:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1763, 88 off146608 00000004:00080000:2.0:1763343276.334827:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1069458802892ns, next at 1070049318579ns, rc = 0 00000040:00080000:2.0:1763343276.334836:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1771, 88 off147264 00000004:00080000:2.0:1763343276.334838:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1069458813966ns, next at 1070049115839ns, rc = 0 00000100:00100000:3.0:1763343276.337085:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.337194:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399920896 00000100:00100000:0.0:1763343276.337204:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399920896 00000100:00100000:0.0:1763343276.337259:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10815 00000100:00100000:0.0:1763343276.337278:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57157:x1848998399920896:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343276.337298:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.337322:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a40fe lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49a0b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.337384:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a4105 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343276.337397:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a4105 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343276.337407:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a4105 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:0.0:1763343276.337449:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343276.337455:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343276.337489:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a40fe lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a0b expref: 307 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.337508:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a4105 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a0b expref: 306 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.337516:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695e00) 00010000:00010000:0.0:1763343276.337518:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343276.337521:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d1e9ec00, rc 0) 00000100:00100000:0.0:1763343276.337576:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57157:x1848998399920896:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 307us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.337583:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10815 00010000:00010000:3.0:1763343276.338385:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a408e lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.338396:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a408e lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.338403:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a408e lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.338408:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343276.338412:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a408e lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.338419:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a408e lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.338432:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695000) 00010000:00010000:3.0:1763343276.338435:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343276.338439:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a408e lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343276.338445:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a408e lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000001:00080000:0.0:1763343276.338501:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973747 is committed 00000004:00080000:0.0:1763343276.338507:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1138 committed 00000004:00080000:0.0:1763343276.339061:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1130 committed 00000004:00080000:0.0:1763343276.339074:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1129 committed 00000004:00080000:0.0:1763343276.339076:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1137 committed 00000004:00010000:3.0:1763343276.339174:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d486f2c0 reply state 00000000789d5d4e transno 4294973747 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a40f7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.339188:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a40f7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.339196:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:3.0:1763343276.339198:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1763343276.339202:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343276.339307:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412990720:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343276.339344:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412990592:0@lo:2:osp-syn-0-1.0 00010000:00080000:3.0:1763343276.339540:0:33856:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763343276.339552:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57155:x1848998399920768:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 5151us (5965us total) trans 4294973747 rc 0/0 00000100:00100000:3.0:1763343276.339561:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10814 00010000:00010000:3.0:1763343276.339587:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a40f7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.339593:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a40f7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.339599:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a40f7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.339604:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343276.339608:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a40f7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.339614:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a40f7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.339622:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:3.0:1763343276.339624:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343276.339627:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a40f7 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.339632:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a40f7 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000100:00100000:2.0:1763343276.340490:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343276.340552:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412990720 00000100:00100000:2.0:1763343276.340559:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412990720 00000100:00100000:1.0:1763343276.340584:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c2f84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412990976:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343276.340599:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7377 00000100:00100000:2.0:1763343276.340607:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+33:3659:x1848998412990720:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343276.340614:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.340641:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4788a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412990848:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343276.340663:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.340686:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412990976 00000100:00100000:1.0:1763343276.340689:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412990976 00000100:00100000:1.0:1763343276.340709:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412990848 00000100:00100000:1.0:1763343276.340711:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412990848 00000100:00100000:1.0:1763343276.340726:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7378 00000100:00100000:1.0:1763343276.340732:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+18:3661:x1848998412990976:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1763343276.340743:0:8414:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2cb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343276.340746:0:8414:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2cb:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763343276.340748:0:8414:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2cb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343276.340751:0:8414:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2cb:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763343276.340752:0:8414:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2cb:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343276.340780:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+34:3659:x1848998412990720:12345-0@lo:2:osp-syn-0-1.0 Request processed in 174us (293us total) trans 21474839257 rc 0/0 00000100:00100000:2.0:1763343276.340787:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7377 00002000:00010000:1.0:1763343276.340795:0:8626:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2cc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343276.340797:0:8626:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2cc:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343276.340800:0:8626:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2cc:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:2.0:1763343276.340801:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7379 00002000:00010000:1.0:1763343276.340802:0:8626:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2cc:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763343276.340804:0:8626:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2cc:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343276.340806:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+19:3660:x1848998412990848:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343276.340832:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+19:3661:x1848998412990976:12345-0@lo:2:osp-syn-1-1.0 Request processed in 100us (217us total) trans 17179871987 rc 0/0 00000100:00100000:1.0:1763343276.340839:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7378 00000004:00080000:1.0:1763343276.340874:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c2f84a80/2, rc 0, transno 17179871987 00000100:00100000:2.0:1763343276.340877:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+19:3660:x1848998412990848:12345-0@lo:2:osp-syn-1-1.0 Request processed in 70us (211us total) trans 17179871988 rc 0/0 00000100:00100000:1.0:1763343276.340879:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c2f84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412990976:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343276.340882:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7379 00000004:00080000:1.0:1763343276.340895:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c4788a80/2, rc 0, transno 17179871988 00000100:00100000:1.0:1763343276.340899:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4788a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412990848:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763343276.340913:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b26a00/2, rc 0, transno 21474839257 00000100:00100000:1.0:1763343276.340917:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412990720:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343276.342660:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343276.342712:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412990592 00000100:00100000:2.0:1763343276.342721:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412990592 00000100:00100000:2.0:1763343276.342767:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7380 00000100:00100000:2.0:1763343276.342777:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+34:3662:x1848998412990592:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1763343276.342906:0:35281:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2ca:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343276.342910:0:35281:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2ca:0x0] updating lvb mtime from disk: 1763343275 -> 1763343275 00002000:00010000:2.0:1763343276.342912:0:35281:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2ca:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343276.342914:0:35281:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2ca:0x0] updating lvb ctime from disk: 1763343275 -> 1763343275 00002000:00010000:2.0:1763343276.342916:0:35281:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2ca:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343276.342963:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+35:3662:x1848998412990592:12345-0@lo:2:osp-syn-0-1.0 Request processed in 187us (310us total) trans 21474839258 rc 0/0 00000100:00100000:2.0:1763343276.342970:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7380 00000004:00080000:0.0:1763343276.342997:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b27800/2, rc 0, transno 21474839258 00000100:00100000:0.0:1763343276.343003:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412990592:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343276.343664:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.343734:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.343775:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399921024 00000100:00100000:0.0:1763343276.343781:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399921024 00000100:00100000:0.0:1763343276.343818:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399921152 00000100:00100000:0.0:1763343276.343821:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399921152 00000100:00100000:1.0:1763343276.343831:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10816 00000100:00100000:1.0:1763343276.343840:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57155:x1848998399921024:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343276.343857:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343276.343876:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a410c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49a12 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.343929:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a410c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a12 expref: 299 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.343944:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a410c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a12 expref: 299 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.343962:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:1.0:1763343276.343965:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343276.343968:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176e00, rc 0) 00000100:00100000:0.0:1763343276.344059:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10817 00000100:00100000:0.0:1763343276.344067:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57157:x1848998399921152:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343276.344075:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.344085:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a4113 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49a19 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.344139:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a411a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00000100:00100000:1.0:1763343276.344326:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57155:x1848998399921024:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 486us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.344333:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10816 00010000:00010000:0.0:1763343276.344546:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a411a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.344564:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a411a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.344581:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a4121 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343276.344589:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a4121 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.344595:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a4121 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.344632:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a411a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.344639:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a411a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.344645:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a411a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.344651:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a411a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.344657:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e90600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.344660:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a411a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.344672:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a411a lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.344682:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695e00) 00010000:00010000:0.0:1763343276.344685:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.344689:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a411a lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.344694:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e90600/0x9104b1ba770a411a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.344708:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a4121 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.344713:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a4121 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.344719:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a4121 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.344724:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e91e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.344726:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a4121 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.344732:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a4121 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.344740:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695500) 00010000:00010000:0.0:1763343276.344742:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.344745:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a4121 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.344750:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e91e00/0x9104b1ba770a4121 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.344779:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a4113 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a19 expref: 299 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.344789:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695e00) 00010000:00010000:0.0:1763343276.344792:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.344795:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ea00/0x9104b1ba770a4113 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a19 expref: 299 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.344805:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d1e9ea00, rc 0) 00000100:00100000:0.0:1763343276.344840:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57157:x1848998399921152:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 773us (1106us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343276.344846:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10817 00000100:00100000:1.0:1763343276.346693:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.346773:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399921280 00000100:00100000:0.0:1763343276.346782:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399921280 00000100:00100000:0.0:1763343276.346865:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10818 00000100:00100000:0.0:1763343276.346876:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57155:x1848998399921280:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343276.346894:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.346912:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a4128 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49a20 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.346979:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a412f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343276.346992:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a412f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.347002:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a412f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:3.0:1763343276.347343:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000004:00200000:0.0:1763343276.347471:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x213:0x0]: returning size 5 00000004:00200000:0.0:1763343276.347476:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343276.347495:0:9827:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a412f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.347520:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4ba00/0x9104b1ba770a4128 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a20 expref: 300 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.347536:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a412f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a20 expref: 299 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.347544:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:0.0:1763343276.347546:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1763343276.347549:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3b4b600, rc 0) 00000100:00100000:0.0:1763343276.347602:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57155:x1848998399921280:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 728us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.347609:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10818 00000100:00100000:0.0:1763343276.347628:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399921536 00000100:00100000:0.0:1763343276.347632:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399921536 00000100:00100000:0.0:1763343276.347657:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10819 00000100:00100000:0.0:1763343276.347664:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57157:x1848998399921536:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343276.347672:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.347674:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343276.347688:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d1e9ec00/0x9104b1ba770a4105 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a0b expref: 299 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.347700:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695e00) 00010000:00010000:0.0:1763343276.347709:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343276.347739:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4136 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49a27 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.347815:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a413d lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343276.347824:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a413d lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.347836:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a413d lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.347849:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4144 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343276.347855:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4144 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.347861:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4144 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.348264:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a414b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x214:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343276.348273:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a414b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.348281:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a414b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:0.0:1763343276.348289:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x214:0x0]: returning size 0 00010000:00010000:0.0:1763343276.348311:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a413d lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.348318:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a413d lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.348324:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a413d lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.348330:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a413d lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.348335:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.348339:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a413d lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.348346:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a413d lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.348354:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695f00) 00010000:00010000:0.0:1763343276.348357:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.348360:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a413d lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.348365:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a413d lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000004:00010000:0.0:1763343276.348374:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009e55c63f reply state 00000000a0e52ba2 transno 4294973748 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4144 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.348384:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4144 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.348390:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695000) 00010000:00010000:0.0:1763343276.348392:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343276.348394:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343276.348414:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4136 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a27 expref: 301 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.348433:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a414b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a27 expref: 300 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.348439:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x214:0x0].0x0 (ffff9401f6695200) 00010000:00010000:0.0:1763343276.348441:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343276.348443:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b200, rc 0) 00000100:00100000:0.0:1763343276.348468:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57157:x1848998399921536:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 805us (1127us total) trans 4294973748 rc 0/0 00000100:00100000:0.0:1763343276.348474:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10819 00000100:00100000:3.0:1763343276.350572:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.350676:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.351355:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399921664 00000100:00100000:2.0:1763343276.351367:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399921664 00000100:00100000:2.0:1763343276.351421:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7381 00000100:00100000:2.0:1763343276.351431:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998399921664:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343276.351447:0:35281:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1763343276.351471:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399921920 00010000:00010000:2.0:1763343276.351472:0:35281:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4159 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49a2e expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343276.351475:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399921920 00002000:00010000:2.0:1763343276.351495:0:35281:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2cb:0x0] initial LVB size: 5, mtime: 0x691a7bab, atime: 0x691a7bab, ctime: 0x691a7bab, blocks: 0x8 00000100:00100000:1.0:1763343276.351505:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10820 00000100:00100000:1.0:1763343276.351511:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57157:x1848998399921920:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343276.351512:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.351514:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.351523:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.351529:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4159 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a2e expref: 18 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343276.351535:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a4160 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x214:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49a35 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.351545:0:35281:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4159 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a2e expref: 18 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343276.351556:0:35281:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583fa00, rc 0) 00000100:00100000:2.0:1763343276.351607:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998399921664:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 177us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.351614:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7381 00010000:00010000:1.0:1763343276.351621:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4167 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x214:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343276.351634:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a414b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a27 expref: 302 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.351647:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4167 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x214:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.351681:0:9827:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a414b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a27 expref: 302 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.351694:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a414b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a27 expref: 302 pid: 9827 timeout: 1169 lvb_type: 0 00000100:00100000:1.0:1763343276.351708:0:9827:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412991104:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343276.351767:0:9827:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9300 going to sleep for 11 seconds 00000100:00100000:0.0:1763343276.355609:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.357472:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412991104:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343276.357508:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4167 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x214:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:2.0:1763343276.357679:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399922048 00000100:00100000:2.0:1763343276.357688:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399922048 00010000:00010000:2.0:1763343276.357729:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a414b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a27 expref: 303 pid: 9827 timeout: 1169 lvb_type: 0 00000100:00100000:2.0:1763343276.357769:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3519 00000100:00100000:2.0:1763343276.357780:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:2407:x1848998399922048:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343276.358122:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343276.358133:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a414b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a27 expref: 303 pid: 9827 timeout: 1169 lvb_type: 0 00010000:00010000:2.0:1763343276.358147:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a414b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a27 expref: 303 pid: 9827 timeout: 1169 lvb_type: 0 00010000:00010000:2.0:1763343276.358172:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a414b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a27 expref: 303 pid: 9827 timeout: 1169 lvb_type: 0 00010000:00010000:2.0:1763343276.358191:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x214:0x0].0x0 (ffff9401f6695200) 00010000:00010000:2.0:1763343276.358197:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4167 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x214:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.358207:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4167 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x214:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.358215:0:7904:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4167 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x214:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.358259:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343276.358337:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:2407:x1848998399922048:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 557us (2739us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.358346:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3519 00010000:00010000:1.0:1763343276.358460:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4167 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x214:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.358469:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4167 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x214:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343276.358501:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x214:0x0]: returning size 0 00000004:00080000:1.0:1763343276.358735:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2cc:0x0], index 0: 0 00000004:00080000:1.0:1763343276.358743:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2cd:0x0], index 1: 0 00000004:00080000:1.0:1763343276.358748:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2ce:0x0], index 1: 0 00000004:00080000:1.0:1763343276.358752:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2cd:0x0], index 0: 0 00010000:00010000:1.0:1763343276.358899:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4167 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x214:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.358912:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4167 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x214:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.358920:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4167 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x214:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.358927:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343276.358931:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4167 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x214:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.358939:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4167 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x214:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.358950:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x214:0x0].0x0 (ffff9401f6695200) 00010000:00010000:1.0:1763343276.358953:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343276.358956:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4167 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x214:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.358963:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4167 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x214:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.359016:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a4160 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x214:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a35 expref: 302 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.359077:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x214:0x0].0x0 (ffff9401f6695200) 00010000:00010000:1.0:1763343276.359080:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343276.359084:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a4160 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x214:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a35 expref: 302 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.359103:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176a00, rc 0) 00000100:00100000:1.0:1763343276.359161:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57157:x1848998399921920:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 7649us (8484us total) trans 4294973749 rc 301/301 00000100:00100000:1.0:1763343276.359170:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10820 00000100:00100000:0.0:1763343276.363553:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.363681:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399922304 00000100:00100000:3.0:1763343276.363695:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399922304 00000100:00100000:3.0:1763343276.363767:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3814 00000100:00100000:3.0:1763343276.363780:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57157:x1848998399922304:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343276.364140:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57157:x1848998399922304:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 361us (600us total) trans 4294973750 rc 0/0 00000100:00100000:3.0:1763343276.364149:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3814 00000100:00100000:2.0:1763343276.367639:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.367804:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399922560 00000100:00100000:0.0:1763343276.367816:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399922560 00000100:00100000:0.0:1763343276.367884:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3815 00000100:00100000:0.0:1763343276.367896:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57157:x1848998399922560:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343276.368196:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57157:x1848998399922560:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 300us (577us total) trans 4294973751 rc 0/0 00000100:00100000:0.0:1763343276.368205:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3815 00000100:00100000:1.0:1763343276.372328:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.372425:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399922816 00000100:00100000:0.0:1763343276.372435:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399922816 00000100:00100000:0.0:1763343276.372488:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10821 00000100:00100000:0.0:1763343276.372497:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:55884:x1848998399922816:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343276.372519:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.372541:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4175 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49a3c expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.374393:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a417c lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343276.374415:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a417c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.374426:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a417c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.374437:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4183 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343276.374443:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4183 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.374449:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4183 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.374525:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a418a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x214:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343276.374533:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a418a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.374540:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a418a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:0.0:1763343276.374550:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x214:0x0]: returning size 0 00010000:00010000:0.0:1763343276.374634:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a417c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.374641:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a417c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.374651:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a417c lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.374657:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a417c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.374662:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.374666:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a417c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.374673:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a417c lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.374684:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695f00) 00010000:00010000:0.0:1763343276.374687:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.374691:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a417c lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.374697:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a417c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.374712:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4183 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.374717:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4183 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.374723:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4183 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.374728:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.374731:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4183 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.374739:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4183 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.374746:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695000) 00010000:00010000:0.0:1763343276.374749:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.374751:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4183 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.374757:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4183 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.374801:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4175 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a3c expref: 306 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.374820:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a418a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a3c expref: 305 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.374827:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x214:0x0].0x0 (ffff9401f6695e00) 00010000:00010000:0.0:1763343276.374829:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343276.374832:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501ba00, rc 0) 00000100:00100000:0.0:1763343276.374907:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:55884:x1848998399922816:12345-192.168.201.40@tcp:101:bash.0 Request processed in 2409us (2591us total) trans 4294973752 rc 0/0 00000100:00100000:0.0:1763343276.374916:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10821 00000100:00100000:1.0:1763343276.378284:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.378368:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399922944 00000100:00100000:0.0:1763343276.378382:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399922944 00000100:00100000:0.0:1763343276.378450:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10822 00000100:00100000:0.0:1763343276.378460:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:55884:x1848998399922944:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343276.378486:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.378512:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4198 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x214:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49a43 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.378550:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a419f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x214:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343276.378565:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a419f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x214:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.378578:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a419f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x214:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.382544:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4198 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x214:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a43 expref: 307 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.382569:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a419f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x214:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a43 expref: 306 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.382579:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x214:0x0].0x0 (ffff9401f6695e00) 00010000:00010000:0.0:1763343276.382582:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343276.382586:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501aa00, rc 0) 00000100:00100000:0.0:1763343276.382678:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:55884:x1848998399922944:12345-192.168.201.40@tcp:101:bash.0 Request processed in 4217us (4403us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.382687:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10822 00000100:00100000:2.0:1763343276.385138:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.385801:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399923200 00000100:00100000:3.0:1763343276.385814:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399923200 00000100:00100000:3.0:1763343276.385880:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10823 00000100:00100000:3.0:1763343276.385891:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:55884:x1848998399923200:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:3.0:1763343276.385953:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343276.385983:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a418a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a3c expref: 306 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.386005:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x214:0x0].0x0 (ffff9401f6695e00) 00010000:00010000:3.0:1763343276.386011:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343276.386209:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a41a6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x214:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343276.386223:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a41a6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x214:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.386233:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a41a6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x214:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000001:00080000:3.0:1763343276.386290:0:33856:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973753 00000004:00010000:3.0:1763343276.386314:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d678e025 reply state 0000000064f11c2f transno 4294973754 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a41a6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x214:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.386326:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a41a6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x214:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.386332:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x214:0x0].0x0 (ffff9401f6695e00) 00010000:00010000:3.0:1763343276.386336:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343276.386339:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343276.386436:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:55884:x1848998399923200:12345-192.168.201.40@tcp:36:bash.0 Request processed in 546us (1307us total) trans 4294973754 rc 0/0 00000100:00100000:3.0:1763343276.386444:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10823 00000020:00080000:3.0:1763343276.386449:0:33856:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343276.389448:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.389523:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399923328 00000100:00100000:0.0:1763343276.389534:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399923328 00000100:00100000:0.0:1763343276.389592:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7382 00000100:00100000:0.0:1763343276.389603:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998399923328:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:0.0:1763343276.389719:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998399923328:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 118us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.389731:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7382 00000100:00100000:1.0:1763343276.394198:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.394341:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399923456 00000100:00100000:0.0:1763343276.394352:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399923456 00000100:00100000:0.0:1763343276.394415:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10824 00000100:00100000:0.0:1763343276.394425:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:55884:x1848998399923456:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343276.394448:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.394470:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a41ad lrc: 2/0,0 mode: --/CR res: [0x240000404:0x214:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49a4a expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.394527:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a41ad lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x214:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a4a expref: 309 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.394542:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a41ad lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x214:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a4a expref: 309 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.394561:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x214:0x0].0x0 (ffff9401f6695e00) 00010000:00010000:0.0:1763343276.394565:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343276.394567:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a400, rc 0) 00000100:00100000:0.0:1763343276.394631:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:55884:x1848998399923456:12345-192.168.201.40@tcp:101:bash.0 Request processed in 201us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.394638:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10824 00000100:00100000:1.0:1763343276.394788:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.395068:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399923584 00000100:00100000:0.0:1763343276.395073:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399923584 00000100:00100000:0.0:1763343276.395100:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7383 00000100:00100000:0.0:1763343276.395107:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2407:x1848998399923584:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:0.0:1763343276.395186:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2407:x1848998399923584:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 78us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.395193:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7383 00000100:00100000:1.0:1763343276.400796:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.401424:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.401480:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399923968 00000100:00100000:3.0:1763343276.401495:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399923840 00000100:00100000:2.0:1763343276.401495:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399923968 00000100:00100000:3.0:1763343276.401499:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399923840 00000100:00100000:3.0:1763343276.401557:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10825 00000100:00100000:2.0:1763343276.401557:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1755 00000100:00100000:3.0:1763343276.401569:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:55884:x1848998399923840:12345-192.168.201.40@tcp:101:bash.0 00000100:00100000:2.0:1763343276.401569:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998399923968:12345-192.168.201.40@tcp:3:lfs.0 00010000:00010000:3.0:1763343276.401586:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343276.401589:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343276.401613:0:28390:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c583e800/0x9104b1ba770a41b4 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.401619:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a41ad lrc: 0/0,0 mode: --/CR res: [0x240000404:0x214:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a4a expref: 309 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.401636:0:28390:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.401638:0:28390:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.401643:0:28390:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583e800/0x9104b1ba770a41b4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.401645:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x214:0x0].0x0 (ffff9401f6695e00) 00010000:00010000:3.0:1763343276.401650:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343276.401655:0:28390:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c583e800/0x9104b1ba770a41b4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.401661:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a41bb lrc: 2/0,0 mode: --/EX res: [0x240000404:0x214:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49a51 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.401699:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a41c2 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x214:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343276.401710:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a41c2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x214:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.401717:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a41c2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x214:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.401757:0:28390:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c583e800/0x9104b1ba770a41b4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.401764:0:28390:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583e800/0x9104b1ba770a41b4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.401770:0:28390:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c583e800/0x9104b1ba770a41b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.401777:0:28390:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583e800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343276.401781:0:28390:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c583e800/0x9104b1ba770a41b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.401788:0:28390:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c583e800/0x9104b1ba770a41b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.401801:0:28390:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c583e800/0x9104b1ba770a41b4 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.401807:0:28390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c583e800/0x9104b1ba770a41b4 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343276.401873:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998399923968:12345-192.168.201.40@tcp:3:lfs.0 Request processed in 307us (450us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763343276.401880:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1755 00000040:00080000:2.0:1763343276.401980:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1764, 88 off146696 00000004:00080000:2.0:1763343276.401988:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1069525962802ns, next at 1070049318579ns, rc = 0 00000040:00080000:2.0:1763343276.402051:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1772, 88 off147352 00000004:00080000:2.0:1763343276.402057:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1069526032457ns, next at 1070049115839ns, rc = 0 00000040:00080000:2.0:1763343276.402251:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1774, 88 off147544 00000004:00080000:2.0:1763343276.402257:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1069526232294ns, next at 1070049115839ns, rc = 0 00000040:00080000:2.0:1763343276.402286:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1765, 88 off146784 00000004:00080000:2.0:1763343276.402291:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1069526266099ns, next at 1070049318579ns, rc = 0 00000001:00080000:0.0:1763343276.404919:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973755 is committed 00000004:00080000:0.0:1763343276.404932:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1132 committed 00010000:00010000:3.0:1763343276.404947:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4144 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00000004:00080000:0.0:1763343276.404949:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1140 committed 00010000:00010000:3.0:1763343276.404964:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4144 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343276.404972:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4144 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343276.404977:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343276.404982:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4144 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343276.404989:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4144 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343276.405005:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695000) 00010000:00010000:3.0:1763343276.405009:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343276.405013:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4144 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343276.405019:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4144 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343276.405059:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a41a6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x214:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.405064:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a41a6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x214:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.405070:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a41a6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x214:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.405075:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343276.405077:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a41a6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x214:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.405083:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a41a6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x214:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.405090:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x214:0x0].0x0 (ffff9401f6695e00) 00010000:00010000:3.0:1763343276.405093:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343276.405096:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a41a6 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x214:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000100:00100000:2.0:1763343276.405100:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1763343276.405101:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a41a6 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x214:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000100:00100000:2.0:1763343276.405118:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5951500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412991232:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343276.405185:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343276.405234:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5950380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412991360:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343276.405266:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343276.405297:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412991232 00000100:00100000:2.0:1763343276.405304:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412991232 00000100:00100000:2.0:1763343276.405339:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412991360 00000100:00100000:2.0:1763343276.405343:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412991360 00000100:00100000:2.0:1763343276.405368:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7384 00000100:00100000:2.0:1763343276.405375:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+36:3661:x1848998412991232:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343276.405407:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7385 00000100:00100000:3.0:1763343276.405415:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5953100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+36:3659:x1848998412991360:12345-0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763343276.405520:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1139 committed 00000100:00100000:3.0:1763343276.405534:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5953100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+38:3659:x1848998412991360:12345-0@lo:2:osp-syn-0-1.0 Request processed in 120us (266us total) trans 21474839259 rc 0/0 00000100:00100000:3.0:1763343276.405540:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7385 00000100:00100000:1.0:1763343276.405645:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c859aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412991488:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343276.405674:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.405703:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412991488 00000100:00100000:1.0:1763343276.405707:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412991488 00000100:00100000:1.0:1763343276.405736:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7386 00000100:00100000:1.0:1763343276.405742:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+19:3660:x1848998412991488:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343276.405838:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+20:3660:x1848998412991488:12345-0@lo:2:osp-syn-1-1.0 Request processed in 96us (162us total) trans 17179871989 rc 0/0 00000100:00100000:1.0:1763343276.405845:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7386 00000004:00080000:1.0:1763343276.405882:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c859aa00/2, rc 0, transno 17179871989 00000100:00100000:1.0:1763343276.405888:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c859aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412991488:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343276.406049:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+37:3661:x1848998412991232:12345-0@lo:2:osp-syn-0-1.0 Request processed in 673us (862us total) trans 21474839260 rc 0/0 00000100:00100000:2.0:1763343276.406055:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7384 00000004:00080000:2.0:1763343276.406080:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5950380/2, rc 0, transno 21474839259 00000100:00100000:2.0:1763343276.406085:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5950380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412991360:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343276.406103:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c859ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412991616:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763343276.406462:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1131 committed 00000100:00100000:2.0:1763343276.406584:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1763343276.406618:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5951500/2, rc 0, transno 21474839260 00000100:00100000:2.0:1763343276.406622:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5951500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412991232:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1763343276.406684:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a41c2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x214:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a51 expref: 301 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.406695:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x214:0x0].0x0 (ffff9401f6695e00) 00010000:00010000:2.0:1763343276.406698:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343276.406712:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a41bb lrc: 0/0,0 mode: --/EX res: [0x240000404:0x214:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a51 expref: 301 pid: 33856 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763343276.406730:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a41c2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x214:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a51 expref: 300 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.406760:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x214:0x0].0x0 (ffff9401f6695e00) 00010000:00010000:2.0:1763343276.406763:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343276.406765:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917e00, rc 0) 00000100:00100000:2.0:1763343276.406818:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:55884:x1848998399923840:12345-192.168.201.40@tcp:101:bash.0 Request processed in 5252us (6033us total) trans 4294973755 rc 0/0 00000100:00100000:2.0:1763343276.406825:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10825 00000100:00100000:0.0:1763343276.406881:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412991616 00000100:00100000:0.0:1763343276.406886:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412991616 00000100:00100000:0.0:1763343276.406919:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7387 00000100:00100000:0.0:1763343276.406926:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+20:3661:x1848998412991616:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343276.407067:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+21:3661:x1848998412991616:12345-0@lo:2:osp-syn-1-1.0 Request processed in 141us (482us total) trans 17179871990 rc 0/0 00000100:00100000:0.0:1763343276.407074:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7387 00000100:00100000:3.0:1763343276.407232:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000004:00080000:2.0:1763343276.408218:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c859ad80/2, rc 0, transno 17179871990 00000100:00100000:2.0:1763343276.408228:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c859ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412991616:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343276.408269:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399924096 00000100:00100000:2.0:1763343276.408276:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399924096 00000100:00100000:2.0:1763343276.408318:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10826 00000100:00100000:2.0:1763343276.408326:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57155:x1848998399924096:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343276.408341:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.408358:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a41c9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49a58 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.408388:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e200/0x9104b1ba770a41d0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343276.408402:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e200/0x9104b1ba770a41d0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.408413:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e200/0x9104b1ba770a41d0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.408513:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a41c9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a58 expref: 302 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.408532:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e200/0x9104b1ba770a41d0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x213:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a58 expref: 301 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.408540:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:2.0:1763343276.408543:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343276.408547:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583e200, rc 0) 00000100:00100000:2.0:1763343276.408597:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57155:x1848998399924096:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 272us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.408604:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10826 00000100:00100000:1.0:1763343276.413551:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412991744:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1763343276.413620:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.413664:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6e8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1848998412991872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1763343276.413687:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.413736:0:7640:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412991744 00000100:00100000:1.0:1763343276.413743:0:7640:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412991744 00000100:00100000:1.0:1763343276.413783:0:7640:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412991872 00000100:00100000:1.0:1763343276.413786:0:7640:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412991872 00000100:00100000:1.0:1763343276.413799:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:1.0:1763343276.413806:0:7640:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3662:x1848998412991744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1763343276.413837:0:7640:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445888000 avail 1299648512 00000100:00100000:1.0:1763343276.413872:0:7640:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3662:x1848998412991744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.413879:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00100000:1.0:1763343276.413897:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:1.0:1763343276.413903:0:7640:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1848998412991872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1763343276.413918:0:7640:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445896192 avail 1299656704 00000100:00100000:1.0:1763343276.413942:0:7640:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1848998412991872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 39us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.413947:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00100000:1.0:1763343276.413968:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9dcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5a605d51-bec9-44a7-a417-e819baf6bfda:3660:1848998412992128:0@lo:400:kworker.0 00000100:00100000:1.0:1763343276.413997:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.414019:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1848998412992640:0@lo:400:kworker.0 00000100:00100000:1.0:1763343276.414064:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.414082:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1848998412993152:0@lo:400:kworker.0 00000100:00100000:1.0:1763343276.414102:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.414117:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1763343276.414123:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c39b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1848998412992000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1763343276.414143:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.414158:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1848998412992512:0@lo:400:kworker.0 00000100:00100000:1.0:1763343276.414177:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.414191:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1848998412993024:0@lo:400:kworker.0 00000100:00100000:1.0:1763343276.414210:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.414235:0:32306:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412992128 00000100:00100000:1.0:1763343276.414250:0:32306:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412992128 00000100:00100000:1.0:1763343276.414278:0:32306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1763343276.414283:0:32306:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3ad8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a605d51-bec9-44a7-a417-e819baf6bfda+23:3660:x1848998412992128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763343276.414316:0:32306:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3ad8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a605d51-bec9-44a7-a417-e819baf6bfda+23:3660:x1848998412992128:12345-0@lo:400:kworker.0 Request processed in 32us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.414322:0:32306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1763343276.414350:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412993024 00000100:00100000:1.0:1763343276.414353:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412993024 00000100:00100000:0.0:1763343276.414382:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412992000 00000100:00100000:1.0:1763343276.414386:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00100000:0.0:1763343276.414386:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412992000 00000100:00100000:1.0:1763343276.414391:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3660:x1848998412993024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763343276.414409:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:0.0:1763343276.414415:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1848998412992000:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1763343276.414420:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3660:x1848998412993024:12345-0@lo:400:kworker.0 Request processed in 29us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.414426:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00002000:00000024:0.0:1763343276.414427:0:8415:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484924992 pending 28672 free 3920224256 avail 3688644608 00000100:00080000:1.0:1763343276.414444:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1763343276.414456:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1848998412992000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.414462:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:0.0:1763343276.414478:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9dc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1848998412992256:0@lo:400:kworker.0 00000100:00100000:1.0:1763343276.414481:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c39b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1848998412992000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1763343276.414492:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1848998412993024:0@lo:400:kworker.0 00000100:00100000:1.0:1763343276.414500:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9dcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5a605d51-bec9-44a7-a417-e819baf6bfda:3660:1848998412992128:0@lo:400:kworker.0 00000100:00100000:0.0:1763343276.414502:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343276.414515:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1848998412992768:0@lo:400:kworker.0 00000100:00100000:1.0:1763343276.414527:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9dc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1848998412992384:0@lo:400:kworker.0 00000100:00100000:0.0:1763343276.414532:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.414544:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.414556:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1848998412992896:0@lo:400:kworker.0 00000100:00100000:0.0:1763343276.414558:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412992640 00000100:00100000:0.0:1763343276.414562:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412992640 00000100:00100000:1.0:1763343276.414575:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343276.414584:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412993152 00000100:00100000:0.0:1763343276.414587:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412993152 00000100:00100000:1.0:1763343276.414596:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412991744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1763343276.414598:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412992512 00000100:00100000:0.0:1763343276.414600:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412992512 00000100:00100000:1.0:1763343276.414606:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6e8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1848998412991872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1763343276.414610:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412992256 00000100:00100000:0.0:1763343276.414612:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412992256 00000100:00100000:0.0:1763343276.414620:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412992768 00000100:00100000:0.0:1763343276.414622:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412992768 00000100:00100000:1.0:1763343276.414630:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412992384 00000100:00100000:1.0:1763343276.414633:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412992384 00000100:00100000:1.0:1763343276.414653:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:1.0:1763343276.414658:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1848998412992640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763343276.414691:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1848998412992640:12345-0@lo:400:kworker.0 Request processed in 33us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.414697:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:1.0:1763343276.414709:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:1.0:1763343276.414714:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1848998412993152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763343276.414736:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1848998412993152:12345-0@lo:400:kworker.0 Request processed in 22us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.414741:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00000100:00100000:1.0:1763343276.414755:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:1.0:1763343276.414760:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1848998412992512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763343276.414782:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1848998412992512:12345-0@lo:400:kworker.0 Request processed in 23us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.414788:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00100000:1.0:1763343276.414797:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:1.0:1763343276.414803:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1848998412992256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763343276.414829:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1848998412992256:12345-0@lo:400:kworker.0 Request processed in 26us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.414834:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00100000:1.0:1763343276.414844:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:1.0:1763343276.414851:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1848998412992384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763343276.414880:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1848998412992384:12345-0@lo:400:kworker.0 Request processed in 30us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.414884:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00080000:1.0:1763343276.414896:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1763343276.414899:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1763343276.414916:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9dc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1848998412992256:0@lo:400:kworker.0 00000100:00100000:1.0:1763343276.414931:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412992896 00000100:00100000:1.0:1763343276.414934:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412992896 00000100:00100000:1.0:1763343276.414957:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 746 00000100:00100000:1.0:1763343276.414962:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1848998412992896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763343276.414989:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1848998412992896:12345-0@lo:400:kworker.0 Request processed in 27us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.414993:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 746 00000100:00080000:1.0:1763343276.415005:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1763343276.415020:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1848998412992512:0@lo:400:kworker.0 00000100:00100000:1.0:1763343276.415059:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1848998412992640:0@lo:400:kworker.0 00000100:00100000:1.0:1763343276.415068:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1848998412993152:0@lo:400:kworker.0 00000100:00080000:0.0:1763343276.415083:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1763343276.415092:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9dc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1848998412992384:0@lo:400:kworker.0 00000100:00100000:1.0:1763343276.415102:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1848998412992896:0@lo:400:kworker.0 00000100:00100000:0.0:1763343276.415106:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:0.0:1763343276.415111:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1848998412992768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763343276.415141:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1848998412992768:12345-0@lo:400:kworker.0 Request processed in 30us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.415146:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00100000:1.0:1763343276.415160:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1848998412992768:0@lo:400:kworker.0 00000100:00100000:2.0:1763343276.416871:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763343276.416893:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1848998412993280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1763343276.416948:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343276.417194:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412993280 00000100:00100000:3.0:1763343276.417202:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412993280 00000100:00100000:3.0:1763343276.417257:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:3.0:1763343276.417265:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1848998412993280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1763343276.417286:0:8415:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484924096 pending 28672 free 3919187968 avail 3687665664 00000100:00100000:3.0:1763343276.417337:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1848998412993280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343276.417344:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00100000:2.0:1763343276.417422:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1848998412993280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1763343276.419009:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.419190:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399924224 00000100:00100000:2.0:1763343276.419199:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399924224 00000100:00100000:2.0:1763343276.419247:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7388 00000100:00100000:2.0:1763343276.419256:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:55884:x1848998399924224:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343276.419270:0:11289:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.419292:0:11289:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c583f800/0x9104b1ba770a41d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49a5f expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343276.419314:0:11289:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343276.419332:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.419334:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.419344:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583f800/0x9104b1ba770a41d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a5f expref: 23 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.419360:0:11289:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c583f800/0x9104b1ba770a41d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a5f expref: 23 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.419372:0:11289:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f800, rc 0) 00000100:00100000:2.0:1763343276.419421:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:55884:x1848998399924224:12345-192.168.201.40@tcp:101:bash.0 Request processed in 166us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.419428:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7388 00000100:00100000:0.0:1763343276.420686:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.421083:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.421232:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399924480 00000100:00100000:2.0:1763343276.421250:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399924480 00000100:00100000:2.0:1763343276.421301:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7389 00000100:00100000:2.0:1763343276.421310:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:55884:x1848998399924480:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343276.421326:0:11289:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.421351:0:11289:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c583e800/0x9104b1ba770a41de lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49a66 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343276.421370:0:11289:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343276.421388:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.421391:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.421399:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583e800/0x9104b1ba770a41de lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a66 expref: 19 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.421413:0:11289:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c583e800/0x9104b1ba770a41de lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a66 expref: 19 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343276.421415:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399924352 00000100:00100000:1.0:1763343276.421419:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399924352 00010000:00010000:2.0:1763343276.421424:0:11289:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583e800, rc 0) 00000100:00100000:1.0:1763343276.421465:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1756 00000100:00100000:2.0:1763343276.421466:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:55884:x1848998399924480:12345-192.168.201.40@tcp:101:bash.0 Request processed in 158us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.421472:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2407:x1848998399924352:12345-192.168.201.40@tcp:4:lfs.0 00000100:00100000:2.0:1763343276.421474:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7389 00010000:00010000:1.0:1763343276.421494:0:28399:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177800/0x9104b1ba770a41e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.421512:0:28399:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a3f7d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49994 expref: 23 pid: 28561 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343276.421521:0:28399:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.421523:0:28399:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.421527:0:28399:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177800/0x9104b1ba770a41e5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.421558:0:28399:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a3f7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49994 expref: 23 pid: 28561 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343276.421571:0:28399:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a3f7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49994 expref: 23 pid: 28561 timeout: 1169 lvb_type: 1 00000100:00100000:1.0:1763343276.421583:0:28399:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_017:lustre-OST0000_UUID:28399:1848998412993408:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343276.421633:0:28399:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9300 going to sleep for 11 seconds 00000100:00100000:0.0:1763343276.424130:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.424199:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.424349:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399924864 00000100:00100000:3.0:1763343276.424359:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399924864 00010000:00010000:3.0:1763343276.424393:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a3f7d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49994 expref: 24 pid: 28561 timeout: 1169 lvb_type: 1 00000100:00100000:3.0:1763343276.424424:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3520 00000100:00100000:3.0:1763343276.424432:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2409:x1848998399924864:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343276.424447:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343276.424465:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a3f7d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49994 expref: 24 pid: 28561 timeout: 1169 lvb_type: 1 00010000:00010000:3.0:1763343276.424477:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a3f7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49994 expref: 24 pid: 28561 timeout: 1169 lvb_type: 1 00010000:00010000:3.0:1763343276.424500:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343276.424503:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343276.424514:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177800/0x9104b1ba770a41e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.424523:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177800/0x9104b1ba770a41e5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.424542:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343276.424586:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2409:x1848998399924864:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 153us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343276.424593:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3520 00010000:00010000:1.0:1763343276.424626:0:28399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176600/0x9104b1ba770a3f7d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49994 expref: 23 pid: 28561 timeout: 1169 lvb_type: 1 00000100:00100000:1.0:1763343276.424640:0:28399:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_017:lustre-OST0000_UUID:28399:1848998412993408:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343276.424659:0:28399:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5177800/0x9104b1ba770a41e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.424669:0:28399:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5177800/0x9104b1ba770a41e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.424677:0:28399:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5177800/0x9104b1ba770a41e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343276.424723:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399924736 00000100:00100000:2.0:1763343276.424728:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399924736 00002000:00010000:2.0:1763343276.424752:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/717 (0->18446744073709551615) 00002000:00100000:2.0:1763343276.424756:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5955c00 with x1848998399924736 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343276.424764:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5955c00. 00000100:00100000:2.0:1763343276.424782:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1757 00000100:00100000:2.0:1763343276.424788:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2408:x1848998399924736:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:2.0:1763343276.424897:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2cd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343276.424900:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2cd:0x0] updating lvb mtime from disk: 0 -> 1763343275 00002000:00010000:2.0:1763343276.424903:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2cd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343276.424905:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2cd:0x0] updating lvb ctime from disk: 0 -> 1763343275 00002000:00010000:2.0:1763343276.424908:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2cd:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343276.424929:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2408:x1848998399924736:12345-192.168.201.40@tcp:10:bash.0 Request processed in 141us (808us total) trans 17179871991 rc 0/0 00000100:00100000:2.0:1763343276.424935:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1757 00002000:00010000:2.0:1763343276.424938:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/717 (0->18446744073709551615) 00002000:00100000:2.0:1763343276.424940:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5955c00 with x1848998399924736 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343276.424944:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5955c00. 00000100:00100000:2.0:1763343276.425879:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.427786:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399924608 00000100:00100000:1.0:1763343276.427801:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399924608 00002000:00010000:1.0:1763343276.427846:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/716 (0->18446744073709551615) 00002000:00100000:1.0:1763343276.427851:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5953b80 with x1848998399924608 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343276.427864:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5953b80. 00000100:00100000:1.0:1763343276.427903:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1758 00000100:00100000:1.0:1763343276.427912:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2407:x1848998399924608:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:1.0:1763343276.428122:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2cc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343276.428126:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2cc:0x0] updating lvb mtime from disk: 0 -> 1763343275 00002000:00010000:1.0:1763343276.428129:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2cc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343276.428131:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2cc:0x0] updating lvb ctime from disk: 0 -> 1763343275 00002000:00010000:1.0:1763343276.428133:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2cc:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343276.428205:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2407:x1848998399924608:12345-192.168.201.40@tcp:10:bash.0 Request processed in 293us (2330us total) trans 21474839262 rc 0/0 00000100:00100000:1.0:1763343276.428213:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1758 00002000:00010000:1.0:1763343276.428217:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/716 (0->18446744073709551615) 00002000:00100000:1.0:1763343276.428219:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5953b80 with x1848998399924608 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343276.428223:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5953b80. 00000001:00080000:0.0:1763343276.429990:0:24675:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839261 is committed 00000001:00080000:0.0:1763343276.430007:0:24675:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839260 is committed 00002000:00010000:1.0:1763343276.431044:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2cb:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:1.0:1763343276.431051:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2cb:0x0] updating lvb mtime from disk: 0 -> 1763343275 00002000:00010000:1.0:1763343276.431054:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2cb:0x0] updating lvb ctime from disk: 0 -> 1763343275 00002000:00010000:1.0:1763343276.431056:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2cb:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1763343276.431069:0:28399:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177800/0x9104b1ba770a41e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.431080:0:28399:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177800/0x9104b1ba770a41e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.431089:0:28399:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5177800/0x9104b1ba770a41e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.431095:0:28399:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343276.431100:0:28399:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5177800/0x9104b1ba770a41e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.431108:0:28399:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5177800/0x9104b1ba770a41e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.431127:0:28399:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5177800/0x9104b1ba770a41e5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.431134:0:28399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177800/0x9104b1ba770a41e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343276.431210:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2407:x1848998399924352:12345-192.168.201.40@tcp:4:lfs.0 Request processed in 9734us (10527us total) trans 21474839261 rc 0/0 00000100:00100000:1.0:1763343276.431219:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1756 00000100:00100000:2.0:1763343276.439105:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.439197:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399925120 00000100:00100000:3.0:1763343276.439207:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399925120 00000100:00100000:3.0:1763343276.439287:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3816 00000100:00100000:3.0:1763343276.439297:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:55884:x1848998399925120:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:3.0:1763343276.439638:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:55884:x1848998399925120:12345-192.168.201.40@tcp:35:bash.0 Request processed in 340us (540us total) trans 4294973756 rc 0/0 00000100:00100000:3.0:1763343276.439646:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3816 00000100:00100000:0.0:1763343276.448357:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.448401:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.448595:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399925248 00000100:00100000:3.0:1763343276.448605:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399925248 00000100:00100000:3.0:1763343276.448658:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399925504 00000100:00100000:3.0:1763343276.448662:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399925504 00000100:00100000:3.0:1763343276.448699:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10827 00000100:00100000:3.0:1763343276.448709:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57158:x1848998399925248:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:3.0:1763343276.448734:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343276.448757:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a41ec lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49a6d expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343276.448824:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10828 00010000:00010000:3.0:1763343276.448826:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a41f3 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00000100:00100000:1.0:1763343276.448833:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57155:x1848998399925504:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:3.0:1763343276.448840:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a41f3 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.448850:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a41f3 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.448861:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a41fa lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343276.448861:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343276.448867:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a41fa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.448876:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a41fa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343276.448879:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3b4b600/0x9104b1ba770a412f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x213:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a20 expref: 304 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.448895:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:1.0:1763343276.448900:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343276.448948:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a4201 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x214:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343276.448948:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4208 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343276.448958:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a4201 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x214:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343276.448958:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4208 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343276.448965:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a4201 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x214:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343276.448965:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4208 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:3.0:1763343276.448989:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x214:0x0]: returning size 5 00000004:00200000:3.0:1763343276.448993:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343276.449009:0:7641:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a4201 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x214:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.449019:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a4201 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.449056:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a41f3 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.449063:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a41f3 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.449068:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a41f3 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.449073:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a41f3 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.449079:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343276.449082:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a41f3 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.449089:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a41f3 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.449096:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c488b500) 00010000:00010000:3.0:1763343276.449098:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00010000:1.0:1763343276.449101:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005f50fabc reply state 00000000b31bdc85 transno 4294973757 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4208 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343276.449102:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a41f3 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.449108:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a41f3 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343276.449112:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4208 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343276.449116:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a41fa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343276.449117:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:1.0:1763343276.449119:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343276.449122:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a41fa lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00000100:00100000:1.0:1763343276.449122:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343276.449127:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a41fa lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.449132:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343276.449135:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a41fa lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.449140:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a41fa lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.449146:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c488b600) 00010000:00010000:3.0:1763343276.449147:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343276.449150:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a41fa lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.449154:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a41fa lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.449176:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a41ec lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a6d expref: 306 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.449188:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a4201 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a6d expref: 305 pid: 7641 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343276.449190:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57155:x1848998399925504:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 359us (789us total) trans 4294973757 rc 0/0 00010000:00010000:3.0:1763343276.449197:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x214:0x0].0x0 (ffff9401f6695e00) 00000100:00100000:1.0:1763343276.449197:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10828 00010000:00010000:3.0:1763343276.449199:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343276.449201:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3000, rc 0) 00000100:00100000:3.0:1763343276.449224:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57158:x1848998399925248:12345-192.168.201.40@tcp:101:rm.0 Request processed in 517us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343276.449229:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10827 00000100:00100000:0.0:1763343276.452388:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.452454:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399925632 00000100:00100000:2.0:1763343276.452464:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399925632 00000100:00100000:2.0:1763343276.452517:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7390 00000100:00100000:2.0:1763343276.452525:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:57155:x1848998399925632:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343276.452545:0:35281:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.452565:0:35281:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c583e600/0x9104b1ba770a420f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49a74 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343276.452586:0:35281:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2cb:0x0] initial LVB size: 4096, mtime: 0x691a7bab, atime: 0x0, ctime: 0x691a7bab, blocks: 0x8 00010000:00010000:2.0:1763343276.452604:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.452606:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.452614:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583e600/0x9104b1ba770a420f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a74 expref: 14 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.452628:0:35281:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c583e600/0x9104b1ba770a420f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a74 expref: 14 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.452641:0:35281:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583e600, rc 0) 00000100:00100000:2.0:1763343276.452700:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:57155:x1848998399925632:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 175us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.452707:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7390 00000100:00100000:1.0:1763343276.454484:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.454568:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399925888 00000100:00100000:2.0:1763343276.454577:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399925888 00000100:00100000:2.0:1763343276.454630:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10829 00000100:00100000:2.0:1763343276.454639:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57158:x1848998399925888:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:2.0:1763343276.454696:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763343276.454724:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a41c2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x214:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a51 expref: 304 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.454743:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a4201 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a6d expref: 303 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.454763:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a419f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x214:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a43 expref: 302 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.454775:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x214:0x0].0x0 (ffff9401f6695e00) 00010000:00010000:2.0:1763343276.454786:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343276.454810:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4216 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343276.454821:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4216 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.454831:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4216 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.454842:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a421d lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343276.454848:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a421d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.454855:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a421d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.454934:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4224 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x214:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343276.454941:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4224 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x214:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.454947:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4224 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x214:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000040:00080000:2.0:1763343276.456151:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1766, 64 off146848 00000040:00080000:2.0:1763343276.456181:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1775, 64 off147608 00000040:00080000:2.0:1763343276.456191:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1776, 64 off147672 00000040:00080000:2.0:1763343276.456201:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1767, 64 off146912 00000100:00100000:0.0:1763343276.456903:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:2.0:1763343276.457261:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a422b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x214:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343276.457277:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a422b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x214:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.457288:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a422b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x214:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.457296:0:33856:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a422b lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x214:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.457303:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a422b lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x214:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.457309:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a422b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x214:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.457385:0:33856:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343276.457407:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4224 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x214:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.457412:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4224 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x214:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.457418:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4224 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x214:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.457424:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.457427:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4224 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x214:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.457434:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4224 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x214:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.457447:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x214:0x0].0x0 (ffff9400c48aca00) 00010000:00010000:2.0:1763343276.457449:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763343276.457454:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4224 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x214:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.457459:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4224 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x214:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000100:00100000:1.0:1763343276.457516:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399926016 00000100:00100000:1.0:1763343276.457526:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399926016 00000100:00100000:1.0:1763343276.457579:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7391 00010000:00010000:2.0:1763343276.457587:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4216 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00000100:00100000:1.0:1763343276.457588:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:57155:x1848998399926016:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343276.457594:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4216 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.457599:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4216 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.457603:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.457606:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4216 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.457607:0:11289:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.457611:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4216 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.457618:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48ac500) 00010000:00010000:2.0:1763343276.457621:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.457621:0:11289:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4232 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49a7b expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.457647:0:11289:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a3f84 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4999b expref: 21 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343276.457656:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.457658:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.457662:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4232 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a7b expref: 21 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.457698:0:11289:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a3f84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4999b expref: 21 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343276.457713:0:11289:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a3f84 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4999b expref: 21 pid: 8626 timeout: 1169 lvb_type: 1 00000100:00100000:1.0:1763343276.457728:0:11289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11289:1848998412993536:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343276.457805:0:11289:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9180 going to sleep for 11 seconds 00010000:00010000:3.0:1763343276.457849:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343276.457856:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a422b lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x214:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.457862:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583fe00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343276.457865:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a422b lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x214:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.457871:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a422b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x214:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.457880:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x214:0x0].0x0 (ffff9400c48aca00) 00010000:00010000:3.0:1763343276.457883:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343276.457886:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a422b lrc: 1/0,0 mode: --/PW res: [0x240000404:0x214:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.457890:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a422b lrc: 0/0,0 mode: --/PW res: [0x240000404:0x214:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343276.457908:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343276.457910:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343276.457912:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343276.457958:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4216 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.457965:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4216 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:2.0:1763343276.457979:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ed942bdb reply state 000000006c378a5f transno 4294973758 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a421d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.457990:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a421d lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.457996:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48acf00) 00010000:00010000:2.0:1763343276.457999:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343276.458002:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343276.458156:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57158:x1848998399925888:12345-192.168.201.40@tcp:36:rm.0 Request processed in 3517us (3680us total) trans 4294973758 rc 0/0 00000100:00100000:2.0:1763343276.458165:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10829 00000100:00100000:0.0:1763343276.461851:0:11289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11289:1848998412993536:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343276.461887:0:11289:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4232 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a7b expref: 21 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.461906:0:11289:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176400, rc 0) 00000100:00100000:0.0:1763343276.461962:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:57155:x1848998399926016:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 4374us (5065us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.461970:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7391 00000100:00100000:3.0:1763343276.462894:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.463152:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399926144 00000100:00100000:2.0:1763343276.463162:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399926144 00010000:00010000:2.0:1763343276.463197:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a3f84 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4999b expref: 21 pid: 8626 timeout: 1169 lvb_type: 1 00000100:00100000:2.0:1763343276.463224:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3521 00000100:00100000:2.0:1763343276.463233:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399926144:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343276.463258:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343276.463284:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a3f84 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4999b expref: 21 pid: 8626 timeout: 1169 lvb_type: 1 00010000:00010000:2.0:1763343276.463298:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a3f84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4999b expref: 21 pid: 8626 timeout: 1169 lvb_type: 1 00010000:00010000:2.0:1763343276.463321:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a3f84 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4999b expref: 21 pid: 8626 timeout: 1169 lvb_type: 1 00010000:00010000:2.0:1763343276.463336:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.463339:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.463344:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4232 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a7b expref: 20 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.463354:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4232 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a7b expref: 20 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.463389:0:7904:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4232 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a7b expref: 20 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343276.463403:0:7904:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc71c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7904:1848998412993664:192.168.201.40@tcp:105: 00000100:00100000:2.0:1763343276.463472:0:7904:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c7ec3480 going to sleep for 11 seconds 00000100:00100000:3.0:1763343276.466150:0:7904:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc71c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7904:1848998412993664:192.168.201.40@tcp:105: 00010000:00010000:3.0:1763343276.466176:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343276.466230:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399926144:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 2997us (3342us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343276.466252:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3521 00000100:00100000:1.0:1763343276.467608:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.467715:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.467868:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399926272 00000100:00100000:2.0:1763343276.467881:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399926272 00002000:00010000:2.0:1763343276.467923:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/715 (5->18446744073709551615) 00002000:00100000:2.0:1763343276.467929:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401edc2fb80 with x1848998399926272 ext(5->18446744073709551615) 00002000:00010000:2.0:1763343276.467942:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9401edc2fb80. 00000100:00100000:2.0:1763343276.467968:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399926400 00000100:00100000:2.0:1763343276.467972:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399926400 00002000:00010000:2.0:1763343276.467985:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/716 (0->18446744073709551615) 00002000:00100000:2.0:1763343276.467987:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c9dc8700 with x1848998399926400 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343276.467993:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401c9dc8700. 00000100:00100000:2.0:1763343276.468019:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1759 00000100:00100000:2.0:1763343276.468055:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399926272:12345-192.168.201.40@tcp:10:lfs.0 00002000:00010000:2.0:1763343276.468419:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2cb:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:2.0:1763343276.468424:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2cb:0x0] updating lvb mtime from disk: 1763343275 -> 1763343275 00002000:00010000:2.0:1763343276.468427:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2cb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343276.468430:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2cb:0x0] updating lvb ctime from disk: 1763343275 -> 1763343275 00002000:00010000:2.0:1763343276.468433:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2cb:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763343276.468487:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998399926272:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 433us (887us total) trans 21474839263 rc 0/0 00000100:00100000:2.0:1763343276.468494:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1759 00002000:00010000:2.0:1763343276.468498:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/715 (5->18446744073709551615) 00002000:00100000:2.0:1763343276.468501:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401edc2fb80 with x1848998399926272 ext(5->18446744073709551615) 00002000:00010000:2.0:1763343276.468505:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9401edc2fb80. 00000100:00100000:2.0:1763343276.468524:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1760 00000100:00100000:2.0:1763343276.468531:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399926400:12345-192.168.201.40@tcp:10:lfs.0 00002000:00010000:2.0:1763343276.468658:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2cc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343276.468661:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2cc:0x0] updating lvb mtime from disk: 0 -> 1763343275 00002000:00010000:2.0:1763343276.468664:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2cc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343276.468666:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2cc:0x0] updating lvb ctime from disk: 0 -> 1763343275 00002000:00010000:2.0:1763343276.468668:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2cc:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343276.468695:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399926400:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 164us (979us total) trans 17179871992 rc 0/0 00000100:00100000:2.0:1763343276.468702:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1760 00002000:00010000:2.0:1763343276.468705:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/716 (0->18446744073709551615) 00002000:00100000:2.0:1763343276.468708:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c9dc8700 with x1848998399926400 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343276.468712:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401c9dc8700. 00000100:00100000:2.0:1763343276.471967:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.472050:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399926656 00000100:00100000:0.0:1763343276.472061:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399926656 00000100:00100000:0.0:1763343276.472120:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10830 00000100:00100000:0.0:1763343276.472131:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57155:x1848998399926656:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:0.0:1763343276.472229:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4239 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343276.472258:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4239 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.472280:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4239 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00010000:0.0:1763343276.472400:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002ea55777 reply state 00000000bc315220 transno 4294973759 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4239 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.472413:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4239 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343276.472421:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:0.0:1763343276.472424:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343276.472428:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343276.472532:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57155:x1848998399926656:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 401us (574us total) trans 4294973759 rc 0/0 00000100:00100000:0.0:1763343276.472539:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10830 00000100:00100000:2.0:1763343276.475439:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.477056:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399926784 00000100:00100000:0.0:1763343276.477071:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399926784 00000100:00100000:2.0:1763343276.477250:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.477300:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399926912 00000100:00100000:3.0:1763343276.477305:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399926912 00000100:00100000:3.0:1763343276.477356:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7392 00000100:00100000:3.0:1763343276.477366:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399926912:12345-192.168.201.40@tcp:2:lfs.0 00002000:00010000:3.0:1763343276.477565:0:11289:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2cb:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763343276.477568:0:11289:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2cb:0x0] updating lvb mtime from disk: 1763343275 -> 1763343275 00002000:00010000:3.0:1763343276.477571:0:11289:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2cb:0x0] updating lvb atime from disk: 1763343275 -> 1763343275 00002000:00010000:3.0:1763343276.477573:0:11289:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2cb:0x0] updating lvb ctime from disk: 1763343275 -> 1763343275 00002000:00010000:3.0:1763343276.477576:0:11289:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2cb:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343276.477786:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399926912:12345-192.168.201.40@tcp:2:lfs.0 Request processed in 420us (545us total) trans 17179871993 rc 0/0 00000100:00100000:3.0:1763343276.477794:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7392 00000100:00100000:1.0:1763343276.477816:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10831 00000100:00100000:1.0:1763343276.477824:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57159:x1848998399926784:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343276.477838:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343276.477864:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4240 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49a82 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.477928:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4247 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343276.477942:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4247 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.477953:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4247 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.477963:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a424e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343276.477970:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a424e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.477977:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a424e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.478013:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4247 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.478020:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4247 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.478063:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4247 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.478068:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343276.478073:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4247 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.478080:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4247 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.478096:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497ed00) 00010000:00010000:1.0:1763343276.478099:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.478103:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4247 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.478108:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4247 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.478119:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a424e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.478124:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a424e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.478129:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a424e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.478133:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343276.478136:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a424e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.478141:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a424e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.478147:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48acf00) 00010000:00010000:1.0:1763343276.478149:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.478151:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a424e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.478156:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a424e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.478180:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4240 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a82 expref: 306 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.478189:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497ed00) 00010000:00010000:1.0:1763343276.478191:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.478194:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4240 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a82 expref: 306 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.478206:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176c00, rc 0) 00000100:00100000:1.0:1763343276.478232:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57159:x1848998399926784:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 409us (2804us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343276.478250:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10831 00000100:00100000:2.0:1763343276.479934:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.480191:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399927168 00000100:00100000:0.0:1763343276.480201:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399927168 00000100:00100000:0.0:1763343276.480260:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3817 00000100:00100000:0.0:1763343276.480279:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8547850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57155:x1848998399927168:12345-192.168.201.40@tcp:35:lfs.0 00000004:00010000:0.0:1763343276.480340:0:6528:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x213:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a40b8 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x213:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499f6 expref: 305 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.480386:0:6528:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a4255 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 00010000:00010000:0.0:1763343276.480398:0:6528:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a410c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a12 expref: 305 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.480409:0:6528:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a4255 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.480445:0:6528:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a410c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a12 expref: 305 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.480458:0:6528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a410c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a12 expref: 305 pid: 6524 timeout: 1169 lvb_type: 0 00000100:00100000:0.0:1763343276.480473:0:6528:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5955880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6528:1848998412993792:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343276.480552:0:6528:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401d84de780 going to sleep for 11 seconds 00000100:00100000:3.0:1763343276.480722:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.480930:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399927296 00000100:00100000:0.0:1763343276.480935:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399927296 00000100:00100000:0.0:1763343276.480977:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10832 00000100:00100000:0.0:1763343276.480984:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57159:x1848998399927296:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343276.480996:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.481009:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a425c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49a89 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.481224:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a4263 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343276.481234:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a4263 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.481256:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a4263 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.481267:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a426a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343276.481322:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a426a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.481329:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a426a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.481363:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a4263 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.481369:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a4263 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.481374:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a4263 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.481380:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a4263 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.481385:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ae00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.481389:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a4263 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.481399:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a4263 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.481408:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c52ecf00) 00010000:00010000:0.0:1763343276.481411:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.481415:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a4263 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.481421:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a4263 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.481433:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a426a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.481438:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a426a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.481443:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a426a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.481448:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.481451:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a426a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.481456:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a426a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.481463:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48acf00) 00010000:00010000:0.0:1763343276.481466:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.481469:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a426a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.481473:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a426a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.481498:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a425c lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a89 expref: 307 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.481506:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c52ecf00) 00010000:00010000:0.0:1763343276.481508:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.481511:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a425c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a89 expref: 307 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.481526:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a600, rc 0) 00000100:00100000:0.0:1763343276.481967:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57159:x1848998399927296:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 980us (1242us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343276.481976:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10832 00000100:00100000:3.0:1763343276.482456:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.482554:0:6528:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5955880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6528:1848998412993792:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343276.482572:0:6528:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a4255 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT1 00000100:00100000:1.0:1763343276.482855:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399927424 00000100:00100000:1.0:1763343276.482861:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399927424 00010000:00010000:1.0:1763343276.482887:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a410c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a12 expref: 306 pid: 6524 timeout: 1169 lvb_type: 0 00000100:00100000:1.0:1763343276.482920:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3522 00000100:00100000:1.0:1763343276.482928:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:2408:x1848998399927424:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343276.482940:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343276.482946:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a410c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a12 expref: 306 pid: 6524 timeout: 1169 lvb_type: 0 00010000:00010000:1.0:1763343276.482957:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a410c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a12 expref: 306 pid: 6524 timeout: 1169 lvb_type: 0 00010000:00010000:1.0:1763343276.482974:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a410c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a12 expref: 306 pid: 6524 timeout: 1169 lvb_type: 0 00010000:00010000:1.0:1763343276.482987:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:1.0:1763343276.482992:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a4255 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT1 00010000:00010000:1.0:1763343276.483001:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a4255 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT1 00010000:00010000:1.0:1763343276.483009:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a4255 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT1 00010000:00010000:1.0:1763343276.483061:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343276.483097:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:2408:x1848998399927424:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 170us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.483104:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3522 00010000:00010000:0.0:1763343276.483339:0:6528:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a4255 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.483351:0:6528:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a4255 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT1 00000040:00080000:0.0:1763343276.483583:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1777, 88 off147760 00000004:00080000:0.0:1763343276.483590:0:6528:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1069607565154ns, next at 1070049115839ns, rc = 0 00000040:00080000:0.0:1763343276.483621:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1768, 88 off147000 00000004:00080000:0.0:1763343276.483625:0:6528:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1069607600826ns, next at 1070049318579ns, rc = 0 00000040:00080000:0.0:1763343276.483648:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1769, 88 off147088 00000004:00080000:0.0:1763343276.483652:0:6528:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1069607627708ns, next at 1070049318579ns, rc = 0 00000040:00080000:0.0:1763343276.483664:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1778, 88 off147848 00000004:00080000:0.0:1763343276.483668:0:6528:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1069607643514ns, next at 1070049115839ns, rc = 0 00000100:00100000:2.0:1763343276.484163:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.484635:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399927552 00000100:00100000:0.0:1763343276.484644:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399927552 00000100:00100000:0.0:1763343276.484878:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10833 00000100:00100000:0.0:1763343276.484888:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57159:x1848998399927552:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343276.484908:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.484931:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4271 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49a90 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.484991:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4278 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343276.485003:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4278 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.485012:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4278 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:0.0:1763343276.485595:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343276.485602:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343276.485642:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4271 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a90 expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.485662:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4278 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a90 expref: 307 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.485671:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53600) 00010000:00010000:0.0:1763343276.485676:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343276.485678:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a200, rc 0) 00000100:00100000:0.0:1763343276.485747:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57159:x1848998399927552:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 860us (1585us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.485754:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10833 00000001:00080000:0.0:1763343276.486666:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973760 is committed 00000004:00080000:0.0:1763343276.486674:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1142 committed 00010000:00010000:2.0:1763343276.486747:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4208 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.486756:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4208 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.486762:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4208 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.486768:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.486771:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4208 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.486778:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4208 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.486791:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:2.0:1763343276.486794:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.486797:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4208 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.486802:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4208 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.486817:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a421d lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.486823:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a421d lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.486828:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a421d lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.486833:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.486835:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a421d lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.486841:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a421d lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.486848:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48acf00) 00010000:00010000:2.0:1763343276.486851:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.486853:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a421d lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.486858:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a421d lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00080000:0.0:1763343276.487094:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1134 committed 00000100:00100000:3.0:1763343276.487251:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412994048:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1763343276.487353:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4239 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.487361:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4239 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.487367:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4239 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.487372:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ac00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.487375:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4239 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.487383:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4239 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.487392:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:2.0:1763343276.487395:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.487398:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4239 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343276.487404:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4239 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000100:00100000:2.0:1763343276.487425:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412993920:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343276.487481:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343276.487519:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763343276.487525:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412994304:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343276.487545:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1763343276.487589:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1133 committed 00000100:00100000:1.0:1763343276.487676:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412994176:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343276.487701:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.487719:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412994688:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343276.487737:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.487752:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763343276.487756:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6e8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412994560:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343276.487771:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.487795:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412993920 00000100:00100000:1.0:1763343276.487802:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412993920 00000100:00100000:1.0:1763343276.487838:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412994304 00000100:00100000:1.0:1763343276.487841:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412994304 00000100:00100000:1.0:1763343276.487853:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412994176 00000100:00100000:1.0:1763343276.487855:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412994176 00000100:00100000:1.0:1763343276.487865:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412994688 00000100:00100000:1.0:1763343276.487867:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412994688 00000100:00100000:1.0:1763343276.487880:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412994560 00000100:00100000:1.0:1763343276.487882:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412994560 00000100:00100000:1.0:1763343276.487899:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7393 00000100:00100000:1.0:1763343276.487907:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+23:3662:x1848998412993920:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343276.487933:0:8414:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:717 count 1 00010000:00010000:1.0:1763343276.487956:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a427f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.487974:0:8414:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c583e800/0x9104b1ba770a41de lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a66 expref: 21 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.487981:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343276.487983:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343276.487987:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a427f lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1763343276.488255:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1141 committed 00000100:00100000:0.0:1763343276.488297:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412994816:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343276.488334:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343276.488349:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763343276.488353:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9dc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412994432:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343276.488372:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:0.0:1763343276.488420:0:6528:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001191c16c reply state 0000000087c714b8 transno 4294973760 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a4255 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.488438:0:6528:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a4255 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.488446:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:0.0:1763343276.488449:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763343276.488452:0:6528:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343276.488457:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:0.0:1763343276.488459:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343276.488464:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a40b8 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x213:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499f6 expref: 298 pid: 33856 timeout: 0 lvb_type: 0 00010000:00080000:0.0:1763343276.488562:0:6528:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763343276.488577:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8547850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57155:x1848998399927168:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 8306us (8651us total) trans 4294973760 rc 0/0 00000100:00100000:0.0:1763343276.488590:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3817 00000100:00100000:3.0:1763343276.489203:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343276.489234:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a4255 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343276.489255:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a4255 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343276.489261:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a4255 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343276.489266:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501bc00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343276.489270:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a4255 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343276.489277:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a4255 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343276.489288:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:3.0:1763343276.489290:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343276.489294:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a4255 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT1 00010000:00010000:3.0:1763343276.489299:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a4255 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT1 00000100:00100000:3.0:1763343276.489324:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412994816 00000100:00100000:3.0:1763343276.489331:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412994816 00000100:00100000:3.0:1763343276.489353:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412994432 00000100:00100000:3.0:1763343276.489356:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412994432 00000100:00100000:3.0:1763343276.489365:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412994048 00000100:00100000:3.0:1763343276.489367:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412994048 00000100:00100000:3.0:1763343276.489381:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7394 00000100:00100000:3.0:1763343276.489388:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+24:3662:x1848998412994304:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763343276.489514:0:11289:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2cc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343276.489518:0:11289:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2cc:0x0] updating lvb mtime from disk: 1763343275 -> 1763343275 00002000:00010000:3.0:1763343276.489520:0:11289:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2cc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343276.489522:0:11289:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2cc:0x0] updating lvb ctime from disk: 1763343275 -> 1763343275 00002000:00010000:3.0:1763343276.489524:0:11289:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2cc:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343276.489561:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+25:3662:x1848998412994304:12345-0@lo:2:osp-syn-1-1.0 Request processed in 173us (2014us total) trans 17179871994 rc 0/0 00000100:00100000:3.0:1763343276.489568:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7394 00000100:00100000:3.0:1763343276.489582:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7395 00000100:00100000:3.0:1763343276.489589:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+24:3660:x1848998412994176:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763343276.489636:0:11289:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2cb:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763343276.489639:0:11289:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2cb:0x0] updating lvb mtime from disk: 1763343275 -> 1763343275 00002000:00010000:3.0:1763343276.489642:0:11289:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2cb:0x0] updating lvb atime from disk: 1763343275 -> 1763343275 00002000:00010000:3.0:1763343276.489644:0:11289:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2cb:0x0] updating lvb ctime from disk: 1763343275 -> 1763343275 00002000:00010000:3.0:1763343276.489646:0:11289:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2cb:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343276.489683:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+25:3660:x1848998412994176:12345-0@lo:2:osp-syn-1-1.0 Request processed in 95us (1980us total) trans 17179871995 rc 0/0 00000100:00100000:3.0:1763343276.489689:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7395 00000100:00100000:3.0:1763343276.489701:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7396 00000100:00100000:3.0:1763343276.489707:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+8:3660:x1848998412994688:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763343276.489765:0:11289:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2ca:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343276.489769:0:11289:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2ca:0x0] updating lvb mtime from disk: 1763343275 -> 1763343275 00002000:00010000:3.0:1763343276.489771:0:11289:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2ca:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343276.489773:0:11289:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2ca:0x0] updating lvb ctime from disk: 1763343275 -> 1763343275 00002000:00010000:3.0:1763343276.489775:0:11289:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2ca:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343276.489800:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+9:3660:x1848998412994688:12345-0@lo:2:osp-syn-0-1.0 Request processed in 92us (2061us total) trans 21474839264 rc 0/0 00000100:00100000:3.0:1763343276.489805:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7396 00000100:00100000:3.0:1763343276.489817:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7397 00000100:00100000:3.0:1763343276.489823:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+8:3660:x1848998412994560:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343276.489835:0:11289:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:717 count 1 00002000:00010000:3.0:1763343276.489854:0:11289:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343276.489860:0:11289:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a4286 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.489872:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343276.489874:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343276.489879:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a4286 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.489890:0:11289:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a4286 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.489898:0:11289:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a4286 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.489905:0:11289:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a4286 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.489921:0:11289:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343276.490098:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+9:3660:x1848998412994560:12345-0@lo:6:osp-syn-0-1.0 Request processed in 274us (2324us total) trans 21474839265 rc 0/0 00000100:00100000:3.0:1763343276.490106:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7397 00000100:00100000:3.0:1763343276.490119:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7398 00000100:00100000:3.0:1763343276.490124:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+8:3661:x1848998412994816:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763343276.490170:0:11289:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2cb:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763343276.490173:0:11289:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2cb:0x0] updating lvb mtime from disk: 1763343275 -> 1763343275 00002000:00010000:3.0:1763343276.490175:0:11289:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2cb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343276.490177:0:11289:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2cb:0x0] updating lvb ctime from disk: 1763343275 -> 1763343275 00002000:00010000:3.0:1763343276.490179:0:11289:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2cb:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343276.490207:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+9:3661:x1848998412994816:12345-0@lo:2:osp-syn-0-1.0 Request processed in 82us (1872us total) trans 21474839266 rc 0/0 00000100:00100000:3.0:1763343276.490213:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7398 00000100:00100000:3.0:1763343276.490228:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7399 00000100:00100000:3.0:1763343276.490234:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+8:3661:x1848998412994432:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343276.490256:0:11289:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:716 count 1 00010000:00010000:3.0:1763343276.490266:0:11289:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a428d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.490279:0:11289:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c583f800/0x9104b1ba770a41d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a5f expref: 14 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.490285:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343276.490287:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343276.490290:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a428d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.490320:0:11289:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c583f800/0x9104b1ba770a41d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a5f expref: 14 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.490334:0:11289:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c583f800/0x9104b1ba770a41d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a5f expref: 14 pid: 11289 timeout: 1169 lvb_type: 0 00000100:00100000:3.0:1763343276.490347:0:11289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11289:1848998412994944:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343276.490401:0:11289:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c82846c0 going to sleep for 11 seconds 00010000:00010000:3.0:1763343276.490419:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343276.490424:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a4286 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.490431:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3916200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343276.490434:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a4286 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.490442:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a4286 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.490456:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a4286 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.490463:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a4286 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.490476:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343276.490478:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343276.490479:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343276.490513:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5dcbb80/2, rc 0, transno 17179871994 00000100:00100000:3.0:1763343276.490520:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412994304:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343276.490538:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7400 00000100:00100000:3.0:1763343276.490545:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+24:3659:x1848998412994048:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763343276.490556:0:35281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:718 count 1 00002000:00010000:3.0:1763343276.490570:0:35281:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343276.490575:0:35281:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4294 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.490582:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343276.490584:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343276.490586:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4294 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.490595:0:35281:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4294 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.490603:0:35281:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4294 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.490609:0:35281:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4294 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.490620:0:35281:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343276.490719:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+25:3659:x1848998412994048:12345-0@lo:6:osp-syn-1-1.0 Request processed in 174us (1516us total) trans 17179871996 rc 0/0 00000100:00100000:3.0:1763343276.490723:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7400 00010000:00010000:3.0:1763343276.490736:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343276.490740:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4294 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.490746:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343276.490749:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4294 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.490761:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4294 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.490770:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4294 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.490777:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4294 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.490788:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343276.490791:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343276.490792:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343276.490810:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5dcb480/2, rc 0, transno 17179871996 00000100:00100000:3.0:1763343276.490815:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412994048:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343276.490859:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:1.0:1763343276.491409:0:8414:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c583e800/0x9104b1ba770a41de lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a66 expref: 21 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.491421:0:8414:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c583e800/0x9104b1ba770a41de lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a66 expref: 21 pid: 11289 timeout: 1169 lvb_type: 0 00000100:00100000:1.0:1763343276.491433:0:8414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8414:1848998412995072:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343276.491487:0:8414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9300 going to sleep for 11 seconds 00000100:00100000:1.0:1763343276.491525:0:3660:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474839260 gen 2 00000004:00080000:1.0:1763343276.491530:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c478bb80, transno 21474839221 00000004:00080000:1.0:1763343276.491540:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c478b800, transno 21474839222 00000004:00080000:1.0:1763343276.491543:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c39b5c00, transno 21474839223 00000004:00080000:1.0:1763343276.491545:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c4b21c00, transno 21474839224 00000004:00080000:1.0:1763343276.491548:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5a3c700, transno 21474839225 00000004:00080000:1.0:1763343276.491551:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c372ad80, transno 21474839226 00000004:00080000:1.0:1763343276.491553:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c3729180, transno 21474839227 00000004:00080000:1.0:1763343276.491556:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c3728700, transno 21474839228 00000004:00080000:1.0:1763343276.491558:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401efc70700, transno 21474839230 00000004:00080000:1.0:1763343276.491561:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c7918a80, transno 21474839231 00000004:00080000:1.0:1763343276.491563:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401efc71180, transno 21474839232 00000004:00080000:1.0:1763343276.491565:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401efc71500, transno 21474839233 00000004:00080000:1.0:1763343276.491567:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6e8ea00, transno 21474839236 00000004:00080000:1.0:1763343276.491569:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6e8e680, transno 21474839237 00000004:00080000:1.0:1763343276.491571:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c2f85f80, transno 21474839238 00000004:00080000:1.0:1763343276.491574:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c2f85880, transno 21474839239 00000004:00080000:1.0:1763343276.491576:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c390d880, transno 21474839243 00000004:00080000:1.0:1763343276.491578:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c390f800, transno 21474839244 00000004:00080000:1.0:1763343276.491580:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c390c700, transno 21474839245 00000004:00080000:1.0:1763343276.491582:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c390ea00, transno 21474839246 00000004:00080000:1.0:1763343276.491584:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9dc9500, transno 21474839247 00000004:00080000:1.0:1763343276.491586:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6280380, transno 21474839248 00000004:00080000:1.0:1763343276.491589:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc2ed80, transno 21474839250 00000004:00080000:1.0:1763343276.491591:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc2e300, transno 21474839251 00000004:00080000:1.0:1763343276.491593:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc2e680, transno 21474839252 00000004:00080000:1.0:1763343276.491596:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc2ce00, transno 21474839253 00000004:00080000:1.0:1763343276.491598:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6e8df80, transno 21474839254 00000004:00080000:1.0:1763343276.491600:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc2c000, transno 21474839255 00000004:00080000:1.0:1763343276.491602:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b26a00, transno 21474839257 00000004:00080000:1.0:1763343276.491604:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b27800, transno 21474839258 00000004:00080000:1.0:1763343276.491606:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5950380, transno 21474839259 00000004:00080000:1.0:1763343276.491608:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5951500, transno 21474839260 00000100:00100000:1.0:1763343276.491614:0:3660:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9400c6e8e300 x1848998412994560/t21474839265(21474839265) o6->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1763343292 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1763343276.491622:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6e8e300/2, rc 0, transno 21474839265 00000100:00100000:1.0:1763343276.491626:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6e8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412994560:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1763343276.491636:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5dc9500/2, rc 0, transno 17179871995 00000100:00100000:1.0:1763343276.491639:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412994176:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763343276.491647:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6282d80/2, rc 0, transno 21474839264 00000100:00100000:1.0:1763343276.491650:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412994688:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763343276.491773:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400cc5de680/2, rc 0, transno 21474839266 00000100:00100000:0.0:1763343276.491778:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412994816:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343276.491792:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399927680 00000100:00100000:0.0:1763343276.491797:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399927680 00000100:00100000:0.0:1763343276.491835:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10834 00000100:00100000:0.0:1763343276.491842:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57159:x1848998399927680:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343276.491855:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.491869:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a429b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49a97 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.491919:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a42a2 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343276.491929:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a42a2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.491938:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a42a2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.491949:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a42a9 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343276.491954:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a42a9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.491959:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a42a9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.491994:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a42a2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.492001:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a42a2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.492006:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a42a2 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.492012:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a42a2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.492018:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.492045:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a42a2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.492052:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a42a2 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.492062:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53600) 00010000:00010000:0.0:1763343276.492065:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.492070:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a42a2 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.492076:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a42a2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.492089:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a42a9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.492095:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a42a9 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.492100:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a42a9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.492105:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.492108:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a42a9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.492113:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a42a9 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.492119:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53100) 00010000:00010000:0.0:1763343276.492121:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.492124:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a42a9 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.492129:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a42a9 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.492157:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a429b lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a97 expref: 298 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.492167:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53600) 00010000:00010000:0.0:1763343276.492169:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.492173:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a429b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a97 expref: 298 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.492181:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501aa00, rc 0) 00000100:00100000:0.0:1763343276.492220:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+297:57159:x1848998399927680:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 377us (1361us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343276.492227:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10834 00000004:00080000:2.0:1763343276.496372:0:8616:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 4 in progress, 1 in flight, 32 done 00000100:00100000:2.0:1763343276.496630:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.496855:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.496875:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.497260:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399927808 00000100:00100000:0.0:1763343276.497260:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399928192 00000100:00100000:3.0:1763343276.497279:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399927808 00000100:00100000:0.0:1763343276.497316:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399928192 00000100:00100000:3.0:1763343276.497321:0:11289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11289:1848998412994944:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343276.497345:0:11289:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a428d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343276.497366:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10835 00000100:00100000:3.0:1763343276.497367:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399927936 00000100:00100000:3.0:1763343276.497369:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399927936 00000100:00100000:0.0:1763343276.497375:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+298:57159:x1848998399928192:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343276.497387:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583f800/0x9104b1ba770a41d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a5f expref: 15 pid: 11289 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.497397:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.497399:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:3.0:1763343276.497412:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3523 00000100:00100000:3.0:1763343276.497417:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9402021f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2410:x1848998399927936:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343276.497422:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4278 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a90 expref: 298 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.497430:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343276.497434:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c583f800/0x9104b1ba770a41d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a5f expref: 15 pid: 11289 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.497440:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53600) 00010000:00010000:3.0:1763343276.497444:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c583f800/0x9104b1ba770a41d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a5f expref: 15 pid: 11289 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.497449:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343276.497458:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c583f800/0x9104b1ba770a41d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a5f expref: 15 pid: 11289 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.497463:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a42b0 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49aa5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.497470:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343276.497472:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343276.497477:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a428d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.497487:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a428d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.497507:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343276.497558:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9402021f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2410:x1848998399927936:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 140us (703us total) trans 0 rc 0/0 00010000:00010000:0.0:1763343276.497564:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a42b7 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00000100:00100000:3.0:1763343276.497565:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3523 00010000:00010000:0.0:1763343276.497574:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a42b7 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.497581:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a42b7 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.497591:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a42be lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343276.497597:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a42be lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.497602:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a42be lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.497614:0:11289:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a428d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.497625:0:11289:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a428d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.497633:0:11289:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a428d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.497640:0:11289:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a428d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.497653:0:11289:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343276.497842:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+9:3661:x1848998412994432:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7607us (9467us total) trans 21474839267 rc 0/0 00000100:00100000:3.0:1763343276.497849:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7399 00010000:00010000:3.0:1763343276.497868:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343276.497874:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a428d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.497881:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917a00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343276.497885:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a428d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.497893:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a428d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.497904:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a428d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.497915:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a428d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.497929:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343276.497930:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343276.497932:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343276.497933:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a42c5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x216:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343276.497940:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a42c5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.497950:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a42c5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:0.0:1763343276.497959:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x216:0x0]: returning size 0 00000100:00100000:3.0:1763343276.497968:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10836 00000100:00100000:3.0:1763343276.497975:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57155:x1848998399927808:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343276.497982:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a42b7 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.497983:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.497988:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a42b7 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.497991:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a42d3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49a9e expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.497993:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a42b7 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.497999:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a42b7 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.498004:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.498007:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a42b7 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.498013:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a42b7 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.498017:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a42d3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a9e expref: 300 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.498020:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53200) 00010000:00010000:0.0:1763343276.498043:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.498047:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a42b7 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.498049:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917e00/0x9104b1ba770a42d3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a9e expref: 300 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.498053:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a42b7 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00000004:00010000:0.0:1763343276.498062:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000017df5bd4 reply state 0000000025180ba5 transno 4294973761 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a42be lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.498065:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:3.0:1763343276.498068:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343276.498070:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917e00, rc 0) 00010000:00010000:0.0:1763343276.498076:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a42be lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.498082:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53400) 00010000:00010000:0.0:1763343276.498084:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343276.498086:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343276.498090:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57155:x1848998399927808:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 116us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343276.498095:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10836 00010000:00010000:0.0:1763343276.498108:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a42b0 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49aa5 expref: 300 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.498121:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a42c5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49aa5 expref: 299 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.498129:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x216:0x0].0x0 (ffff9401edc53a00) 00010000:00010000:0.0:1763343276.498131:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343276.498133:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501ba00, rc 0) 00000100:00100000:0.0:1763343276.498155:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57159:x1848998399928192:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 781us (1279us total) trans 4294973761 rc 0/0 00000100:00100000:0.0:1763343276.498161:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10835 00000004:00080000:0.0:1763343276.498200:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c9dc9c00/2, rc 0, transno 21474839267 00000100:00100000:0.0:1763343276.498207:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9dc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412994432:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763343276.498498:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.498499:0:8414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8414:1848998412995072:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343276.498516:0:8414:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a427f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343276.498605:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399928320 00000100:00100000:0.0:1763343276.498610:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399928320 00010000:00010000:0.0:1763343276.498628:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583e800/0x9104b1ba770a41de lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a66 expref: 22 pid: 11289 timeout: 1169 lvb_type: 0 00000100:00100000:0.0:1763343276.498657:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3524 00000100:00100000:0.0:1763343276.498663:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2410:x1848998399928320:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343276.498673:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343276.498677:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c583e800/0x9104b1ba770a41de lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a66 expref: 22 pid: 11289 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.498687:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c583e800/0x9104b1ba770a41de lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a66 expref: 22 pid: 11289 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.498701:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c583e800/0x9104b1ba770a41de lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a66 expref: 22 pid: 11289 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.498710:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.498712:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.498715:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a427f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.498724:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a427f lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.498748:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343276.498772:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2410:x1848998399928320:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 109us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.498778:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3524 00010000:00010000:1.0:1763343276.498865:0:8414:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a427f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.498873:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a427f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.498881:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a427f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.498889:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a427f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.498909:0:8414:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343276.499112:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+25:3662:x1848998412993920:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11204us (11630us total) trans 17179871997 rc 0/0 00000100:00100000:1.0:1763343276.499119:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7393 00000004:00080000:3.0:1763343276.499280:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5dcb100/2, rc 0, transno 17179871997 00000100:00100000:3.0:1763343276.499287:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412993920:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1763343276.500052:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343276.500061:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a427f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.500071:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343276.500075:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a427f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.500083:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a427f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.500099:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a427f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.500105:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a427f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.500127:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343276.500129:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343276.500131:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343276.500680:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.500809:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399928576 00000100:00100000:0.0:1763343276.500819:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399928576 00000100:00100000:0.0:1763343276.500876:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3818 00000100:00100000:0.0:1763343276.500885:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57155:x1848998399928576:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:0.0:1763343276.501172:0:6528:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x213:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763343276.501231:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1779, 64 off147912 00000040:00080000:0.0:1763343276.501283:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1770, 64 off147152 00000040:00080000:0.0:1763343276.501296:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1771, 64 off147216 00000040:00080000:0.0:1763343276.501306:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1780, 64 off147976 00010000:00010000:0.0:1763343276.501362:0:6528:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a42da lrc: 3/0,1 mode: --/PW res: [0x240000404:0x213:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 00010000:00010000:0.0:1763343276.501377:0:6528:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a42da lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x213:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.501388:0:6528:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a42da lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x213:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.501395:0:6528:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a42da lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x213:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.501401:0:6528:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a42da lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x213:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.501406:0:6528:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a42da lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x213:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343276.501428:0:6528:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343276.501594:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57155:x1848998399928576:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 709us (918us total) trans 4294973762 rc 0/0 00000100:00100000:0.0:1763343276.501602:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3818 00000100:00100000:2.0:1763343276.501812:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:1.0:1763343276.501913:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343276.501920:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a42da lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x213:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT1 00010000:00010000:1.0:1763343276.501928:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501aa00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343276.501931:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a42da lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x213:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT1 00010000:00010000:1.0:1763343276.501939:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a42da lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x213:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT1 00010000:00010000:1.0:1763343276.501951:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x213:0x0].0x0 (ffff9400c4758500) 00010000:00010000:1.0:1763343276.501954:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763343276.501959:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a42da lrc: 1/0,0 mode: --/PW res: [0x240000404:0x213:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT1 00010000:00010000:1.0:1763343276.501965:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a42da lrc: 0/0,0 mode: --/PW res: [0x240000404:0x213:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT1 00010000:00010000:1.0:1763343276.501977:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343276.501979:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343276.501981:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343276.501992:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399928832 00000100:00100000:1.0:1763343276.501998:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399928832 00000100:00100000:1.0:1763343276.502233:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10837 00000100:00100000:1.0:1763343276.502252:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57159:x1848998399928832:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343276.502270:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343276.502282:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a42e1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x216:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49aac expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.502366:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a42e8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x216:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343276.502378:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a42c5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49aa5 expref: 302 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.502388:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a42e8 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x216:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.502419:0:9827:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a42c5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49aa5 expref: 302 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.502432:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a42c5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49aa5 expref: 302 pid: 6525 timeout: 1169 lvb_type: 0 00000100:00100000:1.0:1763343276.502445:0:9827:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5df800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412995200:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343276.502510:0:9827:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9180 going to sleep for 11 seconds 00000100:00100000:0.0:1763343276.504097:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.504298:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5df800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412995200:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343276.504323:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a42e8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x216:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:3.0:1763343276.504507:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399929088 00000100:00100000:3.0:1763343276.504515:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399929088 00000100:00100000:3.0:1763343276.504567:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10838 00000100:00100000:2.0:1763343276.504572:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.504575:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57155:x1848998399929088:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:2.0:1763343276.504592:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399929216 00010000:00010000:3.0:1763343276.504594:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1763343276.504596:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399929216 00010000:00010000:3.0:1763343276.504609:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a42ef lrc: 2/0,0 mode: --/CR res: [0x240000404:0x216:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49ab3 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.504613:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a42c5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49aa5 expref: 304 pid: 6525 timeout: 1169 lvb_type: 0 00000100:00100000:2.0:1763343276.504630:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3525 00000100:00100000:2.0:1763343276.504636:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:2407:x1848998399929216:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343276.504645:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343276.504649:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a42c5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49aa5 expref: 305 pid: 6525 timeout: 1169 lvb_type: 0 00010000:00010000:2.0:1763343276.504659:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a42c5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49aa5 expref: 305 pid: 6525 timeout: 1169 lvb_type: 0 00010000:00010000:2.0:1763343276.504675:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a42c5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49aa5 expref: 305 pid: 6525 timeout: 1169 lvb_type: 0 00010000:00010000:2.0:1763343276.504689:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x216:0x0].0x0 (ffff9401edc53a00) 00010000:00010000:2.0:1763343276.504693:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a42e8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x216:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343276.504696:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a42f6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x216:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343276.504706:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a42e8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x216:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.504938:0:7904:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a42e8 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x216:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343276.504950:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a42f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.504959:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a42f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:3.0:1763343276.504971:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x216:0x0]: returning size 0 00010000:00010000:3.0:1763343276.505079:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a42f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.505087:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a42f6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.505093:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a42f6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.505099:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343276.505103:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a42f6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.505109:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343276.505123:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a42f6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.505131:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x216:0x0].0x0 (ffff9401edc53a00) 00010000:00010000:3.0:1763343276.505133:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763343276.505137:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a42f6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x216:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.505143:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a42f6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x216:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343276.505157:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:2407:x1848998399929216:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 520us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.505163:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3525 00010000:00010000:3.0:1763343276.505176:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a42ef lrc: 1/0,0 mode: --/CR res: [0x240000404:0x216:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ab3 expref: 304 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.505184:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x216:0x0].0x0 (ffff9401edc53a00) 00010000:00010000:3.0:1763343276.505186:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343276.505190:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a42ef lrc: 0/0,0 mode: --/CR res: [0x240000404:0x216:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ab3 expref: 304 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.505198:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3a00, rc 0) 00000100:00100000:3.0:1763343276.505220:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57155:x1848998399929088:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 647us (1130us total) trans 4294973763 rc 301/301 00000100:00100000:3.0:1763343276.505227:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10838 00010000:00010000:1.0:1763343276.505631:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a42e8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x216:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.505639:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a42e8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x216:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343276.505654:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x216:0x0]: returning size 0 00000004:00080000:1.0:1763343276.505793:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2cf:0x0], index 1: 0 00000004:00080000:1.0:1763343276.505801:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2ce:0x0], index 0: 0 00000004:00080000:1.0:1763343276.505806:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2cf:0x0], index 0: 0 00000004:00080000:1.0:1763343276.505810:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2d0:0x0], index 1: 0 00010000:00010000:1.0:1763343276.505896:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a42e8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x216:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.505907:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a42e8 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x216:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.505913:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a42e8 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x216:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.505918:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343276.505922:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a42e8 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x216:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.505927:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a42e8 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x216:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.505938:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x216:0x0].0x0 (ffff9401edc53a00) 00010000:00010000:1.0:1763343276.505940:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343276.505944:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a42e8 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x216:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.505949:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a42e8 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x216:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.505981:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a42e1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x216:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49aac expref: 303 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.505989:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x216:0x0].0x0 (ffff9401edc53a00) 00010000:00010000:1.0:1763343276.505991:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343276.505994:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a42e1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x216:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49aac expref: 303 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.506005:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176e00, rc 0) 00000100:00100000:1.0:1763343276.506062:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57159:x1848998399928832:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3811us (4249us total) trans 4294973764 rc 301/301 00000100:00100000:1.0:1763343276.506069:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10837 00000100:00100000:2.0:1763343276.507752:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.507790:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.507899:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399929472 00000100:00100000:0.0:1763343276.507909:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399929472 00000100:00100000:3.0:1763343276.507943:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399929728 00000100:00100000:3.0:1763343276.507947:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399929728 00000100:00100000:0.0:1763343276.508253:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3819 00000100:00100000:0.0:1763343276.508264:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57155:x1848998399929472:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343276.508392:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3820 00000100:00100000:3.0:1763343276.508401:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57159:x1848998399929728:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343276.508579:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57159:x1848998399929728:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 178us (786us total) trans 4294973766 rc 0/0 00000100:00100000:3.0:1763343276.508586:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3820 00000100:00100000:0.0:1763343276.508640:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57155:x1848998399929472:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 378us (897us total) trans 4294973765 rc 0/0 00000100:00100000:0.0:1763343276.508647:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3819 00000100:00100000:3.0:1763343276.511053:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.511085:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399929984 00000100:00100000:0.0:1763343276.511096:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399929984 00000100:00100000:0.0:1763343276.511154:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3821 00000100:00100000:0.0:1763343276.511164:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57159:x1848998399929984:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343276.511395:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57159:x1848998399929984:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 231us (350us total) trans 4294973767 rc 0/0 00000100:00100000:0.0:1763343276.511403:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3821 00000100:00100000:1.0:1763343276.516002:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.516908:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399930240 00000100:00100000:2.0:1763343276.516919:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399930240 00000100:00100000:2.0:1763343276.516977:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10839 00000100:00100000:2.0:1763343276.516988:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:55884:x1848998399930240:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343276.517011:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.517051:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a430b lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49aba expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.517177:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4312 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343276.517191:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4312 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.517202:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4312 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.517212:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4319 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343276.517220:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4319 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.517226:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4319 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.517305:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4320 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x216:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343276.517314:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4320 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.517321:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4320 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:2.0:1763343276.517332:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x216:0x0]: returning size 0 00010000:00010000:2.0:1763343276.517416:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4312 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.517424:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4312 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.517430:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4312 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.517436:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4312 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.517442:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583fc00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.517445:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4312 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.517452:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4312 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.517467:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48ac100) 00010000:00010000:2.0:1763343276.517471:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.517475:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4312 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.517481:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4312 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.517494:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4319 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.517499:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4319 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.517504:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4319 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.517510:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.517512:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4319 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.517518:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4319 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.517524:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53400) 00010000:00010000:2.0:1763343276.517526:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.517530:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4319 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.517536:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4319 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.517570:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a430b lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49aba expref: 308 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.517588:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4320 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49aba expref: 307 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.517595:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x216:0x0].0x0 (ffff9400c48acd00) 00010000:00010000:2.0:1763343276.517597:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343276.517600:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f000, rc 0) 00000100:00100000:2.0:1763343276.517672:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:55884:x1848998399930240:12345-192.168.201.40@tcp:101:bash.0 Request processed in 686us (1682us total) trans 4294973768 rc 0/0 00000100:00100000:2.0:1763343276.517680:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10839 00000100:00100000:1.0:1763343276.519955:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.520069:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399930368 00000100:00100000:3.0:1763343276.520079:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399930368 00000100:00100000:3.0:1763343276.520133:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10840 00000100:00100000:3.0:1763343276.520143:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:55884:x1848998399930368:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343276.520166:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343276.520185:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a432e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x216:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49ac1 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.520220:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a4335 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x216:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343276.520233:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a4335 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.520257:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a4335 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.520374:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a432e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x216:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ac1 expref: 309 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.520391:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a4335 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ac1 expref: 308 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.520399:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x216:0x0].0x0 (ffff9400c48acd00) 00010000:00010000:3.0:1763343276.520402:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343276.520405:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3000, rc 0) 00000100:00100000:3.0:1763343276.520454:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:55884:x1848998399930368:12345-192.168.201.40@tcp:101:bash.0 Request processed in 312us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343276.520461:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10840 00000100:00100000:0.0:1763343276.523783:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.523836:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.524608:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399930880 00000100:00100000:2.0:1763343276.524608:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399930624 00000100:00100000:3.0:1763343276.524621:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399930880 00000100:00100000:2.0:1763343276.524621:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399930624 00000100:00100000:2.0:1763343276.524688:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10841 00000100:00100000:2.0:1763343276.524700:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57160:x1848998399930624:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343276.524724:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1763343276.524733:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10842 00000100:00100000:3.0:1763343276.524744:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:55884:x1848998399930880:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:2.0:1763343276.524746:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a433c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x216:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49ac8 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.524789:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343276.524811:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4320 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49aba expref: 310 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.524826:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x216:0x0].0x0 (ffff9400c48acd00) 00010000:00010000:3.0:1763343276.524830:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343276.524976:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4343 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x216:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343276.524990:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4343 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x216:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.525001:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4343 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x216:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343276.525003:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a434a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x216:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00000004:00200000:2.0:1763343276.525017:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x216:0x0]: returning size 0 00010000:00010000:3.0:1763343276.525019:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a434a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x216:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.525052:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a434a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x216:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000001:00080000:3.0:1763343276.525091:0:7641:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973769 00000004:00010000:3.0:1763343276.525109:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000075f8b8a reply state 00000000db9365b1 transno 4294973770 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a434a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x216:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.525121:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a434a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x216:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.525127:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x216:0x0].0x0 (ffff9400c48acd00) 00010000:00010000:3.0:1763343276.525130:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343276.525133:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343276.525171:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a433c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x216:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ac8 expref: 314 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.525187:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4343 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x216:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ac8 expref: 313 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.525194:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x216:0x0].0x0 (ffff9400c48acd00) 00010000:00010000:2.0:1763343276.525197:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1763343276.525200:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583ea00, rc 0) 00000100:00100000:3.0:1763343276.525210:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:55884:x1848998399930880:12345-192.168.201.40@tcp:36:bash.0 Request processed in 467us (1372us total) trans 4294973770 rc 0/0 00000100:00100000:3.0:1763343276.525218:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10842 00000020:00080000:3.0:1763343276.525225:0:7641:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763343276.525247:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57160:x1848998399930624:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 539us (1463us total) trans 4294973771 rc 0/0 00000100:00100000:2.0:1763343276.525255:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10841 00000100:00100000:1.0:1763343276.528520:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.528602:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.528696:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399931008 00000100:00100000:0.0:1763343276.528707:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399931008 00000100:00100000:0.0:1763343276.528759:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399931136 00000100:00100000:0.0:1763343276.528762:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399931136 00000100:00100000:0.0:1763343276.528805:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10843 00000100:00100000:2.0:1763343276.528815:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10844 00000100:00100000:0.0:1763343276.528818:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:55884:x1848998399931008:12345-192.168.201.40@tcp:101:bash.0 00000100:00100000:2.0:1763343276.528832:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57160:x1848998399931136:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343276.528847:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.528849:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.528873:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a435f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x216:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49ad6 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.528873:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4358 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x216:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49acf expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.528940:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4358 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x216:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49acf expref: 315 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.528954:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4358 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x216:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49acf expref: 315 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.528973:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x216:0x0].0x0 (ffff9400c48acd00) 00010000:00010000:0.0:1763343276.528977:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343276.528980:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4366 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x216:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343276.528982:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b800, rc 0) 00010000:00010000:2.0:1763343276.528994:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4366 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.529003:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4366 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:2.0:1763343276.529055:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x216:0x0]: returning size 0 00000004:00200000:2.0:1763343276.529060:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1763343276.529069:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:55884:x1848998399931008:12345-192.168.201.40@tcp:101:bash.0 Request processed in 254us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.529077:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10843 00000004:00010000:2.0:1763343276.529078:0:9827:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4366 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.529110:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a435f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x216:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ad6 expref: 315 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.529126:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4366 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ad6 expref: 314 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.529133:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x216:0x0].0x0 (ffff9400c48acd00) 00010000:00010000:2.0:1763343276.529136:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343276.529140:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f400, rc 0) 00000100:00100000:2.0:1763343276.529248:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57160:x1848998399931136:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 421us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.529255:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10844 00000100:00100000:1.0:1763343276.531726:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.531768:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.532230:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399931520 00000100:00100000:2.0:1763343276.532248:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399931520 00000100:00100000:2.0:1763343276.532298:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7401 00000100:00100000:2.0:1763343276.532305:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399931520:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343276.532320:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.532338:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c583f200/0x9104b1ba770a436d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49ae4 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343276.532357:0:8414:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343276.532371:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.532373:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.532380:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583f200/0x9104b1ba770a436d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ae4 expref: 15 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343276.532396:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c583f200/0x9104b1ba770a436d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ae4 expref: 15 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343276.532408:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f200, rc 0) 00000100:00100000:2.0:1763343276.532455:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998399931520:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 151us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.532462:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7401 00000100:00100000:1.0:1763343276.532530:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.532658:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399931648 00000100:00100000:0.0:1763343276.532663:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399931648 00000100:00100000:0.0:1763343276.532691:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7402 00000100:00100000:0.0:1763343276.532697:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edde7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399931648:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343276.532703:0:11289:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.532714:0:11289:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4374 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49aeb expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343276.532728:0:11289:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343276.532738:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.532741:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.532745:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4374 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49aeb expref: 22 pid: 11289 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343276.532756:0:11289:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4374 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49aeb expref: 22 pid: 11289 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343276.532764:0:11289:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a200, rc 0) 00000100:00100000:0.0:1763343276.532784:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edde7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399931648:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 88us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.532789:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7402 00000100:00100000:3.0:1763343276.533007:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399931392 00000100:00100000:3.0:1763343276.533012:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399931392 00000100:00100000:3.0:1763343276.533078:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10845 00000100:00100000:3.0:1763343276.533085:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:55884:x1848998399931392:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343276.533096:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343276.533099:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1763343276.533119:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4358 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x216:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49acf expref: 314 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.533136:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4343 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x216:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ac8 expref: 313 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.533145:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x216:0x0].0x0 (ffff9400c48acd00) 00010000:00010000:3.0:1763343276.533149:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343276.533158:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a437b lrc: 2/0,0 mode: --/EX res: [0x240000404:0x216:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49add expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.533197:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a4382 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x216:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343276.533209:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4366 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ad6 expref: 313 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.533218:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a4382 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x216:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.533259:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4366 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ad6 expref: 313 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.533282:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4366 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ad6 expref: 313 pid: 9827 timeout: 1169 lvb_type: 0 00000100:00100000:3.0:1763343276.533296:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dc8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412995328:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343276.533343:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c8284540 going to sleep for 11 seconds 00000100:00100000:0.0:1763343276.537104:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.537396:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dc8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412995328:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343276.537427:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a4382 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x216:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343276.537630:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399931776 00000100:00100000:2.0:1763343276.537637:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399931776 00010000:00010000:2.0:1763343276.537672:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4366 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ad6 expref: 314 pid: 9827 timeout: 1169 lvb_type: 0 00000100:00100000:2.0:1763343276.537709:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3526 00000100:00100000:2.0:1763343276.537719:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:2408:x1848998399931776:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343276.537733:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343276.537739:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4366 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ad6 expref: 314 pid: 9827 timeout: 1169 lvb_type: 0 00010000:00010000:2.0:1763343276.537751:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4366 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ad6 expref: 314 pid: 9827 timeout: 1169 lvb_type: 0 00010000:00010000:2.0:1763343276.537774:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4366 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ad6 expref: 314 pid: 9827 timeout: 1169 lvb_type: 0 00010000:00010000:2.0:1763343276.537788:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x216:0x0].0x0 (ffff9400c48acd00) 00010000:00010000:2.0:1763343276.537793:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a4382 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x216:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.537801:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a4382 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x216:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.537809:0:7904:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a4382 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x216:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.537834:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343276.537882:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:2408:x1848998399931776:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 165us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.537890:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3526 00000100:00100000:1.0:1763343276.538091:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:3.0:1763343276.538223:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a4382 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x216:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.538231:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a4382 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x216:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000040:00080000:3.0:1763343276.538489:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1781, 88 off148064 00000004:00080000:3.0:1763343276.538498:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1069662472709ns, next at 1070049115839ns, rc = 0 00000040:00080000:3.0:1763343276.538540:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1772, 88 off147304 00000004:00080000:3.0:1763343276.538544:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1069662519681ns, next at 1070049318579ns, rc = 0 00000040:00080000:3.0:1763343276.538561:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1773, 88 off147392 00000004:00080000:3.0:1763343276.538565:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1069662540402ns, next at 1070049318579ns, rc = 0 00000040:00080000:3.0:1763343276.538575:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1782, 88 off148152 00000004:00080000:3.0:1763343276.538578:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1069662553267ns, next at 1070049115839ns, rc = 0 00000100:00100000:0.0:1763343276.539222:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399931904 00000100:00100000:0.0:1763343276.539231:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399931904 00000100:00100000:0.0:1763343276.539320:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10846 00000100:00100000:0.0:1763343276.539329:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57160:x1848998399931904:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343276.539348:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.539365:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4389 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x216:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49af2 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.539409:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a4382 lrc: 2/0,1 mode: EX/EX res: [0x240000404:0x216:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.539419:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4389 lrc: 4/0,0 mode: --/CR res: [0x240000404:0x216:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49af2 expref: 315 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.539436:0:9827:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a4382 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x216:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.539448:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4389 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x216:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49af2 expref: 315 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.539460:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x216:0x0].0x0 (ffff9400c48acd00) 00010000:00010000:0.0:1763343276.539463:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343276.539466:0:9827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4389 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x216:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49af2 expref: 315 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.539474:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a000, rc 0) 00000100:00100000:0.0:1763343276.539530:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57160:x1848998399931904:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 202us (1439us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.539537:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10846 00000001:00080000:3.0:1763343276.543660:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973772 is committed 00000004:00080000:3.0:1763343276.543674:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1144 committed 00000004:00080000:3.0:1763343276.543691:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1136 committed 00000004:00080000:3.0:1763343276.543706:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1135 committed 00000004:00080000:3.0:1763343276.543708:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1143 committed 00010000:00010000:3.0:1763343276.543795:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a4382 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x216:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49add expref: 303 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.543815:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x216:0x0].0x0 (ffff9400c48acd00) 00010000:00010000:3.0:1763343276.543818:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763343276.543823:0:7641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4389 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x216:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49af2 expref: 303 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.543833:0:7641:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4389 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x216:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49af2 expref: 303 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.543841:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4389 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x216:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49af2 expref: 303 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.543880:0:7641:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4389 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x216:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49af2 expref: 303 pid: 9827 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343276.543895:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dc8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412995456:192.168.201.40@tcp:105: 00000100:00100000:3.0:1763343276.543975:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c8284600 going to sleep for 11 seconds 00010000:00010000:2.0:1763343276.544055:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a42be lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.544063:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a42be lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.544071:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a42be lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.544077:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.544081:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a42be lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.544089:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a42be lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.544100:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53400) 00010000:00010000:2.0:1763343276.544103:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.544107:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a42be lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.544113:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a42be lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.544137:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a434a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x216:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.544144:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a434a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x216:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.544149:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a434a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x216:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.544155:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.544158:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a434a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x216:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.544164:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a434a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x216:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.544170:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x216:0x0].0x0 (ffff9400c48acd00) 00010000:00010000:2.0:1763343276.544172:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.544174:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a434a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x216:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.544179:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a434a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x216:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000100:00100000:1.0:1763343276.544351:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412995840:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343276.544399:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.544428:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763343276.544435:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412995712:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343276.544454:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.544478:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412995840 00000100:00100000:1.0:1763343276.544485:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412995840 00000100:00100000:1.0:1763343276.544521:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412995712 00000100:00100000:1.0:1763343276.544524:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412995712 00000100:00100000:1.0:1763343276.544544:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7403 00000100:00100000:1.0:1763343276.544553:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+26:3660:x1848998412995840:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343276.544725:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+27:3660:x1848998412995840:12345-0@lo:2:osp-syn-1-1.0 Request processed in 171us (325us total) trans 17179871998 rc 0/0 00000100:00100000:1.0:1763343276.544732:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7403 00000100:00100000:1.0:1763343276.544750:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7404 00000100:00100000:1.0:1763343276.544756:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+26:3660:x1848998412995712:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343276.544768:0:27798:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:716 count 1 00010000:00010000:1.0:1763343276.544787:0:27798:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4390 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.544804:0:27798:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4232 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a7b expref: 21 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.544812:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343276.544813:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343276.544817:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4390 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.544842:0:27798:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4232 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a7b expref: 21 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.544854:0:27798:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4232 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a7b expref: 21 pid: 11289 timeout: 1169 lvb_type: 0 00000100:00100000:1.0:1763343276.544865:0:27798:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7918a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:27798:1848998412996096:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343276.544899:0:27798:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9180 going to sleep for 11 seconds 00000004:00080000:1.0:1763343276.544937:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400cc5de300/2, rc 0, transno 17179871998 00000100:00100000:1.0:1763343276.544942:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412995840:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343276.545151:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412995968:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343276.545178:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343276.545201:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763343276.545207:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412995584:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343276.545225:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343276.545383:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412995968 00000100:00100000:0.0:1763343276.545387:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412995968 00000100:00100000:0.0:1763343276.545412:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412995584 00000100:00100000:0.0:1763343276.545415:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412995584 00000100:00100000:3.0:1763343276.545429:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4b23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412996224:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343276.545435:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7405 00000100:00100000:0.0:1763343276.545444:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+28:3661:x1848998412995968:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343276.545466:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343276.545488:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343276.545494:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4b21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412996608:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343276.545518:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1763343276.545526:0:11289:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2d0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343276.545531:0:11289:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2d0:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343276.545534:0:11289:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2d0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343276.545536:0:11289:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2d0:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343276.545539:0:11289:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2d0:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343276.545565:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+29:3661:x1848998412995968:12345-0@lo:2:osp-syn-1-1.0 Request processed in 123us (386us total) trans 17179871999 rc 0/0 00000100:00100000:0.0:1763343276.545571:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7405 00000100:00100000:0.0:1763343276.545581:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412996224 00000100:00100000:0.0:1763343276.545584:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412996224 00000100:00100000:0.0:1763343276.545610:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412996608 00000100:00100000:0.0:1763343276.545613:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412996608 00000100:00100000:0.0:1763343276.545628:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7406 00000100:00100000:0.0:1763343276.545633:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+28:3661:x1848998412995584:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763343276.545643:0:11289:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:715 count 1 00010000:00010000:0.0:1763343276.545656:0:11289:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4397 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.545668:0:11289:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4159 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a2e expref: 21 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343276.545675:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.545676:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.545680:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4397 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.545699:0:11289:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4159 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a2e expref: 21 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343276.545708:0:11289:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4159 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a2e expref: 21 pid: 35281 timeout: 1169 lvb_type: 1 00000100:00100000:0.0:1763343276.545717:0:11289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c859b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11289:1848998412996736:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343276.545753:0:11289:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401d84de6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343276.545920:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7407 00000100:00100000:1.0:1763343276.545929:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+10:3662:x1848998412996224:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763343276.545943:0:8412:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:714 count 1 00010000:00010000:1.0:1763343276.545965:0:8412:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a439e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.545979:0:8412:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a4072 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499e1 expref: 14 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.545986:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343276.545988:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343276.545991:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a439e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.546017:0:8412:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a4072 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499e1 expref: 14 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.546049:0:8412:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a4072 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499e1 expref: 14 pid: 35281 timeout: 1169 lvb_type: 0 00000100:00100000:1.0:1763343276.546062:0:8412:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c791a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998412996864:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343276.546080:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7408 00000100:00100000:2.0:1763343276.546091:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+10:3662:x1848998412996608:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343276.546092:0:8412:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9300 going to sleep for 11 seconds 00000100:00100000:1.0:1763343276.546115:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4b23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412996480:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343276.546145:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.546161:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763343276.546168:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4b21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412996352:0@lo:6:osp-syn-0-1.0 00002000:00010000:2.0:1763343276.546179:0:28562:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2cf:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343276.546183:0:28562:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2cf:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763343276.546187:0:28562:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2cf:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1763343276.546193:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1763343276.546194:0:28562:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2cf:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763343276.546198:0:28562:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2cf:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343276.546219:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412996480 00000100:00100000:1.0:1763343276.546225:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412996480 00000100:00100000:2.0:1763343276.546253:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+12:3662:x1848998412996608:12345-0@lo:2:osp-syn-0-1.0 Request processed in 164us (733us total) trans 21474839268 rc 0/0 00000100:00100000:1.0:1763343276.546259:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412996352 00000100:00100000:2.0:1763343276.546263:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7408 00000100:00100000:1.0:1763343276.546264:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412996352 00000100:00100000:1.0:1763343276.546280:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7409 00000100:00100000:2.0:1763343276.546294:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7410 00000100:00100000:1.0:1763343276.546295:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+12:3660:x1848998412996480:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343276.546305:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+12:3660:x1848998412996352:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763343276.546321:0:28562:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:715 count 1 00010000:00010000:2.0:1763343276.546339:0:28562:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a43a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.546352:0:28562:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c583e600/0x9104b1ba770a420f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a74 expref: 14 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.546359:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343276.546361:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343276.546365:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a43a5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1763343276.546387:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c4b21f80/2, rc 0, transno 21474839268 00010000:00010000:2.0:1763343276.546389:0:28562:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c583e600/0x9104b1ba770a420f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a74 expref: 14 pid: 35281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343276.546398:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4b21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412996608:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343276.546400:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+13:3660:x1848998412996480:12345-0@lo:2:osp-syn-0-1.0 Request processed in 110us (251us total) trans 21474839269 rc 0/0 00010000:00010000:2.0:1763343276.546411:0:28562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c583e600/0x9104b1ba770a420f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a74 expref: 14 pid: 35281 timeout: 1169 lvb_type: 0 00000100:00100000:1.0:1763343276.546420:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7409 00000100:00100000:2.0:1763343276.546431:0:28562:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28562:1848998412996992:192.168.201.40@tcp:104: 00000004:00080000:1.0:1763343276.546456:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c4b23480/2, rc 0, transno 21474839269 00000100:00100000:1.0:1763343276.546463:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4b23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412996480:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343276.546478:0:28562:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c7ec3b40 going to sleep for 11 seconds 00000004:00080000:2.0:1763343276.546522:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400cc5dc380/2, rc 0, transno 17179871999 00000100:00100000:2.0:1763343276.546528:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412995968:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343276.549743:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.549847:0:28562:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28562:1848998412996992:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343276.549873:0:28562:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a43a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343276.549960:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dc8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412995456:192.168.201.40@tcp:105: 00010000:00010000:3.0:1763343276.549993:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a437b lrc: 0/0,0 mode: --/EX res: [0x240000404:0x216:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49add expref: 301 pid: 7641 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763343276.550011:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a4382 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x216:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49add expref: 300 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.550073:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3200, rc 0) 00000100:00100000:3.0:1763343276.550130:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:55884:x1848998399931392:12345-192.168.201.40@tcp:101:bash.0 Request processed in 17044us (18413us total) trans 4294973772 rc 0/0 00000100:00100000:3.0:1763343276.550138:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10845 00000100:00100000:1.0:1763343276.550372:0:8412:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c791a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998412996864:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343276.550388:0:8412:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a439e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343276.550413:0:27798:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7918a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:27798:1848998412996096:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343276.550426:0:27798:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4390 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343276.550502:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399932032 00000100:00100000:0.0:1763343276.550510:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399932032 00010000:00010000:0.0:1763343276.550539:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4232 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a7b expref: 22 pid: 11289 timeout: 1169 lvb_type: 0 00000100:00100000:0.0:1763343276.550572:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3527 00000100:00100000:0.0:1763343276.550580:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6275880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2408:x1848998399932032:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343276.550595:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343276.550601:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4232 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a7b expref: 22 pid: 11289 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.550613:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4232 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a7b expref: 22 pid: 11289 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.550638:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4232 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a7b expref: 22 pid: 11289 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.550650:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.550653:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.550657:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4390 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.550666:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4390 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.550694:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343276.550767:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6275880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399932032:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 186us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.550774:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3527 00000100:00100000:0.0:1763343276.550808:0:11289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c859b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11289:1848998412996736:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343276.550821:0:11289:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4397 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.550869:0:27798:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4390 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.550877:0:27798:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4390 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.550885:0:27798:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4390 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.550892:0:27798:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4390 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.550914:0:27798:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343276.551162:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+29:3660:x1848998412995712:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6405us (6706us total) trans 17179872000 rc 0/0 00000100:00100000:1.0:1763343276.551170:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7404 00000004:00080000:1.0:1763343276.551207:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400cc5dea00/2, rc 0, transno 17179872000 00000100:00100000:1.0:1763343276.551213:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412995712:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1763343276.551274:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343276.551280:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4390 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.551288:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343276.551292:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4390 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.551305:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4390 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.551317:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4390 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.551324:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4390 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.551339:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343276.551341:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343276.551343:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343276.552983:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.553115:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.553160:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399932160 00000100:00100000:0.0:1763343276.553169:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399932160 00010000:00010000:0.0:1763343276.553200:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4159 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a2e expref: 21 pid: 35281 timeout: 1169 lvb_type: 1 00000100:00100000:2.0:1763343276.553514:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.554820:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.555656:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399932416 00000100:00100000:0.0:1763343276.555671:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399932416 00010000:00010000:0.0:1763343276.555707:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583e600/0x9104b1ba770a420f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a74 expref: 15 pid: 35281 timeout: 1169 lvb_type: 0 00000100:00100000:0.0:1763343276.555737:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399932288 00000100:00100000:0.0:1763343276.555740:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399932288 00010000:00010000:0.0:1763343276.555752:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a4072 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499e1 expref: 16 pid: 35281 timeout: 1169 lvb_type: 0 00000100:00100000:0.0:1763343276.555772:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3528 00000100:00100000:0.0:1763343276.555781:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6274700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2410:x1848998399932160:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343276.555800:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343276.555807:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4159 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a2e expref: 21 pid: 35281 timeout: 1169 lvb_type: 1 00010000:00010000:0.0:1763343276.555820:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4159 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a2e expref: 21 pid: 35281 timeout: 1169 lvb_type: 1 00010000:00010000:0.0:1763343276.555844:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4159 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a2e expref: 21 pid: 35281 timeout: 1169 lvb_type: 1 00010000:00010000:0.0:1763343276.555859:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.555862:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.555866:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4397 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.555875:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4397 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.555899:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343276.555951:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6274700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2410:x1848998399932160:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 170us (2974us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.555958:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3528 00000100:00100000:0.0:1763343276.555976:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3529 00000100:00100000:0.0:1763343276.555983:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6277100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2410:x1848998399932416:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343276.555992:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343276.555996:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c583e600/0x9104b1ba770a420f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a74 expref: 16 pid: 35281 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.556005:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c583e600/0x9104b1ba770a420f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a74 expref: 16 pid: 35281 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.556019:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c583e600/0x9104b1ba770a420f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49a74 expref: 16 pid: 35281 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.556044:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.556046:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.556049:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a43a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.556056:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a43a5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.556076:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343276.556097:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6277100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2410:x1848998399932416:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 114us (2982us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.556103:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3529 00000100:00100000:0.0:1763343276.556116:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3530 00000100:00100000:0.0:1763343276.556123:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401d84f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2410:x1848998399932288:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343276.556130:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343276.556135:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a4072 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499e1 expref: 14 pid: 35281 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.556144:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a4072 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499e1 expref: 14 pid: 35281 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.556157:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a4072 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b499e1 expref: 14 pid: 35281 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.556165:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.556166:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.556169:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a439e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.556175:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a439e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.556189:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343276.556203:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401d84f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2410:x1848998399932288:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 82us (2691us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.556208:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3530 00010000:00010000:0.0:1763343276.556272:0:11289:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4397 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.556281:0:11289:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4397 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.556288:0:11289:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4397 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.556294:0:11289:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4397 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.556312:0:11289:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343276.556571:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+29:3661:x1848998412995584:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10937us (11344us total) trans 17179872001 rc 0/0 00000100:00100000:0.0:1763343276.556578:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7406 00010000:00010000:0.0:1763343276.556594:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343276.556599:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4397 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.556606:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343276.556609:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4397 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.556617:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4397 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.556627:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4397 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.556633:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4397 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.556647:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343276.556649:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343276.556650:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343276.556681:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400cc5ded80/2, rc 0, transno 17179872001 00000100:00100000:0.0:1763343276.556687:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412995584:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343276.557007:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:1.0:1763343276.557010:0:8412:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a439e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.557021:0:8412:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a439e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.557055:0:8412:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a439e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343276.557062:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399932544 00010000:00010000:1.0:1763343276.557063:0:8412:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a439e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343276.557070:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399932544 00010000:00010000:1.0:1763343276.557083:0:8412:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343276.557268:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399932672 00000100:00100000:3.0:1763343276.557272:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399932672 00000100:00100000:3.0:1763343276.557292:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3822 00000100:00100000:3.0:1763343276.557301:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6275500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57160:x1848998399932544:12345-192.168.201.40@tcp:49:lfs.0 00000100:00100000:1.0:1763343276.557314:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+13:3662:x1848998412996224:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11385us (11846us total) trans 21474839270 rc 0/0 00000100:00100000:1.0:1763343276.557323:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7407 00010000:00010000:1.0:1763343276.557343:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343276.557348:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a439e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.557356:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343276.557360:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a439e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.557372:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a439e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.557387:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a439e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343276.557395:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6275500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57160:x1848998399932544:12345-192.168.201.40@tcp:49:lfs.0 Request processed in 93us (2577us total) trans 0 rc 0/0 00010000:00010000:1.0:1763343276.557397:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176800/0x9104b1ba770a439e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343276.557411:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3822 00010000:00010000:1.0:1763343276.557422:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343276.557425:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343276.557428:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343276.557431:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3823 00000100:00100000:3.0:1763343276.557440:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8547450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:55884:x1848998399932672:12345-192.168.201.40@tcp:49:bash.0 00000004:00080000:1.0:1763343276.557570:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c4b23800/2, rc 0, transno 21474839270 00000100:00100000:1.0:1763343276.557577:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4b23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412996224:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343276.557601:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8547450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:55884:x1848998399932672:12345-192.168.201.40@tcp:49:bash.0 Request processed in 160us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343276.557608:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3823 00010000:00010000:2.0:1763343276.557972:0:28562:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a43a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.557981:0:28562:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a43a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.557988:0:28562:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a43a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.557996:0:28562:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a43a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.558019:0:28562:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343276.558268:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+13:3660:x1848998412996352:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11965us (12076us total) trans 21474839271 rc 0/0 00000100:00100000:2.0:1763343276.558276:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7410 00010000:00010000:3.0:1763343276.558344:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343276.558350:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a43a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.558358:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f400 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343276.558361:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a43a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.558371:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a43a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.558385:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a43a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.558391:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a43a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.558406:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343276.558408:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343276.558410:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343276.558465:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c4b21500/2, rc 0, transno 21474839271 00000100:00100000:1.0:1763343276.558471:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4b21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412996352:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343276.561672:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.561749:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399932800 00000100:00100000:2.0:1763343276.561771:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399932800 00000100:00100000:2.0:1763343276.561833:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7411 00000100:00100000:2.0:1763343276.561843:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:55884:x1848998399932800:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343276.561861:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.561884:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c583f600/0x9104b1ba770a43ac lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49af9 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343276.561908:0:28562:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343276.561936:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.561938:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.561948:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583f600/0x9104b1ba770a43ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49af9 expref: 21 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.561963:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c583f600/0x9104b1ba770a43ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49af9 expref: 21 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.561974:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f600, rc 0) 00000100:00100000:2.0:1763343276.562060:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:55884:x1848998399932800:12345-192.168.201.40@tcp:101:bash.0 Request processed in 218us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.562068:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7411 00000100:00100000:2.0:1763343276.563370:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.564805:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399932928 00000100:00100000:1.0:1763343276.564820:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399932928 00000100:00100000:1.0:1763343276.564883:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7412 00000100:00100000:1.0:1763343276.564892:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6276d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399932928:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343276.564911:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343276.564929:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5176800/0x9104b1ba770a43b3 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49b00 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343276.564987:0:8412:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7918a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8412:1848998412997120:192.168.201.40@tcp:106: 00000100:00100000:1.0:1763343276.565082:0:8412:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9300 going to sleep for 11 seconds 00000100:00100000:3.0:1763343276.566094:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.566155:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399933056 00000100:00100000:2.0:1763343276.566162:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399933056 00000100:00100000:2.0:1763343276.566412:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7413 00000100:00100000:2.0:1763343276.566422:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:55884:x1848998399933056:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343276.566437:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.566454:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c583fe00/0x9104b1ba770a43ba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49b07 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343276.566475:0:28562:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343276.566495:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.566497:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.566506:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583fe00/0x9104b1ba770a43ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b07 expref: 14 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.566521:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c583fe00/0x9104b1ba770a43ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b07 expref: 14 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.566535:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583fe00, rc 0) 00000100:00100000:2.0:1763343276.566593:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:55884:x1848998399933056:12345-192.168.201.40@tcp:101:bash.0 Request processed in 172us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.566600:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7413 00002000:00010000:1.0:1763343276.568727:0:8412:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000400:0x2cf:0x0] updating lvb mtime: 0 -> 1763343275 00002000:00010000:1.0:1763343276.568736:0:8412:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000400:0x2cf:0x0] updating lvb atime: 0 -> 1763343275 00002000:00010000:1.0:1763343276.568739:0:8412:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000400:0x2cf:0x0] updating lvb ctime: 0 -> 1763343275 00000100:00100000:1.0:1763343276.568759:0:8412:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7918a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8412:1848998412997120:192.168.201.40@tcp:106: 00010000:00010000:1.0:1763343276.568789:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176800/0x9104b1ba770a43b3 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b00 expref: 22 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343276.568810:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176800/0x9104b1ba770a43b3 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b00 expref: 22 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343276.568822:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176800, rc 0) 00000100:00100000:1.0:1763343276.568877:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6276d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399932928:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3985us (5512us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343276.568885:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7412 00000100:00100000:3.0:1763343276.575611:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.575714:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.577951:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399933184 00000100:00100000:1.0:1763343276.577967:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399933184 00002000:00010000:1.0:1763343276.578015:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/719 (0->18446744073709551615) 00002000:00100000:1.0:1763343276.578020:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5dc8000 with x1848998399933184 ext(0->18446744073709551615) 00000100:00100000:0.0:1763343276.578057:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399933312 00000100:00100000:0.0:1763343276.578064:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399933312 00002000:00010000:0.0:1763343276.578082:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/718 (0->18446744073709551615) 00002000:00100000:0.0:1763343276.578086:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5dc8380 with x1848998399933312 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343276.578097:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5dc8380. 00000100:00100000:0.0:1763343276.578133:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1761 00000100:00100000:0.0:1763343276.578142:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399933312:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:0.0:1763343276.578332:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2ce:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343276.578336:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2ce:0x0] updating lvb mtime from disk: 0 -> 1763343275 00002000:00010000:0.0:1763343276.578339:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2ce:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343276.578342:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2ce:0x0] updating lvb ctime from disk: 0 -> 1763343275 00002000:00010000:0.0:1763343276.578344:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2ce:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343276.578396:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998399933312:12345-192.168.201.40@tcp:10:bash.0 Request processed in 254us (2797us total) trans 21474839272 rc 0/0 00000100:00100000:0.0:1763343276.578403:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1761 00002000:00010000:0.0:1763343276.578406:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/718 (0->18446744073709551615) 00002000:00100000:0.0:1763343276.578409:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5dc8380 with x1848998399933312 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343276.578413:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5dc8380. 00002000:00010000:1.0:1763343276.578518:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5dc8000. 00000100:00100000:1.0:1763343276.578542:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1762 00000100:00100000:1.0:1763343276.578552:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399933184:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:1.0:1763343276.578641:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2cf:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343276.578644:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2cf:0x0] updating lvb mtime from disk: 1763343275 -> 1763343275 00002000:00010000:1.0:1763343276.578647:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2cf:0x0] updating lvb atime from disk: 1763343275 -> 0 00002000:00010000:1.0:1763343276.578649:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2cf:0x0] updating lvb ctime from disk: 1763343275 -> 1763343275 00002000:00010000:1.0:1763343276.578651:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2cf:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343276.578677:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399933184:12345-192.168.201.40@tcp:10:bash.0 Request processed in 127us (2962us total) trans 17179872002 rc 0/0 00000100:00100000:1.0:1763343276.578684:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1762 00002000:00010000:1.0:1763343276.578687:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/719 (0->18446744073709551615) 00002000:00100000:1.0:1763343276.578690:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5dc8000 with x1848998399933184 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343276.578695:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5dc8000. 00000100:00100000:3.0:1763343276.581041:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.581109:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399933568 00000100:00100000:0.0:1763343276.581118:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399933568 00000100:00100000:0.0:1763343276.581163:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3824 00000100:00100000:0.0:1763343276.581171:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57160:x1848998399933568:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343276.581938:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57160:x1848998399933568:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 764us (914us total) trans 4294973773 rc 0/0 00000100:00100000:0.0:1763343276.581947:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3824 00000100:00100000:1.0:1763343276.584824:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.586404:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399933824 00000100:00100000:0.0:1763343276.586418:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399933824 00000100:00100000:0.0:1763343276.586486:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3825 00000100:00100000:0.0:1763343276.586499:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:55884:x1848998399933824:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:3.0:1763343276.586511:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.586793:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:55884:x1848998399933824:12345-192.168.201.40@tcp:35:bash.0 Request processed in 297us (1977us total) trans 4294973774 rc 0/0 00000100:00100000:0.0:1763343276.586801:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3825 00000100:00100000:2.0:1763343276.587258:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399934080 00000100:00100000:2.0:1763343276.587265:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399934080 00000100:00100000:2.0:1763343276.587304:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10847 00000100:00100000:2.0:1763343276.587312:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57160:x1848998399934080:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343276.587326:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.587347:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a43c1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49b0e expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.587410:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a43c8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343276.590673:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a43c8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.590690:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a43c8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.590723:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a43cf lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343276.590730:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a43cf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.590736:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a43cf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.590857:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a43d6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x216:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343276.590866:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a43d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.590873:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a43d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343276.590884:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x216:0x0]: returning size 5 00010000:00010000:2.0:1763343276.590958:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a43c8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.590965:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a43c8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.590971:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a43c8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.590977:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a43c8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.590983:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583e400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.590987:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a43c8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.590994:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a43c8 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.591006:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48ac400) 00010000:00010000:2.0:1763343276.591009:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.591013:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a43c8 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.591019:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a43c8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.591051:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a43cf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.591057:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a43cf lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.591061:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a43cf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.591066:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.591068:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a43cf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.591073:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a43cf lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.591079:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48ace00) 00010000:00010000:2.0:1763343276.591081:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.591084:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a43cf lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.591089:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a43cf lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.591136:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a43c1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b0e expref: 305 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.591151:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a43d6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b0e expref: 304 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.591157:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x216:0x0].0x0 (ffff9400c48acd00) 00010000:00010000:2.0:1763343276.591159:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343276.591161:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583e600, rc 0) 00000100:00100000:2.0:1763343276.591251:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57160:x1848998399934080:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3938us (4740us total) trans 4294973775 rc 0/0 00000100:00100000:2.0:1763343276.591260:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10847 00000100:00100000:3.0:1763343276.597429:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.597480:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.597544:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399934592 00000100:00100000:2.0:1763343276.597555:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399934592 00000100:00100000:0.0:1763343276.597600:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399934336 00000100:00100000:0.0:1763343276.597606:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399934336 00000100:00100000:2.0:1763343276.597628:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10848 00000100:00100000:2.0:1763343276.597640:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57161:x1848998399934592:12345-192.168.201.40@tcp:36:rm.0 00000100:00100000:0.0:1763343276.597645:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3826 00000100:00100000:0.0:1763343276.597655:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57160:x1848998399934336:12345-192.168.201.40@tcp:35:lfs.0 00010000:00010000:2.0:1763343276.597695:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1763343276.597726:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a4382 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x216:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49add expref: 305 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.597747:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4389 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x216:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49af2 expref: 304 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.597761:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a43d6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b0e expref: 303 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.597773:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a4335 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x216:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ac1 expref: 302 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.597783:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x216:0x0].0x0 (ffff9400c48acd00) 00010000:00010000:2.0:1763343276.597792:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343276.597821:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a43e4 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343276.597833:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a43e4 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.597844:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a43e4 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.597856:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a43eb lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343276.597861:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a43eb lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.597867:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a43eb lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:0.0:1763343276.597933:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57160:x1848998399934336:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 278us (514us total) trans 4294973776 rc 0/0 00010000:00010000:2.0:1763343276.597938:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a43f2 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x216:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00000100:00100000:0.0:1763343276.597944:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3826 00010000:00010000:2.0:1763343276.597951:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a43f2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x216:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.597960:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a43f2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x216:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000040:00080000:2.0:1763343276.598210:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1783, 64 off148216 00000040:00080000:2.0:1763343276.598247:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1774, 64 off147456 00000040:00080000:2.0:1763343276.599926:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1775, 64 off147520 00000040:00080000:2.0:1763343276.599964:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1784, 64 off148280 00010000:00010000:2.0:1763343276.600041:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a43f9 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x216:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343276.600055:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a43f9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x216:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.600065:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a43f9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x216:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.600073:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a43f9 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x216:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.600079:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a43f9 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x216:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.600085:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a43f9 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x216:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.600098:0:7641:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343276.600117:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a43f2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x216:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.600122:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a43f2 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x216:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.600128:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a43f2 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x216:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.600133:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583e400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.600137:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a43f2 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x216:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.600145:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a43f2 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x216:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.600156:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x216:0x0].0x0 (ffff9400c48ac000) 00010000:00010000:2.0:1763343276.600159:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763343276.600163:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a43f2 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x216:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.600168:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a43f2 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x216:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.600276:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a43e4 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.600283:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a43e4 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.600289:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a43e4 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.600294:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a43e4 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.600299:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583e000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.600302:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a43e4 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.600307:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a43e4 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.600314:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48ac400) 00010000:00010000:2.0:1763343276.600316:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.600319:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a43e4 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.600324:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a43e4 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00010000:2.0:1763343276.600338:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003d75fed9 reply state 0000000060c349da transno 4294973777 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a43eb lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.600348:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a43eb lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.600354:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48ace00) 00010000:00010000:2.0:1763343276.600356:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343276.600358:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343276.600435:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57161:x1848998399934592:12345-192.168.201.40@tcp:36:rm.0 Request processed in 2795us (2951us total) trans 4294973777 rc 0/0 00000100:00100000:2.0:1763343276.600442:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10848 00010000:00010000:0.0:1763343276.603635:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343276.603649:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a43f9 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x216:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.603659:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583fa00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343276.603663:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a43f9 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x216:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.603673:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a43f9 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x216:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.603689:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x216:0x0].0x0 (ffff9400c48ac000) 00010000:00010000:0.0:1763343276.603693:0:7451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343276.603697:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a43f9 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x216:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.603702:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a43f9 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x216:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.603720:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343276.603722:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343276.603723:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343276.604911:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.605079:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399934848 00000100:00100000:3.0:1763343276.605090:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399934848 00000100:00100000:3.0:1763343276.605143:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10849 00000100:00100000:3.0:1763343276.605152:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6275500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57160:x1848998399934848:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343276.605179:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343276.605202:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4400 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49b15 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.605295:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a4407 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343276.605309:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a4407 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.605321:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a4407 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.605330:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a440e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343276.605337:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a440e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.605343:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a440e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.605388:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a4407 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.605395:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a4407 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.605402:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a4407 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.605408:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a4407 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.605413:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343276.605418:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a4407 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.605427:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a4407 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.605438:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f669e800) 00010000:00010000:3.0:1763343276.605441:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343276.605445:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a4407 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.605451:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a4407 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.605462:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a440e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.605467:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a440e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.605472:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a440e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.605477:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3916200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343276.605480:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a440e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.605486:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a440e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.605493:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48ace00) 00010000:00010000:3.0:1763343276.605495:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343276.605498:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a440e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.605510:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a440e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.605539:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4400 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b15 expref: 304 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.605550:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f669e800) 00010000:00010000:3.0:1763343276.605552:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343276.605556:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4400 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b15 expref: 304 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.605568:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917000, rc 0) 00000100:00100000:3.0:1763343276.605635:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6275500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57160:x1848998399934848:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 483us (733us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343276.605642:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10849 00000100:00100000:1.0:1763343276.622550:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.623118:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399934976 00000100:00100000:0.0:1763343276.623130:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399934976 00000100:00100000:1.0:1763343276.623709:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10850 00000100:00100000:1.0:1763343276.623721:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57162:x1848998399934976:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343276.623743:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343276.623770:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4415 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49b1c expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.623845:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a441c lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343276.623860:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a441c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.623870:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a441c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.623881:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4423 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343276.623888:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4423 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.623897:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4423 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.623937:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a441c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.623944:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a441c lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.623950:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a441c lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.623955:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343276.623959:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a441c lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.623966:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a441c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.623977:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497ed00) 00010000:00010000:1.0:1763343276.623980:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.623984:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a441c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.623989:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a441c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.624000:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4423 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.624006:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4423 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.624011:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4423 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.624016:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343276.624018:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4423 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.626217:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4423 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.626259:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48ace00) 00010000:00010000:1.0:1763343276.626261:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.626268:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4423 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.626275:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4423 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.626329:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4415 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b1c expref: 304 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.626339:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497ed00) 00010000:00010000:1.0:1763343276.626342:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.626346:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4415 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b1c expref: 304 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.626361:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177800, rc 0) 00000100:00100000:1.0:1763343276.628340:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57162:x1848998399934976:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 4610us (5788us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343276.628352:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10850 00000100:00100000:0.0:1763343276.632682:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.632787:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399935232 00000100:00100000:1.0:1763343276.632798:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399935232 00000100:00100000:1.0:1763343276.633010:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10851 00000100:00100000:1.0:1763343276.633021:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57163:x1848998399935232:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343276.633305:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343276.633330:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a442a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49b23 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.633407:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a4431 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343276.633421:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a4431 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.633432:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a4431 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.633441:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4438 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343276.633449:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4438 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.633455:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4438 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.633497:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a4431 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.633505:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a4431 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.633512:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a4431 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.633519:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343276.633524:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a4431 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.633532:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a4431 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.633544:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497e900) 00010000:00010000:1.0:1763343276.633546:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.633551:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a4431 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.633556:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a4431 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.633570:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4438 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.633576:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4438 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.633581:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4438 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.633587:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343276.633590:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4438 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.633596:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4438 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.633603:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48ace00) 00010000:00010000:1.0:1763343276.633605:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.633608:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4438 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.633618:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4438 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.633645:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a442a lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b23 expref: 304 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.633655:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497e900) 00010000:00010000:1.0:1763343276.633657:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343276.633661:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a442a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b23 expref: 304 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.633674:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177c00, rc 0) 00000100:00100000:1.0:1763343276.635191:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57163:x1848998399935232:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2162us (2513us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343276.635204:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10851 00000100:00100000:2.0:1763343276.638769:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.638866:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399935360 00000100:00100000:1.0:1763343276.638877:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399935360 00000100:00100000:1.0:1763343276.638940:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10852 00000100:00100000:1.0:1763343276.638949:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57163:x1848998399935360:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343276.638969:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343276.638994:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a443f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49b2a expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.639093:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4446 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343276.639107:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4446 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.639121:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4446 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.639131:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a444d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343276.639137:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a444d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.639142:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a444d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.639178:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4446 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.639185:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4446 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.639191:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4446 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.639198:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343276.639201:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4446 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.639209:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4446 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.639220:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497e000) 00010000:00010000:1.0:1763343276.639222:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.639227:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4446 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.639266:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4446 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.639280:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a444d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.639286:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a444d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.639292:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a444d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.639297:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343276.639301:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a444d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.639306:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a444d lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.639313:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48ace00) 00010000:00010000:1.0:1763343276.639316:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.639319:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a444d lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.639325:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a444d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.639350:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a443f lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b2a expref: 304 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.639360:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497e000) 00010000:00010000:1.0:1763343276.639362:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.639366:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a443f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b2a expref: 304 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.639384:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177200, rc 0) 00000100:00100000:1.0:1763343276.639436:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57163:x1848998399935360:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 488us (679us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343276.639444:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10852 00000100:00100000:0.0:1763343276.645667:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.646803:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399935488 00000100:00100000:3.0:1763343276.646815:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399935488 00000100:00100000:0.0:1763343276.647395:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10853 00000100:00100000:0.0:1763343276.647408:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57162:x1848998399935488:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343276.647427:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.647451:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a4454 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49b31 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.647519:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a445b lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343276.647533:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a445b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.647544:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a445b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.648513:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4462 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343276.648527:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4462 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.648537:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4462 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.648701:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a445b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.648709:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a445b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.648716:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a445b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.648721:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a445b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.648728:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.648732:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a445b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.648739:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a445b lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.648751:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53100) 00010000:00010000:0.0:1763343276.648754:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.648758:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a445b lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.648764:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a445b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.648777:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4462 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.648782:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4462 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.648788:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4462 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.648792:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.648794:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4462 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.648800:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4462 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.648807:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48ace00) 00010000:00010000:0.0:1763343276.648809:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.648813:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4462 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.648818:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4462 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.648854:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a4454 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b31 expref: 304 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.648864:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53100) 00010000:00010000:0.0:1763343276.648867:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.648870:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a4454 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b31 expref: 304 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.648885:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501ae00, rc 0) 00000100:00100000:0.0:1763343276.651906:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57162:x1848998399935488:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 4488us (6236us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343276.651921:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10853 00000100:00100000:0.0:1763343276.655378:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.655436:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399935616 00000100:00100000:2.0:1763343276.655448:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399935616 00000100:00100000:2.0:1763343276.655514:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10854 00000100:00100000:2.0:1763343276.655525:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57162:x1848998399935616:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343276.655546:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.655568:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4469 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49b38 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.655647:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4470 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343276.655661:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4470 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.655674:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4470 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343276.655723:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763343276.655727:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763343276.655761:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4469 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b38 expref: 305 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.655778:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4470 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b38 expref: 304 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.655787:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48ac400) 00010000:00010000:2.0:1763343276.655790:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763343276.655794:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583ee00, rc 0) 00000100:00100000:2.0:1763343276.655869:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57162:x1848998399935616:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 345us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.655876:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10854 00000100:00100000:2.0:1763343276.660596:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.660901:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399935744 00000100:00100000:1.0:1763343276.660911:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399935744 00000100:00100000:1.0:1763343276.660973:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10855 00000100:00100000:1.0:1763343276.660983:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6274700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57162:x1848998399935744:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343276.661004:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343276.661052:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4477 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49b3f expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.661128:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a447e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343276.661143:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a447e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.661155:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a447e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.661166:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4485 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343276.661173:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4485 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.661179:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4485 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.662379:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a447e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.662395:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a447e lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.662402:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a447e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.662408:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343276.662412:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a447e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.662420:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a447e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.662435:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48ac400) 00010000:00010000:1.0:1763343276.662438:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.662444:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a447e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.662450:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a447e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.662466:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4485 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.662472:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4485 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.662477:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4485 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.662481:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343276.662485:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4485 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.662490:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4485 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.662497:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48ace00) 00010000:00010000:1.0:1763343276.662499:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.662502:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4485 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.662507:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4485 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.662549:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4477 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b3f expref: 305 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.662560:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48ac400) 00010000:00010000:1.0:1763343276.662562:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.662566:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4477 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b3f expref: 305 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.662577:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177200, rc 0) 00000100:00100000:1.0:1763343276.662663:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6274700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57162:x1848998399935744:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1681us (2076us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343276.662673:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10855 00000100:00100000:0.0:1763343276.666268:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.667680:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399936000 00000100:00100000:1.0:1763343276.667693:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399936000 00000100:00100000:1.0:1763343276.667752:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10856 00000100:00100000:1.0:1763343276.667762:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57164:x1848998399936000:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343276.667784:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343276.667805:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a448c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49b46 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.667879:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4493 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343276.667893:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4493 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.667905:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4493 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.667915:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a449a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343276.667922:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a449a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.667929:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a449a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.667963:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4493 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.667970:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4493 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.667977:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4493 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.667983:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343276.667987:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4493 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.667999:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4493 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.668009:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48ac400) 00010000:00010000:1.0:1763343276.668012:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.668017:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4493 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.668049:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4493 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.668067:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a449a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.668073:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a449a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.668079:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a449a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.668085:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343276.668088:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a449a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.668094:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a449a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.668101:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48ace00) 00010000:00010000:1.0:1763343276.668103:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.668106:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a449a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.668112:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a449a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.668140:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a448c lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b46 expref: 305 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.668150:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48ac400) 00010000:00010000:1.0:1763343276.668152:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343276.668156:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a448c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b46 expref: 305 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.668165:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177c00, rc 0) 00000100:00100000:1.0:1763343276.668242:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57164:x1848998399936000:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 470us (1975us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343276.668250:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10856 00000100:00100000:0.0:1763343276.674978:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.675137:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399936256 00000100:00100000:2.0:1763343276.675149:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399936256 00000100:00100000:2.0:1763343276.675202:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10857 00000100:00100000:2.0:1763343276.675211:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57162:x1848998399936256:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343276.675241:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.675245:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343276.675455:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4470 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b38 expref: 304 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.675475:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48ac400) 00010000:00010000:2.0:1763343276.675485:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343276.675502:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a44a1 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49b4d expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.675609:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a44a8 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343276.675622:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a44a8 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.675632:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a44a8 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.675641:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a44af lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343276.675649:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a44af lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.675655:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a44af lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.676049:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a44b6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343276.676060:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a44b6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.676067:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a44b6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343276.676078:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x218:0x0]: returning size 0 00010000:00010000:2.0:1763343276.676103:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a44a8 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.676110:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a44a8 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.676121:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a44a8 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.676128:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a44a8 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.676134:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.676138:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a44a8 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.676145:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a44a8 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.676153:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48acd00) 00010000:00010000:2.0:1763343276.676156:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.676160:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a44a8 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.676166:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a44a8 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00010000:2.0:1763343276.676177:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b353e85a reply state 00000000da00548a transno 4294973778 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a44af lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.676187:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a44af lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.676193:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48ace00) 00010000:00010000:2.0:1763343276.676196:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343276.676198:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343276.676223:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a44a1 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b4d expref: 306 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.676258:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a44b6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b4d expref: 305 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.676267:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c48ac600) 00010000:00010000:2.0:1763343276.676283:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343276.676286:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f000, rc 0) 00000100:00100000:2.0:1763343276.676359:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57162:x1848998399936256:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1148us (1392us total) trans 4294973778 rc 0/0 00000100:00100000:2.0:1763343276.676367:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10857 00000100:00100000:2.0:1763343276.686580:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.686630:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.686717:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399936512 00000100:00100000:0.0:1763343276.686730:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399936512 00000100:00100000:0.0:1763343276.686787:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399936768 00000100:00100000:0.0:1763343276.686791:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399936768 00000100:00100000:0.0:1763343276.686820:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10858 00000100:00100000:0.0:1763343276.686831:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57162:x1848998399936512:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343276.686861:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.686960:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a44c4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49b54 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.687093:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a44cb lrc: 3/0,1 mode: --/EX res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343276.687108:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a44b6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b4d expref: 308 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.687117:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a44cb lrc: 4/0,1 mode: --/EX res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.687149:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a44b6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b4d expref: 308 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.687163:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a44b6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b4d expref: 308 pid: 7641 timeout: 1169 lvb_type: 0 00000100:00100000:0.0:1763343276.687176:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5956680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412997248:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343276.687267:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401d84de180 going to sleep for 11 seconds 00000100:00100000:1.0:1763343276.687463:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10859 00000100:00100000:1.0:1763343276.687476:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57165:x1848998399936768:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343276.687486:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343276.687497:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a44d2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49b5b expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.687555:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a44d9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343276.687566:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a44d9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.687579:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a44d9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:1.0:1763343276.687590:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x218:0x0]: returning size 0 00010000:00010000:1.0:1763343276.687678:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a44d9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.687686:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a44d9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.687693:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a44d9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.687699:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343276.687702:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a44d9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.687710:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a44d9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.687722:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c48ac600) 00010000:00010000:1.0:1763343276.687726:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1763343276.687730:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a44d9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.687735:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a44d9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.687770:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a44d2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x218:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b5b expref: 310 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.687779:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c48ac600) 00010000:00010000:1.0:1763343276.687781:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343276.687784:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a44d2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x218:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b5b expref: 310 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.687792:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177c00, rc 0) 00000100:00100000:1.0:1763343276.687826:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57165:x1848998399936768:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 354us (1195us total) trans 4294973779 rc 301/301 00000100:00100000:1.0:1763343276.687833:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10859 00000100:00100000:0.0:1763343276.691435:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.691517:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.691610:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5956680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412997248:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343276.691637:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a44cb lrc: 3/0,1 mode: --/EX res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343276.691705:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399937152 00000100:00100000:3.0:1763343276.691714:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399937152 00010000:00010000:3.0:1763343276.691752:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a44b6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b4d expref: 309 pid: 7641 timeout: 1169 lvb_type: 0 00000100:00100000:3.0:1763343276.691791:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3531 00000100:00100000:3.0:1763343276.691802:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:2408:x1848998399937152:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343276.691817:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343276.691824:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a44b6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b4d expref: 309 pid: 7641 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343276.691836:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a44b6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b4d expref: 309 pid: 7641 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343276.691864:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a44b6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b4d expref: 309 pid: 7641 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343276.691881:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c48ac600) 00010000:00010000:3.0:1763343276.691886:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a44cb lrc: 3/0,1 mode: --/EX res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.691895:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a44cb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.691902:0:6511:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a44cb lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.691935:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343276.691980:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:2408:x1848998399937152:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 180us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343276.691987:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3531 00010000:00010000:2.0:1763343276.692469:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a44cb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.692478:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a44cb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343276.692504:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x218:0x0]: returning size 0 00000004:00080000:2.0:1763343276.692695:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2d0:0x0], index 0: 0 00000004:00080000:2.0:1763343276.692703:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2d1:0x0], index 1: 0 00000004:00080000:2.0:1763343276.692707:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2d2:0x0], index 1: 0 00000004:00080000:2.0:1763343276.692711:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2d1:0x0], index 0: 0 00010000:00010000:2.0:1763343276.692818:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a44cb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.692827:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a44cb lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.692833:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a44cb lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.692839:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.692843:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a44cb lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.692849:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a44cb lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.692860:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c48ac600) 00010000:00010000:2.0:1763343276.692862:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343276.692866:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a44cb lrc: 2/0,0 mode: --/EX res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.692873:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a44cb lrc: 0/0,0 mode: --/EX res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.692921:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a44c4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x218:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b54 expref: 308 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.692930:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c48ac600) 00010000:00010000:2.0:1763343276.692932:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343276.692936:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a44c4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x218:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b54 expref: 308 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.692949:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a000, rc 0) 00000100:00100000:2.0:1763343276.692992:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57162:x1848998399936512:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 6163us (6425us total) trans 4294973780 rc 301/301 00000100:00100000:2.0:1763343276.692999:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10858 00000100:00100000:3.0:1763343276.693463:0:9931:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4789c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9931:1848998412997376:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1763343276.693510:0:9931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343276.693533:0:9931:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c8284540 going to sleep for 11 seconds 00000100:00100000:0.0:1763343276.694422:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412997376 00000100:00100000:0.0:1763343276.694433:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412997376 00000100:00100000:0.0:1763343276.694499:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7414 00000100:00100000:0.0:1763343276.694508:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+29:9931:x1848998412997376:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1763343276.694548:0:8412:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 738 00000100:00100000:1.0:1763343276.695315:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399937024 00000100:00100000:1.0:1763343276.695322:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399937024 00000100:00100000:1.0:1763343276.695381:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3827 00000100:00100000:1.0:1763343276.695391:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57165:x1848998399937024:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343276.695645:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57165:x1848998399937024:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 254us (4218us total) trans 4294973781 rc 0/0 00000100:00100000:1.0:1763343276.695654:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3827 00000100:00100000:0.0:1763343276.696251:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+30:9931:x1848998412997376:12345-0@lo:5:osp-pre-1-1.0 Request processed in 1742us (2737us total) trans 17179872003 rc 0/0 00000100:00100000:0.0:1763343276.696260:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7414 00000100:00100000:1.0:1763343276.696497:0:9931:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4789c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9931:1848998412997376:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1763343276.696521:0:9931:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x2d2:0x0]-[0x2c0000400:0x301:0x0] 00000100:00100000:2.0:1763343276.701597:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.701597:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.701679:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399937408 00000100:00100000:1.0:1763343276.701690:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399937408 00000100:00100000:1.0:1763343276.701748:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3828 00000100:00100000:1.0:1763343276.701759:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57162:x1848998399937408:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343276.701994:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57162:x1848998399937408:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 236us (409us total) trans 4294973782 rc 0/0 00000100:00100000:1.0:1763343276.702001:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3828 00000100:00100000:3.0:1763343276.703641:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399937664 00000100:00100000:3.0:1763343276.703651:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399937664 00000100:00100000:1.0:1763343276.704504:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10860 00000100:00100000:1.0:1763343276.704519:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57165:x1848998399937664:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343276.704540:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343276.704569:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a44ee lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49b62 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.704655:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a44f5 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343276.704670:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a44f5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.704681:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a44f5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.704691:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a44fc lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343276.704698:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a44fc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.704703:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a44fc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.704806:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4503 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343276.704814:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4503 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.704820:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4503 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:1.0:1763343276.704829:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x218:0x0]: returning size 0 00010000:00010000:1.0:1763343276.704899:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a44f5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.704905:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a44f5 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.704915:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a44f5 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.704921:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343276.704924:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a44f5 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.704931:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a44f5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.704943:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497e000) 00010000:00010000:1.0:1763343276.704946:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.704951:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a44f5 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.704957:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a44f5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.704969:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a44fc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.704975:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a44fc lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.704980:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a44fc lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.704984:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343276.704986:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a44fc lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.704991:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a44fc lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.705001:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48ace00) 00010000:00010000:1.0:1763343276.705003:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.705006:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a44fc lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.705011:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a44fc lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343276.705087:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a44ee lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b62 expref: 312 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.705104:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4503 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b62 expref: 311 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.705111:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:1.0:1763343276.705114:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343276.705116:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176200, rc 0) 00000100:00100000:1.0:1763343276.705185:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57165:x1848998399937664:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 671us (3601us total) trans 4294973783 rc 0/0 00000100:00100000:1.0:1763343276.705192:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10860 00000100:00100000:0.0:1763343276.705868:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.708139:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399937920 00000100:00100000:1.0:1763343276.708154:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399937920 00000100:00100000:1.0:1763343276.708245:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3829 00000100:00100000:1.0:1763343276.708255:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8547050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57162:x1848998399937920:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343276.708511:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8547050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57162:x1848998399937920:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 247us (2636us total) trans 4294973784 rc 0/0 00000100:00100000:1.0:1763343276.708519:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3829 00000100:00100000:0.0:1763343276.713487:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.713531:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.713653:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399938048 00000100:00100000:3.0:1763343276.713664:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399938048 00000100:00100000:3.0:1763343276.713729:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399938176 00000100:00100000:3.0:1763343276.713732:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399938176 00000100:00100000:3.0:1763343276.713768:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7415 00000100:00100000:3.0:1763343276.713779:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2408:x1848998399938048:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343276.713799:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343276.713823:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4511 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49b69 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343276.713848:0:28562:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343276.713869:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343276.713871:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343276.713880:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4511 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b69 expref: 23 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343276.713895:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4511 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b69 expref: 23 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343276.713909:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917000, rc 0) 00000100:00100000:3.0:1763343276.713962:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2408:x1848998399938048:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 185us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343276.713969:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7415 00000100:00100000:3.0:1763343276.713986:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7416 00000100:00100000:3.0:1763343276.713993:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998399938176:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343276.714001:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343276.714013:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a4518 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49b70 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343276.714056:0:28562:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343276.714068:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343276.714069:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343276.714074:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a4518 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b70 expref: 16 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343276.714092:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a4518 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b70 expref: 16 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343276.714101:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3916200, rc 0) 00000100:00100000:3.0:1763343276.714123:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399938176:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 130us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343276.714129:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7416 00000100:00100000:0.0:1763343276.720699:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.720748:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.720855:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399938560 00000100:00100000:1.0:1763343276.720865:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399938560 00000100:00100000:1.0:1763343276.720924:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399938432 00000100:00100000:1.0:1763343276.720928:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399938432 00000100:00100000:1.0:1763343276.720961:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10861 00000100:00100000:1.0:1763343276.720972:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57165:x1848998399938560:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:3.0:1763343276.720976:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10862 00000100:00100000:3.0:1763343276.720992:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:55884:x1848998399938432:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343276.721002:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343276.721002:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343276.721007:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343276.721055:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a451f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49b7e expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.721057:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4503 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b62 expref: 313 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.721088:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:3.0:1763343276.721094:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343276.721103:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a4526 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49b77 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.721127:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a451f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b7e expref: 314 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.721144:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a451f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b7e expref: 314 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.721162:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:1.0:1763343276.721165:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343276.721168:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177c00, rc 0) 00010000:00010000:3.0:1763343276.721196:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a452d lrc: 3/0,1 mode: --/CW res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343276.721207:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a452d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x218:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.721217:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a452d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x218:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:1.0:1763343276.721226:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57165:x1848998399938560:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 256us (538us total) trans 0 rc 0/0 00000004:00200000:3.0:1763343276.721243:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x218:0x0]: returning size 0 00000100:00100000:1.0:1763343276.721267:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10861 00010000:00010000:3.0:1763343276.721360:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a4526 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b77 expref: 315 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.721374:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a452d lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x218:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b77 expref: 314 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.721380:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:3.0:1763343276.721382:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:3.0:1763343276.721384:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5bd9a00, rc 0) 00000100:00100000:3.0:1763343276.721415:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:55884:x1848998399938432:12345-192.168.201.40@tcp:101:bash.0 Request processed in 429us (669us total) trans 4294973785 rc 0/0 00000100:00100000:3.0:1763343276.721422:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10862 00000100:00100000:2.0:1763343276.725244:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.725367:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399938688 00000100:00100000:3.0:1763343276.725377:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399938688 00000100:00100000:3.0:1763343276.725426:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3830 00000100:00100000:3.0:1763343276.725435:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57165:x1848998399938688:12345-192.168.201.40@tcp:49:lfs.0 00000100:00100000:3.0:1763343276.726748:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57165:x1848998399938688:12345-192.168.201.40@tcp:49:lfs.0 Request processed in 1307us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343276.726758:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3830 00000100:00100000:0.0:1763343276.727120:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.727207:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399938816 00000100:00100000:2.0:1763343276.727214:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399938816 00000100:00100000:2.0:1763343276.727274:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10863 00000100:00100000:2.0:1763343276.727283:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:55884:x1848998399938816:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343276.727300:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.727319:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a453b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49b85 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.727352:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4542 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343276.727367:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4542 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.727378:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4542 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.727487:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a453b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b85 expref: 316 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.727505:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4542 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b85 expref: 315 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.727513:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:2.0:1763343276.727516:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343276.727521:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583e800, rc 0) 00000100:00100000:2.0:1763343276.727578:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:55884:x1848998399938816:12345-192.168.201.40@tcp:101:bash.0 Request processed in 295us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.727586:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10863 00000100:00100000:0.0:1763343276.734189:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.734227:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.734537:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399939072 00000100:00100000:3.0:1763343276.734548:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399939072 00000100:00100000:3.0:1763343276.734617:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3831 00000100:00100000:3.0:1763343276.734628:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57165:x1848998399939072:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343276.734714:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399939328 00000100:00100000:2.0:1763343276.734719:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399939328 00000100:00100000:2.0:1763343276.734754:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10864 00000100:00100000:2.0:1763343276.734762:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:55884:x1848998399939328:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:2.0:1763343276.734792:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343276.734820:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a452d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x218:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b77 expref: 317 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.734840:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:2.0:1763343276.734846:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343276.734874:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57165:x1848998399939072:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 246us (702us total) trans 4294973786 rc 0/0 00000100:00100000:3.0:1763343276.734883:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3831 00010000:00010000:2.0:1763343276.734977:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4549 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343276.734991:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4549 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.735002:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4549 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000001:00080000:2.0:1763343276.735073:0:7641:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973787 00000004:00010000:2.0:1763343276.735099:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000df78ad0d reply state 000000006c51149c transno 4294973788 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4549 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.735111:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4549 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.735117:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:2.0:1763343276.735121:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343276.735124:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343276.735191:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+318:55884:x1848998399939328:12345-192.168.201.40@tcp:36:bash.0 Request processed in 430us (962us total) trans 4294973788 rc 0/0 00000100:00100000:2.0:1763343276.735198:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10864 00000020:00080000:2.0:1763343276.735202:0:7641:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343276.738181:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.738216:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.738312:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399939584 00000100:00100000:1.0:1763343276.738323:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399939584 00000100:00100000:1.0:1763343276.738367:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399939840 00000100:00100000:1.0:1763343276.738370:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399939840 00000100:00100000:0.0:1763343276.738378:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10865 00000100:00100000:0.0:1763343276.738393:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:57165:x1848998399939584:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343276.738418:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.738454:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4550 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49b8c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.738541:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4557 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343276.738556:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4557 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.738569:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4557 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.738580:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a455e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343276.738586:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a455e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.738593:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a455e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.738708:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4565 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343276.738718:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4565 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.738724:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4565 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:0.0:1763343276.738735:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x218:0x0]: returning size 0 00010000:00010000:0.0:1763343276.738818:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4557 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.738825:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4557 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.738831:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4557 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.738836:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4557 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.738842:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.738847:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4557 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.738853:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4557 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.738864:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53100) 00010000:00010000:0.0:1763343276.738866:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.738870:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4557 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.738877:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4557 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.738889:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a455e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.738895:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a455e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.738900:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a455e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.738905:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ba00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.738907:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a455e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.738912:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a455e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.738918:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48ace00) 00010000:00010000:0.0:1763343276.738920:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.738923:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a455e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.738932:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a455e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.738962:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4550 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b8c expref: 322 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.738979:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4565 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b8c expref: 321 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.739005:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:0.0:1763343276.739008:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343276.739011:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b800, rc 0) 00000100:00100000:1.0:1763343276.739077:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10866 00000100:00100000:1.0:1763343276.739089:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:55884:x1848998399939840:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343276.739100:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343276.739104:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:0.0:1763343276.739111:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:57165:x1848998399939584:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 721us (937us total) trans 4294973789 rc 0/0 00010000:00010000:1.0:1763343276.739120:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a451f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b7e expref: 321 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343276.739122:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10865 00010000:00010000:1.0:1763343276.739137:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:1.0:1763343276.739142:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343276.739149:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a4573 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49b93 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.739925:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a457a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343276.739938:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4565 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b8c expref: 320 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.739947:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a457a lrc: 4/0,1 mode: --/EX res: [0x240000404:0x218:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.739977:0:9827:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4565 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b8c expref: 320 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.739990:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4565 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b8c expref: 320 pid: 6525 timeout: 1169 lvb_type: 0 00000100:00100000:1.0:1763343276.740002:0:9827:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7918a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412997504:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343276.740095:0:9827:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1763343276.743097:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.743304:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399940096 00000100:00100000:3.0:1763343276.743314:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399940096 00000100:00100000:3.0:1763343276.744112:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3832 00000100:00100000:3.0:1763343276.744125:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:57165:x1848998399940096:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343276.744390:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+322:57165:x1848998399940096:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 267us (1302us total) trans 4294973790 rc 0/0 00000100:00100000:2.0:1763343276.744399:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3832 00000100:00100000:1.0:1763343276.744565:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7918a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998412997504:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343276.744591:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a457a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x218:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:0.0:1763343276.747115:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.747368:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399940224 00000100:00100000:2.0:1763343276.747378:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399940224 00000100:00100000:0.0:1763343276.747385:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.747455:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399940352 00000100:00100000:1.0:1763343276.747460:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399940352 00000100:00100000:2.0:1763343276.747472:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3833 00000100:00100000:2.0:1763343276.747481:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:57165:x1848998399940224:12345-192.168.201.40@tcp:33:lfs.0 00010000:00010000:1.0:1763343276.747483:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4565 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b8c expref: 323 pid: 6525 timeout: 1169 lvb_type: 0 00000100:00100000:1.0:1763343276.747568:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3532 00000100:00100000:1.0:1763343276.747576:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5951500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:2409:x1848998399940352:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343276.747588:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343276.747594:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4565 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b8c expref: 323 pid: 6525 timeout: 1169 lvb_type: 0 00010000:00010000:1.0:1763343276.747608:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4565 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b8c expref: 323 pid: 6525 timeout: 1169 lvb_type: 0 00010000:00010000:1.0:1763343276.747629:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4565 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b8c expref: 323 pid: 6525 timeout: 1169 lvb_type: 0 00010000:00010000:1.0:1763343276.747645:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:1.0:1763343276.747650:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a457a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x218:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.747659:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a457a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.747665:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a457a lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.747689:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343276.747757:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+322:57165:x1848998399940224:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 277us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.747757:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5951500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+322:2409:x1848998399940352:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 180us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.747767:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3833 00000100:00100000:1.0:1763343276.747767:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3532 00010000:00010000:1.0:1763343276.747793:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a457a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.747801:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a457a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000040:00080000:1.0:1763343276.748150:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1776, 88 off147608 00000004:00080000:1.0:1763343276.748159:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1069872133674ns, next at 1070049318579ns, rc = 0 00000040:00080000:1.0:1763343276.748467:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1785, 88 off148368 00000004:00080000:1.0:1763343276.748473:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1069872448613ns, next at 1070049115839ns, rc = 0 00000040:00080000:1.0:1763343276.748500:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1786, 88 off148456 00000004:00080000:1.0:1763343276.748504:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1069872479758ns, next at 1070049115839ns, rc = 0 00000040:00080000:1.0:1763343276.748514:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1777, 88 off147696 00000004:00080000:1.0:1763343276.748518:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1069872493074ns, next at 1070049318579ns, rc = 0 00010000:00010000:3.0:1763343276.756484:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a43eb lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.756504:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a43eb lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.756511:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a43eb lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.756517:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343276.756523:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a43eb lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.756530:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a43eb lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.756546:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48ace00) 00010000:00010000:3.0:1763343276.756549:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343276.756554:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a43eb lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.756561:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a43eb lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.756585:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a44af lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.756591:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a44af lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.756597:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a44af lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.756601:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583fc00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343276.756604:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a44af lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.756609:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a44af lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.756616:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48ace00) 00010000:00010000:3.0:1763343276.756618:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343276.756621:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a44af lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.756626:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a44af lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.756643:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4549 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.756649:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4549 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.756654:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4549 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.756661:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343276.756664:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4549 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.756669:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4549 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.756675:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:3.0:1763343276.756677:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343276.756680:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4549 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.756685:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4549 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000001:00080000:2.0:1763343276.757106:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973791 is committed 00000004:00080000:2.0:1763343276.757116:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1138 committed 00000004:00080000:2.0:1763343276.757124:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1146 committed 00000004:00080000:2.0:1763343276.757141:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1145 committed 00000004:00080000:2.0:1763343276.757144:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1137 committed 00000100:00100000:3.0:1763343276.757405:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412997632:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343276.757468:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343276.757721:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412998144:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343276.757745:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.757825:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412997760:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343276.757856:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412997888:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343276.757876:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412998016:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343276.758375:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343276.758383:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412998528:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343276.758409:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763343276.758595:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a457a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x218:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b93 expref: 300 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.758608:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:0.0:1763343276.758611:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343276.758626:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a4573 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b93 expref: 300 pid: 9827 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763343276.758643:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a457a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x218:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b93 expref: 299 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.758678:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:0.0:1763343276.758681:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343276.758683:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177000, rc 0) 00000100:00100000:0.0:1763343276.758743:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:55884:x1848998399939840:12345-192.168.201.40@tcp:101:bash.0 Request processed in 19656us (20524us total) trans 4294973791 rc 0/0 00000100:00100000:0.0:1763343276.758754:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10866 00000100:00100000:2.0:1763343276.760793:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412997632 00000100:00100000:2.0:1763343276.760810:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412997632 00000100:00100000:2.0:1763343276.760869:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412998144 00000100:00100000:2.0:1763343276.760872:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412998144 00000100:00100000:2.0:1763343276.760888:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412998528 00000100:00100000:2.0:1763343276.760891:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412998528 00000100:00100000:2.0:1763343276.760913:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7417 00000100:00100000:2.0:1763343276.760923:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+15:3662:x1848998412997632:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763343276.760953:0:11289:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:718 count 1 00010000:00010000:2.0:1763343276.760981:0:11289:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c583ec00/0x9104b1ba770a4581 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.761002:0:11289:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c583fe00/0x9104b1ba770a43ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b07 expref: 15 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.761009:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343276.761012:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343276.761015:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583ec00/0x9104b1ba770a4581 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.761075:0:11289:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c583fe00/0x9104b1ba770a43ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b07 expref: 15 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.761089:0:11289:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c583fe00/0x9104b1ba770a43ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b07 expref: 15 pid: 28562 timeout: 1169 lvb_type: 0 00000100:00100000:2.0:1763343276.761103:0:11289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11289:1848998412998656:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343276.761180:0:11289:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c7ec3480 going to sleep for 11 seconds 00000100:00100000:0.0:1763343276.761273:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.761663:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412998016 00000100:00100000:1.0:1763343276.761671:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412998016 00000100:00100000:1.0:1763343276.761716:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7418 00000100:00100000:1.0:1763343276.761724:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+15:3662:x1848998412998144:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763343276.761741:0:8412:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:719 count 1 00010000:00010000:1.0:1763343276.761758:0:8412:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a4588 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.761775:0:8412:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c583f200/0x9104b1ba770a436d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ae4 expref: 15 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343276.761783:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.761785:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.761788:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a4588 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.761810:0:8412:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c583f200/0x9104b1ba770a436d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ae4 expref: 15 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343276.761820:0:8412:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c583f200/0x9104b1ba770a436d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ae4 expref: 15 pid: 8414 timeout: 1169 lvb_type: 1 00000100:00100000:1.0:1763343276.761830:0:8412:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c791b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998412998784:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343276.761875:0:8412:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9300 going to sleep for 11 seconds 00000100:00100000:1.0:1763343276.761893:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.761923:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412998400:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343276.761955:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.761985:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412997888 00000100:00100000:1.0:1763343276.761989:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412997888 00000100:00100000:1.0:1763343276.762005:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412998400 00000100:00100000:1.0:1763343276.762007:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412998400 00000100:00100000:1.0:1763343276.762020:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7419 00000100:00100000:1.0:1763343276.762052:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+16:3662:x1848998412998528:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1763343276.762188:0:8413:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2d1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343276.762192:0:8413:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2d1:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343276.762195:0:8413:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2d1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343276.762197:0:8413:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2d1:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763343276.762199:0:8413:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2d1:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343276.762252:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+17:3662:x1848998412998528:12345-0@lo:2:osp-syn-0-1.0 Request processed in 201us (3841us total) trans 21474839273 rc 0/0 00000100:00100000:1.0:1763343276.762261:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7419 00000100:00100000:1.0:1763343276.762280:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7420 00000100:00100000:1.0:1763343276.762287:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+31:3661:x1848998412998016:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343276.762378:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+32:3661:x1848998412998016:12345-0@lo:2:osp-syn-1-1.0 Request processed in 91us (1105us total) trans 17179872004 rc 0/0 00000100:00100000:1.0:1763343276.762384:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7420 00000100:00100000:1.0:1763343276.762398:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7421 00000100:00100000:1.0:1763343276.762404:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+31:3660:x1848998412997888:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343276.762414:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:720 count 1 00010000:00010000:1.0:1763343276.762425:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a458f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.762436:0:8413:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4374 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49aeb expref: 22 pid: 11289 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343276.762443:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.762445:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.762447:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a458f lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.762468:0:8413:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4374 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49aeb expref: 22 pid: 11289 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343276.762478:0:8413:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4374 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49aeb expref: 22 pid: 11289 timeout: 1169 lvb_type: 1 00000100:00100000:1.0:1763343276.762489:0:8413:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c791b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8413:1848998412998912:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343276.762519:0:8413:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401ed059000 going to sleep for 11 seconds 00000100:00100000:1.0:1763343276.762538:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7422 00000100:00100000:1.0:1763343276.762545:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+16:3660:x1848998412998400:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343276.762622:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+17:3660:x1848998412998400:12345-0@lo:2:osp-syn-0-1.0 Request processed in 77us (665us total) trans 21474839274 rc 0/0 00000100:00100000:1.0:1763343276.762628:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7422 00000004:00080000:1.0:1763343276.762671:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6b56680/2, rc 0, transno 21474839273 00000100:00100000:1.0:1763343276.762678:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412998528:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763343276.762709:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c7918380/2, rc 0, transno 17179872004 00000100:00100000:1.0:1763343276.762714:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998412998016:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343276.762730:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.762749:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c791b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412998272:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343276.762768:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1763343276.762794:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6b57b80/2, rc 0, transno 21474839274 00000100:00100000:1.0:1763343276.762799:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412998400:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343276.762809:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412997760 00000100:00100000:1.0:1763343276.762814:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412997760 00000100:00100000:1.0:1763343276.762829:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412998272 00000100:00100000:1.0:1763343276.762831:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412998272 00000100:00100000:1.0:1763343276.762842:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7423 00000100:00100000:1.0:1763343276.762847:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+33:3659:x1848998412997760:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343276.762857:0:8414:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:719 count 1 00010000:00010000:1.0:1763343276.762868:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4596 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.762879:0:8414:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c583f600/0x9104b1ba770a43ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49af9 expref: 22 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.762885:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343276.762886:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343276.762888:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4596 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.762907:0:8414:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c583f600/0x9104b1ba770a43ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49af9 expref: 22 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.762915:0:8414:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c583f600/0x9104b1ba770a43ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49af9 expref: 22 pid: 28562 timeout: 1169 lvb_type: 0 00000100:00100000:1.0:1763343276.762923:0:8414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7919880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8414:1848998412999040:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343276.762947:0:8414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c31d2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1763343276.763187:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7424 00000100:00100000:0.0:1763343276.763197:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+33:3659:x1848998412998272:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1763343276.763282:0:8626:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2d2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343276.763286:0:8626:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2d2:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343276.763288:0:8626:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2d2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343276.763290:0:8626:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2d2:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343276.763292:0:8626:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2d2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343276.763334:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+34:3659:x1848998412998272:12345-0@lo:2:osp-syn-1-1.0 Request processed in 140us (564us total) trans 17179872005 rc 0/0 00000100:00100000:0.0:1763343276.763341:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7424 00000100:00100000:0.0:1763343276.763624:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.763662:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.763687:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399940736 00000100:00100000:0.0:1763343276.763692:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399940736 00000100:00100000:0.0:1763343276.763730:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10867 00000100:00100000:0.0:1763343276.763737:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57166:x1848998399940736:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343276.763755:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.763774:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a459d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49ba1 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.763849:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a45a4 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343276.763861:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a45a4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.763872:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a45a4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.763882:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a45ab lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343276.763889:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a45ab lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.763896:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a45ab lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.763992:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a45b2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343276.764001:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a45b2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.764007:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a45b2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:0.0:1763343276.764017:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x218:0x0]: returning size 2 00010000:00010000:0.0:1763343276.764123:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a45a4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.764129:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a45a4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.764138:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a45a4 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.764143:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a45a4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.764149:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.764153:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a45a4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.764160:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a45a4 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.764170:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53100) 00010000:00010000:0.0:1763343276.764174:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.764177:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a45a4 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.764183:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a45a4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.764195:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a45ab lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.764201:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a45ab lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.764205:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a45ab lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.764210:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.764212:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a45ab lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.764221:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a45ab lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.764228:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53900) 00010000:00010000:0.0:1763343276.764261:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.764265:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a45ab lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.764271:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a45ab lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.764313:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a459d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ba1 expref: 302 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.764329:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a45b2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ba1 expref: 301 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.764336:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:0.0:1763343276.764338:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343276.764341:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b000, rc 0) 00000100:00100000:0.0:1763343276.764379:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57166:x1848998399940736:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 643us (717us total) trans 4294973792 rc 0/0 00000100:00100000:0.0:1763343276.764386:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10867 00000100:00100000:3.0:1763343276.764601:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399940480 00000100:00100000:3.0:1763343276.764607:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399940480 00000100:00100000:3.0:1763343276.764638:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7425 00000100:00100000:3.0:1763343276.764645:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:55884:x1848998399940480:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343276.764655:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343276.764667:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a45c0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49b9a expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343276.764683:0:28562:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343276.764701:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343276.764703:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343276.764712:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a45c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b9a expref: 17 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.764723:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a45c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b9a expref: 17 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.764733:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917a00, rc 0) 00000004:00080000:1.0:1763343276.764752:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c791b100/2, rc 0, transno 17179872005 00000100:00100000:1.0:1763343276.764759:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c791b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412998272:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343276.764763:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:55884:x1848998399940480:12345-192.168.201.40@tcp:101:bash.0 Request processed in 120us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343276.764769:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7425 00000100:00100000:0.0:1763343276.767840:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.767859:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.767864:0:8414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7919880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8414:1848998412999040:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343276.767880:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399940864 00000100:00100000:0.0:1763343276.767886:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399940864 00010000:00010000:3.0:1763343276.767899:0:8414:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4596 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.767919:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583f200/0x9104b1ba770a436d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ae4 expref: 17 pid: 8414 timeout: 1169 lvb_type: 1 00000100:00100000:0.0:1763343276.767955:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399941120 00000100:00100000:0.0:1763343276.767959:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399941120 00010000:00010000:0.0:1763343276.767971:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583f600/0x9104b1ba770a43ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49af9 expref: 23 pid: 28562 timeout: 1169 lvb_type: 0 00000100:00100000:0.0:1763343276.767993:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3533 00000100:00100000:0.0:1763343276.768001:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2410:x1848998399940864:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343276.768020:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343276.768049:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c583f200/0x9104b1ba770a436d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ae4 expref: 17 pid: 8414 timeout: 1169 lvb_type: 1 00000100:00100000:3.0:1763343276.768053:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3534 00000100:00100000:3.0:1763343276.768061:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2410:x1848998399941120:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343276.768061:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c583f200/0x9104b1ba770a436d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ae4 expref: 17 pid: 8414 timeout: 1169 lvb_type: 1 00010000:00010000:3.0:1763343276.768071:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343276.768075:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c583f600/0x9104b1ba770a43ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49af9 expref: 23 pid: 28562 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343276.768082:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c583f600/0x9104b1ba770a43ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49af9 expref: 23 pid: 28562 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.768086:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.768088:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.768093:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a4588 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.768095:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c583f600/0x9104b1ba770a43ac lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49af9 expref: 23 pid: 28562 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.768103:0:6511:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a4588 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.768106:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343276.768108:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343276.768110:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4596 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.768117:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4596 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.768120:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343276.768131:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343276.768207:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c583f200/0x9104b1ba770a436d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ae4 expref: 17 pid: 8414 timeout: 1169 lvb_type: 1 00000100:00100000:1.0:1763343276.768224:0:8412:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c791b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998412998784:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343276.768252:0:8412:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a4588 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.768261:0:8412:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a4588 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.768266:0:8412:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a4588 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.768276:0:8412:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a4588 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.768283:0:8412:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a4588 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.768299:0:8412:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343276.768701:0:8413:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c791b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8413:1848998412998912:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343276.768715:0:8413:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a458f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343276.768774:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2410:x1848998399940864:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 772us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.768782:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3533 00000100:00100000:3.0:1763343276.768903:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2410:x1848998399941120:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 841us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343276.768909:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3534 00010000:00010000:3.0:1763343276.768929:0:8414:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4596 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.768937:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4596 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.768945:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4596 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.768951:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4596 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.768970:0:8414:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1763343276.769189:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763343276.769197:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a4588 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.769210:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343276.769214:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a4588 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.769223:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a4588 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.769253:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a4588 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.769261:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a4588 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.769279:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343276.769283:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4596 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.769289:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343276.769292:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4596 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.769299:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4596 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.769308:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4596 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.769319:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4596 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.769330:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343276.769332:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343276.769334:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343276.769769:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+34:3659:x1848998412997760:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6918us (7035us total) trans 17179872006 rc 0/0 00000100:00100000:1.0:1763343276.769774:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+17:3662:x1848998412998144:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8052us (12027us total) trans 21474839275 rc 0/0 00000100:00100000:3.0:1763343276.769778:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7423 00000100:00100000:1.0:1763343276.769782:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7418 00010000:00010000:1.0:1763343276.769799:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343276.769834:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6b56a00/2, rc 0, transno 21474839275 00000100:00100000:1.0:1763343276.769840:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412998144:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1763343276.769898:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c7918a80/2, rc 0, transno 17179872006 00000100:00100000:2.0:1763343276.769904:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412997760:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343276.770097:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.770453:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399940992 00000100:00100000:3.0:1763343276.770460:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399940992 00010000:00010000:3.0:1763343276.770486:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4374 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49aeb expref: 22 pid: 11289 timeout: 1169 lvb_type: 1 00000100:00100000:3.0:1763343276.770524:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3535 00000100:00100000:3.0:1763343276.770532:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2410:x1848998399940992:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343276.770547:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343276.770552:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4374 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49aeb expref: 22 pid: 11289 timeout: 1169 lvb_type: 1 00010000:00010000:3.0:1763343276.770563:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4374 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49aeb expref: 22 pid: 11289 timeout: 1169 lvb_type: 1 00010000:00010000:3.0:1763343276.770582:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4374 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49aeb expref: 22 pid: 11289 timeout: 1169 lvb_type: 1 00010000:00010000:3.0:1763343276.770595:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343276.770596:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343276.770601:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a458f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.770614:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a458f lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.770643:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343276.770679:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2410:x1848998399940992:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 148us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343276.770686:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3535 00000100:00100000:0.0:1763343276.770763:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:2.0:1763343276.770770:0:8413:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a458f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.770779:0:8413:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a458f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.770788:0:8413:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a458f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.770794:0:8413:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a458f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.770817:0:8413:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343276.770873:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.770891:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.770941:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399941376 00000100:00100000:1.0:1763343276.770945:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399941376 00010000:00010000:1.0:1763343276.770963:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583fe00/0x9104b1ba770a43ba lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b07 expref: 16 pid: 28562 timeout: 1169 lvb_type: 0 00000100:00100000:1.0:1763343276.770990:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3536 00000100:00100000:1.0:1763343276.770996:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998399941376:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343276.771005:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343276.771010:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c583fe00/0x9104b1ba770a43ba lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b07 expref: 16 pid: 28562 timeout: 1169 lvb_type: 0 00010000:00010000:1.0:1763343276.771020:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c583fe00/0x9104b1ba770a43ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b07 expref: 16 pid: 28562 timeout: 1169 lvb_type: 0 00000100:00100000:2.0:1763343276.771046:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+34:3660:x1848998412997888:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8641us (9151us total) trans 17179872007 rc 0/0 00000100:00100000:2.0:1763343276.771053:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7421 00010000:00010000:1.0:1763343276.771055:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.771057:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.771061:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c583ec00/0x9104b1ba770a4581 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343276.771066:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399941248 00000100:00100000:2.0:1763343276.771069:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399941248 00010000:00010000:1.0:1763343276.771069:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583ec00/0x9104b1ba770a4581 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.771081:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343276.771086:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399941504 00000100:00100000:2.0:1763343276.771088:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399941504 00000100:00100000:1.0:1763343276.771103:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998399941376:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 107us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.771105:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7426 00000100:00100000:1.0:1763343276.771110:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3536 00000100:00100000:2.0:1763343276.771111:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998399941248:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343276.771122:0:8413:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.771134:0:8413:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c583f000/0x9104b1ba770a45c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49ba8 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763343276.771142:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c7918700/2, rc 0, transno 17179872007 00000100:00100000:1.0:1763343276.771147:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998412997888:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343276.771164:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7427 00000100:00100000:1.0:1763343276.771170:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:55884:x1848998399941504:12345-192.168.201.40@tcp:101:bash.0 00000100:00100000:2.0:1763343276.771175:0:8413:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5956680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412999168:192.168.201.40@tcp:106: 00010000:00010000:1.0:1763343276.771176:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343276.771186:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a45ce lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49baf expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343276.771202:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343276.771213:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.771215:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1763343276.771219:0:8413:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c7ec3c00 going to sleep for 11 seconds 00010000:00010000:1.0:1763343276.771221:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a45ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49baf expref: 22 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.771246:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a45ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49baf expref: 22 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.771257:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176a00, rc 0) 00000100:00100000:1.0:1763343276.771283:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:55884:x1848998399941504:12345-192.168.201.40@tcp:101:bash.0 Request processed in 113us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.771288:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7427 00010000:00010000:3.0:1763343276.771893:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343276.771901:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a458f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.771909:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343276.771913:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a458f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.771921:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a458f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.771935:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a458f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.771942:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a458f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.771960:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343276.771963:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343276.771965:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343276.772124:0:11289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c583fe00/0x9104b1ba770a43ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b07 expref: 17 pid: 28562 timeout: 1169 lvb_type: 0 00000100:00100000:2.0:1763343276.772135:0:11289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11289:1848998412998656:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343276.772153:0:11289:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c583ec00/0x9104b1ba770a4581 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.772162:0:11289:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c583ec00/0x9104b1ba770a4581 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.772169:0:11289:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c583ec00/0x9104b1ba770a4581 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.772177:0:11289:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c583ec00/0x9104b1ba770a4581 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.772184:0:11289:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583ec00/0x9104b1ba770a4581 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.772203:0:11289:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343276.772209:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343276.772213:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c583ec00/0x9104b1ba770a4581 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.772219:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583ec00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343276.772222:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c583ec00/0x9104b1ba770a4581 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.772228:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c583ec00/0x9104b1ba770a4581 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.772251:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c583ec00/0x9104b1ba770a4581 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.772257:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c583ec00/0x9104b1ba770a4581 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.772268:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343276.772270:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343276.772271:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343276.772444:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+17:3662:x1848998412997632:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11519us (14970us total) trans 21474839276 rc 0/0 00000100:00100000:2.0:1763343276.772452:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7417 00000004:00080000:1.0:1763343276.772465:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5951c00/2, rc 0, transno 21474839276 00000100:00100000:1.0:1763343276.772471:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412997632:0@lo:6:osp-syn-0-1.0 00002000:00010000:2.0:1763343276.775517:0:8413:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x2d0:0x0] updating lvb mtime: 0 -> 1763343276 00002000:00010000:2.0:1763343276.775527:0:8413:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x2d0:0x0] updating lvb atime: 0 -> 1763343276 00002000:00010000:2.0:1763343276.775529:0:8413:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x2d0:0x0] updating lvb ctime: 0 -> 1763343276 00000100:00100000:2.0:1763343276.775551:0:8413:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5956680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412999168:192.168.201.40@tcp:106: 00010000:00010000:2.0:1763343276.775586:0:8413:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c583f000/0x9104b1ba770a45c7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ba8 expref: 16 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343276.775608:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c583f000/0x9104b1ba770a45c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ba8 expref: 16 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343276.775619:0:8413:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f000, rc 0) 00000100:00100000:2.0:1763343276.775679:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998399941248:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 4567us (4915us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343276.775689:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7426 00000100:00100000:3.0:1763343276.777201:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.777250:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.777345:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399941760 00000100:00100000:1.0:1763343276.777356:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399941760 00002000:00010000:1.0:1763343276.777394:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/721 (0->18446744073709551615) 00002000:00100000:1.0:1763343276.777399:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c39b4a80 with x1848998399941760 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343276.777412:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c39b4a80. 00000100:00100000:1.0:1763343276.777440:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399941632 00000100:00100000:1.0:1763343276.777443:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399941632 00002000:00010000:1.0:1763343276.777457:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/720 (0->18446744073709551615) 00002000:00100000:1.0:1763343276.777460:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c39b5500 with x1848998399941632 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343276.777466:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c39b5500. 00000100:00100000:1.0:1763343276.777488:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1763 00000100:00100000:1.0:1763343276.777497:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399941760:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:1.0:1763343276.777676:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2d1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343276.777680:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2d1:0x0] updating lvb mtime from disk: 0 -> 1763343276 00002000:00010000:1.0:1763343276.777682:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2d1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343276.777684:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2d1:0x0] updating lvb ctime from disk: 0 -> 1763343276 00002000:00010000:1.0:1763343276.777686:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2d1:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343276.777729:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2407:x1848998399941760:12345-192.168.201.40@tcp:10:bash.0 Request processed in 231us (533us total) trans 17179872008 rc 0/0 00000100:00100000:1.0:1763343276.777736:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1763 00002000:00010000:1.0:1763343276.777739:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/721 (0->18446744073709551615) 00002000:00100000:1.0:1763343276.777741:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c39b4a80 with x1848998399941760 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343276.777745:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c39b4a80. 00000100:00100000:1.0:1763343276.777760:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1764 00000100:00100000:1.0:1763343276.777767:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998399941632:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:1.0:1763343276.777851:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2d0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343276.777854:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2d0:0x0] updating lvb mtime from disk: 1763343276 -> 1763343276 00002000:00010000:1.0:1763343276.777856:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2d0:0x0] updating lvb atime from disk: 1763343276 -> 0 00002000:00010000:1.0:1763343276.777858:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2d0:0x0] updating lvb ctime from disk: 1763343276 -> 1763343276 00002000:00010000:1.0:1763343276.777860:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2d0:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343276.777896:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399941632:12345-192.168.201.40@tcp:10:bash.0 Request processed in 116us (631us total) trans 21474839277 rc 0/0 00000100:00100000:1.0:1763343276.777906:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1764 00002000:00010000:1.0:1763343276.777909:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/720 (0->18446744073709551615) 00002000:00100000:1.0:1763343276.777911:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c39b5500 with x1848998399941632 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343276.777915:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c39b5500. 00000100:00100000:0.0:1763343276.779563:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.780212:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399942016 00000100:00100000:2.0:1763343276.780221:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399942016 00000100:00100000:2.0:1763343276.780388:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3834 00000100:00100000:2.0:1763343276.780397:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8546450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57166:x1848998399942016:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343276.781474:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8546450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57166:x1848998399942016:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1073us (1912us total) trans 4294973793 rc 0/0 00000100:00100000:2.0:1763343276.781487:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3834 00000100:00100000:0.0:1763343276.781969:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.782089:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399942272 00000100:00100000:2.0:1763343276.782097:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399942272 00000100:00100000:2.0:1763343276.782134:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3835 00000100:00100000:2.0:1763343276.782143:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:55884:x1848998399942272:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:2.0:1763343276.782376:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:55884:x1848998399942272:12345-192.168.201.40@tcp:35:bash.0 Request processed in 233us (407us total) trans 4294973794 rc 0/0 00000100:00100000:2.0:1763343276.782384:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3835 00000100:00100000:3.0:1763343276.785309:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.785484:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399942528 00000100:00100000:0.0:1763343276.785495:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399942528 00000100:00100000:0.0:1763343276.785559:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10868 00000100:00100000:0.0:1763343276.785569:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57166:x1848998399942528:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343276.785591:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.785614:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a45d5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49bb6 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.785720:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a45dc lrc: 3/0,1 mode: --/CW res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343276.785736:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a45b2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ba1 expref: 304 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.785745:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a45dc lrc: 4/0,1 mode: --/CW res: [0x240000404:0x218:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.785779:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a45b2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ba1 expref: 304 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.785791:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a45b2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ba1 expref: 304 pid: 9827 timeout: 1169 lvb_type: 0 00000100:00100000:0.0:1763343276.785805:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c8bc2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412999296:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343276.785903:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401d84de780 going to sleep for 11 seconds 00000100:00100000:1.0:1763343276.788381:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.788500:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c8bc2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412999296:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343276.788530:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a45dc lrc: 3/0,1 mode: --/CW res: [0x240000404:0x218:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343276.788600:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399942656 00000100:00100000:3.0:1763343276.788608:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399942656 00010000:00010000:3.0:1763343276.788641:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a45b2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ba1 expref: 305 pid: 9827 timeout: 1169 lvb_type: 0 00000100:00100000:3.0:1763343276.788736:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3537 00000100:00100000:3.0:1763343276.788746:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401d84f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:2409:x1848998399942656:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343276.788766:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343276.788774:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a45b2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ba1 expref: 305 pid: 9827 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343276.788786:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a45b2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ba1 expref: 305 pid: 9827 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343276.788807:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a45b2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ba1 expref: 305 pid: 9827 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343276.788823:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:3.0:1763343276.788828:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a45dc lrc: 3/0,1 mode: --/CW res: [0x240000404:0x218:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.788838:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a45dc lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x218:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.788845:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a45dc lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x218:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343276.789249:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343276.789663:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a45dc lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x218:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.789672:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a45dc lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x218:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343276.789697:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x218:0x0]: returning size 5 00010000:00010000:1.0:1763343276.789898:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a45d5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x218:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bb6 expref: 306 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.789917:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a45dc lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x218:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bb6 expref: 305 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.789924:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:1.0:1763343276.789927:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1763343276.789929:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b600, rc 0) 00000100:00100000:1.0:1763343276.790422:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57166:x1848998399942528:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 4851us (5118us total) trans 4294973795 rc 0/0 00000100:00100000:1.0:1763343276.790431:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10868 00000100:00100000:2.0:1763343276.790677:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401d84f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:2409:x1848998399942656:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1931us (2303us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.790686:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3537 00010000:00010000:1.0:1763343276.795717:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343276.799904:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.800451:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.800657:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399942784 00000100:00100000:2.0:1763343276.800670:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399942784 00000100:00100000:0.0:1763343276.800700:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399942912 00000100:00100000:0.0:1763343276.800707:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399942912 00000100:00100000:2.0:1763343276.800784:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10869 00000100:00100000:0.0:1763343276.800794:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10870 00000100:00100000:2.0:1763343276.800800:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57166:x1848998399942784:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:0.0:1763343276.800809:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57167:x1848998399942912:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:2.0:1763343276.800828:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.800828:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.800854:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a45ea lrc: 2/0,0 mode: --/CR res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49bbd expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.800855:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a45f1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49bc4 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.800937:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a45f8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343276.800955:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a45f8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.800967:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a45f8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.800975:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a45ff lrc: 3/1,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343276.800982:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4606 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343276.800992:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a45dc lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x218:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bb6 expref: 307 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.800996:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4606 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.801005:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a45ff lrc: 4/1,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343276.801006:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4606 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.801136:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a460d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343276.801138:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a45dc lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x218:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bb6 expref: 307 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.801161:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a45dc lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x218:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bb6 expref: 307 pid: 7641 timeout: 1169 lvb_type: 0 00000100:00100000:2.0:1763343276.801173:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5956680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412999424:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343276.801179:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a460d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.801188:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a460d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:2.0:1763343276.801279:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c7ec3480 going to sleep for 11 seconds 00000100:00100000:2.0:1763343276.803180:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5956680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998412999424:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343276.803208:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a45ff lrc: 3/1,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:1.0:1763343276.804056:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.804455:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399943040 00000100:00100000:2.0:1763343276.804464:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399943040 00010000:00010000:2.0:1763343276.804501:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a45dc lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x218:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bb6 expref: 308 pid: 7641 timeout: 1169 lvb_type: 0 00000100:00100000:2.0:1763343276.804541:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3538 00000100:00100000:2.0:1763343276.804550:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7919880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:2407:x1848998399943040:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343276.804566:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343276.804573:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a45dc lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x218:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bb6 expref: 308 pid: 7641 timeout: 1169 lvb_type: 0 00010000:00010000:2.0:1763343276.804587:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a45dc lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x218:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bb6 expref: 308 pid: 7641 timeout: 1169 lvb_type: 0 00010000:00010000:2.0:1763343276.804608:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a45dc lrc: 0/0,0 mode: --/CW res: [0x240000404:0x218:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bb6 expref: 308 pid: 7641 timeout: 1169 lvb_type: 0 00010000:00010000:2.0:1763343276.804627:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:2.0:1763343276.804631:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a45ff lrc: 3/1,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.804641:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a45ff lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.804648:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a45ff lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.804656:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a460d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.804662:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a460d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.804667:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a460d lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.804715:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343276.804749:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a460d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.804757:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a460d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:2.0:1763343276.804765:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7919880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:2407:x1848998399943040:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 214us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.804775:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3538 00000004:00200000:0.0:1763343276.804801:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x218:0x0]: returning size 5 00000004:00200000:0.0:1763343276.804806:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343276.804828:0:9827:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a460d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.804837:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a460d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.804845:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a45f8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.804850:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a45f8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.804858:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a45f8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.804863:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a45f8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.804867:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.804869:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a45f8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.804873:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a45f8 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.804880:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53100) 00010000:00010000:0.0:1763343276.804882:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.804885:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a45f8 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.804889:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a45f8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.804898:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4606 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.804901:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4606 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.804905:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4606 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.804907:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ba00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.804909:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4606 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.804915:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4606 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.804919:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53900) 00010000:00010000:0.0:1763343276.804920:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.804921:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4606 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.804924:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4606 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.804950:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a45f1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bc4 expref: 307 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.804962:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a460d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bc4 expref: 306 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.804969:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:0.0:1763343276.804971:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343276.804973:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b800, rc 0) 00000100:00100000:0.0:1763343276.805014:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57167:x1848998399942912:12345-192.168.201.40@tcp:101:rm.0 Request processed in 4210us (4564us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.805021:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10870 00010000:00010000:2.0:1763343276.805167:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a45ff lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.805185:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a45ff lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343276.805218:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x218:0x0]: returning size 5 00000004:00200000:2.0:1763343276.805222:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343276.805244:0:7641:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a45ff lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343276.805279:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a45ea lrc: 0/0,0 mode: --/CR res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bbd expref: 306 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.805293:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a45ff lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bbd expref: 305 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.805301:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:2.0:1763343276.805303:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343276.805306:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583fe00, rc 0) 00000100:00100000:2.0:1763343276.805343:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57166:x1848998399942784:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 4549us (5449us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.805350:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10869 00000100:00100000:0.0:1763343276.808756:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.808835:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.809185:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.809626:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399943680 00000100:00100000:2.0:1763343276.809636:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399943680 00000100:00100000:2.0:1763343276.809692:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399943552 00000100:00100000:2.0:1763343276.809697:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399943552 00000100:00100000:2.0:1763343276.809731:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10871 00000100:00100000:1.0:1763343276.809737:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399943168 00000100:00100000:2.0:1763343276.809745:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57166:x1848998399943680:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:1.0:1763343276.809745:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399943168 00010000:00010000:2.0:1763343276.809774:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1763343276.809777:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10872 00000100:00100000:0.0:1763343276.809788:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57167:x1848998399943552:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:2.0:1763343276.809798:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a4614 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49bcb expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343276.809800:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 455 00000100:00100000:1.0:1763343276.809815:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:2408:x1848998399943168:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343276.809828:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343276.809836:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763343276.809855:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a45ff lrc: 0/0,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bbd expref: 308 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.809913:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:1.0:1763343276.809919:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343276.809930:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a457a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x218:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b93 expref: 307 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.809948:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a460d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bc4 expref: 306 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.809963:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4542 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b85 expref: 305 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.809973:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:0.0:1763343276.809977:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343276.809983:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:2408:x1848998399943168:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 170us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.809993:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 455 00010000:00010000:0.0:1763343276.810002:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a461b lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343276.810015:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a461b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.810509:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a461b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.810526:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4622 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343276.810534:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4622 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.810541:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4622 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.810576:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4629 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343276.810589:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4629 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x218:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.810599:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4629 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x218:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:2.0:1763343276.810611:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x218:0x0]: returning size 5 00010000:00010000:0.0:1763343276.810615:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4630 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343276.810626:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4630 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.810634:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4630 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.810766:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a4614 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x218:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bcb expref: 305 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.810782:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4629 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x218:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bcb expref: 304 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.810789:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:2.0:1763343276.810792:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343276.810795:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583e000, rc 0) 00000100:00100000:2.0:1763343276.810847:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57166:x1848998399943680:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1106us (2012us total) trans 4294973796 rc 0/0 00000100:00100000:2.0:1763343276.810854:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10871 00000004:00080000:0.0:1763343276.810879:0:6525:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x218:0x0] is inserted into orphan list, open count = 2 00010000:00010000:0.0:1763343276.810951:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4630 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.810960:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4630 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.810966:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4630 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.810971:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501be00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.810976:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4630 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.810983:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4630 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.810992:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:0.0:1763343276.810995:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763343276.810999:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4630 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x218:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.811005:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4630 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x218:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.811019:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a461b lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.811053:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a461b lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.811063:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a461b lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.811068:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a461b lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.811072:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.811075:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a461b lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.811080:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a461b lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.811088:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53d00) 00010000:00010000:0.0:1763343276.811090:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.811093:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a461b lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.811098:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a461b lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00000004:00010000:0.0:1763343276.811113:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000050286ff3 reply state 00000000b47f70ae transno 4294973797 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4622 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.811123:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4622 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.811128:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53300) 00010000:00010000:0.0:1763343276.811131:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343276.811133:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343276.811181:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57167:x1848998399943552:12345-192.168.201.40@tcp:36:rm.0 Request processed in 1396us (1995us total) trans 4294973797 rc 0/0 00000100:00100000:0.0:1763343276.811191:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10872 00000100:00100000:3.0:1763343276.813371:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.813428:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399943808 00000100:00100000:0.0:1763343276.813447:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399943808 00000100:00100000:0.0:1763343276.813506:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10873 00000100:00100000:0.0:1763343276.813517:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57166:x1848998399943808:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343276.813544:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.813569:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a463e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49bd2 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.813629:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a463e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bd2 expref: 306 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.813644:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a463e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bd2 expref: 306 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.813662:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:0.0:1763343276.813665:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343276.813669:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b200, rc 0) 00000100:00100000:0.0:1763343276.813741:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57166:x1848998399943808:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 225us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.813750:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10873 00000100:00100000:1.0:1763343276.816959:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.817135:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399943936 00000100:00100000:2.0:1763343276.817145:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399943936 00000100:00100000:2.0:1763343276.817204:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7428 00000100:00100000:2.0:1763343276.817215:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399943936:12345-192.168.201.40@tcp:1:lfs.0 00010000:00010000:2.0:1763343276.817270:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c583e400/0x9104b1ba770a4645 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.817289:0:8413:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a45c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b9a expref: 16 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.817295:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343276.817298:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343276.817302:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583e400/0x9104b1ba770a4645 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.817337:0:8413:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a45c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b9a expref: 16 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.817350:0:8413:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a45c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b9a expref: 16 pid: 28562 timeout: 1169 lvb_type: 0 00000100:00100000:2.0:1763343276.817363:0:8413:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412999552:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343276.818578:0:8413:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c7ec3480 going to sleep for 11 seconds 00000100:00100000:2.0:1763343276.826416:0:8413:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998412999552:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343276.826450:0:8413:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c583e400/0x9104b1ba770a4645 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343276.827573:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.828104:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399944064 00000100:00100000:0.0:1763343276.828114:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399944064 00002000:00100000:0.0:1763343276.828165:0:28390:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2d0:0x0] (0->4) req@ffff9400c39b4000 x1848998399944064/t0(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:17/0 lens 496/0 e 0 to 0 dl 1763343287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763343276.828175:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c39b4000 with x1848998399944064 ext(0->4) 00010000:00010000:0.0:1763343276.828185:0:28390:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a45c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b9a expref: 17 pid: 28562 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.828200:0:28390:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a45c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b9a expref: 17 pid: 28562 timeout: 1169 lvb_type: 0 00002000:00010000:0.0:1763343276.828207:0:28390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9400c39b4000 00000100:00100000:0.0:1763343276.828243:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 123 00000100:00100000:0.0:1763343276.828253:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998399944064:12345-192.168.201.40@tcp:4:bash.0 00000100:00100000:0.0:1763343276.829258:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2407:x1848998399944064:12345-192.168.201.40@tcp:4:bash.0 Request processed in 1000us (1685us total) trans 21474839278 rc 0/0 00000100:00100000:0.0:1763343276.829269:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 123 00002000:00100000:0.0:1763343276.829279:0:28390:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2d0:0x0] (0->4) req@ffff9400c39b4000 x1848998399944064/t21474839278(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:17/0 lens 496/448 e 0 to 0 dl 1763343287 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763343276.829288:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c39b4000 with x1848998399944064 ext(0->4) 00010000:00010000:0.0:1763343276.829294:0:28390:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a45c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b9a expref: 19 pid: 28562 timeout: 1169 lvb_type: 0 00010000:00010000:0.0:1763343276.829309:0:28390:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a45c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b9a expref: 19 pid: 28562 timeout: 1169 lvb_type: 0 00002000:00010000:0.0:1763343276.829316:0:28390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9400c39b4000 00000100:00100000:3.0:1763343276.830950:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.832178:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399944192 00000100:00100000:2.0:1763343276.832193:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399944192 00000100:00100000:2.0:1763343276.832555:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10874 00000100:00100000:2.0:1763343276.832566:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57168:x1848998399944192:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343276.832587:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.833142:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a464c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49bd9 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.833210:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4653 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343276.833222:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4653 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.833245:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4653 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.833257:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a465a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343276.833264:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a465a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.833271:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a465a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.833313:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4653 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.833320:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4653 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.833325:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4653 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00000100:00100000:3.0:1763343276.833891:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:2.0:1763343276.833987:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4653 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.833996:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583fa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.834001:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4653 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.834009:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4653 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.834022:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c6733a00) 00010000:00010000:2.0:1763343276.834061:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.834068:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4653 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.834074:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4653 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.834090:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a465a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.834096:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a465a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.834102:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a465a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.834107:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583fe00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.834110:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a465a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.834115:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a465a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.834123:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53300) 00010000:00010000:2.0:1763343276.834125:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.834128:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a465a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.834134:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a465a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.834165:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a464c lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bd9 expref: 307 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.834175:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c6733a00) 00010000:00010000:2.0:1763343276.834178:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.834182:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a464c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bd9 expref: 307 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.834195:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f000, rc 0) 00000100:00100000:1.0:1763343276.834287:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399944320 00000100:00100000:1.0:1763343276.834298:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399944320 00010000:00010000:1.0:1763343276.834331:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a45c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b9a expref: 19 pid: 28562 timeout: 1169 lvb_type: 0 00000100:00100000:2.0:1763343276.834343:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57168:x1848998399944192:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1777us (3402us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343276.834353:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10874 00000100:00100000:1.0:1763343276.834383:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3539 00000100:00100000:1.0:1763343276.834394:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2408:x1848998399944320:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343276.834407:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1763343276.834426:0:6509:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2d0:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:1.0:1763343276.834429:0:6509:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2d0:0x0] updating lvb atime from disk: 0 -> 1763343276 00002000:00010000:1.0:1763343276.834431:0:6509:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2d0:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1763343276.834437:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a45c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b9a expref: 19 pid: 28562 timeout: 1169 lvb_type: 0 00010000:00010000:1.0:1763343276.834449:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a45c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b9a expref: 19 pid: 28562 timeout: 1169 lvb_type: 0 00010000:00010000:1.0:1763343276.834466:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a45c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b9a expref: 19 pid: 28562 timeout: 1169 lvb_type: 0 00010000:00010000:1.0:1763343276.834480:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.834483:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.834487:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c583e400/0x9104b1ba770a4645 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.834497:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583e400/0x9104b1ba770a4645 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.834531:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343276.834566:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998399944320:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 173us (677us total) trans 0 rc 0/0 00010000:00010000:2.0:1763343276.834570:0:8413:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c583e400/0x9104b1ba770a4645 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343276.834575:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3539 00010000:00010000:2.0:1763343276.834585:0:8413:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c583e400/0x9104b1ba770a4645 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.834606:0:8413:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c583e400/0x9104b1ba770a4645 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.834613:0:8413:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583e400/0x9104b1ba770a4645 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.834619:0:8413:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c583e400/0x9104b1ba770a4645 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.834625:0:8413:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583e400 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343276.834628:0:8413:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c583e400/0x9104b1ba770a4645 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.834634:0:8413:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c583e400/0x9104b1ba770a4645 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.834646:0:8413:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c583e400/0x9104b1ba770a4645 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.834652:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c583e400/0x9104b1ba770a4645 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343276.834694:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998399943936:12345-192.168.201.40@tcp:1:lfs.0 Request processed in 17481us (17745us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.834703:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7428 00000100:00100000:3.0:1763343276.837735:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.838376:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399944448 00000100:00100000:2.0:1763343276.838717:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399944448 00000100:00100000:2.0:1763343276.838788:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10875 00000100:00100000:2.0:1763343276.838798:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57168:x1848998399944448:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343276.838819:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.838844:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4661 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49be0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.838912:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4668 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343276.838924:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4668 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.838934:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4668 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.838942:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a466f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343276.838954:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a466f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343276.838960:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a466f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.839143:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4668 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.839153:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4668 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.839159:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4668 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.839165:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4668 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.839179:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583e600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343276.839184:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4668 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.839191:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4668 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.839208:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c6733500) 00010000:00010000:1.0:1763343276.839211:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.839216:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4668 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.839222:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4668 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.839244:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a466f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.839250:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a466f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.839255:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a466f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.839260:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583ec00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343276.839263:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a466f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.839268:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a466f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.839274:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53300) 00010000:00010000:1.0:1763343276.839276:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.839279:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a466f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.839284:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a466f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.839310:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4661 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49be0 expref: 307 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.839320:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c6733500) 00010000:00010000:1.0:1763343276.839322:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.839325:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4661 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49be0 expref: 307 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.839337:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583e800, rc 0) 00000100:00100000:1.0:1763343276.839393:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57168:x1848998399944448:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 597us (1668us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343276.839400:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10875 00000100:00100000:0.0:1763343276.839553:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.840306:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399944704 00000100:00100000:1.0:1763343276.840314:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399944704 00000100:00100000:1.0:1763343276.840351:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10876 00000100:00100000:1.0:1763343276.840359:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57166:x1848998399944704:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:1.0:1763343276.840393:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343276.840410:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a463e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bd2 expref: 306 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.840425:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:1.0:1763343276.840428:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343276.840450:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4676 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343276.840460:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4676 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.840468:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4676 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000040:00080000:1.0:1763343276.840660:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1778, 88 off147784 00000004:00080000:1.0:1763343276.840666:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1069964641564ns, next at 1070049318579ns, rc = 0 00000040:00080000:1.0:1763343276.840697:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1787, 88 off148544 00000004:00080000:1.0:1763343276.840702:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1069964677408ns, next at 1070049115839ns, rc = 0 00000040:00080000:1.0:1763343276.840734:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1788, 88 off148632 00000004:00080000:1.0:1763343276.840739:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1069964714525ns, next at 1070049115839ns, rc = 0 00000040:00080000:1.0:1763343276.840749:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1779, 88 off147872 00000004:00080000:1.0:1763343276.840753:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1069964728233ns, next at 1070049318579ns, rc = 0 00000100:00100000:3.0:1763343276.842126:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.842196:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399944832 00000100:00100000:0.0:1763343276.842205:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399944832 00000100:00100000:0.0:1763343276.842264:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10877 00000100:00100000:0.0:1763343276.842284:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57168:x1848998399944832:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343276.842304:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.842325:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a467d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49be7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.842381:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4684 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343276.842392:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4684 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.842403:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4684 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:0.0:1763343276.842439:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343276.842455:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343276.842491:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a467d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49be7 expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.842508:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4684 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49be7 expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.842517:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53d00) 00010000:00010000:0.0:1763343276.842520:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343276.842522:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501be00, rc 0) 00000100:00100000:0.0:1763343276.842586:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57168:x1848998399944832:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 313us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.842594:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10877 00000100:00100000:0.0:1763343276.846197:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.846514:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399944960 00000100:00100000:3.0:1763343276.846525:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399944960 00000100:00100000:3.0:1763343276.846579:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10878 00000100:00100000:3.0:1763343276.846588:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57168:x1848998399944960:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343276.846607:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343276.846625:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a468b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49bee expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.846685:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4692 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343276.846697:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4692 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.846707:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4692 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.846715:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a4699 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343276.846721:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a4699 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.846727:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a4699 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.846759:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4692 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.846765:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4692 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.846770:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4692 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.846776:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4692 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.846782:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd9a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343276.846786:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4692 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.846793:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4692 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.846803:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53d00) 00010000:00010000:3.0:1763343276.846805:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343276.846809:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4692 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.846814:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4692 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.846824:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a4699 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.846829:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a4699 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.846834:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a4699 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.846838:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fca00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343276.846840:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a4699 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.846845:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a4699 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.846850:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53300) 00010000:00010000:3.0:1763343276.846852:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343276.846855:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a4699 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.846860:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a4699 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.846881:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a468b lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bee expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.846889:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53d00) 00010000:00010000:3.0:1763343276.846891:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343276.846894:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a468b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bee expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.846902:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5bd8e00, rc 0) 00000100:00100000:3.0:1763343276.846965:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57168:x1848998399944960:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 377us (776us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343276.846972:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10878 00000001:00080000:2.0:1763343276.848922:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973798 is committed 00000004:00080000:2.0:1763343276.848935:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1140 committed 00000004:00080000:2.0:1763343276.848954:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1148 committed 00000004:00080000:2.0:1763343276.848966:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1147 committed 00000004:00080000:2.0:1763343276.848969:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1139 committed 00000100:00100000:2.0:1763343276.849106:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412999808:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343276.849167:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343276.849218:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412999808 00000100:00100000:2.0:1763343276.849225:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412999808 00000100:00100000:2.0:1763343276.849288:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7429 00000100:00100000:2.0:1763343276.849296:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+34:3659:x1848998412999808:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343276.849430:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763343276.849451:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c8bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412999936:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343276.849486:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343276.849511:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412999936 00000100:00100000:0.0:1763343276.849515:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412999936 00000100:00100000:0.0:1763343276.849548:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7430 00000100:00100000:0.0:1763343276.849555:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+17:3659:x1848998412999936:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343276.849612:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412999680:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343276.849704:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+18:3659:x1848998412999936:12345-0@lo:2:osp-syn-0-1.0 Request processed in 149us (217us total) trans 21474839279 rc 0/0 00000100:00100000:0.0:1763343276.849712:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7430 00000004:00080000:0.0:1763343276.849757:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c8bc1180/2, rc 0, transno 21474839279 00000100:00100000:0.0:1763343276.849763:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c8bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412999936:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343276.849839:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.849865:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763343276.849872:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c8bc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413000064:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343276.849890:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343276.849903:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4622 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.849916:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4622 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.849925:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4622 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.849932:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501aa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343276.849937:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4622 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.849945:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4622 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00000004:00010000:1.0:1763343276.849952:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004bf7df29 reply state 00000000acc6626a transno 4294973798 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4676 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343276.849962:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53300) 00010000:00010000:3.0:1763343276.849967:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.849968:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4676 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343276.849972:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4622 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343276.849978:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:3.0:1763343276.849983:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4622 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343276.849983:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1763343276.849986:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1763343276.850085:0:9827:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763343276.850093:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998412999680 00000100:00100000:0.0:1763343276.850099:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998412999680 00000100:00100000:1.0:1763343276.850103:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+300:57166:x1848998399944704:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 9741us (10548us total) trans 4294973798 rc 0/0 00000100:00100000:1.0:1763343276.850113:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10876 00000100:00100000:0.0:1763343276.850132:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413000064 00000100:00100000:0.0:1763343276.850136:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413000064 00010000:00010000:1.0:1763343276.850137:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4676 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.850147:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4676 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.850154:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4676 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00000100:00100000:0.0:1763343276.850160:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7431 00010000:00010000:1.0:1763343276.850162:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343276.850167:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4676 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00000100:00100000:0.0:1763343276.850170:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+35:3662:x1848998412999680:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1763343276.850261:0:8414:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2d1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343276.850265:0:8414:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2d1:0x0] updating lvb mtime from disk: 1763343276 -> 1763343276 00002000:00010000:0.0:1763343276.850267:0:8414:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2d1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343276.850269:0:8414:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2d1:0x0] updating lvb ctime from disk: 1763343276 -> 1763343276 00002000:00010000:0.0:1763343276.850271:0:8414:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2d1:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343276.850307:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+36:3662:x1848998412999680:12345-0@lo:2:osp-syn-1-1.0 Request processed in 138us (466us total) trans 17179872009 rc 0/0 00000100:00100000:0.0:1763343276.850313:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7431 00000100:00100000:0.0:1763343276.850326:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7432 00000100:00100000:0.0:1763343276.850332:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+18:3662:x1848998413000064:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763343276.850386:0:8414:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2d1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343276.850389:0:8414:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2d1:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343276.850391:0:8414:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2d1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343276.850393:0:8414:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2d1:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343276.850395:0:8414:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2d1:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343276.850420:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+19:3662:x1848998413000064:12345-0@lo:2:osp-syn-0-1.0 Request processed in 88us (528us total) trans 21474839280 rc 0/0 00000100:00100000:0.0:1763343276.850426:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7432 00000004:00080000:0.0:1763343276.850466:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c8bc3b80/2, rc 0, transno 21474839280 00000100:00100000:0.0:1763343276.850471:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c8bc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413000064:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763343276.850482:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401efc72300/2, rc 0, transno 17179872009 00000100:00100000:0.0:1763343276.850486:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998412999680:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1763343276.850606:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4676 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.850791:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:1.0:1763343276.850794:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343276.850798:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4676 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.850804:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4676 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00002000:00010000:2.0:1763343276.850821:0:8413:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2d2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343276.850826:0:8413:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2d2:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763343276.850829:0:8413:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2d2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343276.850831:0:8413:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2d2:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763343276.850833:0:8413:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2d2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343276.850874:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+36:3659:x1848998412999808:12345-0@lo:2:osp-syn-1-1.0 Request processed in 1579us (1707us total) trans 17179872010 rc 0/0 00000100:00100000:2.0:1763343276.850881:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7429 00000004:00080000:0.0:1763343276.851652:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6b56d80/2, rc 0, transno 17179872010 00000100:00100000:0.0:1763343276.851661:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998412999808:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343276.853369:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.853509:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399945216 00000100:00100000:1.0:1763343276.853524:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399945216 00000100:00100000:1.0:1763343276.853583:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10879 00000100:00100000:1.0:1763343276.853593:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+299:57168:x1848998399945216:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343276.853626:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343276.853630:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343276.853657:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4684 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49be7 expref: 299 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.853676:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53d00) 00010000:00010000:1.0:1763343276.853688:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343276.853703:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a46a0 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49bf5 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.853807:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a46a7 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343276.853819:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a46a7 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.853827:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a46a7 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.853838:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a46ae lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343276.853844:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a46ae lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.853849:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a46ae lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.854337:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a46b5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x219:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343276.854348:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a46b5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.854356:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a46b5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:0.0:1763343276.854366:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x219:0x0]: returning size 0 00010000:00010000:0.0:1763343276.854390:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a46a7 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.854396:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a46a7 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.854403:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a46a7 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.854409:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a46a7 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.854416:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.854420:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a46a7 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.854427:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a46a7 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.854436:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497e500) 00010000:00010000:0.0:1763343276.854439:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.854443:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a46a7 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.854449:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a46a7 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000004:00010000:0.0:1763343276.854460:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000da128db1 reply state 00000000f0beed1e transno 4294973799 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a46ae lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.854470:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a46ae lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343276.854475:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c497ef00) 00010000:00010000:0.0:1763343276.854477:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343276.854480:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343276.854507:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a46a0 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bf5 expref: 301 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.854528:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a46b5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bf5 expref: 300 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.854535:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x219:0x0].0x0 (ffff9401edc53100) 00010000:00010000:0.0:1763343276.854538:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343276.854540:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b400, rc 0) 00000100:00100000:0.0:1763343276.854603:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57168:x1848998399945216:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1012us (1243us total) trans 4294973799 rc 0/0 00000100:00100000:0.0:1763343276.854612:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10879 00000100:00100000:3.0:1763343276.857598:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.858104:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399945344 00000100:00100000:1.0:1763343276.858116:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399945344 00000100:00100000:1.0:1763343276.858168:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10880 00000100:00100000:1.0:1763343276.858177:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57166:x1848998399945344:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343276.858201:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343276.858222:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a46c3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49bfc expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.858286:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a46c3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bfc expref: 302 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.858307:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a46c3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bfc expref: 302 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.858326:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:1.0:1763343276.858329:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343276.858333:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177800, rc 0) 00000100:00100000:1.0:1763343276.858386:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57166:x1848998399945344:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 209us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.858393:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10880 00000100:00100000:0.0:1763343276.862005:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.862083:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399945600 00000100:00100000:3.0:1763343276.862093:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.862097:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399945600 00000100:00100000:1.0:1763343276.862978:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399945728 00000100:00100000:0.0:1763343276.863004:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10881 00000100:00100000:0.0:1763343276.863021:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57168:x1848998399945600:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343276.863077:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.863102:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a46ca lrc: 2/0,0 mode: --/CR res: [0x240000404:0x219:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49c03 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343276.863319:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399945728 00000100:00100000:1.0:1763343276.863646:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10882 00000100:00100000:1.0:1763343276.863655:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57166:x1848998399945728:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343276.863664:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343276.863676:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a46d1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49c0a expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.863724:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a46d8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343276.863739:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a46d8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.863751:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a46d8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343276.863786:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x218:0x0]: returning size 5 00000004:00200000:1.0:1763343276.863790:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343276.863806:0:9827:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a46d8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.863832:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a46d1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c0a expref: 306 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.863837:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a46df lrc: 3/0,1 mode: --/EX res: [0x240000404:0x219:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343276.863854:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a46b5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bf5 expref: 305 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.863855:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a46d8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c0a expref: 305 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.863873:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a46df lrc: 4/0,1 mode: --/EX res: [0x240000404:0x219:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343276.863874:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:1.0:1763343276.863881:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1763343276.863885:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177c00, rc 0) 00010000:00010000:0.0:1763343276.863918:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a46b5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bf5 expref: 305 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.863938:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a46b5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bf5 expref: 305 pid: 9827 timeout: 1169 lvb_type: 0 00000100:00100000:0.0:1763343276.863952:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c3728700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998413000192:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343276.863974:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57166:x1848998399945728:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 319us (1880us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.863983:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10882 00000100:00100000:0.0:1763343276.864021:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401d84de780 going to sleep for 11 seconds 00000100:00100000:2.0:1763343276.868950:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.869047:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c3728700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998413000192:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343276.869085:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a46df lrc: 3/0,1 mode: --/EX res: [0x240000404:0x219:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000100:00100000:3.0:1763343276.869121:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399945856 00000100:00100000:3.0:1763343276.869129:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399945856 00010000:00010000:3.0:1763343276.869165:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a46b5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bf5 expref: 305 pid: 9827 timeout: 1169 lvb_type: 0 00000100:00100000:3.0:1763343276.869204:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3540 00000100:00100000:3.0:1763343276.869215:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:2407:x1848998399945856:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343276.869241:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343276.869248:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a46b5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bf5 expref: 305 pid: 9827 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343276.869260:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a46b5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bf5 expref: 305 pid: 9827 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343276.869284:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a46b5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bf5 expref: 305 pid: 9827 timeout: 1169 lvb_type: 0 00010000:00010000:3.0:1763343276.869302:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x219:0x0].0x0 (ffff9401edc53100) 00010000:00010000:3.0:1763343276.869307:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a46df lrc: 3/0,1 mode: --/EX res: [0x240000404:0x219:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.869317:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a46df lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x219:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.869325:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a46df lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x219:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.869354:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343276.869379:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a46df lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x219:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.869388:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a46df lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x219:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:0.0:1763343276.869411:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x219:0x0]: returning size 0 00000004:00080000:0.0:1763343276.869619:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2d3:0x0], index 1: 0 00000004:00080000:0.0:1763343276.869627:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2d2:0x0], index 0: 0 00000004:00080000:0.0:1763343276.869632:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2d3:0x0], index 0: 0 00000004:00080000:0.0:1763343276.869637:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2d4:0x0], index 1: 0 00000100:00100000:2.0:1763343276.869638:0:8617:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b57100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8617:1848998413000320:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1763343276.869688:0:8617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343276.869715:0:8617:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c7ec3480 going to sleep for 11 seconds 00000100:00100000:2.0:1763343276.869732:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413000320 00000100:00100000:2.0:1763343276.869736:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413000320 00010000:00010000:0.0:1763343276.869749:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a46df lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x219:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.869759:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a46df lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x219:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.869768:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a46df lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x219:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00000100:00100000:2.0:1763343276.869779:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7433 00010000:00010000:0.0:1763343276.869781:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.869787:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a46df lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x219:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00000100:00100000:2.0:1763343276.869790:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+19:8617:x1848998413000320:12345-0@lo:5:osp-pre-0-1.0 00010000:00010000:0.0:1763343276.869801:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a46df lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x219:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.869813:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x219:0x0].0x0 (ffff9401edc53100) 00010000:00010000:0.0:1763343276.869816:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343276.869820:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a46df lrc: 2/0,0 mode: --/EX res: [0x240000404:0x219:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.869826:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a46df lrc: 0/0,0 mode: --/EX res: [0x240000404:0x219:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00002000:00080000:2.0:1763343276.869835:0:8413:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 738 00010000:00010000:0.0:1763343276.869882:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a46ca lrc: 1/0,0 mode: --/CR res: [0x240000404:0x219:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c03 expref: 305 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.869893:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x219:0x0].0x0 (ffff9401edc53100) 00010000:00010000:0.0:1763343276.869896:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343276.869903:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a46ca lrc: 0/0,0 mode: --/CR res: [0x240000404:0x219:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c03 expref: 305 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.869921:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501ba00, rc 0) 00000100:00100000:0.0:1763343276.870673:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57168:x1848998399945600:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 7654us (8673us total) trans 4294973800 rc 301/301 00000100:00100000:0.0:1763343276.870684:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10881 00000100:00100000:3.0:1763343276.870690:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:2407:x1848998399945856:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1473us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343276.870700:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3540 00000100:00100000:2.0:1763343276.871190:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+20:8617:x1848998413000320:12345-0@lo:5:osp-pre-0-1.0 Request processed in 1403us (1500us total) trans 21474839281 rc 0/0 00000100:00100000:2.0:1763343276.871197:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7433 00000100:00100000:0.0:1763343276.871291:0:8617:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b57100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8617:1848998413000320:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1763343276.871306:0:8617:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x2d3:0x0]-[0x280000400:0x301:0x0] 00000100:00100000:3.0:1763343276.871429:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.871897:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399945984 00000100:00100000:2.0:1763343276.871904:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399945984 00000100:00100000:2.0:1763343276.871944:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7434 00000100:00100000:2.0:1763343276.871953:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998399945984:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343276.872093:0:8413:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.872117:0:8413:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c583fe00/0x9104b1ba770a46ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49c11 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343276.872145:0:8413:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2d0:0x0] initial LVB size: 5, mtime: 0x691a7bac, atime: 0x691a7bac, ctime: 0x691a7bac, blocks: 0x8 00010000:00010000:2.0:1763343276.872167:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.872170:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.872180:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583fe00/0x9104b1ba770a46ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c11 expref: 18 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343276.872252:0:8413:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c583fe00/0x9104b1ba770a46ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c11 expref: 18 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343276.872264:0:8413:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583fe00, rc 0) 00000100:00100000:2.0:1763343276.872299:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998399945984:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 348us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.872306:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7434 00000100:00100000:2.0:1763343276.876125:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.876260:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399946240 00000100:00100000:0.0:1763343276.876271:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399946240 00000100:00100000:0.0:1763343276.876326:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3836 00000100:00100000:0.0:1763343276.876336:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57168:x1848998399946240:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343276.876656:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57168:x1848998399946240:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 320us (540us total) trans 4294973801 rc 0/0 00000100:00100000:0.0:1763343276.876664:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3836 00000100:00100000:3.0:1763343276.881555:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.881684:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399946496 00000100:00100000:2.0:1763343276.881708:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399946496 00000100:00100000:2.0:1763343276.881769:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3837 00000100:00100000:2.0:1763343276.881780:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57168:x1848998399946496:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343276.882070:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57168:x1848998399946496:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 291us (526us total) trans 4294973802 rc 0/0 00000100:00100000:2.0:1763343276.882078:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3837 00000100:00100000:1.0:1763343276.895161:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.895271:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399946752 00000100:00100000:0.0:1763343276.895281:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399946752 00000100:00100000:0.0:1763343276.895334:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10883 00000100:00100000:0.0:1763343276.895344:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:55884:x1848998399946752:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343276.895370:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.895394:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a46f4 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49c18 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.895539:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a46fb lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343276.895555:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a46fb lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.895568:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a46fb lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.895580:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4702 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343276.895587:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4702 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.895593:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4702 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.895658:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4709 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x219:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343276.895665:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4709 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.895672:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4709 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:0.0:1763343276.895682:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x219:0x0]: returning size 0 00010000:00010000:0.0:1763343276.895774:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a46fb lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.895782:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a46fb lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.895788:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a46fb lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.895794:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a46fb lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.895801:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.895804:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a46fb lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.895812:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a46fb lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.895824:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53100) 00010000:00010000:0.0:1763343276.895827:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.895832:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a46fb lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.895841:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a46fb lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.895859:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4702 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.895864:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4702 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.895869:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4702 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.895875:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.895878:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4702 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.895884:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4702 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.895891:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c497ef00) 00010000:00010000:0.0:1763343276.895894:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.895897:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4702 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.895902:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4702 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.895939:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a46f4 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c18 expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.895957:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4709 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c18 expref: 307 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.895968:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x219:0x0].0x0 (ffff9401edc53900) 00010000:00010000:0.0:1763343276.895971:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343276.895973:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501ac00, rc 0) 00000100:00100000:0.0:1763343276.896089:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:55884:x1848998399946752:12345-192.168.201.40@tcp:101:bash.0 Request processed in 744us (938us total) trans 4294973803 rc 0/0 00000100:00100000:0.0:1763343276.896096:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10883 00000100:00100000:3.0:1763343276.898473:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.898785:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399946880 00000100:00100000:1.0:1763343276.898797:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399946880 00000100:00100000:1.0:1763343276.898859:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10884 00000100:00100000:1.0:1763343276.898870:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:55884:x1848998399946880:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343276.898905:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343276.898934:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4717 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x219:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49c1f expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.898974:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a471e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x219:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343276.898991:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a471e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x219:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.899006:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a471e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x219:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.899199:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4717 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x219:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c1f expref: 309 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.899220:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a471e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x219:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c1f expref: 308 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.899242:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x219:0x0].0x0 (ffff9401edc53900) 00010000:00010000:1.0:1763343276.899245:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343276.899250:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176e00, rc 0) 00000100:00100000:1.0:1763343276.899319:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:55884:x1848998399946880:12345-192.168.201.40@tcp:101:bash.0 Request processed in 450us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.899327:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10884 00000100:00100000:3.0:1763343276.908303:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.908396:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399947136 00000100:00100000:0.0:1763343276.908411:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399947136 00000100:00100000:0.0:1763343276.908635:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10885 00000100:00100000:0.0:1763343276.908647:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:55884:x1848998399947136:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:0.0:1763343276.908714:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343276.908747:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4709 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c18 expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.908997:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x219:0x0].0x0 (ffff9401edc53900) 00010000:00010000:0.0:1763343276.909004:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343276.909381:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4725 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x219:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343276.909397:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4725 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x219:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.909407:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4725 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x219:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000001:00080000:0.0:1763343276.909459:0:6525:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973804 00000004:00010000:0.0:1763343276.909482:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007be917f5 reply state 000000005193a2d4 transno 4294973805 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4725 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x219:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.909498:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4725 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x219:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.909505:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x219:0x0].0x0 (ffff9401edc53900) 00010000:00010000:0.0:1763343276.909508:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343276.909510:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343276.909623:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:55884:x1848998399947136:12345-192.168.201.40@tcp:36:bash.0 Request processed in 976us (2597us total) trans 4294973805 rc 0/0 00000100:00100000:0.0:1763343276.909632:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10885 00000020:00080000:0.0:1763343276.909637:0:6525:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763343276.913257:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.913349:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.913471:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399947392 00000100:00100000:0.0:1763343276.913482:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399947392 00000100:00100000:0.0:1763343276.913542:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10886 00000100:00100000:0.0:1763343276.913553:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:55884:x1848998399947392:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343276.913580:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.913603:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a472c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x219:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49c26 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.913670:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a472c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x219:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c26 expref: 311 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.913692:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a472c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x219:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c26 expref: 311 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.913712:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x219:0x0].0x0 (ffff9401edc53900) 00010000:00010000:0.0:1763343276.913716:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343276.913719:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b400, rc 0) 00000100:00100000:0.0:1763343276.913787:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:55884:x1848998399947392:12345-192.168.201.40@tcp:101:bash.0 Request processed in 235us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343276.913796:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10886 00000100:00100000:3.0:1763343276.914287:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399947264 00000100:00100000:3.0:1763343276.914294:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399947264 00000100:00100000:3.0:1763343276.914934:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7435 00000100:00100000:3.0:1763343276.914947:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2410:x1848998399947264:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:3.0:1763343276.915554:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2410:x1848998399947264:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 607us (2304us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343276.915564:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7435 00000100:00100000:3.0:1763343276.929184:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.929447:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.929522:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399947776 00000100:00100000:0.0:1763343276.929532:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399947776 00000100:00100000:1.0:1763343276.930070:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399947520 00000100:00100000:1.0:1763343276.930076:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399947520 00000100:00100000:1.0:1763343276.930122:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7436 00000100:00100000:1.0:1763343276.930132:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2409:x1848998399947520:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:1.0:1763343276.930258:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2409:x1848998399947520:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 127us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.930266:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7436 00000100:00100000:3.0:1763343276.930515:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10887 00000100:00100000:3.0:1763343276.930525:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:55884:x1848998399947776:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343276.930541:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343276.930544:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343276.930570:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a472c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x219:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c26 expref: 311 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.930590:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x219:0x0].0x0 (ffff9401edc53900) 00010000:00010000:3.0:1763343276.930595:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343276.930608:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a4733 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x219:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49c2d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.930652:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a473a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x219:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343276.930666:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a473a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x219:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.930675:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a473a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x219:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000040:00080000:3.0:1763343276.930883:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1789, 88 off148720 00000004:00080000:3.0:1763343276.930891:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1070054866548ns, next at 1070049115839ns, rc = 0 00000040:00080000:3.0:1763343276.930928:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1780, 88 off147960 00000004:00080000:3.0:1763343276.930933:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1070054908684ns, next at 1070049318579ns, rc = 0 00000040:00080000:3.0:1763343276.930979:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1781, 88 off148048 00000004:00080000:3.0:1763343276.930983:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1070054958778ns, next at 1070049318579ns, rc = 0 00000040:00080000:3.0:1763343276.931004:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1790, 88 off148808 00000004:00080000:3.0:1763343276.931008:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1070054983504ns, next at 1070049115839ns, rc = 0 00000100:00100000:2.0:1763343276.935474:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.935728:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399947904 00000100:00100000:0.0:1763343276.935739:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399947904 00000100:00100000:0.0:1763343276.935810:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1765 00000100:00100000:0.0:1763343276.935821:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2409:x1848998399947904:12345-192.168.201.40@tcp:3:lfs.0 00010000:00010000:0.0:1763343276.935863:0:28390:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9400c501ac00/0x9104b1ba770a4741 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.935878:0:28390:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.935881:0:28390:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343276.935887:0:28390:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501ac00/0x9104b1ba770a4741 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.935902:0:28390:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c501ac00/0x9104b1ba770a4741 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.935998:0:28390:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9400c501ac00/0x9104b1ba770a4741 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.936007:0:28390:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501ac00/0x9104b1ba770a4741 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.936016:0:28390:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c501ac00/0x9104b1ba770a4741 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.936163:0:28390:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ac00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343276.936168:0:28390:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c501ac00/0x9104b1ba770a4741 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.936179:0:28390:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c501ac00/0x9104b1ba770a4741 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.936195:0:28390:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c501ac00/0x9104b1ba770a4741 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.936202:0:28390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c501ac00/0x9104b1ba770a4741 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343276.936281:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2409:x1848998399947904:12345-192.168.201.40@tcp:3:lfs.0 Request processed in 461us (816us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763343276.936289:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1765 00010000:00010000:1.0:1763343276.937573:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a46ae lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.937584:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a46ae lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.937594:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a46ae lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.937599:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343276.937610:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a46ae lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.937616:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a46ae lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.937631:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c497ef00) 00010000:00010000:1.0:1763343276.937634:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.937638:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a46ae lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.937645:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a46ae lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.937673:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4725 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x219:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343276.937680:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4725 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x219:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343276.937685:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4725 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x219:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343276.937690:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ba00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343276.937693:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4725 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x219:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343276.937699:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4725 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x219:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343276.937712:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x219:0x0].0x0 (ffff9401edc53900) 00010000:00010000:1.0:1763343276.937714:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.937717:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4725 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x219:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343276.937723:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4725 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x219:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00000001:00080000:2.0:1763343276.937852:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973806 is committed 00000004:00080000:2.0:1763343276.937859:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1150 committed 00000100:00100000:1.0:1763343276.938762:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413000576:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343276.938822:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343276.938876:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413000576 00000100:00100000:1.0:1763343276.938883:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413000576 00000100:00100000:1.0:1763343276.938925:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7437 00000100:00100000:1.0:1763343276.938933:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+36:3659:x1848998413000576:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343276.939135:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+37:3659:x1848998413000576:12345-0@lo:2:osp-syn-1-1.0 Request processed in 202us (312us total) trans 17179872011 rc 0/0 00000100:00100000:1.0:1763343276.939142:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7437 00000100:00100000:3.0:1763343276.939164:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343276.939176:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413000448:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763343276.939183:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401edc1b480/2, rc 0, transno 17179872011 00000100:00100000:1.0:1763343276.939191:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413000576:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343276.939215:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1763343276.939454:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1142 committed 00000004:00080000:2.0:1763343276.939467:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1141 committed 00000004:00080000:2.0:1763343276.939469:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1149 committed 00010000:00010000:2.0:1763343276.939553:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a473a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x219:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c2d expref: 303 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.939565:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x219:0x0].0x0 (ffff9401edc53900) 00010000:00010000:2.0:1763343276.939567:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343276.939581:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a4733 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x219:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c2d expref: 303 pid: 6525 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763343276.939608:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a473a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x219:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c2d expref: 302 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.939638:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x219:0x0].0x0 (ffff9401edc53900) 00010000:00010000:2.0:1763343276.939640:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343276.939643:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fd600, rc 0) 00000100:00100000:2.0:1763343276.939702:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:55884:x1848998399947776:12345-192.168.201.40@tcp:101:bash.0 Request processed in 9179us (10255us total) trans 4294973806 rc 0/0 00000100:00100000:2.0:1763343276.939710:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10887 00000100:00100000:3.0:1763343276.939846:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6280380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413000832:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343276.939874:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343276.940015:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9dc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413000704:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343276.940066:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343276.940225:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413000448 00000100:00100000:3.0:1763343276.940355:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413000448 00000100:00100000:3.0:1763343276.940392:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413000832 00000100:00100000:3.0:1763343276.940395:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413000832 00000100:00100000:2.0:1763343276.940532:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413000704 00000100:00100000:2.0:1763343276.940537:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413000704 00000100:00100000:2.0:1763343276.940569:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7438 00000100:00100000:2.0:1763343276.940577:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edde7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+37:3661:x1848998413000448:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343276.940659:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7439 00000100:00100000:0.0:1763343276.940670:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+21:3660:x1848998413000704:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343276.940721:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edde7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+38:3661:x1848998413000448:12345-0@lo:2:osp-syn-1-1.0 Request processed in 143us (1505us total) trans 17179872012 rc 0/0 00000100:00100000:2.0:1763343276.940729:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7438 00000100:00100000:0.0:1763343276.940781:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+22:3660:x1848998413000704:12345-0@lo:2:osp-syn-0-1.0 Request processed in 114us (713us total) trans 21474839282 rc 0/0 00000100:00100000:0.0:1763343276.940790:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7439 00000004:00080000:0.0:1763343276.940831:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c9dc9500/2, rc 0, transno 21474839282 00000100:00100000:0.0:1763343276.940838:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9dc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413000704:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763343276.940886:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401edc19f80/2, rc 0, transno 17179872012 00000100:00100000:2.0:1763343276.940895:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413000448:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343276.941129:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7440 00000100:00100000:3.0:1763343276.941138:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+21:3661:x1848998413000832:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343276.941274:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+22:3661:x1848998413000832:12345-0@lo:2:osp-syn-0-1.0 Request processed in 138us (1398us total) trans 21474839283 rc 0/0 00000100:00100000:3.0:1763343276.941280:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7440 00000004:00080000:0.0:1763343276.943457:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6280380/2, rc 0, transno 21474839283 00000100:00100000:0.0:1763343276.943471:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6280380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413000832:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343276.948796:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.948851:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.948879:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399948032 00000100:00100000:3.0:1763343276.948892:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399948032 00000100:00100000:1.0:1763343276.949994:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399948160 00000100:00100000:1.0:1763343276.950002:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399948160 00000100:00100000:1.0:1763343276.950075:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7441 00000100:00100000:1.0:1763343276.950084:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:55884:x1848998399948160:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343276.950100:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343276.950124:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4748 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49c3b expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343276.950154:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343276.950181:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.950184:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343276.950192:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4748 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c3b expref: 24 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.950208:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4748 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c3b expref: 24 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.950220:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177a00, rc 0) 00000100:00100000:1.0:1763343276.950292:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:55884:x1848998399948160:12345-192.168.201.40@tcp:101:bash.0 Request processed in 209us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.950299:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7441 00000100:00100000:2.0:1763343276.950928:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10888 00000100:00100000:2.0:1763343276.950937:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57166:x1848998399948032:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343276.950948:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343276.950962:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a474f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49c34 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.950996:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4756 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343276.951008:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4756 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.951018:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4756 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.951138:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a474f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c34 expref: 304 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.951153:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f800/0x9104b1ba770a4756 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x218:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c34 expref: 303 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.951160:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:2.0:1763343276.951164:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343276.951166:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f800, rc 0) 00000100:00100000:2.0:1763343276.951203:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57166:x1848998399948032:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 267us (2417us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.951209:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10888 00000100:00100000:2.0:1763343276.952859:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.952903:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399948288 00000100:00100000:3.0:1763343276.952913:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399948288 00000100:00100000:3.0:1763343276.953267:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7442 00000100:00100000:3.0:1763343276.953277:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:55884:x1848998399948288:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343276.953293:0:8413:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343276.953312:0:8413:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fd800/0x9104b1ba770a475d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49c42 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343276.953336:0:8413:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343276.953821:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343276.953824:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343276.953834:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fd800/0x9104b1ba770a475d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c42 expref: 19 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.953856:0:8413:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fd800/0x9104b1ba770a475d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c42 expref: 19 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.953867:0:8413:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fd800, rc 0) 00000100:00100000:0.0:1763343276.953872:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.953918:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:55884:x1848998399948288:12345-192.168.201.40@tcp:101:bash.0 Request processed in 643us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343276.953919:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399948416 00000100:00100000:2.0:1763343276.953926:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399948416 00000100:00100000:3.0:1763343276.953929:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7442 00000100:00100000:2.0:1763343276.953973:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1766 00000100:00100000:2.0:1763343276.953982:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2407:x1848998399948416:12345-192.168.201.40@tcp:4:lfs.0 00010000:00010000:2.0:1763343276.954003:0:28390:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4764 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.954046:0:28390:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4511 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b69 expref: 24 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343276.954055:0:28390:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.954057:0:28390:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343276.954060:0:28390:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4764 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.954090:0:28390:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4511 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b69 expref: 24 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343276.954105:0:28390:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4511 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b69 expref: 24 pid: 28562 timeout: 1170 lvb_type: 1 00000100:00100000:2.0:1763343276.954119:0:28390:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:28390:1848998413000960:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343276.954556:0:28390:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c7ec3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1763343276.959706:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.959824:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399948544 00000100:00100000:3.0:1763343276.959834:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399948544 00002000:00010000:3.0:1763343276.959871:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/723 (0->18446744073709551615) 00002000:00100000:3.0:1763343276.959877:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401edc1bb80 with x1848998399948544 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343276.959889:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401edc1bb80. 00000100:00100000:3.0:1763343276.959926:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1767 00000100:00100000:3.0:1763343276.959936:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2408:x1848998399948544:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:3.0:1763343276.960153:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2d3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343276.960157:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2d3:0x0] updating lvb mtime from disk: 0 -> 1763343276 00002000:00010000:3.0:1763343276.960159:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2d3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343276.960161:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2d3:0x0] updating lvb ctime from disk: 0 -> 1763343276 00002000:00010000:3.0:1763343276.960163:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2d3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343276.960220:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2408:x1848998399948544:12345-192.168.201.40@tcp:10:bash.0 Request processed in 285us (525us total) trans 17179872013 rc 0/0 00000100:00100000:3.0:1763343276.960239:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1767 00002000:00010000:3.0:1763343276.960244:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/723 (0->18446744073709551615) 00002000:00100000:3.0:1763343276.960246:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401edc1bb80 with x1848998399948544 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343276.960252:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401edc1bb80. 00000100:00100000:1.0:1763343276.960458:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.960481:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.960552:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399948800 00000100:00100000:0.0:1763343276.960557:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399948800 00002000:00010000:0.0:1763343276.960575:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/722 (0->18446744073709551615) 00002000:00100000:0.0:1763343276.960579:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401edc19180 with x1848998399948800 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343276.960586:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9401edc19180. 00000100:00100000:0.0:1763343276.960608:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1768 00000100:00100000:0.0:1763343276.960615:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2407:x1848998399948800:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:0.0:1763343276.960713:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2d2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343276.960716:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2d2:0x0] updating lvb mtime from disk: 0 -> 1763343276 00002000:00010000:0.0:1763343276.960718:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2d2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343276.960721:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2d2:0x0] updating lvb ctime from disk: 0 -> 1763343276 00002000:00010000:0.0:1763343276.960723:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2d2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343276.960748:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399948800:12345-192.168.201.40@tcp:10:bash.0 Request processed in 133us (265us total) trans 21474839284 rc 0/0 00000100:00100000:0.0:1763343276.960754:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1768 00002000:00010000:0.0:1763343276.960757:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/722 (0->18446744073709551615) 00002000:00100000:0.0:1763343276.960759:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401edc19180 with x1848998399948800 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343276.960763:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9401edc19180. 00000100:00100000:2.0:1763343276.961085:0:28390:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:28390:1848998413000960:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343276.961113:0:28390:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4764 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343276.962203:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399948672 00000100:00100000:3.0:1763343276.962212:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399948672 00010000:00010000:3.0:1763343276.962256:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4511 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b69 expref: 26 pid: 28562 timeout: 1170 lvb_type: 1 00000100:00100000:3.0:1763343276.962350:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3541 00000100:00100000:3.0:1763343276.962359:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2409:x1848998399948672:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343276.962372:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343276.962389:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4511 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b69 expref: 26 pid: 28562 timeout: 1170 lvb_type: 1 00010000:00010000:3.0:1763343276.962402:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4511 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b69 expref: 26 pid: 28562 timeout: 1170 lvb_type: 1 00010000:00010000:3.0:1763343276.962424:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c3917000/0x9104b1ba770a4511 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b69 expref: 26 pid: 28562 timeout: 1170 lvb_type: 1 00010000:00010000:3.0:1763343276.962440:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343276.962442:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343276.962446:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4764 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.962456:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4764 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343276.962489:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343276.962542:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2409:x1848998399948672:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 183us (2083us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343276.962550:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3541 00010000:00010000:2.0:1763343276.962849:0:28390:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4764 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.962858:0:28390:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4764 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343276.966587:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343276.966804:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399949056 00000100:00100000:3.0:1763343276.966815:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399949056 00000100:00100000:3.0:1763343276.966872:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3838 00000100:00100000:3.0:1763343276.966882:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:55884:x1848998399949056:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:3.0:1763343276.967212:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:55884:x1848998399949056:12345-192.168.201.40@tcp:35:bash.0 Request processed in 330us (637us total) trans 4294973807 rc 0/0 00000100:00100000:3.0:1763343276.967219:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3838 00000001:00080000:3.0:1763343276.972132:0:25994:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872014 is committed 00000001:00080000:3.0:1763343276.972155:0:25994:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872012 is committed 00002000:00010000:2.0:1763343276.972559:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2d2:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:2.0:1763343276.972565:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2d2:0x0] updating lvb mtime from disk: 0 -> 1763343276 00002000:00010000:2.0:1763343276.972567:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2d2:0x0] updating lvb ctime from disk: 0 -> 1763343276 00002000:00010000:2.0:1763343276.972570:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2d2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1763343276.972583:0:28390:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4764 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.972595:0:28390:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4764 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.972604:0:28390:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4764 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.972612:0:28390:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583fc00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343276.972617:0:28390:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4764 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.972626:0:28390:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4764 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.972653:0:28390:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4764 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.972661:0:28390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4764 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343276.973413:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2407:x1848998399948416:12345-192.168.201.40@tcp:4:lfs.0 Request processed in 19423us (19535us total) trans 17179872014 rc 0/0 00000100:00100000:2.0:1763343276.973430:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1766 00000100:00100000:0.0:1763343276.973774:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343276.974019:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399949184 00000100:00100000:1.0:1763343276.974091:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399949184 00000100:00100000:1.0:1763343276.974146:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10889 00000100:00100000:1.0:1763343276.974155:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57169:x1848998399949184:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:1.0:1763343276.974179:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343276.974201:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a476b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49c49 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.974278:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4772 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343276.974296:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4772 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.974307:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4772 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.974318:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4779 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343276.974324:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4779 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.974330:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4779 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.974408:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4780 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x219:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343276.974417:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4780 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x219:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.974424:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4780 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x219:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343276.974465:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x219:0x0]: returning size 5 00000004:00200000:1.0:1763343276.974470:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343276.974488:0:9827:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4780 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x219:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.974499:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4780 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.974507:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4772 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.974515:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4772 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.974520:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4772 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.974537:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4772 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.974541:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343276.974545:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4772 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.974551:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4772 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.974561:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497ef00) 00010000:00010000:1.0:1763343276.974564:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.974568:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4772 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.974573:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4772 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.974585:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4779 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.974590:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4779 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.974595:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4779 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.974599:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343276.974602:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4779 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.974607:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4779 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.974613:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c497eb00) 00010000:00010000:1.0:1763343276.974616:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343276.974619:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4779 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.974623:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4779 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343276.974656:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a476b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c49 expref: 306 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.974671:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4780 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c49 expref: 305 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343276.974678:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x219:0x0].0x0 (ffff9401edc53900) 00010000:00010000:1.0:1763343276.974680:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343276.974683:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176000, rc 0) 00000100:00100000:1.0:1763343276.974733:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57169:x1848998399949184:12345-192.168.201.40@tcp:101:rm.0 Request processed in 580us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343276.974740:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10889 00000100:00100000:0.0:1763343276.980564:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343276.980890:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399949440 00000100:00100000:2.0:1763343276.980901:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399949440 00000100:00100000:2.0:1763343276.980966:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10890 00000100:00100000:2.0:1763343276.980976:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57169:x1848998399949440:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:2.0:1763343276.981054:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763343276.981083:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a473a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x219:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c2d expref: 305 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.981107:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4780 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c49 expref: 304 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.981123:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a471e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x219:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c1f expref: 303 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343276.981134:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x219:0x0].0x0 (ffff9401edc53900) 00010000:00010000:2.0:1763343276.981147:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343276.981178:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4787 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343276.981190:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4787 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.981199:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4787 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.981209:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a478e lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343276.981215:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a478e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.981222:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a478e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.981317:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4795 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x219:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343276.981325:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4795 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x219:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.981332:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4795 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x219:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000040:00080000:2.0:1763343276.982433:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1791, 64 off148872 00000004:00080000:2.0:1763343276.982443:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1070106417689ns, next at 1071106415333ns, rc = 0 00000040:00080000:2.0:1763343276.982467:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1782, 64 off148112 00000004:00080000:2.0:1763343276.982471:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1070106446482ns, next at 1071106445174ns, rc = 0 00000040:00080000:2.0:1763343276.982482:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1783, 64 off148176 00000040:00080000:2.0:1763343276.982491:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1792, 64 off148936 00010000:00010000:2.0:1763343276.982547:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a479c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x219:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343276.982561:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a479c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x219:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.982571:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a479c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x219:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.982579:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a479c lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x219:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.982585:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a479c lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x219:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.982602:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a479c lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x219:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.982627:0:6525:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343276.982648:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4795 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x219:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.982654:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4795 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x219:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.982660:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4795 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x219:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.982665:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.982669:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4795 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x219:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.982676:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4795 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x219:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.982687:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x219:0x0].0x0 (ffff9400c4758f00) 00010000:00010000:2.0:1763343276.982690:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763343276.982694:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4795 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x219:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.982701:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4795 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x219:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.982711:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343276.982721:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a479c lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x219:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.982729:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583fa00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343276.982733:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a479c lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x219:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.982740:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a479c lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x219:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.982752:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x219:0x0].0x0 (ffff9400c4758f00) 00010000:00010000:3.0:1763343276.982755:0:7451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343276.982759:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a479c lrc: 1/0,0 mode: --/PW res: [0x240000404:0x219:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.982765:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a479c lrc: 0/0,0 mode: --/PW res: [0x240000404:0x219:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343276.982784:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343276.982787:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343276.982789:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343276.982831:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4787 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.982838:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4787 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.982847:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4787 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.982852:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4787 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.982857:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583fc00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343276.982859:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4787 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.982866:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4787 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.982874:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758600) 00010000:00010000:2.0:1763343276.982881:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343276.982884:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4787 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.982889:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4787 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00000004:00010000:2.0:1763343276.982902:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f30a022f reply state 0000000057cdf878 transno 4294973808 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a478e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.982912:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a478e lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343276.982964:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758000) 00010000:00010000:2.0:1763343276.982969:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343276.982973:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343276.983100:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57169:x1848998399949440:12345-192.168.201.40@tcp:36:rm.0 Request processed in 2121us (2543us total) trans 4294973808 rc 0/0 00000100:00100000:2.0:1763343276.983111:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10890 00000100:00100000:2.0:1763343276.995983:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.996315:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399949696 00000100:00100000:0.0:1763343276.996325:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399949696 00000100:00100000:0.0:1763343276.996380:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10891 00000100:00100000:0.0:1763343276.996389:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57166:x1848998399949696:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:0.0:1763343276.996443:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343276.996479:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a46d8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x218:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c0a expref: 304 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.996500:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:0.0:1763343276.996504:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343276.996569:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a47a3 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343276.996581:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a47a3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.996589:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a47a3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00010000:0.0:1763343276.996689:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000076177648 reply state 00000000315300c3 transno 4294973809 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a47a3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.996699:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a47a3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.996705:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:0.0:1763343276.996708:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343276.996710:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343276.996806:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57166:x1848998399949696:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 416us (833us total) trans 4294973809 rc 0/0 00000100:00100000:0.0:1763343276.996815:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10891 00000100:00100000:3.0:1763343276.997202:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343276.997321:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399949824 00000100:00100000:0.0:1763343276.997326:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399949824 00000100:00100000:0.0:1763343276.997356:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10892 00000100:00100000:0.0:1763343276.997363:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57170:x1848998399949824:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343276.997376:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343276.997396:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a47aa lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49c50 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.997450:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a47b1 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343276.997461:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a47b1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.997471:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a47b1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.997481:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a47b8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343276.997489:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a47b8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.997496:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a47b8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.997526:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a47b1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.997533:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a47b1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.997539:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a47b1 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.997547:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a47b1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.997553:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.997557:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a47b1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.997568:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a47b1 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.997578:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53100) 00010000:00010000:0.0:1763343276.997581:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.997585:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a47b1 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.997592:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a47b1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.997602:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a47b8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.997608:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a47b8 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.997614:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a47b8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.997618:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343276.997621:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a47b8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.997626:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a47b8 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.997632:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758000) 00010000:00010000:0.0:1763343276.997635:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.997638:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a47b8 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.997643:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a47b8 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343276.999781:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a47aa lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c50 expref: 306 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.999803:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53100) 00010000:00010000:0.0:1763343276.999807:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343276.999812:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a47aa lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c50 expref: 306 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343276.999831:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b600, rc 0) 00000100:00100000:0.0:1763343276.999905:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57170:x1848998399949824:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2540us (2703us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343276.999914:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10892 00000100:00100000:2.0:1763343277.003159:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.003519:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399949952 00000100:00100000:3.0:1763343277.003531:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399949952 00000100:00080000:1.0:1763343277.003615:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1763343277.003616:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7443 00000100:00100000:3.0:1763343277.003629:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:57166:x1848998399949952:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343277.003647:0:8413:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343277.003670:0:8413:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a47bf lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49c57 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343277.003708:0:8413:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2d2:0x0] initial LVB size: 4096, mtime: 0x691a7bac, atime: 0x0, ctime: 0x691a7bac, blocks: 0x8 00010000:00010000:3.0:1763343277.003734:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343277.003737:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343277.003744:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a47bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c57 expref: 14 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.003762:0:8413:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a47bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c57 expref: 14 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.003775:0:8413:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5bd8e00, rc 0) 00000100:00100000:3.0:1763343277.003837:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:57166:x1848998399949952:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 210us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343277.003844:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7443 00000100:00100000:1.0:1763343277.011321:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.011497:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399950080 00000100:00100000:2.0:1763343277.011507:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399950080 00000100:00100000:2.0:1763343277.011575:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7444 00000100:00100000:2.0:1763343277.011587:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:57166:x1848998399950080:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.011603:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.011623:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c583fc00/0x9104b1ba770a47c6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49c5e expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.011651:0:8412:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a4518 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b70 expref: 21 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343277.011659:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.011661:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.011666:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583fc00/0x9104b1ba770a47c6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c5e expref: 21 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.011700:0:8412:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a4518 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b70 expref: 21 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343277.011714:0:8412:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a4518 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b70 expref: 21 pid: 28562 timeout: 1170 lvb_type: 1 00000100:00100000:2.0:1763343277.011727:0:8412:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6276d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998413001088:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343277.011806:0:8412:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c7ec3480 going to sleep for 11 seconds 00000100:00080000:1.0:1763343277.011862:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1763343277.013565:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.013626:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399950208 00000100:00100000:2.0:1763343277.013635:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399950208 00000100:00080000:1.0:1763343277.013699:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1763343277.013712:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10893 00000100:00100000:2.0:1763343277.013723:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57170:x1848998399950208:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.013745:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.013766:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a47cd lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49c65 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.013899:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a47d4 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343277.013918:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a47d4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.013930:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a47d4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.013941:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a47db lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343277.013948:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a47db lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.013955:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a47db lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.013999:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a47d4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.014007:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a47d4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.014017:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a47d4 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.014048:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a47d4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.014061:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.014065:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a47d4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.014072:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a47d4 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.014085:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758600) 00010000:00010000:2.0:1763343277.014088:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.014093:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a47d4 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.014099:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a47d4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.014111:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a47db lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.014116:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a47db lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.014121:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a47db lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.014125:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.014128:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a47db lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.014142:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a47db lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.014149:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758000) 00010000:00010000:2.0:1763343277.014152:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.014154:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a47db lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.014160:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a47db lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.014185:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a47cd lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c65 expref: 306 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.014194:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758600) 00010000:00010000:2.0:1763343277.014197:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.014200:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a47cd lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c65 expref: 306 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.014211:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f400, rc 0) 00000100:00100000:2.0:1763343277.014275:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57170:x1848998399950208:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 555us (722us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343277.014282:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10893 00000100:00100000:2.0:1763343277.015512:0:8412:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6276d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998413001088:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343277.015546:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c583fc00/0x9104b1ba770a47c6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c5e expref: 21 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.015563:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583fc00, rc 0) 00000100:00100000:2.0:1763343277.015611:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:57166:x1848998399950080:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 4027us (4300us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.015620:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7444 00000100:00100000:1.0:1763343277.017846:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.017913:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399950336 00000100:00100000:2.0:1763343277.017924:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399950336 00010000:00010000:2.0:1763343277.017971:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a4518 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b70 expref: 21 pid: 28562 timeout: 1170 lvb_type: 1 00000100:00100000:2.0:1763343277.018020:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3542 00000100:00100000:3.0:1763343277.018066:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.018106:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399950464 00000100:00100000:1.0:1763343277.018111:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399950464 00000100:00100000:1.0:1763343277.018152:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10894 00000100:00100000:1.0:1763343277.018161:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57170:x1848998399950464:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343277.018180:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.018205:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a47e2 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49c6c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.018289:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a47e9 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343277.018303:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a47e9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.018315:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a47e9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:1.0:1763343277.018363:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763343277.018368:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763343277.018404:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a47e2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c6c expref: 307 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.018422:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a47e9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c6c expref: 306 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.018431:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497ef00) 00010000:00010000:1.0:1763343277.018434:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343277.018437:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176400, rc 0) 00000100:00100000:1.0:1763343277.018486:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57170:x1848998399950464:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 325us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.018494:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10894 00000100:00100000:2.0:1763343277.019050:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399950336:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343277.019065:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343277.019085:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a4518 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b70 expref: 21 pid: 28562 timeout: 1170 lvb_type: 1 00010000:00010000:2.0:1763343277.019101:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a4518 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b70 expref: 21 pid: 28562 timeout: 1170 lvb_type: 1 00010000:00010000:2.0:1763343277.019121:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c3916200/0x9104b1ba770a4518 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49b70 expref: 21 pid: 28562 timeout: 1170 lvb_type: 1 00010000:00010000:2.0:1763343277.019134:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.019136:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.019141:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c583fc00/0x9104b1ba770a47c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c5e expref: 20 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.019150:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583fc00/0x9104b1ba770a47c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c5e expref: 20 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.019190:0:6509:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9400c583fc00/0x9104b1ba770a47c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c5e expref: 20 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343277.019206:0:6509:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6276d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6509:1848998413001216:192.168.201.40@tcp:105: 00000100:00100000:2.0:1763343277.019290:0:6509:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c7ec3480 going to sleep for 11 seconds 00000100:00100000:2.0:1763343277.023396:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.023437:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.023478:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.023499:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399950592 00000100:00100000:0.0:1763343277.023509:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399950720 00000100:00100000:3.0:1763343277.023510:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399950592 00000100:00100000:0.0:1763343277.023517:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399950720 00000100:00100000:2.0:1763343277.023529:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399950848 00000100:00100000:2.0:1763343277.023534:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399950848 00002000:00010000:2.0:1763343277.023561:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/721 (0->18446744073709551615) 00002000:00010000:0.0:1763343277.023561:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/722 (5->18446744073709551615) 00002000:00100000:2.0:1763343277.023569:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401f6507b80 with x1848998399950848 ext(0->18446744073709551615) 00002000:00100000:0.0:1763343277.023570:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401f6504000 with x1848998399950720 ext(5->18446744073709551615) 00000100:00100000:3.0:1763343277.023578:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10895 00002000:00010000:2.0:1763343277.023589:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9401f6507b80. 00002000:00010000:0.0:1763343277.023589:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401f6504000. 00000100:00100000:3.0:1763343277.023591:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57170:x1848998399950592:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343277.023612:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343277.023631:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a47f0 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49c73 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343277.023675:0:6509:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6276d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6509:1848998413001216:192.168.201.40@tcp:105: 00010000:00010000:1.0:1763343277.023697:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343277.023704:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a47f7 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343277.023720:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a47f7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.023733:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a47f7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.023745:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a47fe lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343277.023753:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a47fe lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00000100:00100000:1.0:1763343277.023754:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399950336:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 4729us (5916us total) trans 0 rc 0/0 00010000:00010000:3.0:1763343277.023770:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a47fe lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000100:00100000:1.0:1763343277.023774:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3542 00010000:00010000:3.0:1763343277.023819:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a47f7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.023827:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a47f7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.023833:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a47f7 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.023838:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a47f7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.023844:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5b3d200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343277.023848:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a47f7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.023854:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a47f7 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.023866:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497ef00) 00010000:00010000:3.0:1763343277.023868:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343277.023871:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a47f7 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.023877:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a47f7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.023889:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a47fe lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.023895:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a47fe lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.023900:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a47fe lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.023905:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5b3d000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343277.023908:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a47fe lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.023913:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a47fe lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.023918:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758000) 00010000:00010000:3.0:1763343277.023920:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343277.023923:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a47fe lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.023928:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d000/0x9104b1ba770a47fe lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.023951:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a47f0 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c73 expref: 307 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.023958:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497ef00) 00010000:00010000:3.0:1763343277.023961:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343277.023965:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a47f0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c73 expref: 307 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.023973:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5bd9a00, rc 0) 00000100:00100000:3.0:1763343277.024002:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57170:x1848998399950592:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 416us (617us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343277.024008:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10895 00000100:00100000:0.0:1763343277.024549:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1769 00000100:00100000:0.0:1763343277.024563:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399950720:12345-192.168.201.40@tcp:10:lfs.0 00000100:00100000:2.0:1763343277.024743:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1770 00000100:00100000:2.0:1763343277.024756:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399950848:12345-192.168.201.40@tcp:10:lfs.0 00002000:00010000:0.0:1763343277.024865:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2d2:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:0.0:1763343277.024870:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2d2:0x0] updating lvb mtime from disk: 1763343276 -> 1763343276 00002000:00010000:0.0:1763343277.024874:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2d2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343277.024875:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2d1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343277.024877:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2d2:0x0] updating lvb ctime from disk: 1763343276 -> 1763343276 00002000:00010000:2.0:1763343277.024880:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2d1:0x0] updating lvb mtime from disk: 0 -> 1763343276 00002000:00010000:0.0:1763343277.024882:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2d2:0x0] updating lvb blocks from disk: 8 -> 8 00002000:00010000:2.0:1763343277.024890:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2d1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343277.024893:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2d1:0x0] updating lvb ctime from disk: 0 -> 1763343276 00002000:00010000:2.0:1763343277.024895:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2d1:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343277.024917:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998399950720:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 358us (1477us total) trans 17179872015 rc 0/0 00000100:00100000:2.0:1763343277.024929:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399950848:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 175us (1449us total) trans 21474839285 rc 0/0 00000100:00100000:0.0:1763343277.024934:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1769 00002000:00010000:0.0:1763343277.024941:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/722 (5->18446744073709551615) 00000100:00100000:2.0:1763343277.024945:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1770 00002000:00100000:0.0:1763343277.024947:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401f6504000 with x1848998399950720 ext(5->18446744073709551615) 00002000:00010000:2.0:1763343277.024951:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/721 (0->18446744073709551615) 00002000:00010000:0.0:1763343277.024954:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401f6504000. 00002000:00100000:2.0:1763343277.024955:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401f6507b80 with x1848998399950848 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343277.024963:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9401f6507b80. 00000100:00100000:2.0:1763343277.029829:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.029976:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399951104 00000100:00100000:3.0:1763343277.029989:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399951104 00000100:00100000:2.0:1763343277.030717:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.032260:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399951360 00000100:00100000:2.0:1763343277.032274:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399951360 00000100:00100000:2.0:1763343277.032326:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10896 00000100:00100000:2.0:1763343277.032336:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57170:x1848998399951104:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.032357:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.032360:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343277.032386:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a47e9 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c6c expref: 307 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.032406:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497ef00) 00010000:00010000:2.0:1763343277.032416:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343277.032433:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4805 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49c7a expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.032536:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a480c lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343277.032548:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a480c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.032558:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a480c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.032568:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4813 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343277.032574:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4813 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.032580:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4813 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:1.0:1763343277.033384:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10897 00000100:00100000:1.0:1763343277.033400:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57166:x1848998399951360:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:1.0:1763343277.033471:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a481a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343277.033484:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a481a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.033495:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a481a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00010000:1.0:1763343277.033588:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000094f1e195 reply state 000000007a8e9e24 transno 4294973810 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a481a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.033601:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a481a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.033607:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:1.0:1763343277.033610:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343277.033613:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343277.033720:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57166:x1848998399951360:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 324us (3004us total) trans 4294973810 rc 0/0 00000100:00100000:1.0:1763343277.033728:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10897 00010000:00010000:2.0:1763343277.035590:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4821 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343277.035614:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4821 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.035627:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4821 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:2.0:1763343277.035641:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21b:0x0]: returning size 0 00010000:00010000:2.0:1763343277.035670:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a480c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.035677:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a480c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.035696:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a480c lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.035702:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a480c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.035707:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.035712:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a480c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.035719:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a480c lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.035732:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758600) 00010000:00010000:2.0:1763343277.035735:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.035740:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a480c lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.035747:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a480c lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000004:00010000:2.0:1763343277.035762:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c3f5b8de reply state 00000000944df993 transno 4294973811 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4813 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.035773:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4813 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.035779:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758000) 00010000:00010000:2.0:1763343277.035782:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343277.035785:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343277.035830:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4805 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c7a expref: 310 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.035850:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4821 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c7a expref: 309 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.035858:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c4758b00) 00010000:00010000:2.0:1763343277.035860:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343277.035863:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f200, rc 0) 00000100:00100000:2.0:1763343277.039705:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57170:x1848998399951104:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 7355us (9871us total) trans 4294973811 rc 0/0 00000100:00100000:2.0:1763343277.039721:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10896 00000100:00100000:1.0:1763343277.043390:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.043573:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399951488 00000100:00100000:3.0:1763343277.043584:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399951488 00000100:00100000:1.0:1763343277.044467:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7445 00000100:00100000:1.0:1763343277.044485:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2409:x1848998399951488:12345-192.168.201.40@tcp:2:lfs.0 00002000:00010000:1.0:1763343277.044636:0:8413:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2d0:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763343277.044640:0:8413:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2d0:0x0] updating lvb mtime from disk: 1763343276 -> 1763343276 00002000:00010000:1.0:1763343277.044642:0:8413:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2d0:0x0] updating lvb atime from disk: 1763343276 -> 1763343276 00002000:00010000:1.0:1763343277.044644:0:8413:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2d0:0x0] updating lvb ctime from disk: 1763343276 -> 1763343276 00002000:00010000:1.0:1763343277.044646:0:8413:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2d0:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763343277.044714:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2409:x1848998399951488:12345-192.168.201.40@tcp:2:lfs.0 Request processed in 235us (1335us total) trans 21474839286 rc 0/0 00000100:00100000:1.0:1763343277.044722:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7445 00000100:00100000:1.0:1763343277.051074:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.051459:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.051509:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399951744 00000100:00100000:0.0:1763343277.051520:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399951744 00000100:00100000:0.0:1763343277.051584:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10898 00000100:00100000:0.0:1763343277.051594:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57170:x1848998399951744:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343277.051619:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343277.051642:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a482f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49c81 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343277.051726:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399952000 00000100:00100000:3.0:1763343277.051731:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399952000 00010000:00010000:0.0:1763343277.051749:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4836 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343277.051764:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4821 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c7a expref: 312 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.051773:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4836 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00000100:00100000:0.0:1763343277.051824:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3839 00000100:00100000:0.0:1763343277.051831:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8544450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57166:x1848998399952000:12345-192.168.201.40@tcp:35:lfs.0 00000004:00010000:0.0:1763343277.051865:0:6527:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x218:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4629 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x218:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bcb expref: 312 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.051897:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a483d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343277.051907:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a46c3 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bfc expref: 312 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.051914:0:6527:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a483d lrc: 4/0,1 mode: --/EX res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343277.051946:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a46c3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bfc expref: 312 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.051958:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a46c3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bfc expref: 312 pid: 9827 timeout: 1170 lvb_type: 0 00000100:00100000:0.0:1763343277.051974:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c372aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6527:1848998413001344:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343277.052085:0:6527:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401d84de840 going to sleep for 11 seconds 00010000:00010000:0.0:1763343277.052111:0:9827:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4821 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c7a expref: 312 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.052119:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4821 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c7a expref: 312 pid: 9827 timeout: 1170 lvb_type: 0 00000100:00100000:0.0:1763343277.052127:0:9827:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c372b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998413001472:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343277.052146:0:9827:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401d84de180 going to sleep for 11 seconds 00000100:00100000:1.0:1763343277.054783:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c372b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998413001472:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343277.054816:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4836 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:0.0:1763343277.055075:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c372aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6527:1848998413001344:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343277.055090:0:6527:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a483d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00000100:00100000:0.0:1763343277.055858:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.055952:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.056021:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399952256 00000100:00100000:1.0:1763343277.056045:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399952256 00010000:00010000:1.0:1763343277.056081:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4821 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c7a expref: 313 pid: 9827 timeout: 1170 lvb_type: 0 00000100:00100000:1.0:1763343277.056112:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399952128 00000100:00100000:1.0:1763343277.056114:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399952128 00010000:00010000:1.0:1763343277.056124:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a46c3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bfc expref: 314 pid: 9827 timeout: 1170 lvb_type: 0 00000100:00100000:1.0:1763343277.056150:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3543 00000100:00100000:1.0:1763343277.056159:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401d84f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:2407:x1848998399952256:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343277.056174:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343277.056180:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4821 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c7a expref: 314 pid: 9827 timeout: 1170 lvb_type: 0 00010000:00010000:1.0:1763343277.056190:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4821 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c7a expref: 314 pid: 9827 timeout: 1170 lvb_type: 0 00010000:00010000:1.0:1763343277.056210:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4821 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c7a expref: 314 pid: 9827 timeout: 1170 lvb_type: 0 00010000:00010000:1.0:1763343277.056236:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c4758b00) 00010000:00010000:1.0:1763343277.056242:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4836 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.056250:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4836 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.056256:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4836 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.056289:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343277.056343:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401d84f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:2407:x1848998399952256:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 184us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.056350:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3543 00000100:00100000:1.0:1763343277.056395:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3544 00000100:00100000:1.0:1763343277.056401:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:2408:x1848998399952128:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343277.056407:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343277.056412:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a46c3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bfc expref: 312 pid: 9827 timeout: 1170 lvb_type: 0 00010000:00010000:1.0:1763343277.056421:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a46c3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bfc expref: 312 pid: 9827 timeout: 1170 lvb_type: 0 00010000:00010000:1.0:1763343277.056444:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a46c3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bfc expref: 312 pid: 9827 timeout: 1170 lvb_type: 0 00010000:00010000:1.0:1763343277.056454:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:1.0:1763343277.056458:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a483d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343277.056465:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a483d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343277.056471:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a483d lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343277.056485:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343277.056505:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:2408:x1848998399952128:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 103us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.056511:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3544 00010000:00010000:1.0:1763343277.056537:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4836 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.056545:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4836 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343277.056569:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21b:0x0]: returning size 0 00000004:00080000:1.0:1763343277.056762:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2d4:0x0], index 0: 0 00000004:00080000:1.0:1763343277.056770:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2d5:0x0], index 1: 0 00000004:00080000:1.0:1763343277.056775:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2d6:0x0], index 1: 0 00000004:00080000:1.0:1763343277.056779:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2d5:0x0], index 0: 0 00010000:00010000:1.0:1763343277.056886:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4836 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.056894:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4836 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.056899:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4836 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.056904:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.056908:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4836 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.056915:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4836 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.056923:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c4758b00) 00010000:00010000:1.0:1763343277.056925:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343277.056929:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4836 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.056934:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4836 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.056980:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a482f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x21b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c81 expref: 311 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.056989:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c4758b00) 00010000:00010000:1.0:1763343277.056992:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343277.056995:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a482f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c81 expref: 311 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.057011:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a400, rc 0) 00000100:00100000:1.0:1763343277.057092:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57170:x1848998399951744:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 5499us (5633us total) trans 4294973812 rc 301/301 00000100:00100000:1.0:1763343277.057101:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10898 00010000:00010000:0.0:1763343277.057320:0:6527:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a483d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343277.057328:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a483d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00000040:00080000:0.0:1763343277.057482:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1784, 88 off148264 00000004:00080000:0.0:1763343277.057491:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1070181465850ns, next at 1071106445174ns, rc = 0 00000040:00080000:0.0:1763343277.057523:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1793, 88 off149024 00000004:00080000:0.0:1763343277.057528:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1070181503220ns, next at 1071106415333ns, rc = 0 00000040:00080000:0.0:1763343277.057545:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1794, 88 off149112 00000004:00080000:0.0:1763343277.057549:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1070181524540ns, next at 1071106415333ns, rc = 0 00000040:00080000:0.0:1763343277.057566:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1785, 88 off148352 00000004:00080000:0.0:1763343277.057570:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1070181545535ns, next at 1071106445174ns, rc = 0 00000100:00100000:3.0:1763343277.062219:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.062657:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399952512 00000100:00100000:1.0:1763343277.062671:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399952512 00000100:00100000:1.0:1763343277.062733:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3840 00000100:00100000:1.0:1763343277.062745:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57170:x1848998399952512:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343277.063067:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57170:x1848998399952512:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 324us (857us total) trans 4294973814 rc 0/0 00000100:00100000:1.0:1763343277.063078:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3840 00000100:00100000:2.0:1763343277.072620:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.073400:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399952768 00000100:00100000:3.0:1763343277.073412:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399952768 00000100:00100000:3.0:1763343277.073476:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3841 00000100:00100000:3.0:1763343277.073486:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57170:x1848998399952768:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343277.073730:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57170:x1848998399952768:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 244us (1119us total) trans 4294973815 rc 0/0 00000100:00100000:3.0:1763343277.073739:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3841 00000001:00080000:2.0:1763343277.076423:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973813 is committed 00000004:00080000:2.0:1763343277.076438:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1145 committed 00000004:00080000:2.0:1763343277.076458:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1153 committed 00000004:00080000:2.0:1763343277.076473:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1152 committed 00000004:00080000:2.0:1763343277.076475:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1144 committed 00000004:00080000:2.0:1763343277.076490:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1143 committed 00000004:00080000:2.0:1763343277.076492:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1151 committed 00000100:00100000:1.0:1763343277.077096:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413001984:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343277.077167:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343277.077204:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763343277.077209:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413001600:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343277.077236:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343277.077264:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413001728:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343277.077289:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343277.077312:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763343277.077317:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413001856:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343277.077336:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343277.077368:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413001984 00000100:00100000:1.0:1763343277.077375:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413001984 00000100:00100000:1.0:1763343277.077426:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413001600 00000100:00100000:1.0:1763343277.077429:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413001600 00000100:00100000:1.0:1763343277.077444:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413001728 00000100:00100000:1.0:1763343277.077447:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413001728 00000100:00100000:1.0:1763343277.077461:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413001856 00000100:00100000:1.0:1763343277.077463:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413001856 00000100:00100000:1.0:1763343277.077481:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7446 00000100:00100000:1.0:1763343277.077489:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+8:3661:x1848998413001984:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763343277.077637:0:28562:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2d2:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763343277.077642:0:28562:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2d2:0x0] updating lvb mtime from disk: 1763343276 -> 1763343276 00002000:00010000:1.0:1763343277.077645:0:28562:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2d2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343277.077647:0:28562:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2d2:0x0] updating lvb ctime from disk: 1763343276 -> 1763343276 00002000:00010000:1.0:1763343277.077650:0:28562:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2d2:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763343277.077692:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+9:3661:x1848998413001984:12345-0@lo:2:osp-syn-1-1.0 Request processed in 203us (523us total) trans 17179872016 rc 0/0 00000100:00100000:1.0:1763343277.077699:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7446 00000100:00100000:1.0:1763343277.077718:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7447 00000100:00100000:1.0:1763343277.077724:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6276d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+8:3661:x1848998413001600:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343277.077738:0:28562:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:723 count 1 00010000:00010000:1.0:1763343277.077757:0:28562:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a484b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.077777:0:28562:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4748 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c3b expref: 14 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.077784:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343277.077787:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343277.077791:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a484b lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.077818:0:28562:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4748 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c3b expref: 14 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.077833:0:28562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4748 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c3b expref: 14 pid: 8412 timeout: 1170 lvb_type: 0 00000100:00100000:1.0:1763343277.077846:0:28562:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f648a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28562:1848998413002112:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343277.077905:0:28562:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1763343277.077927:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7448 00000100:00100000:1.0:1763343277.077935:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+8:3659:x1848998413001728:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343277.077948:0:11289:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:724 count 1 00002000:00010000:1.0:1763343277.077970:0:11289:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343277.077976:0:11289:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4852 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.077984:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343277.077986:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343277.077991:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4852 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.078004:0:11289:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4852 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.078014:0:11289:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4852 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.078045:0:11289:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4852 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.078065:0:11289:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343277.078259:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+9:3659:x1848998413001728:12345-0@lo:6:osp-syn-1-1.0 Request processed in 324us (968us total) trans 17179872017 rc 0/0 00000100:00100000:1.0:1763343277.078269:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7448 00000100:00100000:1.0:1763343277.078283:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7449 00000100:00100000:1.0:1763343277.078290:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+8:3659:x1848998413001856:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763343277.078345:0:11289:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2d1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343277.078349:0:11289:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2d1:0x0] updating lvb mtime from disk: 1763343276 -> 1763343276 00002000:00010000:1.0:1763343277.078351:0:11289:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2d1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343277.078353:0:11289:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2d1:0x0] updating lvb ctime from disk: 1763343276 -> 1763343276 00002000:00010000:1.0:1763343277.078356:0:11289:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2d1:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343277.078381:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+9:3659:x1848998413001856:12345-0@lo:2:osp-syn-1-1.0 Request processed in 91us (1043us total) trans 17179872018 rc 0/0 00000100:00100000:1.0:1763343277.078387:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7449 00000100:00080000:1.0:1763343277.078405:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1763343277.078434:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343277.078441:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4852 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.078449:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343277.078454:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4852 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.078462:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4852 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.078478:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4852 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.078490:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4852 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.078505:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343277.078506:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343277.078508:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343277.078537:0:3659:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179872012 gen 2 00000004:00080000:1.0:1763343277.078544:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b19180, transno 17179871972 00000004:00080000:1.0:1763343277.078552:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b19c00, transno 17179871973 00000004:00080000:1.0:1763343277.078555:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b1a680, transno 17179871974 00000004:00080000:1.0:1763343277.078558:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b1a300, transno 17179871975 00000004:00080000:1.0:1763343277.078561:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b18000, transno 17179871976 00000004:00080000:1.0:1763343277.078565:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c514d880, transno 17179871977 00000004:00080000:1.0:1763343277.078567:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c4788e00, transno 17179871979 00000004:00080000:1.0:1763343277.078570:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c4788380, transno 17179871980 00000004:00080000:1.0:1763343277.078572:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c478aa00, transno 17179871981 00000004:00080000:1.0:1763343277.078574:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c390ce00, transno 17179871982 00000004:00080000:1.0:1763343277.078577:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c4789880, transno 17179871983 00000004:00080000:1.0:1763343277.078579:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c4789180, transno 17179871984 00000004:00080000:1.0:1763343277.078582:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c2f84a80, transno 17179871987 00000004:00080000:1.0:1763343277.078584:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c4788a80, transno 17179871988 00000004:00080000:1.0:1763343277.078587:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c859aa00, transno 17179871989 00000004:00080000:1.0:1763343277.078590:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c859ad80, transno 17179871990 00000004:00080000:1.0:1763343277.078592:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5dcbb80, transno 17179871994 00000004:00080000:1.0:1763343277.078594:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5dc9500, transno 17179871995 00000004:00080000:1.0:1763343277.078597:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5dcb480, transno 17179871996 00000004:00080000:1.0:1763343277.078599:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5dcb100, transno 17179871997 00000004:00080000:1.0:1763343277.078602:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400cc5de300, transno 17179871998 00000004:00080000:1.0:1763343277.078604:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400cc5dc380, transno 17179871999 00000004:00080000:1.0:1763343277.078607:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400cc5dea00, transno 17179872000 00000004:00080000:1.0:1763343277.078609:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400cc5ded80, transno 17179872001 00000004:00080000:1.0:1763343277.078620:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c7918380, transno 17179872004 00000004:00080000:1.0:1763343277.078622:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c791b100, transno 17179872005 00000004:00080000:1.0:1763343277.078625:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c7918a80, transno 17179872006 00000004:00080000:1.0:1763343277.078627:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c7918700, transno 17179872007 00000004:00080000:1.0:1763343277.078629:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401efc72300, transno 17179872009 00000004:00080000:1.0:1763343277.078632:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6b56d80, transno 17179872010 00000004:00080000:1.0:1763343277.078634:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc1b480, transno 17179872011 00000004:00080000:1.0:1763343277.078637:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc19f80, transno 17179872012 00000100:00100000:1.0:1763343277.078643:0:3659:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9401edc18000 x1848998413001856/t17179872018(17179872018) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763343293 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1763343277.078654:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401edc18000/2, rc 0, transno 17179872018 00000100:00100000:1.0:1763343277.078658:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413001856:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763343277.078670:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401edc1a680/2, rc 0, transno 17179872017 00000100:00100000:1.0:1763343277.078673:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413001728:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1763343277.078837:0:9930:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 4 in progress, 2 in flight, 32 done 00000004:00080000:1.0:1763343277.078856:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401edc1a300/2, rc 0, transno 17179872016 00000100:00100000:1.0:1763343277.078861:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413001984:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343277.079481:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c372b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413002496:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343277.079519:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343277.079543:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763343277.079548:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c3729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413002368:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343277.079565:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343277.079590:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413002496 00000100:00100000:0.0:1763343277.079595:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413002496 00000100:00100000:0.0:1763343277.079632:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413002368 00000100:00100000:0.0:1763343277.079634:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413002368 00000100:00100000:0.0:1763343277.079649:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7450 00000100:00100000:0.0:1763343277.079655:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+23:3660:x1848998413002496:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763343277.079748:0:8413:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2d0:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763343277.079751:0:8413:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2d0:0x0] updating lvb mtime from disk: 1763343276 -> 1763343276 00002000:00010000:0.0:1763343277.079754:0:8413:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2d0:0x0] updating lvb atime from disk: 1763343276 -> 1763343276 00002000:00010000:0.0:1763343277.079756:0:8413:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2d0:0x0] updating lvb ctime from disk: 1763343276 -> 1763343276 00002000:00010000:0.0:1763343277.079758:0:8413:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2d0:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763343277.079788:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+24:3660:x1848998413002496:12345-0@lo:2:osp-syn-0-1.0 Request processed in 133us (268us total) trans 21474839287 rc 0/0 00000100:00100000:0.0:1763343277.079795:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7450 00000100:00100000:0.0:1763343277.079811:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7451 00000100:00100000:0.0:1763343277.079816:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+23:3660:x1848998413002368:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763343277.079828:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:723 count 1 00002000:00010000:0.0:1763343277.079849:0:8413:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343277.079854:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c501b600/0x9104b1ba770a4859 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.079864:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.079866:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.079871:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501b600/0x9104b1ba770a4859 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.079883:0:8413:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c501b600/0x9104b1ba770a4859 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.079891:0:8413:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c501b600/0x9104b1ba770a4859 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.079897:0:8413:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501b600/0x9104b1ba770a4859 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.079915:0:8413:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343277.080336:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a478e lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.080345:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a478e lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.080351:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a478e lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.080356:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583ee00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343277.080360:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a478e lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.080367:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a478e lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.080381:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758000) 00010000:00010000:3.0:1763343277.080384:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343277.080388:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a478e lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.080393:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a478e lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00000100:00100000:1.0:1763343277.080968:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c3728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413002240:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343277.081010:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343277.081048:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763343277.081053:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6401500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413002624:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343277.081071:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343277.082301:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.082943:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413002240 00000100:00100000:2.0:1763343277.082952:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413002240 00000100:00100000:2.0:1763343277.082995:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413002624 00000100:00100000:2.0:1763343277.082998:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413002624 00000100:00100000:2.0:1763343277.083053:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7452 00000100:00100000:2.0:1763343277.083063:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+26:3662:x1848998413002240:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763343277.083091:0:35281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:722 count 1 00010000:00010000:2.0:1763343277.083122:0:35281:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a4860 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.083143:0:35281:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fd800/0x9104b1ba770a475d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c42 expref: 21 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.083152:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343277.083155:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343277.083159:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a4860 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.083194:0:35281:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fd800/0x9104b1ba770a475d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c42 expref: 21 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.083207:0:35281:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fd800/0x9104b1ba770a475d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c42 expref: 21 pid: 8413 timeout: 1170 lvb_type: 0 00000100:00100000:2.0:1763343277.083238:0:35281:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6505880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35281:1848998413002752:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343277.083319:0:35281:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c7ec3c00 going to sleep for 11 seconds 00000100:00080000:2.0:1763343277.083336:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00010000:2.0:1763343277.083392:0:6527:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000077c25dfa reply state 00000000909f7152 transno 4294973813 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a483d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343277.083408:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a483d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343277.083417:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:2.0:1763343277.083420:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1763343277.083424:0:6527:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343277.083430:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:2.0:1763343277.083433:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343277.083438:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4629 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x218:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49bcb expref: 305 pid: 9827 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343277.083637:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+26:3660:x1848998413002368:12345-0@lo:6:osp-syn-0-1.0 Request processed in 3819us (4068us total) trans 21474839288 rc 0/0 00000100:00100000:0.0:1763343277.083647:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7451 00000100:00100000:0.0:1763343277.083669:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7453 00000100:00100000:0.0:1763343277.083676:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f648b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+25:3662:x1848998413002624:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763343277.083794:0:8413:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2d1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343277.083799:0:8413:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2d1:0x0] updating lvb mtime from disk: 1763343276 -> 1763343276 00002000:00010000:0.0:1763343277.083801:0:8413:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2d1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343277.083803:0:8413:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2d1:0x0] updating lvb ctime from disk: 1763343276 -> 1763343276 00002000:00010000:0.0:1763343277.083805:0:8413:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2d1:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343277.083833:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f648b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+26:3662:x1848998413002624:12345-0@lo:2:osp-syn-0-1.0 Request processed in 158us (2760us total) trans 21474839289 rc 0/0 00000100:00100000:0.0:1763343277.083839:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7453 00010000:00010000:0.0:1763343277.083867:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343277.083874:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c501b600/0x9104b1ba770a4859 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.083882:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343277.083887:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c501b600/0x9104b1ba770a4859 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.083896:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c501b600/0x9104b1ba770a4859 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.083913:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c501b600/0x9104b1ba770a4859 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.083921:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c501b600/0x9104b1ba770a4859 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.083940:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343277.083942:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343277.083944:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343277.083980:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c3729c00/2, rc 0, transno 21474839288 00000100:00100000:0.0:1763343277.083988:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c3729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413002368:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1763343277.083999:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c372b800/2, rc 0, transno 21474839287 00000100:00100000:0.0:1763343277.084003:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c372b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413002496:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763343277.084308:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6401500/2, rc 0, transno 21474839289 00000100:00100000:1.0:1763343277.084314:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6401500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413002624:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343277.084333:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399953024 00000100:00100000:1.0:1763343277.084338:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399953024 00000100:00100000:1.0:1763343277.084376:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10899 00000100:00100000:1.0:1763343277.084383:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:55884:x1848998399953024:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343277.084396:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.084412:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4867 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49c88 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.084632:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a486e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343277.084643:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a486e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.084652:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a486e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.084660:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4875 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343277.084667:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4875 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.084672:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4875 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.084719:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a487c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343277.084725:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a487c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.084731:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a487c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343277.084740:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21b:0x0]: returning size 0 00010000:00010000:1.0:1763343277.084817:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a486e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.084825:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a486e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.084831:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a486e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.084838:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a486e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.084844:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.084848:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a486e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.084854:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a486e lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.084864:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c497ef00) 00010000:00010000:1.0:1763343277.084867:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.084870:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a486e lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.084876:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a486e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.084886:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4875 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.084895:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4875 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.084900:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4875 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.084906:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.084910:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4875 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.084920:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4875 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.084929:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758000) 00010000:00010000:1.0:1763343277.084932:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.084935:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4875 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00080000:2.0:1763343277.084940:0:6527:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00010000:00010000:1.0:1763343277.084942:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4875 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000100:00100000:2.0:1763343277.084965:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8544450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57166:x1848998399952000:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 33132us (33900us total) trans 4294973813 rc 0/0 00010000:00010000:1.0:1763343277.084973:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a483d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT1 00000100:00100000:2.0:1763343277.084976:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3839 00010000:00010000:1.0:1763343277.084986:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a483d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343277.084993:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a483d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343277.084999:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.085002:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a483d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343277.085009:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a483d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343277.085017:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:1.0:1763343277.085019:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343277.085040:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a483d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343277.085047:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a483d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343277.085149:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4867 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c88 expref: 308 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.085167:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a487c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c88 expref: 307 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.085174:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c497e500) 00010000:00010000:1.0:1763343277.085176:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343277.085178:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176200, rc 0) 00000100:00100000:1.0:1763343277.085473:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:55884:x1848998399953024:12345-192.168.201.40@tcp:101:bash.0 Request processed in 1087us (3178us total) trans 4294973816 rc 0/0 00000100:00100000:1.0:1763343277.085480:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10899 00010000:00010000:3.0:1763343277.087408:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a47a3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.087425:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a47a3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.087432:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a47a3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.087440:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343277.087446:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a47a3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.087454:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a47a3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.087473:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:3.0:1763343277.087476:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343277.087481:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a47a3 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.087487:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a47a3 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.087503:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a481a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.087509:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a481a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.087514:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a481a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.087520:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343277.087523:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a481a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.087528:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a481a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.087537:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:3.0:1763343277.087539:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343277.087542:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a481a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.087547:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a481a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x218:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.087558:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4813 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343277.087563:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4813 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343277.087568:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4813 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343277.087573:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343277.087576:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4813 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343277.087581:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4813 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343277.087587:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758000) 00010000:00010000:3.0:1763343277.087590:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343277.087592:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4813 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343277.087598:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4813 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000100:00100000:0.0:1763343277.088768:0:28562:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f648a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28562:1848998413002112:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343277.088802:0:28562:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a484b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343277.088840:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.088866:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399953152 00000100:00100000:0.0:1763343277.088874:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399953152 00010000:00010000:0.0:1763343277.088906:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fd800/0x9104b1ba770a475d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c42 expref: 22 pid: 8413 timeout: 1170 lvb_type: 0 00000100:00100000:0.0:1763343277.088936:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3545 00000100:00100000:0.0:1763343277.088944:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6401f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399953152:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343277.088959:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343277.088965:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fd800/0x9104b1ba770a475d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c42 expref: 22 pid: 8413 timeout: 1170 lvb_type: 0 00010000:00010000:0.0:1763343277.088975:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fd800/0x9104b1ba770a475d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c42 expref: 22 pid: 8413 timeout: 1170 lvb_type: 0 00010000:00010000:0.0:1763343277.089000:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.089002:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.089008:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a4860 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.089364:0:35281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fd800/0x9104b1ba770a475d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c42 expref: 22 pid: 8413 timeout: 1170 lvb_type: 0 00000100:00100000:3.0:1763343277.089379:0:35281:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6505880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35281:1848998413002752:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343277.089694:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a4860 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.089851:0:35281:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a4860 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.089855:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343277.089866:0:35281:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a4860 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.089876:0:35281:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a4860 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.089886:0:35281:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a4860 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.089896:0:35281:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a4860 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.089928:0:35281:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343277.089953:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343277.089963:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a4860 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.089972:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f400 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343277.089977:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a4860 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.089988:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a4860 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343277.089999:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:1.0:1763343277.090003:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a4860 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.090049:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c583f400/0x9104b1ba770a4860 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.090071:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343277.090074:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343277.090076:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343277.090308:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c3728a80/2, rc 0, transno 21474839290 00000100:00100000:1.0:1763343277.090316:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c3728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413002240:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343277.090372:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6401f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399953152:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 983us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.090382:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3545 00000100:00100000:0.0:1763343277.090406:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399953280 00000100:00100000:0.0:1763343277.090412:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399953280 00010000:00010000:0.0:1763343277.090432:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4748 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c3b expref: 15 pid: 8412 timeout: 1170 lvb_type: 0 00000100:00100000:0.0:1763343277.090949:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3546 00000100:00100000:0.0:1763343277.090960:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6505880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998399953280:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343277.090977:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343277.090982:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4748 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c3b expref: 15 pid: 8412 timeout: 1170 lvb_type: 0 00010000:00010000:0.0:1763343277.090996:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4748 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c3b expref: 15 pid: 8412 timeout: 1170 lvb_type: 0 00010000:00010000:0.0:1763343277.091049:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4748 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c3b expref: 15 pid: 8412 timeout: 1170 lvb_type: 0 00010000:00010000:0.0:1763343277.091062:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.091064:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.091068:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a484b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.091077:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a484b lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.091101:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343277.091166:0:28562:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a484b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.091178:0:28562:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a484b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.091193:0:28562:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a484b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.091201:0:28562:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a484b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.091218:0:28562:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343277.091477:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343277.091483:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a484b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.091491:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343277.091495:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a484b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.091503:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a484b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.091515:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a484b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.091524:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a484b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.091540:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343277.091542:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343277.091543:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343277.093144:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6505880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399953280:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 2174us (3135us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.093159:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3546 00000100:00100000:2.0:1763343277.093966:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6276d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+9:3661:x1848998413001600:12345-0@lo:6:osp-syn-1-1.0 Request processed in 16237us (16733us total) trans 17179872019 rc 0/0 00000100:00100000:2.0:1763343277.093977:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7447 00000004:00080000:0.0:1763343277.094100:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401edc18e00/2, rc 0, transno 17179872019 00000100:00100000:0.0:1763343277.094108:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413001600:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343277.094286:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+26:3662:x1848998413002240:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11222us (13272us total) trans 21474839290 rc 0/0 00000100:00100000:3.0:1763343277.094294:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7452 00000100:00100000:1.0:1763343277.094310:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.094353:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.094355:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399953408 00000100:00100000:2.0:1763343277.094364:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399953408 00000100:00100000:2.0:1763343277.094407:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399953536 00000100:00100000:2.0:1763343277.094409:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399953536 00000100:00100000:2.0:1763343277.094430:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10900 00000100:00100000:2.0:1763343277.094438:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57166:x1848998399953408:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.094459:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.094481:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a488a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49c8f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.094537:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a488a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c8f expref: 304 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.094551:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e400/0x9104b1ba770a488a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c8f expref: 304 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.094569:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:2.0:1763343277.094572:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343277.094575:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583e400, rc 0) 00000100:00100000:2.0:1763343277.094608:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57166:x1848998399953408:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 171us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.094615:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10900 00000100:00100000:2.0:1763343277.094627:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10901 00000100:00100000:2.0:1763343277.094633:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f648bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:55884:x1848998399953536:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343277.094641:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.094649:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4891 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49c96 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.094667:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4898 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343277.094675:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4898 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.094683:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4898 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.094778:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4891 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c96 expref: 305 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.094793:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4898 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c96 expref: 304 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.094800:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c497e500) 00010000:00010000:2.0:1763343277.094803:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343277.094806:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583ec00, rc 0) 00000100:00100000:2.0:1763343277.094834:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f648bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:55884:x1848998399953536:12345-192.168.201.40@tcp:101:bash.0 Request processed in 201us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.094842:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10901 00000100:00100000:3.0:1763343277.097317:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.098884:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.098974:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399954048 00000100:00100000:2.0:1763343277.098985:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399954048 00000100:00100000:2.0:1763343277.099072:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3842 00000100:00100000:2.0:1763343277.099082:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57166:x1848998399954048:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:2.0:1763343277.099329:0:6527:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x218:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1763343277.099392:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1786, 64 off148416 00000040:00080000:2.0:1763343277.099422:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1795, 64 off149176 00000040:00080000:2.0:1763343277.099432:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1796, 64 off149240 00000040:00080000:2.0:1763343277.099441:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1787, 64 off148480 00010000:00010000:2.0:1763343277.099497:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a489f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x218:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343277.099513:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a489f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x218:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343277.099526:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a489f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x218:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343277.099534:0:6527:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a489f lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x218:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343277.099542:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a489f lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x218:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343277.099548:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a489f lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x218:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343277.099577:0:6527:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343277.099709:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399953792 00000100:00100000:0.0:1763343277.099716:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399953792 00000100:00100000:2.0:1763343277.099763:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57166:x1848998399954048:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 680us (884us total) trans 4294973817 rc 0/0 00000100:00100000:2.0:1763343277.099776:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3842 00000100:00100000:1.0:1763343277.099904:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10902 00000100:00100000:1.0:1763343277.099912:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:55884:x1848998399953792:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:1.0:1763343277.099946:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343277.099967:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a487c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c88 expref: 305 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.099980:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c497e500) 00010000:00010000:1.0:1763343277.099985:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343277.100128:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a48a6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343277.100139:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a48a6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.100147:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a48a6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000001:00080000:1.0:1763343277.100185:0:9827:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973818 00000004:00010000:1.0:1763343277.100206:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000221a220d reply state 000000008b6eff0d transno 4294973819 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a48a6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.100222:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a48a6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.100465:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c497e500) 00010000:00010000:1.0:1763343277.100468:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343277.100471:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343277.100541:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:55884:x1848998399953792:12345-192.168.201.40@tcp:36:bash.0 Request processed in 629us (3234us total) trans 4294973819 rc 0/0 00000100:00100000:1.0:1763343277.100548:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10902 00000020:00080000:1.0:1763343277.100552:0:9827:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1763343277.100760:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343277.100768:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a489f lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x218:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343277.100775:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583e000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343277.100779:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a489f lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x218:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343277.100790:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a489f lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x218:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343277.100800:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x218:0x0].0x0 (ffff9400c497e900) 00010000:00010000:3.0:1763343277.100802:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343277.100806:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a489f lrc: 1/0,0 mode: --/PW res: [0x240000404:0x218:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343277.100811:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a489f lrc: 0/0,0 mode: --/PW res: [0x240000404:0x218:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343277.100822:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343277.100824:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343277.100826:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343277.107418:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.107477:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399954176 00000100:00100000:2.0:1763343277.107488:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399954176 00000100:00100000:2.0:1763343277.107550:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10903 00000100:00100000:2.0:1763343277.107561:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:55884:x1848998399954176:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343277.107586:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.107609:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a48ad lrc: 2/0,0 mode: --/CR res: [0x240000404:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49c9d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.107667:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a48ad lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c9d expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.107681:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a48ad lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c9d expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.107698:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c497e500) 00010000:00010000:2.0:1763343277.107700:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343277.107704:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583e800, rc 0) 00000100:00100000:0.0:1763343277.107910:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.107919:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:55884:x1848998399954176:12345-192.168.201.40@tcp:101:bash.0 Request processed in 356us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.107929:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10903 00000100:00100000:2.0:1763343277.107949:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399954432 00000100:00100000:2.0:1763343277.107953:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399954432 00000100:00100000:2.0:1763343277.107990:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10904 00000100:00100000:2.0:1763343277.107998:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57166:x1848998399954432:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.108007:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.108061:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a48b4 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49ca4 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.108127:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a48bb lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343277.108136:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a48bb lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.108145:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a48bb lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.108156:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a48c2 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343277.108163:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a48c2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.108169:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a48c2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.108282:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a48c9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343277.108291:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a48c9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.108298:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a48c9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343277.108308:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21b:0x0]: returning size 0 00010000:00010000:2.0:1763343277.108384:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a48bb lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.108391:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a48bb lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.108398:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a48bb lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.108404:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a48bb lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.108410:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583e000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.108414:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a48bb lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.108421:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a48bb lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.108432:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758600) 00010000:00010000:2.0:1763343277.108435:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.108439:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a48bb lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.108445:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a48bb lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.108456:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a48c2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.108462:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a48c2 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.108467:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a48c2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.108472:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.108474:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a48c2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.108484:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a48c2 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.108490:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758d00) 00010000:00010000:2.0:1763343277.108492:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.108495:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a48c2 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.108500:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a48c2 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.108534:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a48b4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ca4 expref: 311 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.108547:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a48c9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ca4 expref: 310 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.108554:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c497e500) 00010000:00010000:2.0:1763343277.108557:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343277.108559:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f600, rc 0) 00000100:00100000:2.0:1763343277.108605:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57166:x1848998399954432:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 607us (695us total) trans 4294973820 rc 0/0 00000100:00100000:2.0:1763343277.108612:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10904 00000100:00100000:0.0:1763343277.111726:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.113202:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399954688 00000100:00100000:1.0:1763343277.113218:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399954688 00000100:00100000:0.0:1763343277.114168:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.116329:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10905 00000100:00100000:1.0:1763343277.116355:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:55884:x1848998399954688:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343277.116381:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.116385:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343277.116418:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a48ad lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c9d expref: 310 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.116443:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c497e500) 00010000:00010000:1.0:1763343277.116449:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343277.116465:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a48d7 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49cab expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.116514:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a48de lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343277.116529:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a48c9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ca4 expref: 310 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.116539:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a48de lrc: 4/0,1 mode: --/EX res: [0x240000404:0x21b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.116576:0:9827:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a48c9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ca4 expref: 310 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.116590:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a48c9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ca4 expref: 310 pid: 7641 timeout: 1170 lvb_type: 0 00000100:00100000:1.0:1763343277.116604:0:9827:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6488700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998413002880:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343277.116714:0:9827:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c7e54900 going to sleep for 11 seconds 00000100:00100000:3.0:1763343277.117840:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399954816 00000100:00100000:3.0:1763343277.117851:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399954816 00000100:00100000:3.0:1763343277.117910:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7454 00000100:00100000:3.0:1763343277.117919:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399954816:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343277.117933:0:35281:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.118012:0:35281:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a48e5 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49cb2 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343277.118078:0:35281:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343277.118098:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.118100:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.118110:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a48e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cb2 expref: 15 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343277.118126:0:35281:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a48e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cb2 expref: 15 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343277.118139:0:35281:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583ea00, rc 0) 00000100:00100000:2.0:1763343277.118193:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998399954816:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 275us (4032us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.118201:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7454 00000100:00100000:0.0:1763343277.123449:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.123546:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.123618:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399954944 00000100:00100000:2.0:1763343277.123625:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399955072 00000100:00100000:3.0:1763343277.123629:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399954944 00000100:00100000:2.0:1763343277.123632:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399955072 00010000:00010000:2.0:1763343277.123671:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a48c9 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ca4 expref: 311 pid: 7641 timeout: 1170 lvb_type: 0 00000100:00100000:3.0:1763343277.123699:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7455 00000100:00100000:2.0:1763343277.123704:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3547 00000100:00100000:3.0:1763343277.123717:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998399954944:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:2.0:1763343277.123718:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:2410:x1848998399955072:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343277.123738:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343277.123739:0:35281:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.123746:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a48c9 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ca4 expref: 311 pid: 7641 timeout: 1170 lvb_type: 0 00010000:00010000:3.0:1763343277.123760:0:35281:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d000/0x9104b1ba770a48ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49cb9 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.123761:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a48c9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ca4 expref: 311 pid: 7641 timeout: 1170 lvb_type: 0 00002000:00010000:3.0:1763343277.123797:0:35281:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343277.123797:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c497e500) 00010000:00010000:2.0:1763343277.123807:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a48de lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343277.123817:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343277.123820:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.123823:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a48de lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343277.123829:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d000/0x9104b1ba770a48ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cb9 expref: 22 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343277.123836:0:6511:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a48de lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343277.123848:0:35281:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d000/0x9104b1ba770a48ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cb9 expref: 22 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343277.123859:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343277.123861:0:35281:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5b3d000, rc 0) 00000100:00100000:2.0:1763343277.123912:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:2410:x1848998399955072:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 199us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343277.123914:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2408:x1848998399954944:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 202us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.123925:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3547 00000100:00100000:3.0:1763343277.123929:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7455 00010000:00010000:1.0:1763343277.124014:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a48c9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ca4 expref: 310 pid: 7641 timeout: 1170 lvb_type: 0 00000100:00100000:1.0:1763343277.124052:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6488700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998413002880:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343277.124071:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a48de lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.124079:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a48de lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.124084:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a48de lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000040:00080000:1.0:1763343277.124320:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1788, 88 off148568 00000004:00080000:1.0:1763343277.124327:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1070248302300ns, next at 1071106445174ns, rc = 0 00000040:00080000:1.0:1763343277.124361:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1797, 88 off149328 00000004:00080000:1.0:1763343277.124365:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1070248340375ns, next at 1071106415333ns, rc = 0 00000040:00080000:1.0:1763343277.124377:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1798, 88 off149416 00000004:00080000:1.0:1763343277.124380:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1070248355278ns, next at 1071106415333ns, rc = 0 00000040:00080000:1.0:1763343277.124387:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1789, 88 off148656 00000004:00080000:1.0:1763343277.124390:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1070248365370ns, next at 1071106445174ns, rc = 0 00000100:00100000:3.0:1763343277.130494:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.130568:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399955200 00000100:00100000:3.0:1763343277.130578:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399955200 00000100:00100000:3.0:1763343277.130633:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10906 00000100:00100000:3.0:1763343277.130645:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57166:x1848998399955200:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343277.130671:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343277.130695:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a48f3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49cc0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1763343277.130716:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973821 is committed 00000004:00080000:1.0:1763343277.130724:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1147 committed 00000004:00080000:1.0:1763343277.130740:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1155 committed 00010000:00010000:2.0:1763343277.130743:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a48a6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00000004:00080000:1.0:1763343277.130749:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1154 committed 00000004:00080000:1.0:1763343277.130751:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1146 committed 00010000:00010000:2.0:1763343277.130753:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a48a6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.130759:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a48a6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00000100:00100000:0.0:1763343277.130891:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413003392:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343277.130951:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343277.130985:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763343277.130991:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413003008:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343277.131010:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343277.131281:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413003264:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343277.131305:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343277.131324:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763343277.131328:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413003136:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1763343277.131459:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a48de lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:0.0:1763343277.131484:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343277.131524:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413003392 00000100:00100000:0.0:1763343277.131529:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413003392 00010000:00010000:3.0:1763343277.131544:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a48f3 lrc: 4/0,0 mode: --/CR res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cc0 expref: 304 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.131557:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.131571:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a48de lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x21b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cab expref: 305 pid: 9827 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343277.131606:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413003008 00000100:00100000:0.0:1763343277.131611:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413003008 00000100:00100000:0.0:1763343277.131626:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413003264 00000100:00100000:0.0:1763343277.131628:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413003264 00000100:00100000:0.0:1763343277.131641:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413003136 00000100:00100000:0.0:1763343277.131643:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413003136 00000100:00100000:0.0:1763343277.131660:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7456 00000100:00100000:0.0:1763343277.131666:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+29:3661:x1848998413003392:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1763343277.131768:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a48f3 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cc0 expref: 305 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.131790:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c497e500) 00010000:00010000:3.0:1763343277.131793:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343277.131797:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a48f3 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cc0 expref: 305 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.131807:0:6525:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a48f3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cc0 expref: 305 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.131813:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a48f3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cc0 expref: 305 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.131838:0:6525:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a48f3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cc0 expref: 305 pid: 6525 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343277.131848:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b26300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998413003520:192.168.201.40@tcp:105: 00000100:00100000:3.0:1763343277.131909:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c8284540 going to sleep for 11 seconds 00000100:00100000:3.0:1763343277.131992:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413003776:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343277.132019:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343277.132212:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c497e500) 00010000:00010000:2.0:1763343277.132213:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a48a6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.132216:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343277.132223:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a48a6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.132240:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a48d7 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cab expref: 305 pid: 9827 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763343277.132242:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c497e500) 00010000:00010000:2.0:1763343277.132245:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:0.0:1763343277.132245:0:28562:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2d5:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:2.0:1763343277.132250:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a48a6 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00002000:00010000:0.0:1763343277.132252:0:28562:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2d5:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343277.132259:0:28562:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2d5:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:1.0:1763343277.132260:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a48de lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cab expref: 304 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.132262:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a48a6 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00002000:00010000:0.0:1763343277.132263:0:28562:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2d5:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343277.132279:0:28562:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2d5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343277.132469:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413003776 00000100:00100000:3.0:1763343277.132472:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763343277.132476:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413003776 00000100:00100000:1.0:1763343277.132480:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7457 00000100:00100000:3.0:1763343277.132483:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413003904:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343277.132492:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+30:3661:x1848998413003008:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763343277.132512:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7458 00002000:00080000:1.0:1763343277.132513:0:11289:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:720 count 1 00000100:00100000:3.0:1763343277.132518:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343277.132523:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+30:3660:x1848998413003264:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1763343277.132530:0:11289:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176000/0x9104b1ba770a48fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.132547:0:11289:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c583fe00/0x9104b1ba770a46ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c11 expref: 21 pid: 8413 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1763343277.132553:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413003904 00000100:00100000:3.0:1763343277.132559:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413003904 00010000:00010000:1.0:1763343277.132564:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343277.132569:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343277.132572:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176000/0x9104b1ba770a48fa lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343277.132587:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7459 00000100:00100000:3.0:1763343277.132598:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+31:3660:x1848998413003136:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1763343277.132599:0:11289:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c583fe00/0x9104b1ba770a46ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c11 expref: 21 pid: 8413 timeout: 0 lvb_type: 1 00002000:00080000:3.0:1763343277.132615:0:8412:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:721 count 1 00010000:00010000:1.0:1763343277.132617:0:11289:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c583fe00/0x9104b1ba770a46ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c11 expref: 21 pid: 8413 timeout: 1170 lvb_type: 1 00000100:00100000:2.0:1763343277.132622:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+31:3660:x1848998413003264:12345-0@lo:2:osp-syn-0-1.0 Request processed in 101us (1314us total) trans 21474839292 rc 0/0 00000100:00100000:2.0:1763343277.132629:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7458 00010000:00010000:3.0:1763343277.132631:0:8412:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4901 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343277.132632:0:11289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6488700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11289:1848998413004160:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343277.132650:0:8412:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c583fc00/0x9104b1ba770a47c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c5e expref: 21 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343277.132653:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7460 00010000:00010000:3.0:1763343277.132663:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1763343277.132664:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+10:3659:x1848998413003776:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763343277.132666:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343277.132671:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4901 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343277.132673:0:11289:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc6d480 going to sleep for 11 seconds 00002000:00080000:2.0:1763343277.132679:0:27798:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:722 count 1 00000100:00100000:1.0:1763343277.132695:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7461 00010000:00010000:2.0:1763343277.132696:0:27798:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4908 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.132698:0:8412:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c583fc00/0x9104b1ba770a47c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c5e expref: 21 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.132719:0:8412:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c583fc00/0x9104b1ba770a47c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c5e expref: 21 pid: 8412 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.132719:0:27798:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a47bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c57 expref: 14 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.132739:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343277.132743:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1763343277.132745:0:8412:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998413004288:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343277.132747:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4908 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.132775:0:27798:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a47bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c57 expref: 14 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.132785:0:27798:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a47bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c57 expref: 14 pid: 8413 timeout: 1170 lvb_type: 0 00000100:00100000:3.0:1763343277.132791:0:8412:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c8284480 going to sleep for 11 seconds 00000100:00100000:0.0:1763343277.132873:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+30:3661:x1848998413003392:12345-0@lo:2:osp-syn-0-1.0 Request processed in 1206us (1921us total) trans 21474839291 rc 0/0 00000100:00100000:0.0:1763343277.132880:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7456 00000004:00080000:0.0:1763343277.132932:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bff800/2, rc 0, transno 21474839292 00000100:00100000:0.0:1763343277.132937:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413003264:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343277.132952:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+10:3659:x1848998413003904:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343277.132955:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413004032:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343277.132983:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1763343277.133014:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bfc380/2, rc 0, transno 21474839291 00000100:00100000:0.0:1763343277.133018:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413003392:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343277.133049:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763343277.133055:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413003648:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343277.133088:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343277.133112:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413004032 00000100:00100000:0.0:1763343277.133116:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413004032 00000100:00100000:0.0:1763343277.133134:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413003648 00000100:00100000:0.0:1763343277.133137:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413003648 00000100:00100000:0.0:1763343277.133154:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7462 00000100:00100000:0.0:1763343277.133161:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+12:3661:x1848998413004032:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343277.133175:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7463 00000100:00100000:0.0:1763343277.133180:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+12:3661:x1848998413003648:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343277.133699:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+13:3659:x1848998413003904:12345-0@lo:2:osp-syn-1-1.0 Request processed in 994us (1181us total) trans 17179872020 rc 0/0 00000100:00100000:1.0:1763343277.133707:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7461 00000004:00080000:1.0:1763343277.133740:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b27800/2, rc 0, transno 17179872020 00000100:00100000:1.0:1763343277.133745:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413003904:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1763343277.133768:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c497e500) 00010000:00010000:1.0:1763343277.133771:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343277.133774:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176c00, rc 0) 00000100:00100000:1.0:1763343277.133801:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:55884:x1848998399954688:12345-192.168.201.40@tcp:101:bash.0 Request processed in 17458us (22091us total) trans 4294973821 rc 0/0 00000100:00100000:1.0:1763343277.133810:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10905 00000100:00100000:2.0:1763343277.133896:0:27798:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c372b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:27798:1848998413004416:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343277.133929:0:27798:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c45320c0 going to sleep for 11 seconds 00002000:00080000:2.0:1763343277.134654:0:8626:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:721 count 1 00010000:00010000:2.0:1763343277.134674:0:8626:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c583f400/0x9104b1ba770a490f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.134690:0:8626:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a45ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49baf expref: 14 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.134698:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343277.134700:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343277.134703:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583f400/0x9104b1ba770a490f lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.134733:0:8626:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a45ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49baf expref: 14 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.134745:0:8626:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a45ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49baf expref: 14 pid: 8412 timeout: 1170 lvb_type: 0 00000100:00100000:2.0:1763343277.134757:0:8626:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c511ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998413004544:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343277.134795:0:8626:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c4532840 going to sleep for 11 seconds 00002000:00010000:0.0:1763343277.134867:0:28561:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2d6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343277.134871:0:28561:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2d6:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343277.134873:0:28561:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2d6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343277.134875:0:28561:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2d6:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343277.134877:0:28561:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2d6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343277.134929:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+13:3661:x1848998413004032:12345-0@lo:2:osp-syn-1-1.0 Request processed in 1766us (1942us total) trans 17179872021 rc 0/0 00000100:00100000:0.0:1763343277.134938:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7462 00000004:00080000:2.0:1763343277.134962:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b2d500/2, rc 0, transno 17179872021 00000100:00100000:2.0:1763343277.135088:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413004032:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343277.137634:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.137667:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399955328 00000100:00100000:2.0:1763343277.137675:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399955328 00010000:00010000:2.0:1763343277.137713:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583fe00/0x9104b1ba770a46ed lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c11 expref: 22 pid: 8413 timeout: 1170 lvb_type: 1 00000100:00100000:3.0:1763343277.137739:0:8412:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998413004288:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343277.137753:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3548 00000100:00100000:2.0:1763343277.137763:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c511d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399955328:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343277.137777:0:8412:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4901 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.137780:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343277.137791:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c583fe00/0x9104b1ba770a46ed lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c11 expref: 22 pid: 8413 timeout: 1170 lvb_type: 1 00010000:00010000:2.0:1763343277.137804:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c583fe00/0x9104b1ba770a46ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c11 expref: 22 pid: 8413 timeout: 1170 lvb_type: 1 00010000:00010000:2.0:1763343277.137830:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.137832:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.137838:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176000/0x9104b1ba770a48fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343277.137842:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:2.0:1763343277.137852:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176000/0x9104b1ba770a48fa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343277.137870:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399955456 00010000:00010000:2.0:1763343277.137874:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343277.137876:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399955456 00010000:00010000:3.0:1763343277.137897:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583fc00/0x9104b1ba770a47c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c5e expref: 23 pid: 8412 timeout: 1170 lvb_type: 0 00000100:00100000:2.0:1763343277.137923:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c511d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2407:x1848998399955328:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 159us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343277.137928:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3549 00000100:00100000:2.0:1763343277.137937:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3548 00000100:00100000:3.0:1763343277.137942:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2407:x1848998399955456:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343277.137951:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343277.137956:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c583fc00/0x9104b1ba770a47c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c5e expref: 22 pid: 8412 timeout: 1170 lvb_type: 0 00010000:00010000:3.0:1763343277.137967:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c583fc00/0x9104b1ba770a47c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c5e expref: 22 pid: 8412 timeout: 1170 lvb_type: 0 00010000:00010000:3.0:1763343277.137980:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c583fc00/0x9104b1ba770a47c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c5e expref: 22 pid: 8412 timeout: 1170 lvb_type: 0 00010000:00010000:3.0:1763343277.137991:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343277.137993:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343277.137997:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4901 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.138005:0:6511:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4901 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.138059:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343277.138068:0:11289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c583fe00/0x9104b1ba770a46ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c11 expref: 21 pid: 8413 timeout: 1170 lvb_type: 1 00000100:00100000:1.0:1763343277.138081:0:11289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6488700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11289:1848998413004160:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343277.138087:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399955456:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 146us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343277.138095:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3549 00010000:00010000:1.0:1763343277.138101:0:11289:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5176000/0x9104b1ba770a48fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.138112:0:11289:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5176000/0x9104b1ba770a48fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.138120:0:11289:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5176000/0x9104b1ba770a48fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.138129:0:11289:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176000/0x9104b1ba770a48fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.138136:0:11289:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176000/0x9104b1ba770a48fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.138157:0:11289:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343277.138441:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b26300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998413003520:192.168.201.40@tcp:105: 00010000:00010000:0.0:1763343277.138458:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5b3d200, rc 0) 00000100:00100000:0.0:1763343277.138490:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57166:x1848998399955200:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 7848us (8467us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.138498:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+30:3661:x1848998413003008:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6007us (7485us total) trans 21474839293 rc 0/0 00000100:00100000:0.0:1763343277.138499:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10906 00000100:00100000:1.0:1763343277.138511:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7457 00000004:00080000:2.0:1763343277.138619:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6401180/2, rc 0, transno 21474839293 00000100:00100000:2.0:1763343277.138626:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413003008:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1763343277.138642:0:8412:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4901 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.138650:0:8412:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4901 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.138658:0:8412:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4901 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.138665:0:8412:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4901 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.138687:0:8412:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1763343277.138805:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+30:3660:x1848998413003136:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6209us (7458us total) trans 21474839294 rc 0/0 00000100:00100000:2.0:1763343277.138812:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7459 00010000:00010000:1.0:1763343277.138861:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763343277.138868:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5176000/0x9104b1ba770a48fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.138876:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343277.138880:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5176000/0x9104b1ba770a48fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.138888:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5176000/0x9104b1ba770a48fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.138901:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5176000/0x9104b1ba770a48fa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.138908:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176000/0x9104b1ba770a48fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.138922:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343277.138925:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4901 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.138931:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5b3c400 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343277.138934:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4901 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.138941:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4901 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.138950:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4901 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.138961:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4901 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.138972:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343277.138974:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343277.138975:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343277.139161:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bfe680/2, rc 0, transno 21474839294 00000100:00100000:0.0:1763343277.139167:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413003136:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1763343277.140141:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343277.142287:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.142365:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.142386:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399955584 00000100:00100000:2.0:1763343277.142398:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399955584 00000100:00100000:0.0:1763343277.142413:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.142436:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399955840 00000100:00100000:0.0:1763343277.142440:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399955840 00000100:00100000:2.0:1763343277.142454:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3843 00000100:00100000:2.0:1763343277.142468:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:55884:x1848998399955584:12345-192.168.201.40@tcp:49:bash.0 00010000:00010000:0.0:1763343277.142469:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a45ce lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49baf expref: 15 pid: 8412 timeout: 1170 lvb_type: 0 00000100:00100000:0.0:1763343277.142497:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399955712 00000100:00100000:0.0:1763343277.142500:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399955712 00010000:00010000:0.0:1763343277.142513:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a47bf lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c57 expref: 16 pid: 8413 timeout: 1170 lvb_type: 0 00000100:00100000:0.0:1763343277.142530:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3550 00000100:00100000:0.0:1763343277.142539:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401d84f2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399955840:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343277.142551:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343277.142557:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a45ce lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49baf expref: 16 pid: 8412 timeout: 1170 lvb_type: 0 00010000:00010000:0.0:1763343277.142568:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a45ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49baf expref: 16 pid: 8412 timeout: 1170 lvb_type: 0 00000100:00100000:2.0:1763343277.142595:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:55884:x1848998399955584:12345-192.168.201.40@tcp:49:bash.0 Request processed in 130us (323us total) trans 0 rc 0/0 00010000:00010000:0.0:1763343277.142598:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.142602:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1763343277.142606:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3843 00010000:00010000:0.0:1763343277.142609:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c583f400/0x9104b1ba770a490f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.142621:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583f400/0x9104b1ba770a490f lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.142643:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343277.142667:0:8626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a45ce lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49baf expref: 16 pid: 8412 timeout: 1170 lvb_type: 0 00000100:00100000:0.0:1763343277.142667:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401d84f2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399955840:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 127us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.142683:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3550 00000100:00100000:2.0:1763343277.142693:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c511ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998413004544:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343277.142722:0:8626:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c583f400/0x9104b1ba770a490f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.142735:0:8626:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c583f400/0x9104b1ba770a490f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343277.142743:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3551 00010000:00010000:2.0:1763343277.142746:0:8626:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c583f400/0x9104b1ba770a490f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343277.142753:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399955712:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343277.142762:0:8626:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c583f400/0x9104b1ba770a490f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.142764:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343277.142774:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a47bf lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c57 expref: 14 pid: 8413 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.142778:0:8626:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583f400/0x9104b1ba770a490f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.142791:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a47bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c57 expref: 14 pid: 8413 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.142801:0:8626:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343277.142807:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.142810:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.142814:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4908 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.142828:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4908 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.142841:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343277.142859:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399955712:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 109us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.142866:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3551 00000100:00100000:2.0:1763343277.143082:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3661:x1848998413003648:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9898us (9991us total) trans 17179872022 rc 0/0 00000100:00100000:2.0:1763343277.143091:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7463 00010000:00010000:2.0:1763343277.143114:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343277.143120:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c583f400/0x9104b1ba770a490f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.143128:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f400 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343277.143131:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c583f400/0x9104b1ba770a490f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.143139:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c583f400/0x9104b1ba770a490f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.143151:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c583f400/0x9104b1ba770a490f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.143158:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c583f400/0x9104b1ba770a490f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.143174:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343277.143176:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343277.143177:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343277.143198:0:27798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a47bf lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c57 expref: 13 pid: 8413 timeout: 1170 lvb_type: 0 00000100:00100000:2.0:1763343277.143207:0:27798:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c372b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:27798:1848998413004416:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343277.143217:0:27798:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4908 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.143238:0:27798:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4908 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.143244:0:27798:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4908 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.143252:0:27798:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4908 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.143259:0:27798:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4908 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.143281:0:27798:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343277.143468:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+13:3659:x1848998413003776:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10805us (11447us total) trans 17179872023 rc 0/0 00000100:00100000:2.0:1763343277.143475:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7460 00000004:00080000:2.0:1763343277.143511:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b26a00/2, rc 0, transno 17179872023 00000100:00100000:2.0:1763343277.143517:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413003776:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1763343277.143540:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b25500/2, rc 0, transno 17179872022 00000100:00100000:2.0:1763343277.143544:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413003648:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1763343277.143754:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343277.143760:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4908 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.143768:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583e600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343277.143771:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4908 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.143779:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4908 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.143790:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4908 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.143797:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4908 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.143812:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343277.143814:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343277.143815:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343277.146101:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.146531:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.146590:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399956096 00000100:00100000:1.0:1763343277.146601:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399956096 00000100:00100000:1.0:1763343277.146666:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7464 00000100:00100000:1.0:1763343277.146676:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:55884:x1848998399956096:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343277.146696:0:27798:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.146719:0:27798:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a4916 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49cc7 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343277.146743:0:27798:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343277.146765:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343277.146767:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343277.146776:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a4916 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cc7 expref: 21 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.146792:0:27798:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a4916 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cc7 expref: 21 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.146805:0:27798:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176200, rc 0) 00000100:00100000:1.0:1763343277.146862:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:55884:x1848998399956096:12345-192.168.201.40@tcp:101:bash.0 Request processed in 187us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.146871:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7464 00000100:00100000:2.0:1763343277.148101:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399955968 00000100:00100000:2.0:1763343277.148111:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399955968 00000100:00100000:2.0:1763343277.148159:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3844 00000100:00100000:2.0:1763343277.148168:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8545c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57166:x1848998399955968:12345-192.168.201.40@tcp:49:lfs.0 00000100:00100000:2.0:1763343277.148295:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8545c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57166:x1848998399955968:12345-192.168.201.40@tcp:49:lfs.0 Request processed in 127us (2203us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.148302:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3844 00000100:00100000:3.0:1763343277.151281:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.151360:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.152958:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399956224 00000100:00100000:2.0:1763343277.152985:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399956224 00000100:00100000:2.0:1763343277.153100:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7465 00000100:00100000:2.0:1763343277.153112:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:55884:x1848998399956224:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343277.153133:0:8626:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.153162:0:8626:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c583e000/0x9104b1ba770a491d lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49cce expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343277.153193:0:8626:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343277.153235:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.153238:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.153247:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583e000/0x9104b1ba770a491d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cce expref: 14 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.153266:0:8626:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c583e000/0x9104b1ba770a491d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cce expref: 14 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.153279:0:8626:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583e000, rc 0) 00000100:00100000:2.0:1763343277.153349:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:55884:x1848998399956224:12345-192.168.201.40@tcp:101:bash.0 Request processed in 240us (2084us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.153357:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7465 00000100:00100000:1.0:1763343277.153522:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399956480 00000100:00100000:1.0:1763343277.153532:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399956480 00000100:00100000:1.0:1763343277.153571:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3845 00000100:00100000:1.0:1763343277.153579:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57166:x1848998399956480:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343277.153789:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57166:x1848998399956480:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 210us (2427us total) trans 4294973822 rc 0/0 00000100:00100000:1.0:1763343277.153805:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3845 00000100:00100000:3.0:1763343277.155629:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.155681:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.155969:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399956608 00000100:00100000:1.0:1763343277.155979:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399956608 00000100:00100000:0.0:1763343277.156116:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399956736 00000100:00100000:0.0:1763343277.156120:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399956736 00002000:00010000:0.0:1763343277.156141:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/725 (0->18446744073709551615) 00002000:00100000:0.0:1763343277.156146:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401efc72300 with x1848998399956736 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343277.156160:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401efc72300. 00000100:00100000:3.0:1763343277.156459:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00002000:00010000:1.0:1763343277.156636:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/724 (0->18446744073709551615) 00002000:00100000:1.0:1763343277.156641:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b2f800 with x1848998399956608 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343277.156648:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5b2f800. 00000100:00100000:0.0:1763343277.156685:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1771 00000100:00100000:0.0:1763343277.156696:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399956736:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:0.0:1763343277.156891:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2d5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343277.156896:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2d5:0x0] updating lvb mtime from disk: 0 -> 1763343276 00002000:00010000:0.0:1763343277.156899:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2d5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343277.156901:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2d5:0x0] updating lvb ctime from disk: 0 -> 1763343276 00002000:00010000:0.0:1763343277.156903:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2d5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343277.156957:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1772 00000100:00100000:2.0:1763343277.156969:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399956608:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:2.0:1763343277.157178:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2d4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343277.157181:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2d4:0x0] updating lvb mtime from disk: 0 -> 1763343276 00002000:00010000:2.0:1763343277.157183:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2d4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343277.157185:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2d4:0x0] updating lvb ctime from disk: 0 -> 1763343276 00002000:00010000:2.0:1763343277.157186:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2d4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343277.157369:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399956608:12345-192.168.201.40@tcp:10:bash.0 Request processed in 400us (1748us total) trans 21474839295 rc 0/0 00000100:00100000:0.0:1763343277.157371:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998399956736:12345-192.168.201.40@tcp:10:bash.0 Request processed in 674us (1686us total) trans 17179872024 rc 0/0 00000100:00100000:2.0:1763343277.157385:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1772 00002000:00010000:2.0:1763343277.157391:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/724 (0->18446744073709551615) 00002000:00100000:2.0:1763343277.157394:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b2f800 with x1848998399956608 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343277.157400:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5b2f800. 00000100:00100000:0.0:1763343277.157653:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1771 00002000:00010000:0.0:1763343277.157658:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/725 (0->18446744073709551615) 00002000:00100000:0.0:1763343277.157661:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401efc72300 with x1848998399956736 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343277.157667:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401efc72300. 00000100:00100000:0.0:1763343277.157701:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399956992 00000100:00100000:0.0:1763343277.157706:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399956992 00000100:00100000:0.0:1763343277.157912:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10907 00000100:00100000:0.0:1763343277.157920:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57166:x1848998399956992:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343277.157941:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343277.157966:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4924 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49cd5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.159376:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a492b lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343277.159402:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a492b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.159414:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a492b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.159432:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4932 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343277.159439:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4932 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.159455:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4932 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.159583:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4939 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343277.159592:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4939 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.159598:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4939 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:0.0:1763343277.159610:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21b:0x0]: returning size 2 00010000:00010000:0.0:1763343277.159694:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a492b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.159702:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a492b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.159707:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a492b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.159713:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a492b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.159719:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343277.159724:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a492b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.159730:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a492b lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.159743:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53100) 00010000:00010000:0.0:1763343277.159746:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343277.159750:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a492b lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.159756:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a492b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.159782:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4932 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.159788:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4932 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.159798:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4932 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.159803:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343277.159806:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4932 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.159811:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4932 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.159818:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53e00) 00010000:00010000:0.0:1763343277.159820:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343277.159822:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4932 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.159828:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4932 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.159881:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4924 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cd5 expref: 306 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.159897:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4939 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cd5 expref: 305 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.159904:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c497e500) 00010000:00010000:0.0:1763343277.159906:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343277.159908:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a800, rc 0) 00000100:00100000:0.0:1763343277.159986:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57166:x1848998399956992:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2065us (3527us total) trans 4294973823 rc 0/0 00000100:00100000:0.0:1763343277.159993:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10907 00000100:00100000:3.0:1763343277.169411:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.169923:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399957248 00000100:00100000:1.0:1763343277.169935:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399957248 00000100:00100000:1.0:1763343277.170010:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3846 00000100:00100000:1.0:1763343277.170061:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57166:x1848998399957248:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343277.170336:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57166:x1848998399957248:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 315us (935us total) trans 4294973824 rc 0/0 00000100:00100000:1.0:1763343277.170345:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3846 00000100:00100000:3.0:1763343277.176977:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.177136:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399957376 00000100:00100000:2.0:1763343277.177150:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399957376 00000100:00100000:1.0:1763343277.178180:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3847 00000100:00100000:1.0:1763343277.178202:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57166:x1848998399957376:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:1.0:1763343277.178400:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57166:x1848998399957376:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 206us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.178408:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3847 00000100:00100000:0.0:1763343277.180545:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.180641:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399957632 00000100:00100000:2.0:1763343277.180652:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399957632 00000100:00100000:2.0:1763343277.180714:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10908 00000100:00100000:2.0:1763343277.180724:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57166:x1848998399957632:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.180742:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.180765:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4947 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49cdc expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.180883:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a494e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343277.180897:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a494e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.180909:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a494e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:2.0:1763343277.180922:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21b:0x0]: returning size 2 00010000:00010000:2.0:1763343277.181978:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4947 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21b:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cdc expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.182001:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a494e lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x21b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cdc expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.182011:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c497e500) 00010000:00010000:2.0:1763343277.182015:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343277.182019:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f000, rc 0) 00000100:00100000:2.0:1763343277.182186:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57166:x1848998399957632:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1462us (1651us total) trans 4294973825 rc 0/0 00000100:00100000:2.0:1763343277.182194:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10908 00000100:00100000:3.0:1763343277.184538:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.184676:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399957888 00000100:00100000:2.0:1763343277.184689:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399957888 00000100:00100000:2.0:1763343277.185007:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3848 00000100:00100000:2.0:1763343277.185018:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57166:x1848998399957888:12345-192.168.201.40@tcp:35:lfs.0 00000004:00010000:2.0:1763343277.185190:0:6527:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x21b:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a494e lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x21b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cdc expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.185241:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a495c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343277.185255:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4898 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c96 expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.185263:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4939 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cd5 expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.185270:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a48de lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x21b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cab expref: 308 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.185277:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a48f3 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cc0 expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.185287:0:6527:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a495c lrc: 7/0,1 mode: --/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343277.185324:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a48f3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cc0 expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.185337:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a48f3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cc0 expref: 308 pid: 6525 timeout: 1170 lvb_type: 0 00000100:00100000:2.0:1763343277.185356:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c511ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6527:1848998413004672:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343277.185656:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a48de lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cab expref: 308 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.185666:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a48de lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x21b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cab expref: 308 pid: 9827 timeout: 1170 lvb_type: 0 00000100:00100000:2.0:1763343277.185674:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c511c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6527:1848998413004800:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343277.185707:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4939 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cd5 expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.185715:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4939 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cd5 expref: 308 pid: 6525 timeout: 1170 lvb_type: 0 00000100:00100000:2.0:1763343277.185723:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c511d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6527:1848998413004928:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343277.185752:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4898 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c96 expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.185760:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4898 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c96 expref: 308 pid: 6525 timeout: 1170 lvb_type: 0 00000100:00100000:2.0:1763343277.185769:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc2ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6527:1848998413005056:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343277.185790:0:6527:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c4532840 going to sleep for 11 seconds 00000100:00100000:2.0:1763343277.187496:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c511ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6527:1848998413004672:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343277.188105:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.188153:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399958016 00000100:00100000:2.0:1763343277.188161:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399958016 00010000:00010000:2.0:1763343277.188198:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a48f3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cc0 expref: 309 pid: 6525 timeout: 1170 lvb_type: 0 00000100:00100000:2.0:1763343277.188508:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3552 00000100:00100000:2.0:1763343277.188520:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:2407:x1848998399958016:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343277.188535:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343277.188542:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a48f3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cc0 expref: 309 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.188554:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a48f3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cc0 expref: 309 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.188578:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a48f3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cc0 expref: 309 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.188592:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c497e500) 00010000:00010000:2.0:1763343277.188597:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a495c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343277.188605:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a495c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343277.188610:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343277.188665:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:2407:x1848998399958016:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 147us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.188672:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3552 00000100:00100000:2.0:1763343277.188859:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c511c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6527:1848998413004800:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343277.189250:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.189317:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c511d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6527:1848998413004928:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343277.189326:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc2ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6527:1848998413005056:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343277.189356:0:6527:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a495c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00000100:00100000:1.0:1763343277.189464:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.189558:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399958272 00000100:00100000:0.0:1763343277.189563:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399958272 00010000:00010000:0.0:1763343277.189583:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4939 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cd5 expref: 308 pid: 6525 timeout: 1170 lvb_type: 0 00000100:00100000:1.0:1763343277.189590:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.189615:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399958144 00000100:00100000:0.0:1763343277.189619:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399958144 00010000:00010000:0.0:1763343277.189632:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a48de lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x21b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cab expref: 309 pid: 9827 timeout: 1170 lvb_type: 0 00000100:00100000:0.0:1763343277.189658:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399958400 00000100:00100000:0.0:1763343277.189662:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399958400 00010000:00010000:0.0:1763343277.189673:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4898 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c96 expref: 310 pid: 6525 timeout: 1170 lvb_type: 0 00000100:00100000:3.0:1763343277.189698:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3553 00000100:00100000:3.0:1763343277.189708:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6488700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:2409:x1848998399958272:12345-192.168.201.40@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1763343277.189708:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3554 00000100:00100000:2.0:1763343277.189714:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f648a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:2408:x1848998399958144:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343277.189718:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343277.189722:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343277.189723:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4939 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cd5 expref: 310 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.189726:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a48de lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x21b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cab expref: 310 pid: 9827 timeout: 1170 lvb_type: 0 00010000:00010000:3.0:1763343277.189733:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4939 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cd5 expref: 310 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.189756:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a48de lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cab expref: 310 pid: 9827 timeout: 1170 lvb_type: 0 00000100:00100000:1.0:1763343277.189763:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3555 00010000:00010000:2.0:1763343277.189772:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a48de lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cab expref: 310 pid: 9827 timeout: 1170 lvb_type: 0 00000100:00100000:1.0:1763343277.189772:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:2408:x1848998399958400:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343277.189781:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343277.189785:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c497e500) 00010000:00010000:1.0:1763343277.189786:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4898 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c96 expref: 309 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.189789:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a495c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343277.189796:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a495c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343277.189801:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343277.189929:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f648a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:2408:x1848998399958144:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 213us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.189937:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3554 00010000:00010000:3.0:1763343277.189938:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4939 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cd5 expref: 309 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:3.0:1763343277.189949:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c497e500) 00010000:00010000:3.0:1763343277.189954:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a495c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343277.189959:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a495c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343277.189967:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343277.190011:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4898 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c96 expref: 307 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:1.0:1763343277.190048:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4898 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49c96 expref: 307 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:1.0:1763343277.190059:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c497e500) 00010000:00010000:1.0:1763343277.190063:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a495c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343277.190070:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a495c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343277.190077:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a495c lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343277.190103:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343277.190125:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:2408:x1848998399958400:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 355us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.190131:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3555 00000100:00100000:2.0:1763343277.190236:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6488700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:2409:x1848998399958272:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 519us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.190244:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3553 00010000:00010000:3.0:1763343277.190410:0:6527:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a495c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343277.190418:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a495c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00000004:00020000:3.0:1763343277.190617:0:6527:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0001-mdtlov: can not set all stale mirrors for [0x240000404:0x21b:0x0]: rc = -1 00010000:00010000:3.0:1763343277.190649:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a495c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343277.190657:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a495c lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343277.190663:0:6527:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a495c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343277.190669:0:6527:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343277.190673:0:6527:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a495c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343277.190681:0:6527:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a495c lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343277.190689:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c497e500) 00010000:00010000:3.0:1763343277.190692:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1763343277.190696:0:6527:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a495c lrc: 2/0,0 mode: --/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343277.190702:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a495c lrc: 0/0,0 mode: --/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343277.190719:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c497e500) 00010000:00010000:3.0:1763343277.190721:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763343277.190727:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a494e lrc: 0/0,0 mode: --/PW res: [0x240000404:0x21b:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cdc expref: 304 pid: 6525 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343277.190942:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57166:x1848998399957888:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 5926us (6419us total) trans 4294973826 rc -1/-1 00000100:00100000:3.0:1763343277.190952:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3848 00000100:00100000:1.0:1763343277.192681:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.192878:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399958528 00000100:00100000:2.0:1763343277.192890:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399958528 00000100:00100000:2.0:1763343277.192952:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10909 00000100:00100000:2.0:1763343277.192962:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57166:x1848998399958528:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.192984:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.193006:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4963 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49ce3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.193085:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4963 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ce3 expref: 305 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.193099:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4963 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ce3 expref: 305 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.193118:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c4758800) 00010000:00010000:2.0:1763343277.193121:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343277.193124:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583fa00, rc 0) 00000100:00100000:2.0:1763343277.193178:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57166:x1848998399958528:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 217us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.193185:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10909 00000100:00100000:2.0:1763343277.193899:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.193947:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399958656 00000100:00100000:0.0:1763343277.193953:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399958656 00000100:00100000:0.0:1763343277.193993:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10910 00000100:00100000:0.0:1763343277.194002:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57171:x1848998399958656:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:0.0:1763343277.194011:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343277.194047:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a200/0x9104b1ba770a496a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49cea expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.194105:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a4971 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343277.194116:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a4971 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.194125:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a4971 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.194137:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4978 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343277.194143:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4978 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.194149:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4978 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.194218:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a497f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343277.194240:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a497f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.194247:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a497f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:0.0:1763343277.194281:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21b:0x0]: returning size 5 00000004:00200000:0.0:1763343277.194286:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343277.194307:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a497f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.194318:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a497f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.194328:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a4971 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.194333:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a4971 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.194338:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a4971 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.194348:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a4971 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.194353:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ae00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343277.194356:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a4971 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.194363:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a4971 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.194373:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53100) 00010000:00010000:0.0:1763343277.194376:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343277.194380:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a4971 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.194386:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a4971 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.194401:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4978 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.194406:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4978 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.194410:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4978 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.194415:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343277.194418:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4978 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.194424:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4978 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.194435:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53e00) 00010000:00010000:0.0:1763343277.194437:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343277.194440:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4978 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.194446:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4978 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.194474:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a200/0x9104b1ba770a496a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cea expref: 307 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.194487:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a497f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cea expref: 306 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.194494:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c4758800) 00010000:00010000:0.0:1763343277.194496:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343277.194498:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b000, rc 0) 00000100:00100000:0.0:1763343277.194545:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57171:x1848998399958656:12345-192.168.201.40@tcp:101:rm.0 Request processed in 544us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.194552:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10910 00000100:00100000:0.0:1763343277.196458:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.196692:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399958912 00000100:00100000:2.0:1763343277.196704:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399958912 00000100:00100000:2.0:1763343277.196762:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3849 00000100:00100000:2.0:1763343277.196773:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8546c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57166:x1848998399958912:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343277.196995:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8546c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57166:x1848998399958912:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 223us (546us total) trans 4294973827 rc 0/0 00000100:00100000:2.0:1763343277.197003:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3849 00000100:00100000:2.0:1763343277.198124:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.198169:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399959168 00000100:00100000:1.0:1763343277.198177:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399959168 00000100:00100000:1.0:1763343277.198233:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10911 00000100:00100000:1.0:1763343277.198243:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57171:x1848998399959168:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:1.0:1763343277.198284:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1763343277.198312:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a497f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cea expref: 307 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.198340:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4963 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ce3 expref: 306 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.198352:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c4758800) 00010000:00010000:1.0:1763343277.198362:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343277.198391:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4986 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343277.198403:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4986 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.198413:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4986 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.198425:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a498d lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343277.198432:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a498d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.198438:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a498d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.198517:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4994 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343277.198524:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4994 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.198530:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4994 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000040:00080000:1.0:1763343277.198763:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1790, 64 off148720 00000040:00080000:1.0:1763343277.198784:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1799, 64 off149480 00000040:00080000:1.0:1763343277.198792:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1800, 64 off149544 00000040:00080000:1.0:1763343277.198799:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1791, 64 off148784 00010000:00010000:1.0:1763343277.198837:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a499b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343277.198845:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a499b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.198851:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a499b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.198857:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a499b lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x21b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.198863:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a499b lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x21b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.198868:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a499b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x21b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.198894:0:9827:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343277.198910:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4994 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.198916:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4994 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.198922:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4994 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.198928:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.198932:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4994 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.198939:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4994 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.198948:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c38f5a00) 00010000:00010000:1.0:1763343277.198951:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343277.198954:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4994 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.198960:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4994 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.199120:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4986 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.199127:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4986 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.199132:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4986 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.199136:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4986 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.199141:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.199143:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4986 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.199148:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4986 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.199155:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:1.0:1763343277.199158:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.199161:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4986 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.199166:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4986 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000004:00010000:1.0:1763343277.199178:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005b9f892b reply state 00000000a2e89ead transno 4294973828 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a498d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.199188:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a498d lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.199193:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5000) 00010000:00010000:1.0:1763343277.199195:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343277.199198:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343277.199272:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57171:x1848998399959168:12345-192.168.201.40@tcp:36:rm.0 Request processed in 1029us (1151us total) trans 4294973828 rc 0/0 00000100:00100000:1.0:1763343277.199279:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10911 00010000:00010000:3.0:1763343277.199410:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343277.199416:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a499b lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x21b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343277.199421:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176400 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343277.199424:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a499b lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x21b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343277.199429:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a499b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x21b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343277.199437:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21b:0x0].0x0 (ffff9400c38f5a00) 00010000:00010000:3.0:1763343277.199439:0:7451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343277.199442:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a499b lrc: 1/0,0 mode: --/PW res: [0x240000404:0x21b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343277.199446:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a499b lrc: 0/0,0 mode: --/PW res: [0x240000404:0x21b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343277.199459:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343277.199460:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343277.199462:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343277.214508:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.218582:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399959296 00000100:00100000:0.0:1763343277.218600:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399959296 00000100:00100000:1.0:1763343277.218728:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10912 00000100:00100000:1.0:1763343277.218740:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57172:x1848998399959296:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343277.218767:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.218795:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a49a2 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49cf1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.218871:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a49a9 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343277.218886:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a49a9 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.218898:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a49a9 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.218909:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a49b0 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343277.218916:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a49b0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.218923:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a49b0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.218965:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a49a9 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.218971:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a49a9 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.218977:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a49a9 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.218984:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a49a9 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.218989:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.218994:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a49a9 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.219001:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a49a9 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.219013:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:1.0:1763343277.219017:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.219051:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a49a9 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.219059:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a49a9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.219071:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a49b0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.219077:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a49b0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.219083:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a49b0 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.219088:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.219091:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a49b0 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.219097:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a49b0 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.219104:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5000) 00010000:00010000:1.0:1763343277.219107:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.219110:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a49b0 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.219115:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a49b0 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.219144:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a49a2 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cf1 expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.219154:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:1.0:1763343277.219157:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.219160:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a49a2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cf1 expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.219174:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176000, rc 0) 00000100:00100000:1.0:1763343277.219257:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57172:x1848998399959296:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 518us (4759us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343277.219265:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10912 00000100:00100000:2.0:1763343277.223725:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.223790:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399959424 00000100:00100000:1.0:1763343277.223801:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399959424 00000100:00100000:1.0:1763343277.223854:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10913 00000100:00100000:1.0:1763343277.223863:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57172:x1848998399959424:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343277.223883:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.223909:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a49b7 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49cf8 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.223983:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a49be lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343277.223998:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a49be lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.224009:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a49be lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.224019:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a49c5 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343277.224146:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a49c5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.224153:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a49c5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.224192:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a49be lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.224199:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a49be lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.224205:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a49be lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.224216:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a49be lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.224222:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.224235:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a49be lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.224243:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a49be lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.224253:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5c00) 00010000:00010000:1.0:1763343277.224256:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.224261:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a49be lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.224267:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a49be lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.224278:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a49c5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.224283:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a49c5 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.224289:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a49c5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.224294:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.224297:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a49c5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.224303:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a49c5 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.224314:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5000) 00010000:00010000:1.0:1763343277.224316:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.224319:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a49c5 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.224324:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a49c5 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.224348:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a49b7 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cf8 expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.224357:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5c00) 00010000:00010000:1.0:1763343277.224360:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.224363:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a49b7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cf8 expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.224375:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176c00, rc 0) 00000100:00100000:1.0:1763343277.224439:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57172:x1848998399959424:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 577us (724us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343277.224447:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10913 00000100:00100000:2.0:1763343277.229670:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.229748:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399959552 00000100:00100000:1.0:1763343277.229759:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399959552 00000100:00100000:1.0:1763343277.229822:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10914 00000100:00100000:1.0:1763343277.229833:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57172:x1848998399959552:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343277.229855:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.229881:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a49cc lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49cff expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.229946:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a49d3 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343277.229960:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a49d3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.229971:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a49d3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:1.0:1763343277.230017:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000100:00100000:0.0:1763343277.233505:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000004:00200000:1.0:1763343277.233624:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763343277.233725:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a49cc lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cff expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.233754:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a49d3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cff expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.233764:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:1.0:1763343277.233767:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343277.233773:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176400, rc 0) 00000100:00100000:1.0:1763343277.233843:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57172:x1848998399959552:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 4011us (4184us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.233852:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10914 00000100:00100000:1.0:1763343277.233889:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399959808 00000100:00100000:1.0:1763343277.233898:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399959808 00000100:00100000:1.0:1763343277.233951:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10915 00000100:00100000:1.0:1763343277.233960:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57173:x1848998399959808:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343277.233979:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.233999:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a49da lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49d06 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.234097:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a49e1 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343277.234111:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a49e1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.234122:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a49e1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.234132:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a49e8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343277.234139:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a49e8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.234145:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a49e8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.234182:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a49e1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.234189:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a49e1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.234195:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a49e1 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.234201:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a49e1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.234206:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.234211:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a49e1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.234218:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a49e1 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.234242:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:1.0:1763343277.234245:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.234249:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a49e1 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.234255:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a49e1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.234266:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a49e8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.234271:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a49e8 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.234277:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a49e8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.234282:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.234285:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a49e8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.234290:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a49e8 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.234296:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5000) 00010000:00010000:1.0:1763343277.234298:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.234301:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a49e8 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.234305:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a49e8 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.234328:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a49da lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d06 expref: 309 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.234337:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:1.0:1763343277.234340:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343277.234344:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a49da lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d06 expref: 309 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.234352:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177c00, rc 0) 00000100:00100000:1.0:1763343277.234374:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57173:x1848998399959808:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 416us (885us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343277.234381:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10915 00000100:00100000:2.0:1763343277.237933:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.238076:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399960064 00000100:00100000:1.0:1763343277.238093:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399960064 00000100:00100000:1.0:1763343277.238173:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10916 00000100:00100000:1.0:1763343277.238184:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c511d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57172:x1848998399960064:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343277.238207:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.238211:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343277.238252:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a49d3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cff expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.238275:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:1.0:1763343277.238286:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343277.238304:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a49ef lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49d0d expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.238424:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a49f6 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343277.238439:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a49f6 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.238449:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a49f6 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.238460:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a49fd lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343277.238466:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a49fd lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.238473:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a49fd lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.238860:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4a04 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343277.238869:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4a04 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.238876:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4a04 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343277.238886:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21d:0x0]: returning size 0 00010000:00010000:1.0:1763343277.238911:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a49f6 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.238918:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a49f6 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.238925:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a49f6 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.238931:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a49f6 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.238937:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.238941:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a49f6 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.238948:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a49f6 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.238957:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5300) 00010000:00010000:1.0:1763343277.238960:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.238964:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a49f6 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.238969:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a49f6 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000004:00010000:1.0:1763343277.238979:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000404d27a7 reply state 00000000085b5ee4 transno 4294973829 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a49fd lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.238990:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a49fd lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.238995:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5000) 00010000:00010000:1.0:1763343277.238998:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343277.239000:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343277.239064:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a49ef lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d0d expref: 310 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.239082:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4a04 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d0d expref: 309 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.239089:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9400c38f5400) 00010000:00010000:1.0:1763343277.239091:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343277.239094:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177200, rc 0) 00000100:00100000:1.0:1763343277.239151:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c511d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57172:x1848998399960064:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 969us (1233us total) trans 4294973829 rc 0/0 00000100:00100000:1.0:1763343277.239158:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10916 00000100:00100000:0.0:1763343277.243242:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.243336:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399960320 00000100:00100000:2.0:1763343277.243348:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399960320 00000100:00100000:2.0:1763343277.243416:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10917 00000100:00100000:2.0:1763343277.243428:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57172:x1848998399960320:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.243458:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.243488:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4a12 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49d14 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.243628:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4a19 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343277.243645:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4a04 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d0d expref: 311 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.243657:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4a19 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.243701:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4a04 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d0d expref: 311 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.243716:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4a04 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d0d expref: 311 pid: 9827 timeout: 1170 lvb_type: 0 00000100:00100000:2.0:1763343277.243733:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c511c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998413005184:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343277.243837:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c45320c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343277.248173:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c511c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998413005184:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343277.248203:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4a19 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000100:00100000:3.0:1763343277.251254:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.251316:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.251354:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399960704 00000100:00100000:3.0:1763343277.251364:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399960704 00000100:00100000:3.0:1763343277.251432:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10918 00000100:00100000:3.0:1763343277.251443:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57174:x1848998399960704:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343277.251466:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343277.251493:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a4a20 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49d1b expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.251596:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4a27 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343277.251610:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4a27 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.251621:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4a27 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.251631:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4a2e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343277.251637:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4a2e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.251642:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4a2e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.251759:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4a35 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343277.251769:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4a35 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.251775:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4a35 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:3.0:1763343277.251790:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21d:0x0]: returning size 0 00010000:00010000:3.0:1763343277.251874:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4a35 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.251881:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4a35 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.251888:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4a35 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.251893:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5b3c400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343277.251897:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4a35 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.251904:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4a35 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.251916:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9400c38f5400) 00010000:00010000:3.0:1763343277.251919:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763343277.251924:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4a35 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.251930:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4a35 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.251947:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4a27 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.251953:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4a27 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.251958:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4a27 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.251967:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4a27 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.251971:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5bd9a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343277.251974:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4a27 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.251979:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4a27 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.251986:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4f00) 00010000:00010000:3.0:1763343277.251988:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343277.251991:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4a27 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.251997:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4a27 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.252006:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4a2e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.252010:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4a2e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.252015:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4a2e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.252019:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5b3d200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343277.252022:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4a2e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.252083:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4a2e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.252095:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5000) 00010000:00010000:3.0:1763343277.252097:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343277.252100:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4a2e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.252105:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4a2e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.252141:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a4a20 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d1b expref: 314 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.252150:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4f00) 00010000:00010000:3.0:1763343277.252153:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343277.252156:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a4a20 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d1b expref: 314 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.252167:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5bd8e00, rc 0) 00000100:00100000:3.0:1763343277.252219:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57174:x1848998399960704:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 777us (902us total) trans 4294973830 rc 301/301 00000100:00100000:3.0:1763343277.252239:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10918 00000100:00100000:1.0:1763343277.252664:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399960448 00000100:00100000:1.0:1763343277.252671:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399960448 00010000:00010000:1.0:1763343277.252696:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4a04 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d0d expref: 313 pid: 9827 timeout: 1170 lvb_type: 0 00000100:00100000:1.0:1763343277.252728:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3556 00000100:00100000:1.0:1763343277.252736:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7919880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:2408:x1848998399960448:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343277.252747:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343277.252752:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4a04 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d0d expref: 313 pid: 9827 timeout: 1170 lvb_type: 0 00010000:00010000:1.0:1763343277.252762:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4a04 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d0d expref: 313 pid: 9827 timeout: 1170 lvb_type: 0 00010000:00010000:1.0:1763343277.252775:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4a04 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d0d expref: 313 pid: 9827 timeout: 1170 lvb_type: 0 00010000:00010000:1.0:1763343277.252785:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9400c38f5400) 00010000:00010000:1.0:1763343277.252788:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4a19 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.252796:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4a19 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.252805:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4a19 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.252830:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343277.252858:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7919880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:2408:x1848998399960448:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 123us (1618us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.252864:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3556 00010000:00010000:2.0:1763343277.252933:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4a19 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.252941:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4a19 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:2.0:1763343277.252958:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21d:0x0]: returning size 0 00000004:00080000:2.0:1763343277.253131:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2d7:0x0], index 1: 0 00000004:00080000:2.0:1763343277.253138:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2d6:0x0], index 0: 0 00000004:00080000:2.0:1763343277.253143:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2d7:0x0], index 0: 0 00000004:00080000:2.0:1763343277.253147:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2d8:0x0], index 1: 0 00010000:00010000:2.0:1763343277.253241:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4a19 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.253249:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4a19 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.253255:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4a19 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.253261:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.253264:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4a19 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.253275:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4a19 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.253284:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9400c38f5400) 00010000:00010000:2.0:1763343277.253286:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343277.253289:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4a19 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.253294:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4a19 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.253327:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4a12 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x21d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d14 expref: 312 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.253335:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9400c38f5400) 00010000:00010000:2.0:1763343277.253338:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343277.253342:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4a12 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d14 expref: 312 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.253354:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583fc00, rc 0) 00000100:00100000:2.0:1763343277.253388:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57172:x1848998399960320:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 9964us (10169us total) trans 4294973831 rc 301/301 00000100:00100000:2.0:1763343277.253396:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10917 00000100:00100000:0.0:1763343277.262125:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.262771:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.263015:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399960960 00000100:00100000:2.0:1763343277.263053:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399960960 00000100:00100000:1.0:1763343277.263800:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399961216 00000100:00100000:1.0:1763343277.263807:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399961216 00000100:00100000:2.0:1763343277.263909:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3850 00000100:00100000:2.0:1763343277.263923:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57174:x1848998399960960:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343277.264289:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57174:x1848998399960960:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 368us (2175us total) trans 4294973832 rc 0/0 00000100:00100000:2.0:1763343277.264299:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3850 00000100:00100000:0.0:1763343277.265134:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3851 00000100:00100000:0.0:1763343277.265145:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57172:x1848998399961216:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343277.265314:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57172:x1848998399961216:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 171us (2543us total) trans 4294973833 rc 0/0 00000100:00100000:0.0:1763343277.265322:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3851 00000100:00100000:0.0:1763343277.270950:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.271885:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399961728 00000100:00100000:3.0:1763343277.271897:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399961728 00000100:00100000:3.0:1763343277.271968:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3852 00000100:00100000:3.0:1763343277.271982:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57172:x1848998399961728:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343277.272266:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57172:x1848998399961728:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 286us (1323us total) trans 4294973834 rc 0/0 00000100:00100000:3.0:1763343277.272426:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3852 00000100:00100000:1.0:1763343277.273496:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.273627:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399961472 00000100:00100000:3.0:1763343277.273635:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399961472 00000100:00100000:3.0:1763343277.273674:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10919 00000100:00100000:3.0:1763343277.273682:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57174:x1848998399961472:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343277.273695:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343277.273718:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4a4a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49d22 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.273783:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4a51 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343277.273796:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4a51 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.273806:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4a51 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.273816:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a4a58 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343277.273823:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a4a58 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.273829:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a4a58 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.273922:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a4a5f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343277.273930:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a4a5f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.273937:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a4a5f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:3.0:1763343277.273950:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21d:0x0]: returning size 0 00010000:00010000:3.0:1763343277.274012:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4a51 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.274018:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4a51 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.274058:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4a51 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.274065:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4a51 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.274071:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5b3c400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343277.274075:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4a51 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.274081:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4a51 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.274092:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4f00) 00010000:00010000:3.0:1763343277.274094:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343277.274098:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4a51 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.274104:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4a51 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.274116:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a4a58 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.274121:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a4a58 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.274131:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a4a58 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.274136:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5b3de00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343277.274138:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a4a58 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.274144:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a4a58 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.274150:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5000) 00010000:00010000:3.0:1763343277.274152:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343277.274155:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a4a58 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.274160:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a4a58 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.274194:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4a4a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d22 expref: 317 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.274212:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a4a5f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d22 expref: 316 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.274219:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9401fd0d4c00) 00010000:00010000:3.0:1763343277.274234:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343277.274238:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5bd8e00, rc 0) 00000100:00100000:0.0:1763343277.277596:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57174:x1848998399961472:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3899us (4087us total) trans 4294973835 rc 0/0 00000100:00100000:0.0:1763343277.277612:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10919 00000100:00100000:1.0:1763343277.281404:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.281524:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399961984 00000100:00100000:0.0:1763343277.281535:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399961984 00000100:00100000:0.0:1763343277.281771:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10920 00000100:00100000:0.0:1763343277.281783:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:55884:x1848998399961984:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343277.281809:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343277.281812:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343277.281837:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd8e00/0x9104b1ba770a4a5f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d22 expref: 316 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.281855:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9401fd0d4c00) 00010000:00010000:0.0:1763343277.281865:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343277.281881:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a4a6d lrc: 2/0,0 mode: --/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49d29 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343277.282050:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.282158:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399962112 00000100:00100000:3.0:1763343277.282163:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399962112 00000100:00100000:3.0:1763343277.282230:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10921 00000100:00100000:3.0:1763343277.282238:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c511c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57174:x1848998399962112:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343277.282247:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343277.282255:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4a74 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49d30 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.282395:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4a7b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343277.282402:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4a82 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343277.282409:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4a7b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343277.282421:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4a7b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343277.282421:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4a7b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343277.282430:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4a82 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00000004:00200000:3.0:1763343277.282443:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21d:0x0]: returning size 0 00000004:00200000:3.0:1763343277.282448:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1763343277.282451:0:6525:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4a7b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343277.282460:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4a82 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00010000:3.0:1763343277.282464:0:9827:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4a7b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343277.282488:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5bd9a00/0x9104b1ba770a4a74 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d30 expref: 319 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.282508:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4a7b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d30 expref: 318 pid: 9827 timeout: 1170 lvb_type: 0 00010000:00010000:3.0:1763343277.282518:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4a7b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d30 expref: 318 pid: 9827 timeout: 1170 lvb_type: 0 00010000:00010000:3.0:1763343277.282525:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5b3d200, rc 0) 00000100:00100000:3.0:1763343277.282639:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c511c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+318:57174:x1848998399962112:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 401us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343277.282647:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10921 00000100:00100000:1.0:1763343277.286093:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.286139:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.286151:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399962240 00000100:00100000:0.0:1763343277.286164:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399962240 00010000:00010000:0.0:1763343277.286203:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4a7b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d30 expref: 318 pid: 9827 timeout: 1170 lvb_type: 0 00000100:00100000:0.0:1763343277.286253:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3557 00000100:00100000:0.0:1763343277.286262:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401d84f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+318:2410:x1848998399962240:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343277.286279:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343277.286286:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4a7b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d30 expref: 318 pid: 9827 timeout: 1170 lvb_type: 0 00010000:00010000:0.0:1763343277.286300:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4a7b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d30 expref: 318 pid: 9827 timeout: 1170 lvb_type: 0 00010000:00010000:0.0:1763343277.286326:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4a7b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d30 expref: 318 pid: 9827 timeout: 1170 lvb_type: 0 00010000:00010000:0.0:1763343277.286340:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9401edc53100) 00010000:00010000:0.0:1763343277.286346:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4a82 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.286356:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4a82 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.286368:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4a82 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00000100:00100000:3.0:1763343277.286371:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399962368 00000100:00100000:3.0:1763343277.286377:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399962368 00010000:00010000:0.0:1763343277.286396:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343277.286416:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7466 00000100:00100000:3.0:1763343277.286425:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998399962368:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343277.286442:0:27798:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343277.286461:0:27798:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a4a89 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49d37 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343277.286466:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401d84f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:2410:x1848998399962240:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 202us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.286478:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3557 00002000:00010000:3.0:1763343277.286489:0:27798:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343277.286507:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343277.286510:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343277.286520:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a4a89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d37 expref: 16 pid: 27798 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343277.286537:0:27798:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a4a89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d37 expref: 16 pid: 27798 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343277.286548:0:27798:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5b3de00, rc 0) 00000100:00100000:3.0:1763343277.286572:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998399962368:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 150us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343277.286578:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7466 00010000:00010000:2.0:1763343277.286762:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4a82 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.286771:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4a82 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:2.0:1763343277.286795:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21d:0x0]: returning size 0 00010000:00010000:2.0:1763343277.286928:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a4a6d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d29 expref: 318 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.286951:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4a82 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d29 expref: 317 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.286958:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9401edc53100) 00010000:00010000:2.0:1763343277.286961:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1763343277.286964:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a400, rc 0) 00000100:00100000:2.0:1763343277.287003:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:55884:x1848998399961984:12345-192.168.201.40@tcp:101:bash.0 Request processed in 5222us (5610us total) trans 4294973836 rc 0/0 00000100:00100000:2.0:1763343277.287010:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10920 00000100:00100000:1.0:1763343277.291657:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.291703:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.291838:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399962496 00000100:00100000:2.0:1763343277.291848:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399962496 00000100:00100000:2.0:1763343277.291910:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399962624 00000100:00100000:2.0:1763343277.291914:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399962624 00000100:00100000:2.0:1763343277.292270:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10922 00000100:00100000:2.0:1763343277.292280:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+318:57174:x1848998399962496:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.292302:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.292320:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4a97 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49d3e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.292371:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4a97 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d3e expref: 319 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.292384:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4a97 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d3e expref: 319 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.292400:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9401edc53100) 00010000:00010000:2.0:1763343277.292403:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343277.292406:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f600, rc 0) 00000100:00100000:2.0:1763343277.292458:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:57174:x1848998399962496:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 180us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.292466:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10922 00000100:00100000:2.0:1763343277.292483:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10923 00000100:00100000:2.0:1763343277.292489:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+318:55884:x1848998399962624:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343277.292496:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.292503:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4a9e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49d45 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.292521:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4aa5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343277.292529:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4aa5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.292537:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4aa5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.292636:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4a9e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d45 expref: 320 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.292649:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4aa5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d45 expref: 319 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.292656:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9401edc53100) 00010000:00010000:2.0:1763343277.292658:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343277.292661:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583fe00, rc 0) 00000100:00100000:2.0:1763343277.292687:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:55884:x1848998399962624:12345-192.168.201.40@tcp:101:bash.0 Request processed in 198us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.292694:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10923 00000100:00100000:1.0:1763343277.300927:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.300978:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.301119:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399962880 00000100:00100000:2.0:1763343277.301130:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399962880 00000100:00100000:2.0:1763343277.301196:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10924 00000100:00100000:2.0:1763343277.301207:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:55884:x1848998399962880:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:2.0:1763343277.301451:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4aac lrc: 3/0,1 mode: --/PW res: [0x240000404:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343277.301469:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4aac lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.301480:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4aac lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000001:00080000:2.0:1763343277.301527:0:6525:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973837 00000004:00010000:2.0:1763343277.301552:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000648e1a0 reply state 000000004f6e7f41 transno 4294973838 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4aac lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.301569:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4aac lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x21d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.301577:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9401edc53100) 00010000:00010000:2.0:1763343277.301579:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343277.301583:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343277.301662:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+322:55884:x1848998399962880:12345-192.168.201.40@tcp:36:bash.0 Request processed in 456us (746us total) trans 4294973838 rc 0/0 00000100:00100000:2.0:1763343277.301670:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10924 00000020:00080000:2.0:1763343277.301674:0:6525:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343277.301749:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399963136 00000100:00100000:3.0:1763343277.301753:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399963136 00000100:00100000:3.0:1763343277.301787:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3853 00000100:00100000:3.0:1763343277.301794:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+322:57174:x1848998399963136:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343277.301883:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:57174:x1848998399963136:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 89us (904us total) trans 4294973839 rc 0/0 00000100:00100000:3.0:1763343277.301893:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3853 00000100:00100000:3.0:1763343277.303771:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.303859:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399963392 00000100:00100000:1.0:1763343277.303868:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399963392 00000100:00100000:3.0:1763343277.304070:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.304810:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399963648 00000100:00100000:2.0:1763343277.304818:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399963648 00000100:00100000:2.0:1763343277.304864:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10925 00000100:00100000:2.0:1763343277.304873:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+324:55884:x1848998399963392:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343277.304897:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.304900:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343277.304925:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4a97 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d3e expref: 324 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.304943:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9401edc53100) 00010000:00010000:2.0:1763343277.304948:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343277.304960:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4ab3 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49d4c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.305009:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4aba lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343277.305021:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4aba lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.305060:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4aba lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000040:00080000:2.0:1763343277.305288:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1801, 88 off149632 00000004:00080000:2.0:1763343277.305296:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1070429270721ns, next at 1071106415333ns, rc = 0 00000040:00080000:2.0:1763343277.305320:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1792, 88 off148872 00000004:00080000:2.0:1763343277.305324:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1070429299118ns, next at 1071106445174ns, rc = 0 00000040:00080000:2.0:1763343277.305345:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1793, 88 off148960 00000004:00080000:2.0:1763343277.305349:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1070429324416ns, next at 1071106445174ns, rc = 0 00000040:00080000:2.0:1763343277.305358:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1802, 88 off149720 00000004:00080000:2.0:1763343277.305361:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1070429336591ns, next at 1071106415333ns, rc = 0 00000100:00100000:3.0:1763343277.305479:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10926 00000100:00100000:3.0:1763343277.305489:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+325:57174:x1848998399963648:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343277.305498:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343277.305511:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a4ac1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49d53 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.305565:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a4ac8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343277.305574:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a4ac8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.305581:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a4ac8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.305591:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a4acf lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343277.305598:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a4acf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.305603:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a4acf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.305678:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4ad6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343277.305686:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4ad6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.305692:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4ad6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:3.0:1763343277.305700:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21d:0x0]: returning size 2 00010000:00010000:3.0:1763343277.305742:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4ad6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.305749:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4ad6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.305755:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4ad6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.305761:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5b3d200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343277.305765:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4ad6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.305771:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4ad6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.305779:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9401edc53100) 00010000:00010000:3.0:1763343277.305782:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1763343277.305786:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4ad6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.305792:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4ad6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.305802:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a4ac8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.305807:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a4ac8 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.305816:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a4ac8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.305820:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c7ec0c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343277.305822:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a4ac8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.305827:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a4ac8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.305832:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4e00) 00010000:00010000:3.0:1763343277.305834:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343277.305837:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a4ac8 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.305841:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a4ac8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.305849:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a4acf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.305854:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a4acf lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.305859:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a4acf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.305864:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c7ec1c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343277.305867:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a4acf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.305872:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a4acf lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.305882:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5000) 00010000:00010000:3.0:1763343277.305884:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343277.305886:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a4acf lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.305890:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a4acf lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.305919:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a4ac1 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d53 expref: 327 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.305927:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4e00) 00010000:00010000:3.0:1763343277.305930:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343277.305933:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a4ac1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d53 expref: 327 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.305945:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401c7ec0600, rc 0) 00000100:00100000:2.0:1763343277.307149:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+326:57174:x1848998399963648:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1655us (3072us total) trans 4294973841 rc 301/301 00000100:00100000:2.0:1763343277.307162:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10926 00000100:00100000:3.0:1763343277.311906:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.311971:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399963904 00000100:00100000:2.0:1763343277.311982:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399963904 00000100:00100000:2.0:1763343277.312056:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3854 00000100:00100000:2.0:1763343277.312067:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+326:57174:x1848998399963904:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343277.313549:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+327:57174:x1848998399963904:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1478us (1647us total) trans 4294973842 rc 0/0 00000100:00100000:2.0:1763343277.313560:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3854 00000001:00080000:1.0:1763343277.314399:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973841 is committed 00000004:00080000:1.0:1763343277.314411:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1157 committed 00000004:00080000:1.0:1763343277.314426:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1149 committed 00000004:00080000:1.0:1763343277.314436:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1148 committed 00000004:00080000:1.0:1763343277.314438:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1156 committed 00010000:00010000:2.0:1763343277.314522:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a498d lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.314536:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a498d lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.314548:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a498d lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.314553:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.314558:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a498d lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.314565:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a498d lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.314580:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5000) 00010000:00010000:2.0:1763343277.314584:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.314588:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a498d lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.314594:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a498d lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.314611:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a49fd lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.314616:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a49fd lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.314621:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a49fd lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.314625:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.314627:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a49fd lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.314632:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a49fd lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.314639:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5000) 00010000:00010000:2.0:1763343277.314641:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.314644:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a49fd lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.314649:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a49fd lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.314664:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4aac lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x21d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.314670:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4aac lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x21d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.314675:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4aac lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x21d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.314679:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583e600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.314682:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4aac lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x21d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.314686:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4aac lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x21d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.314694:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9401edc53100) 00010000:00010000:2.0:1763343277.314696:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.314699:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4aac lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x21d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.314703:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4aac lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x21d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.314753:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4aba lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d4c expref: 304 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.314762:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9401edc53100) 00010000:00010000:2.0:1763343277.314764:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343277.314777:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4ab3 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d4c expref: 304 pid: 6525 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763343277.314793:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4aba lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d4c expref: 303 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.314819:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9401edc53100) 00010000:00010000:2.0:1763343277.314821:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343277.314824:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583ee00, rc 0) 00000100:00100000:3.0:1763343277.315059:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413005568:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343277.315108:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343277.315140:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343277.315145:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413005440:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343277.315162:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343277.315187:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413005568 00000100:00100000:3.0:1763343277.315194:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413005568 00000100:00100000:3.0:1763343277.315239:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413005440 00000100:00100000:3.0:1763343277.315242:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413005440 00000100:00100000:3.0:1763343277.315266:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7467 00000100:00100000:3.0:1763343277.315273:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+14:3660:x1848998413005568:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763343277.315424:0:8626:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2d7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343277.315428:0:8626:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2d7:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343277.315430:0:8626:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2d7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343277.315433:0:8626:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2d7:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343277.315435:0:8626:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2d7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343277.315468:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+15:3660:x1848998413005568:12345-0@lo:2:osp-syn-1-1.0 Request processed in 195us (360us total) trans 17179872025 rc 0/0 00000100:00100000:3.0:1763343277.315475:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7467 00000100:00100000:3.0:1763343277.315491:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7468 00000100:00100000:3.0:1763343277.315497:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+14:3660:x1848998413005440:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763343277.315509:0:8626:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:726 count 1 00010000:00010000:3.0:1763343277.315527:0:8626:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4ae4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.315545:0:8626:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a48e5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cb2 expref: 15 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343277.315552:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343277.315555:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343277.315559:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4ae4 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.315587:0:8626:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a48e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cb2 expref: 15 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343277.315600:0:8626:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a48e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cb2 expref: 15 pid: 35281 timeout: 1170 lvb_type: 1 00000100:00100000:3.0:1763343277.315615:0:8626:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c39b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998413005824:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343277.315754:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413005312:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343277.315786:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343277.315806:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c372aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413005952:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343277.315824:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343277.315842:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1763343277.315848:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413005696:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343277.315869:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343277.315885:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413006336:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343277.315902:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343277.315926:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413005312 00000100:00100000:0.0:1763343277.315930:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413005312 00000100:00100000:0.0:1763343277.315953:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413005952 00000100:00100000:0.0:1763343277.315956:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413005952 00000100:00100000:0.0:1763343277.315971:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413005696 00000100:00100000:0.0:1763343277.315973:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413005696 00000100:00100000:0.0:1763343277.315983:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413006336 00000100:00100000:0.0:1763343277.315985:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413006336 00000100:00100000:0.0:1763343277.315995:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7469 00000100:00100000:0.0:1763343277.316001:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+16:3662:x1848998413005312:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763343277.316013:0:28561:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:725 count 1 00010000:00010000:0.0:1763343277.316041:0:28561:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4aeb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.316053:0:28561:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c583e000/0x9104b1ba770a491d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cce expref: 15 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.316059:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343277.316061:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343277.316064:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4aeb lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.316083:0:28561:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c583e000/0x9104b1ba770a491d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cce expref: 15 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.316092:0:28561:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c583e000/0x9104b1ba770a491d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cce expref: 15 pid: 8626 timeout: 1170 lvb_type: 0 00000100:00100000:0.0:1763343277.316101:0:28561:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b26300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998413006464:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343277.316507:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:55884:x1848998399963392:12345-192.168.201.40@tcp:101:bash.0 Request processed in 11631us (12739us total) trans 4294973840 rc 0/0 00000100:00100000:2.0:1763343277.316517:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10925 00000100:00100000:2.0:1763343277.316550:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413006080:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763343277.316580:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343277.316593:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763343277.316597:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f648a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413006208:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343277.316611:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343277.316626:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413006080 00000100:00100000:2.0:1763343277.316629:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413006080 00000100:00100000:2.0:1763343277.316644:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413006208 00000100:00100000:2.0:1763343277.316646:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413006208 00000100:00100000:2.0:1763343277.316655:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7470 00000100:00100000:2.0:1763343277.316660:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+33:3662:x1848998413005952:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763343277.316673:0:8412:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:724 count 1 00010000:00010000:2.0:1763343277.316688:0:8412:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c583f600/0x9104b1ba770a4af2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.316699:0:8412:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a4916 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cc7 expref: 21 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.316706:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343277.316707:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343277.316711:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583f600/0x9104b1ba770a4af2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.316728:0:8412:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a4916 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cc7 expref: 21 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.316736:0:8412:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a4916 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cc7 expref: 21 pid: 27798 timeout: 1170 lvb_type: 0 00000100:00100000:2.0:1763343277.316745:0:8412:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4788e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998413006592:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343277.318196:0:8626:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c8284180 going to sleep for 11 seconds 00000100:00100000:3.0:1763343277.318242:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7471 00000100:00100000:3.0:1763343277.318255:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+16:3662:x1848998413005696:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343277.318449:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+17:3662:x1848998413005696:12345-0@lo:2:osp-syn-1-1.0 Request processed in 197us (2577us total) trans 17179872026 rc 0/0 00000100:00100000:3.0:1763343277.318456:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7471 00000100:00100000:3.0:1763343277.318478:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7472 00000100:00100000:3.0:1763343277.318486:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+33:3662:x1848998413006336:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343277.318582:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+34:3662:x1848998413006336:12345-0@lo:2:osp-syn-0-1.0 Request processed in 96us (2677us total) trans 21474839296 rc 0/0 00000100:00100000:3.0:1763343277.318588:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7472 00000100:00100000:3.0:1763343277.318601:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7473 00000100:00100000:3.0:1763343277.318608:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edde7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+33:3659:x1848998413006080:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343277.318620:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:725 count 1 00010000:00010000:3.0:1763343277.318636:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4af9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.318651:0:8413:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d000/0x9104b1ba770a48ec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cb9 expref: 21 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343277.318659:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343277.318661:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343277.318664:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4af9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.318691:0:8413:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d000/0x9104b1ba770a48ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cb9 expref: 21 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343277.318701:0:8413:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d000/0x9104b1ba770a48ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cb9 expref: 21 pid: 35281 timeout: 1170 lvb_type: 1 00000100:00100000:3.0:1763343277.318714:0:8413:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c39b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998413006720:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343277.318750:0:8413:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c8284480 going to sleep for 11 seconds 00000100:00100000:3.0:1763343277.318770:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7474 00000100:00100000:3.0:1763343277.318778:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c511ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+33:3659:x1848998413006208:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343277.318855:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c511ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+34:3659:x1848998413006208:12345-0@lo:2:osp-syn-0-1.0 Request processed in 78us (2242us total) trans 21474839297 rc 0/0 00000100:00100000:3.0:1763343277.318861:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7474 00000004:00080000:3.0:1763343277.318910:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c7918a80/2, rc 0, transno 17179872025 00000100:00100000:3.0:1763343277.318916:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413005568:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343277.318964:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.319238:0:8412:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc440a80 going to sleep for 11 seconds 00000004:00080000:2.0:1763343277.319266:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f648a680/2, rc 0, transno 21474839297 00000100:00100000:2.0:1763343277.319272:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f648a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413006208:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343277.319287:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399964032 00000100:00100000:2.0:1763343277.319293:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399964032 00000100:00100000:0.0:1763343277.319881:0:28561:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401d84dea80 going to sleep for 11 seconds 00000004:00080000:0.0:1763343277.319920:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c7919880/2, rc 0, transno 17179872026 00000100:00100000:0.0:1763343277.319926:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413005696:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763343277.319936:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6488700/2, rc 0, transno 21474839296 00000100:00100000:0.0:1763343277.319939:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413006336:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343277.320015:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3855 00000100:00100000:1.0:1763343277.320211:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8544850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57174:x1848998399964032:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:1.0:1763343277.320356:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8544850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57174:x1848998399964032:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 332us (1391us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.320368:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3855 00000100:00100000:0.0:1763343277.328644:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.328671:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.328726:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399964288 00000100:00100000:2.0:1763343277.328736:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399964288 00000100:00100000:0.0:1763343277.328759:0:28561:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b26300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998413006464:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343277.328785:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7475 00010000:00010000:0.0:1763343277.328786:0:28561:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4aeb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343277.328794:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:55884:x1848998399964288:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343277.328810:0:35281:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.328830:0:35281:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4b00 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49d5a expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343277.328833:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.328850:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399964160 00000100:00100000:0.0:1763343277.328853:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399964160 00010000:00010000:2.0:1763343277.328859:0:35281:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a4a89 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d37 expref: 18 pid: 27798 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343277.328867:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.328870:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.328870:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a48e5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cb2 expref: 18 pid: 35281 timeout: 1170 lvb_type: 1 00010000:00010000:2.0:1763343277.328874:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4b00 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d5a expref: 18 pid: 35281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343277.328889:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399964544 00000100:00100000:0.0:1763343277.328891:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399964544 00010000:00010000:0.0:1763343277.328902:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a4916 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cc7 expref: 22 pid: 27798 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.328904:0:35281:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a4a89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d37 expref: 18 pid: 27798 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343277.328916:0:35281:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a4a89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d37 expref: 18 pid: 27798 timeout: 1170 lvb_type: 1 00000100:00100000:0.0:1763343277.328919:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3558 00000100:00100000:0.0:1763343277.328925:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998399964160:12345-192.168.201.40@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1763343277.328929:0:35281:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4788380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35281:1848998413006848:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343277.328933:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343277.328937:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a48e5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x2d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cb2 expref: 18 pid: 35281 timeout: 1170 lvb_type: 1 00010000:00010000:0.0:1763343277.328947:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a48e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cb2 expref: 18 pid: 35281 timeout: 1170 lvb_type: 1 00010000:00010000:0.0:1763343277.328966:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.328968:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.328972:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4ae4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.328980:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4ae4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343277.328993:0:35281:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c329cb40 going to sleep for 11 seconds 00010000:00010000:0.0:1763343277.328993:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343277.329015:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3559 00000100:00100000:0.0:1763343277.329015:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998399964160:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 89us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.329021:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2409:x1848998399964544:12345-192.168.201.40@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1763343277.329038:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3558 00010000:00010000:2.0:1763343277.329054:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343277.329059:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a4916 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cc7 expref: 22 pid: 27798 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.329068:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a4916 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cc7 expref: 22 pid: 27798 timeout: 1170 lvb_type: 0 00000100:00100000:0.0:1763343277.329077:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:2.0:1763343277.329086:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.329088:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.329091:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c583f600/0x9104b1ba770a4af2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343277.329093:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399964416 00000100:00100000:0.0:1763343277.329096:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399964416 00010000:00010000:2.0:1763343277.329099:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583f600/0x9104b1ba770a4af2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.329109:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583e000/0x9104b1ba770a491d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cce expref: 18 pid: 8626 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.329111:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343277.329126:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3560 00000100:00100000:2.0:1763343277.329129:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2409:x1848998399964544:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 108us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.329132:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2409:x1848998399964416:12345-192.168.201.40@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1763343277.329135:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3559 00010000:00010000:0.0:1763343277.329139:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343277.329142:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c583e000/0x9104b1ba770a491d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cce expref: 18 pid: 8626 timeout: 1170 lvb_type: 0 00010000:00010000:0.0:1763343277.329151:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c583e000/0x9104b1ba770a491d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cce expref: 18 pid: 8626 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.329163:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a4916 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cc7 expref: 21 pid: 27798 timeout: 1170 lvb_type: 0 00010000:00010000:0.0:1763343277.329163:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c583e000/0x9104b1ba770a491d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cce expref: 18 pid: 8626 timeout: 1170 lvb_type: 0 00000100:00100000:2.0:1763343277.329175:0:8412:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4788e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998413006592:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343277.329175:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.329176:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.329179:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4aeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.329186:0:8412:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c583f600/0x9104b1ba770a4af2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.329193:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4aeb lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.329195:0:8412:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c583f600/0x9104b1ba770a4af2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.329202:0:8412:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c583f600/0x9104b1ba770a4af2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.329207:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343277.329212:0:8412:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c583f600/0x9104b1ba770a4af2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.329232:0:8412:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583f600/0x9104b1ba770a4af2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343277.329236:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2409:x1848998399964416:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 91us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.329242:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3560 00010000:00010000:2.0:1763343277.329248:0:8412:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343277.329260:0:28561:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4aeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.329266:0:28561:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4aeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.329273:0:28561:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4aeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.329280:0:28561:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4aeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.329294:0:28561:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763343277.329684:0:8413:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c39b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998413006720:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343277.329705:0:8413:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4af9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.329732:0:8626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a48e5 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cb2 expref: 16 pid: 35281 timeout: 1170 lvb_type: 1 00000100:00100000:3.0:1763343277.329748:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c39b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998413005824:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343277.329759:0:8626:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4ae4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.329766:0:8626:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4ae4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.329772:0:8626:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4ae4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.329780:0:8626:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4ae4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.329786:0:8626:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4ae4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.329800:0:8626:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1763343277.330296:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+18:3662:x1848998413005312:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14291us (14505us total) trans 17179872027 rc 0/0 00000100:00100000:0.0:1763343277.330306:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7469 00010000:00010000:0.0:1763343277.330331:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1763343277.330337:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c583f600/0x9104b1ba770a4af2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.330351:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343277.330359:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c583f600/0x9104b1ba770a4af2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.330368:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c583f600/0x9104b1ba770a4af2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.330383:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c583f600/0x9104b1ba770a4af2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.330390:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c583f600/0x9104b1ba770a4af2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.330405:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763343277.330408:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4aeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.330414:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343277.330417:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4aeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.330423:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4aeb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.330430:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4aeb lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.330441:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4aeb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.330450:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343277.330453:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4ae4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.330458:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5b3d200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343277.330461:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4ae4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.330467:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4ae4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.330474:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4ae4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.330480:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3d200/0x9104b1ba770a4ae4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.330488:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343277.330490:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343277.330491:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343277.330518:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c7919f80/2, rc 0, transno 17179872027 00000100:00100000:0.0:1763343277.330524:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413005312:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343277.330650:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+34:3662:x1848998413005952:12345-0@lo:6:osp-syn-0-1.0 Request processed in 13986us (14821us total) trans 21474839298 rc 0/0 00000100:00100000:2.0:1763343277.330657:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7470 00010000:00010000:2.0:1763343277.330674:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763343277.330691:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c372aa00/2, rc 0, transno 21474839298 00000100:00100000:2.0:1763343277.330696:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c372aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413005952:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1763343277.330737:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343277.330844:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+17:3660:x1848998413005440:12345-0@lo:6:osp-syn-1-1.0 Request processed in 15347us (15679us total) trans 17179872028 rc 0/0 00000100:00100000:2.0:1763343277.330851:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7468 00000100:00100000:1.0:1763343277.333518:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.333571:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399964672 00000100:00100000:2.0:1763343277.333581:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399964672 00010000:00010000:2.0:1763343277.333619:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d000/0x9104b1ba770a48ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cb9 expref: 21 pid: 35281 timeout: 1170 lvb_type: 1 00000100:00100000:2.0:1763343277.333661:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3561 00000100:00100000:2.0:1763343277.333672:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399964672:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343277.333687:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343277.333692:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d000/0x9104b1ba770a48ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cb9 expref: 21 pid: 35281 timeout: 1170 lvb_type: 1 00010000:00010000:2.0:1763343277.333711:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d000/0x9104b1ba770a48ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cb9 expref: 21 pid: 35281 timeout: 1170 lvb_type: 1 00010000:00010000:2.0:1763343277.333735:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3d000/0x9104b1ba770a48ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49cb9 expref: 21 pid: 35281 timeout: 1170 lvb_type: 1 00010000:00010000:2.0:1763343277.333751:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.333754:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.333759:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4af9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.333768:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4af9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.333805:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343277.333829:0:8413:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4af9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.333839:0:8413:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4af9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.333848:0:8413:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4af9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.333855:0:8413:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4af9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343277.333868:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399964672:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 197us (359us total) trans 0 rc 0/0 00010000:00010000:0.0:1763343277.333872:0:8413:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343277.333875:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3561 00000100:00100000:0.0:1763343277.334144:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edde7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+34:3659:x1848998413006080:12345-0@lo:6:osp-syn-0-1.0 Request processed in 15535us (17561us total) trans 21474839299 rc 0/0 00000100:00100000:0.0:1763343277.334153:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7473 00010000:00010000:0.0:1763343277.334282:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343277.334290:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4af9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.334299:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5b3c400 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343277.334303:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4af9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.334312:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4af9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.334327:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4af9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.334338:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5b3c400/0x9104b1ba770a4af9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.334355:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343277.334357:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343277.334358:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343277.334553:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c7918e00/2, rc 0, transno 17179872028 00000100:00100000:3.0:1763343277.334561:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413005440:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1763343277.334725:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bfc700/2, rc 0, transno 21474839299 00000100:00100000:2.0:1763343277.334731:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413006080:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343277.339752:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.339885:0:35281:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4788380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35281:1848998413006848:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343277.339919:0:35281:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4b00 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d5a expref: 15 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.339940:0:35281:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583fa00, rc 0) 00000100:00100000:3.0:1763343277.340005:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:55884:x1848998399964288:12345-192.168.201.40@tcp:101:bash.0 Request processed in 11210us (11331us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343277.340015:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7475 00000100:00100000:1.0:1763343277.340192:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399964800 00000100:00100000:1.0:1763343277.340200:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399964800 00010000:00010000:1.0:1763343277.340241:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a4a89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d37 expref: 15 pid: 27798 timeout: 1170 lvb_type: 1 00000100:00100000:1.0:1763343277.340279:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3562 00000100:00100000:1.0:1763343277.340289:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998399964800:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343277.340306:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343277.340312:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a4a89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d37 expref: 15 pid: 27798 timeout: 1170 lvb_type: 1 00010000:00010000:1.0:1763343277.340324:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a4a89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d37 expref: 15 pid: 27798 timeout: 1170 lvb_type: 1 00010000:00010000:1.0:1763343277.340350:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5b3de00/0x9104b1ba770a4a89 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d37 expref: 15 pid: 27798 timeout: 1170 lvb_type: 1 00010000:00010000:1.0:1763343277.340365:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343277.340367:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343277.340374:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4b00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d5a expref: 14 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.340383:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4b00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d5a expref: 14 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.340420:0:6510:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4b00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d5a expref: 14 pid: 35281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343277.340434:0:6510:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c859ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6510:1848998413006976:192.168.201.40@tcp:105: 00000100:00100000:1.0:1763343277.340491:0:6510:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc6dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1763343277.343355:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.343437:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399965056 00000100:00100000:0.0:1763343277.343447:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399965056 00000100:00100000:0.0:1763343277.343507:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10927 00000100:00100000:0.0:1763343277.343517:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57176:x1848998399965056:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343277.343544:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343277.343570:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4b07 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49d61 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.343687:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4b0e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343277.343702:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4b0e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.343715:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4b0e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.343729:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4b15 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343277.343734:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4b15 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.343744:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4b15 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.343877:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4b1c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343277.343887:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4b1c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.343894:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4b1c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:0.0:1763343277.343910:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21d:0x0]: returning size 2 00010000:00010000:0.0:1763343277.344003:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4b0e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.344010:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4b0e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.344016:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4b0e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.344063:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4b0e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.344070:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343277.344074:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4b0e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.344081:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4b0e lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.344095:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53e00) 00010000:00010000:0.0:1763343277.344098:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343277.344104:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4b0e lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.344110:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4b0e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.344123:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4b15 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.344129:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4b15 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.344134:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4b15 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.344139:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ba00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343277.344141:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4b15 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.344147:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4b15 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.344154:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401edc53500) 00010000:00010000:0.0:1763343277.344156:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343277.344159:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4b15 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.344164:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4b15 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.344207:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4b07 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d61 expref: 306 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.344232:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4b1c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d61 expref: 305 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.344239:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9401edc53100) 00010000:00010000:0.0:1763343277.344242:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1763343277.344245:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501aa00, rc 0) 00000100:00100000:0.0:1763343277.344317:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57176:x1848998399965056:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 800us (973us total) trans 4294973843 rc 0/0 00000100:00100000:0.0:1763343277.344325:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10927 00000100:00100000:3.0:1763343277.344765:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.345305:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399965184 00000100:00100000:2.0:1763343277.345313:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399965184 00000100:00100000:2.0:1763343277.345358:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7476 00000100:00100000:2.0:1763343277.345366:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:55884:x1848998399965184:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343277.345379:0:35281:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.345395:0:35281:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c583e600/0x9104b1ba770a4b2a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49d68 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343277.345414:0:35281:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343277.345431:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.345433:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.345442:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583e600/0x9104b1ba770a4b2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d68 expref: 21 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.345455:0:35281:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c583e600/0x9104b1ba770a4b2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d68 expref: 21 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.345465:0:35281:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583e600, rc 0) 00000100:00100000:2.0:1763343277.345506:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:55884:x1848998399965184:12345-192.168.201.40@tcp:101:bash.0 Request processed in 140us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.345512:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7476 00000100:00100000:1.0:1763343277.348695:0:6510:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c859ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6510:1848998413006976:192.168.201.40@tcp:105: 00010000:00010000:1.0:1763343277.348726:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343277.348791:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399964800:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 8503us (9048us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.348803:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3562 00000100:00100000:0.0:1763343277.351628:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.351714:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.351860:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399965440 00000100:00100000:3.0:1763343277.351871:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399965440 00000100:00100000:3.0:1763343277.351925:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3856 00000100:00100000:3.0:1763343277.351979:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57176:x1848998399965440:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343277.352270:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57176:x1848998399965440:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 294us (654us total) trans 4294973844 rc 0/0 00000100:00100000:3.0:1763343277.352279:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3856 00000100:00100000:0.0:1763343277.352363:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.352665:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399965568 00000100:00100000:2.0:1763343277.352671:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399965568 00002000:00010000:2.0:1763343277.352695:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/727 (0->18446744073709551615) 00002000:00100000:2.0:1763343277.352700:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6b57800 with x1848998399965568 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343277.352711:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c6b57800. 00000100:00100000:3.0:1763343277.353469:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399965696 00000100:00100000:3.0:1763343277.353475:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399965696 00002000:00010000:3.0:1763343277.353495:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/726 (0->18446744073709551615) 00002000:00100000:3.0:1763343277.353499:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6b54700 with x1848998399965696 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343277.353505:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c6b54700. 00000100:00100000:2.0:1763343277.353606:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1773 00000100:00100000:2.0:1763343277.353616:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399965568:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:2.0:1763343277.353801:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2d7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343277.353806:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2d7:0x0] updating lvb mtime from disk: 0 -> 1763343276 00002000:00010000:2.0:1763343277.353808:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2d7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343277.353810:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2d7:0x0] updating lvb ctime from disk: 0 -> 1763343276 00002000:00010000:2.0:1763343277.353813:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2d7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343277.353861:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998399965568:12345-192.168.201.40@tcp:10:bash.0 Request processed in 247us (2146us total) trans 17179872029 rc 0/0 00000100:00100000:2.0:1763343277.353869:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1773 00002000:00010000:2.0:1763343277.353873:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/727 (0->18446744073709551615) 00002000:00100000:2.0:1763343277.353875:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6b57800 with x1848998399965568 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343277.353881:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c6b57800. 00000100:00100000:2.0:1763343277.353896:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1774 00000100:00100000:2.0:1763343277.353904:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399965696:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:2.0:1763343277.353999:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2d6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343277.354003:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2d6:0x0] updating lvb mtime from disk: 0 -> 1763343276 00002000:00010000:2.0:1763343277.354005:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2d6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343277.354007:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2d6:0x0] updating lvb ctime from disk: 0 -> 1763343276 00002000:00010000:2.0:1763343277.354009:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2d6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343277.354052:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399965696:12345-192.168.201.40@tcp:10:bash.0 Request processed in 148us (1688us total) trans 21474839300 rc 0/0 00000100:00100000:2.0:1763343277.354059:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1774 00002000:00010000:2.0:1763343277.354062:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/726 (0->18446744073709551615) 00002000:00100000:2.0:1763343277.354065:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6b54700 with x1848998399965696 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343277.354069:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c6b54700. 00000100:00100000:0.0:1763343277.357421:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.357529:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399965824 00000100:00100000:2.0:1763343277.357539:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399965824 00000100:00100000:2.0:1763343277.357635:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10928 00000100:00100000:2.0:1763343277.357646:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57176:x1848998399965824:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.357670:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.357695:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4b31 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49d6f expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.357765:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4b38 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343277.357778:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4b38 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.357789:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4b38 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.357800:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4b3f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343277.357806:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4b3f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.357812:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4b3f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.357893:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4b46 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343277.357903:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4a82 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d29 expref: 307 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.357912:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4b46 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.357945:0:33856:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4a82 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d29 expref: 307 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.357959:0:33856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4a82 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d29 expref: 307 pid: 6525 timeout: 1170 lvb_type: 0 00000100:00100000:2.0:1763343277.357972:0:33856:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4788e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998413007104:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343277.358802:0:33856:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c329cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1763343277.363889:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.363972:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399966080 00000100:00100000:3.0:1763343277.363983:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399966080 00000100:00100000:3.0:1763343277.364140:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3857 00000100:00100000:3.0:1763343277.364154:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:39284:x1848998399966080:12345-192.168.201.40@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1763343277.364273:0:33856:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4788e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998413007104:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343277.364302:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4b46 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:3.0:1763343277.364496:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:39284:x1848998399966080:12345-192.168.201.40@tcp:35:ldlm_bl.0 Request processed in 344us (617us total) trans 4294973845 rc 0/0 00000100:00100000:3.0:1763343277.364504:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3857 00000100:00100000:1.0:1763343277.366837:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.367849:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399966208 00000100:00100000:2.0:1763343277.367862:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399966208 00010000:00010000:2.0:1763343277.367903:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4a82 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d29 expref: 309 pid: 6525 timeout: 1170 lvb_type: 0 00000100:00100000:0.0:1763343277.368496:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3563 00000100:00100000:0.0:1763343277.368511:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:2408:x1848998399966208:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343277.368528:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343277.368536:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4a82 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d29 expref: 309 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:0.0:1763343277.368549:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4a82 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d29 expref: 309 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:0.0:1763343277.368572:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4a82 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d29 expref: 309 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:0.0:1763343277.368589:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9401edc53100) 00010000:00010000:0.0:1763343277.368594:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4b46 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343277.368605:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4b46 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343277.368612:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4b46 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343277.368750:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343277.368845:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4b46 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343277.368855:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4b46 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:1.0:1763343277.368912:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21d:0x0]: returning size 5 00000004:00200000:1.0:1763343277.368917:0:33856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343277.368940:0:33856:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4b46 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343277.368959:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4b46 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343277.368968:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4b38 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343277.368975:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4b38 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343277.368982:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4b38 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343277.368987:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583ec00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.368991:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4b38 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343277.368998:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4b38 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343277.369007:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758a00) 00010000:00010000:1.0:1763343277.369010:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.369014:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4b38 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343277.369020:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4b38 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000100:00100000:0.0:1763343277.369342:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:2408:x1848998399966208:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 832us (2512us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.369351:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3563 00010000:00010000:1.0:1763343277.369757:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4b3f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343277.369764:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4b3f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343277.369769:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4b3f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343277.369774:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.369777:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4b3f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343277.369783:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4b3f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343277.369794:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758700) 00010000:00010000:1.0:1763343277.369797:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.369800:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4b3f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343277.369804:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4b3f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343277.369847:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4b31 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d6f expref: 308 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.369863:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4b46 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d6f expref: 307 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.369870:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9401edc53100) 00010000:00010000:1.0:1763343277.369872:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343277.369875:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f200, rc 0) 00000100:00100000:1.0:1763343277.369927:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57176:x1848998399965824:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 12283us (12515us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.369935:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10928 00000100:00100000:1.0:1763343277.375718:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.376126:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399966336 00000100:00100000:2.0:1763343277.376136:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399966336 00000100:00100000:2.0:1763343277.376200:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10929 00000100:00100000:2.0:1763343277.376211:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57177:x1848998399966336:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:2.0:1763343277.376246:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.376272:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4b4d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49d76 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.376344:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4b54 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343277.376358:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4b54 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.376370:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4b54 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.376384:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4b5b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343277.376390:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4b5b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.376402:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4b5b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.376472:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4b62 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343277.376481:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4b62 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.376487:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4b62 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:2.0:1763343277.376523:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21d:0x0]: returning size 5 00000004:00200000:2.0:1763343277.376527:0:33856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343277.376545:0:33856:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4b62 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.376557:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4b62 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.376565:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4b54 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.376571:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4b54 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.376578:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4b54 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.376584:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.376588:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4b54 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.376594:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4b54 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.376605:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758900) 00010000:00010000:2.0:1763343277.376608:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.376613:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4b54 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.376618:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4b54 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.376631:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4b5b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.376637:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4b5b lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.376642:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4b5b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.376647:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.376650:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4b5b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.376656:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4b5b lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.376662:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758e00) 00010000:00010000:2.0:1763343277.376664:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.376666:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4b5b lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.376672:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4b5b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.376703:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4b4d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d76 expref: 309 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.376718:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4b62 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d76 expref: 308 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.376725:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9401edc53100) 00010000:00010000:2.0:1763343277.376727:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343277.376730:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583e000, rc 0) 00000100:00100000:2.0:1763343277.376796:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57177:x1848998399966336:12345-192.168.201.40@tcp:101:rm.0 Request processed in 587us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.376804:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10929 00000100:00100000:3.0:1763343277.377064:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.377188:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399966592 00000100:00100000:0.0:1763343277.377194:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399966592 00000100:00100000:0.0:1763343277.377243:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10930 00000100:00100000:0.0:1763343277.377251:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57176:x1848998399966592:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343277.377263:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343277.377274:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4b69 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49d7d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.377337:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4b70 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343277.377348:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4b46 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d6f expref: 309 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.377356:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4b62 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d76 expref: 309 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.377362:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4b70 lrc: 5/0,1 mode: --/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.377398:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4b62 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d76 expref: 309 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.377410:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4b62 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d76 expref: 309 pid: 33856 timeout: 1170 lvb_type: 0 00000100:00100000:0.0:1763343277.377423:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b54380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998413007232:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343277.377486:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4b46 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d6f expref: 309 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.377494:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4b46 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d6f expref: 309 pid: 33856 timeout: 1170 lvb_type: 0 00000100:00100000:0.0:1763343277.377503:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6e8ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998413007360:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343277.377525:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401d84de840 going to sleep for 11 seconds 00000100:00100000:0.0:1763343277.380953:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b54380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998413007232:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343277.383748:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.383790:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.383829:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.383914:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399966720 00000100:00100000:2.0:1763343277.383925:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399966720 00010000:00010000:2.0:1763343277.383965:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4b46 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d6f expref: 310 pid: 33856 timeout: 1170 lvb_type: 0 00000100:00100000:2.0:1763343277.384003:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3564 00000100:00100000:2.0:1763343277.384014:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401d84f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:2407:x1848998399966720:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343277.384052:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343277.384060:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4b46 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d6f expref: 310 pid: 33856 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.384072:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4b46 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d6f expref: 310 pid: 33856 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.384096:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9401edc53100) 00010000:00010000:2.0:1763343277.384102:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4b70 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.384113:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4b70 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.384119:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343277.384168:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401d84f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:2407:x1848998399966720:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 156us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.384175:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3564 00000100:00100000:2.0:1763343277.384236:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399966848 00000100:00100000:2.0:1763343277.384240:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399966848 00010000:00010000:2.0:1763343277.384253:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4b62 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d76 expref: 310 pid: 33856 timeout: 1170 lvb_type: 0 00000100:00100000:3.0:1763343277.384391:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3565 00000100:00100000:3.0:1763343277.384401:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:2407:x1848998399966848:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343277.384410:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343277.384415:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4b62 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d76 expref: 310 pid: 33856 timeout: 1170 lvb_type: 0 00010000:00010000:3.0:1763343277.384426:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4b62 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d76 expref: 310 pid: 33856 timeout: 1170 lvb_type: 0 00010000:00010000:3.0:1763343277.384438:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4b62 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d76 expref: 310 pid: 33856 timeout: 1170 lvb_type: 0 00010000:00010000:3.0:1763343277.384452:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9401edc53100) 00010000:00010000:3.0:1763343277.384456:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4b70 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.384464:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4b70 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.384471:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4b70 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.384487:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343277.384507:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:2407:x1848998399966848:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 108us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343277.384513:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3565 00000100:00100000:3.0:1763343277.384549:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399966976 00000100:00100000:3.0:1763343277.384554:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399966976 00000100:00100000:3.0:1763343277.384580:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10931 00000100:00100000:3.0:1763343277.384587:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57177:x1848998399966976:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:3.0:1763343277.384602:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343277.384621:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a4b77 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49d84 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.384699:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a4b7e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343277.384708:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a4b7e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.384715:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a4b7e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.384727:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a4b85 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343277.384732:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a4b85 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.384737:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a4b85 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.384811:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a4b8c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343277.384819:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4b70 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.384826:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a4b8c lrc: 4/1,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.384839:0:33856:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4b70 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.384848:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a4b8c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343277.385521:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4b46 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d6f expref: 310 pid: 33856 timeout: 1170 lvb_type: 0 00000100:00100000:0.0:1763343277.385539:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6e8ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998413007360:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343277.385558:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4b70 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.385566:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4b70 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.385571:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4b70 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT1 00000004:00200000:0.0:1763343277.385589:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21d:0x0]: returning size 5 00010000:00010000:0.0:1763343277.385708:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4b69 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d7d expref: 311 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.385728:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4b70 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d7d expref: 310 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:0.0:1763343277.385737:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4b70 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d7d expref: 310 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:0.0:1763343277.385743:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501be00, rc 0) 00000100:00100000:0.0:1763343277.385794:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57176:x1848998399966592:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 8542us (8729us total) trans 4294973846 rc 0/0 00000100:00100000:0.0:1763343277.385802:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10930 00000100:00100000:3.0:1763343277.391576:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.391689:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.391776:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399967360 00000100:00100000:2.0:1763343277.391787:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399967360 00010000:00010000:2.0:1763343277.391829:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4b70 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d7d expref: 310 pid: 6525 timeout: 1170 lvb_type: 0 00000100:00100000:0.0:1763343277.392051:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399967232 00000100:00100000:0.0:1763343277.392057:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399967232 00000100:00100000:0.0:1763343277.392093:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10932 00000100:00100000:0.0:1763343277.392103:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57176:x1848998399967232:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343277.392125:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343277.392144:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4b9a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49d8b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.392256:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4ba1 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343277.392284:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4ba1 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x21d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.392298:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4ba1 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x21d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000100:00100000:2.0:1763343277.392621:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3566 00000100:00100000:2.0:1763343277.392631:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:2409:x1848998399967360:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343277.392643:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343277.392650:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4b70 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d7d expref: 312 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.392664:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4b70 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d7d expref: 312 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.392683:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4b70 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x21d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d7d expref: 312 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.392704:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9401edc53100) 00010000:00010000:2.0:1763343277.392709:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a4b8c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.392717:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a4b8c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.392724:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a4b8c lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.392731:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4ba1 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x21d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.392738:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4ba1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.392743:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4ba1 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x21d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.392824:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4ba1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.392831:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4ba1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:0.0:1763343277.392847:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21d:0x0]: returning size 5 00010000:00010000:0.0:1763343277.392950:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4b9a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21d:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d8b expref: 313 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.392965:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4ba1 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x21d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d8b expref: 312 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.392972:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9401edc53100) 00010000:00010000:0.0:1763343277.392976:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343277.392978:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b400, rc 0) 00000100:00100000:0.0:1763343277.393048:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57176:x1848998399967232:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 946us (1482us total) trans 4294973847 rc 0/0 00000100:00100000:0.0:1763343277.393056:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10932 00010000:00010000:2.0:1763343277.393233:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343277.393510:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a4b8c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.393519:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a4b8c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:3.0:1763343277.393549:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21d:0x0]: returning size 5 00000004:00200000:3.0:1763343277.393553:0:33856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343277.393567:0:33856:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a4b8c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.393578:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a4b8c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.393587:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a4b7e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.393594:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a4b7e lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.393601:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a4b7e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.393607:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c7ec0c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343277.393611:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a4b7e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.393619:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a4b7e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.393628:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4e00) 00010000:00010000:3.0:1763343277.393631:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343277.393636:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a4b7e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.393642:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a4b7e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.393654:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a4b85 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.393660:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a4b85 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.393666:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a4b85 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.393671:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121e800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343277.393674:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a4b85 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.393680:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a4b85 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.393686:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4a00) 00010000:00010000:3.0:1763343277.393688:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343277.393691:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a4b85 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.393697:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a4b85 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.393726:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a4b77 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d84 expref: 312 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.393740:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a4b8c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d84 expref: 311 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.393748:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9401edc53100) 00010000:00010000:3.0:1763343277.393751:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343277.393753:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121ea00, rc 0) 00000100:00100000:2.0:1763343277.393800:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:2409:x1848998399967360:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1170us (2110us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.393808:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3566 00000100:00100000:3.0:1763343277.394458:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57177:x1848998399966976:12345-192.168.201.40@tcp:101:rm.0 Request processed in 9869us (10626us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343277.394466:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10931 00000100:00100000:3.0:1763343277.398595:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.398676:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399967488 00000100:00100000:0.0:1763343277.398686:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399967488 00000100:00100000:0.0:1763343277.398744:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7477 00000100:00100000:0.0:1763343277.398755:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998399967488:12345-192.168.201.40@tcp:1:lfs.0 00010000:00010000:0.0:1763343277.398801:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a4baf lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.398825:0:8413:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4b00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d5a expref: 15 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.398832:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343277.398835:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343277.398839:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a4baf lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.398870:0:8413:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4b00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d5a expref: 15 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.398882:0:8413:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4b00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d5a expref: 15 pid: 35281 timeout: 1170 lvb_type: 0 00000100:00100000:0.0:1763343277.398896:0:8413:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6e8ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8413:1848998413007488:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343277.398972:0:8413:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401d84de780 going to sleep for 11 seconds 00000100:00100000:1.0:1763343277.400365:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.400436:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399967744 00000100:00100000:3.0:1763343277.400445:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399967744 00000100:00100000:3.0:1763343277.400495:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10933 00000100:00100000:3.0:1763343277.400505:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57177:x1848998399967744:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:3.0:1763343277.400557:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:3.0:1763343277.400583:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4ba1 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x21d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d8b expref: 310 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.400603:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4aba lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d4c expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.400614:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a4b8c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d84 expref: 308 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.400624:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4b1c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d61 expref: 307 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.400635:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4aa5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d45 expref: 306 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.400649:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9401edc53100) 00010000:00010000:3.0:1763343277.400658:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343277.400682:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a4bb6 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343277.400693:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a4bb6 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.400702:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a4bb6 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.400713:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a4bbd lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343277.400719:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a4bbd lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.400725:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a4bbd lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.400800:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a4bc4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343277.400808:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a4bc4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.400815:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a4bc4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00080000:3.0:1763343277.401789:0:33856:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x21d:0x0] is inserted into orphan list, open count = 2 00010000:00010000:3.0:1763343277.401878:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a4bc4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.401892:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a4bc4 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.401898:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a4bc4 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.401904:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c7ec0600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343277.401908:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a4bc4 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.401915:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a4bc4 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.401928:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9401fd0d4600) 00010000:00010000:3.0:1763343277.401931:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763343277.401935:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a4bc4 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.401942:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a4bc4 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.401960:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a4bb6 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.401966:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a4bb6 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.401972:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a4bb6 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.401977:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121e200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343277.401980:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a4bb6 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.401990:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a4bb6 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.401996:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4700) 00010000:00010000:3.0:1763343277.401998:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343277.402001:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a4bb6 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.402007:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a4bb6 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:3.0:1763343277.402016:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e2f03b8b reply state 00000000cbf89a51 transno 4294973848 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a4bbd lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.406358:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a4bbd lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343277.406370:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4300) 00010000:00010000:3.0:1763343277.406373:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343277.406378:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343277.406481:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57177:x1848998399967744:12345-192.168.201.40@tcp:36:rm.0 Request processed in 5972us (6116us total) trans 4294973848 rc 0/0 00000100:00100000:3.0:1763343277.406492:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10933 00000100:00100000:1.0:1763343277.407411:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.407488:0:8413:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6e8ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8413:1848998413007488:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343277.407513:0:8413:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a4baf lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343277.407561:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399967872 00000100:00100000:3.0:1763343277.407567:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399967872 00002000:00100000:3.0:1763343277.407605:0:28390:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x2c0000400:0x2d7:0x0] (0->4) req@ffff9400c5bfea00 x1848998399967872/t0(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:18/0 lens 496/0 e 0 to 0 dl 1763343288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343277.407614:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5bfea00 with x1848998399967872 ext(0->4) 00010000:00010000:3.0:1763343277.407620:0:28390:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4b00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d5a expref: 16 pid: 35281 timeout: 1170 lvb_type: 0 00010000:00010000:3.0:1763343277.407638:0:28390:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4b00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d5a expref: 16 pid: 35281 timeout: 1170 lvb_type: 0 00002000:00010000:3.0:1763343277.407645:0:28390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9400c5bfea00 00000100:00100000:3.0:1763343277.407673:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 124 00000100:00100000:3.0:1763343277.407682:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399967872:12345-192.168.201.40@tcp:4:bash.0 00000100:00100000:3.0:1763343277.409195:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998399967872:12345-192.168.201.40@tcp:4:bash.0 Request processed in 1505us (1779us total) trans 17179872030 rc 0/0 00000100:00100000:3.0:1763343277.409207:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 124 00002000:00100000:3.0:1763343277.409218:0:28390:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x2c0000400:0x2d7:0x0] (0->4) req@ffff9400c5bfea00 x1848998399967872/t17179872030(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:18/0 lens 496/448 e 0 to 0 dl 1763343288 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343277.409238:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5bfea00 with x1848998399967872 ext(0->4) 00010000:00010000:3.0:1763343277.409247:0:28390:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4b00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d5a expref: 18 pid: 35281 timeout: 1170 lvb_type: 0 00010000:00010000:3.0:1763343277.409262:0:28390:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4b00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d5a expref: 18 pid: 35281 timeout: 1170 lvb_type: 0 00002000:00010000:3.0:1763343277.409270:0:28390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9400c5bfea00 00000100:00100000:3.0:1763343277.415904:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.416017:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399968000 00000100:00100000:2.0:1763343277.416145:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399968000 00010000:00010000:2.0:1763343277.416188:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4b00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d5a expref: 18 pid: 35281 timeout: 1170 lvb_type: 0 00000100:00100000:2.0:1763343277.416532:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3567 00000100:00100000:2.0:1763343277.416543:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2409:x1848998399968000:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343277.416565:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1763343277.416585:0:35278:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2d7:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:2.0:1763343277.416588:0:35278:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2d7:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1763343277.416596:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4b00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d5a expref: 18 pid: 35281 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.416611:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4b00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d5a expref: 18 pid: 35281 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.416636:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4b00 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d5a expref: 18 pid: 35281 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.416655:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.416657:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.416663:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a4baf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.416673:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a4baf lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.419429:0:8413:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a4baf lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.419449:0:8413:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a4baf lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.419489:0:8413:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a4baf lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.419498:0:8413:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a4baf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.419505:0:8413:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a4baf lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.419512:0:8413:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343277.419516:0:8413:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a4baf lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.419524:0:8413:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a4baf lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.419544:0:8413:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a4baf lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343277.419632:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998399967488:12345-192.168.201.40@tcp:1:lfs.0 Request processed in 20874us (21043us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.419643:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7477 00010000:00010000:2.0:1763343277.420428:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a4baf lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.420461:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343277.420511:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2409:x1848998399968000:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 3968us (4618us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.420521:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3567 00000100:00100000:3.0:1763343277.424173:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.424289:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399968128 00000100:00100000:2.0:1763343277.424301:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399968128 00000100:00100000:2.0:1763343277.424362:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10934 00000100:00100000:2.0:1763343277.424373:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57178:x1848998399968128:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.424402:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.424429:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4bcb lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49d92 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.424527:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4bd2 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343277.424542:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4bd2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.424555:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4bd2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.424564:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4bd9 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343277.424570:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4bd9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.424576:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4bd9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.424614:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4bd2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.424620:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4bd2 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.424626:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4bd2 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.424636:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.424641:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4bd2 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.424648:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4bd2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.424660:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758900) 00010000:00010000:2.0:1763343277.424662:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.424666:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4bd2 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.424671:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4bd2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.424682:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4bd9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.424688:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4bd9 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.424692:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4bd9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.424696:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.424698:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4bd9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.424703:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4bd9 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.424708:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4300) 00010000:00010000:2.0:1763343277.424710:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.424713:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4bd9 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.424718:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4bd9 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.424743:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4bcb lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d92 expref: 308 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.424753:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758900) 00010000:00010000:2.0:1763343277.424755:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.424758:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4bcb lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d92 expref: 308 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.424768:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f400, rc 0) 00000100:00100000:2.0:1763343277.424835:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57178:x1848998399968128:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 463us (673us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343277.424842:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10934 00000100:00100000:1.0:1763343277.428547:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.428639:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399968384 00000100:00100000:0.0:1763343277.428649:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399968384 00000100:00100000:0.0:1763343277.428704:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10935 00000100:00100000:0.0:1763343277.428714:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57176:x1848998399968384:12345-192.168.201.40@tcp:36:lfs.0 00000100:00100000:0.0:1763343277.428831:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57176:x1848998399968384:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 119us (295us total) trans 0 rc -116/-116 00000100:00100000:0.0:1763343277.428839:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10935 00000100:00100000:1.0:1763343277.435924:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.437338:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399968512 00000100:00100000:2.0:1763343277.437352:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399968512 00000100:00100000:0.0:1763343277.437970:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10936 00000100:00100000:0.0:1763343277.437983:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57178:x1848998399968512:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343277.438005:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343277.438052:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4be0 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49d99 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.438135:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a4be7 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343277.438153:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a4be7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.438167:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a4be7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.438178:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4bee lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343277.438185:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4bee lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.438191:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4bee lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.438247:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a4be7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.438255:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a4be7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.438263:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a4be7 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.438268:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a4be7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.438274:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343277.438278:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a4be7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.438286:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a4be7 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.438299:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53e00) 00010000:00010000:0.0:1763343277.438302:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343277.438307:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a4be7 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.438313:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a4be7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.438330:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4bee lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.438336:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4bee lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.438341:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4bee lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.438346:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501aa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343277.438348:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4bee lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.438357:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4bee lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.438364:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4300) 00010000:00010000:0.0:1763343277.438367:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343277.438369:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4bee lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.438375:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4bee lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.438402:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4be0 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d99 expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.438412:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53e00) 00010000:00010000:0.0:1763343277.438414:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343277.438418:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4be0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d99 expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.438432:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a400, rc 0) 00000100:00100000:0.0:1763343277.440629:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57178:x1848998399968512:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2635us (4701us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343277.440642:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10936 00000100:00100000:2.0:1763343277.441862:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.442129:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399968768 00000100:00100000:3.0:1763343277.442139:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399968768 00000100:00100000:3.0:1763343277.442610:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.442683:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3858 00000100:00100000:2.0:1763343277.442695:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57176:x1848998399968768:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343277.442958:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57176:x1848998399968768:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 265us (1100us total) trans 4294973849 rc 0/0 00000100:00100000:2.0:1763343277.442966:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3858 00000100:00100000:1.0:1763343277.443115:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399968896 00000100:00100000:1.0:1763343277.443121:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399968896 00000100:00100000:1.0:1763343277.443152:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10937 00000100:00100000:1.0:1763343277.443159:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57178:x1848998399968896:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343277.443170:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.443194:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4bf5 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49da0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.443284:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4bfc lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343277.443299:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4bfc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.443311:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4bfc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:1.0:1763343277.443340:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763343277.443345:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763343277.443374:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4bf5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49da0 expref: 310 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.443391:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4bfc lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49da0 expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.443400:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6696900) 00010000:00010000:1.0:1763343277.443403:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343277.443407:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176200, rc 0) 00000100:00100000:1.0:1763343277.443434:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57178:x1848998399968896:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 276us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.443440:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10937 00000100:00100000:2.0:1763343277.451259:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.451855:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.451987:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399969280 00000100:00100000:0.0:1763343277.451998:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399969280 00000100:00100000:3.0:1763343277.452148:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399969024 00000100:00100000:3.0:1763343277.452153:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399969024 00000100:00100000:0.0:1763343277.452870:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3859 00000100:00100000:0.0:1763343277.452883:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57176:x1848998399969280:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:0.0:1763343277.453163:0:19639:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x21d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763343277.453248:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1803, 64 off149784 00000040:00080000:0.0:1763343277.453275:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1794, 64 off149024 00000040:00080000:0.0:1763343277.453286:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1795, 64 off149088 00000040:00080000:0.0:1763343277.453296:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1804, 64 off149848 00010000:00010000:0.0:1763343277.453364:0:19639:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4c03 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19639 initiator: MDT0 00010000:00010000:0.0:1763343277.453381:0:19639:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4c03 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343277.453392:0:19639:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4c03 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343277.453400:0:19639:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4c03 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x21d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343277.453407:0:19639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4c03 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x21d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343277.453413:0:19639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4c03 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x21d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343277.453433:0:19639:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343277.453639:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57176:x1848998399969280:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 756us (1783us total) trans 4294973850 rc 0/0 00000100:00100000:0.0:1763343277.453648:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3859 00010000:00010000:0.0:1763343277.453679:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343277.453685:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4c03 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x21d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343277.453692:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a400 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343277.453696:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4c03 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x21d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343277.453708:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4c03 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x21d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343277.453721:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21d:0x0].0x0 (ffff9401edc53e00) 00010000:00010000:0.0:1763343277.453724:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343277.453729:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4c03 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x21d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343277.453735:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4c03 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x21d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343277.453749:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343277.453751:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343277.453752:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343277.454233:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10938 00000100:00100000:2.0:1763343277.454247:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57178:x1848998399969024:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.454263:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.454277:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4c0a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49da7 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.454332:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4c11 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343277.454342:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4c11 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.454350:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4c11 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.454358:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4c18 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343277.454364:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4c18 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.454370:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4c18 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.454396:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4c11 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.454403:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4c11 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.454409:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4c11 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.454414:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.454418:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4c11 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.454425:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4c11 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.454433:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6696900) 00010000:00010000:2.0:1763343277.454436:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.454439:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4c11 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.454444:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4c11 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.454454:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4c18 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.454458:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4c18 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.454463:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4c18 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.454467:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.454469:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4c18 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.454474:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4c18 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.454479:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4300) 00010000:00010000:2.0:1763343277.454482:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.454485:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4c18 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.454490:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4c18 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.454513:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4c0a lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49da7 expref: 311 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.454522:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6696900) 00010000:00010000:2.0:1763343277.454524:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.454528:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4c0a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49da7 expref: 311 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.454536:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f400, rc 0) 00000100:00100000:2.0:1763343277.454589:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57178:x1848998399969024:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 346us (3342us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343277.454596:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10938 00000100:00100000:2.0:1763343277.462689:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.462800:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399969536 00000100:00100000:1.0:1763343277.462812:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399969536 00000100:00100000:1.0:1763343277.462881:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10939 00000100:00100000:1.0:1763343277.462891:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57178:x1848998399969536:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343277.462915:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.462918:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343277.462946:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4bfc lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49da0 expref: 310 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.462967:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6696900) 00010000:00010000:1.0:1763343277.462980:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343277.462995:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4c1f lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49dae expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.463303:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4c26 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343277.463319:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4c26 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.463329:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4c26 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.463345:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4c2d lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343277.463352:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4c2d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.463359:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4c2d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.463730:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4c34 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343277.463739:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4c34 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.463746:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4c34 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:1.0:1763343277.463756:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21e:0x0]: returning size 0 00010000:00010000:1.0:1763343277.463778:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4c26 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.463785:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4c26 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.463791:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4c26 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.463797:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4c26 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.463803:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.463807:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4c26 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.463818:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4c26 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.463826:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6696500) 00010000:00010000:1.0:1763343277.463829:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.463832:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4c26 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.463838:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4c26 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00000004:00010000:1.0:1763343277.463848:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b2818aac reply state 0000000017d3f86e transno 4294973851 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4c2d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.463857:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4c2d lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.463863:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4300) 00010000:00010000:1.0:1763343277.463866:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343277.463868:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343277.463895:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4c1f lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dae expref: 312 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.463911:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4c34 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dae expref: 311 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.463918:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21e:0x0].0x0 (ffff9401f6696400) 00010000:00010000:1.0:1763343277.463920:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343277.463923:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176400, rc 0) 00000100:00100000:1.0:1763343277.463979:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57178:x1848998399969536:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1089us (1302us total) trans 4294973851 rc 0/0 00000100:00100000:1.0:1763343277.463990:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10939 00000100:00100000:3.0:1763343277.466402:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.466482:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399969792 00000100:00100000:1.0:1763343277.466493:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399969792 00000100:00100000:1.0:1763343277.466922:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10940 00000100:00100000:1.0:1763343277.466933:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57178:x1848998399969792:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343277.466957:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.466978:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4c42 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x21e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49db5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.467236:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4c49 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343277.467252:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4c34 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dae expref: 313 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.467260:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4c49 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.467296:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4c34 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dae expref: 313 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.467310:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4c34 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dae expref: 313 pid: 6525 timeout: 1170 lvb_type: 0 00000100:00100000:1.0:1763343277.467324:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c372b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998413007616:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343277.468830:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc6d780 going to sleep for 11 seconds 00000100:00100000:3.0:1763343277.469136:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.469403:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399970048 00000100:00100000:0.0:1763343277.469412:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399970048 00000100:00100000:0.0:1763343277.469459:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10941 00000100:00100000:0.0:1763343277.469469:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57179:x1848998399970048:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343277.469487:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343277.469505:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4c50 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x21e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49dbc expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.469609:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4c57 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343277.469622:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4c57 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343277.469631:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4c57 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:0.0:1763343277.469644:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21e:0x0]: returning size 0 00010000:00010000:0.0:1763343277.469714:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4c57 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343277.469721:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4c57 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343277.469727:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4c57 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343277.469732:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501aa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343277.469735:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4c57 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343277.469742:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4c57 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343277.469753:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21e:0x0].0x0 (ffff9401f6696400) 00010000:00010000:0.0:1763343277.469755:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763343277.469760:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4c57 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343277.469765:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a4c57 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343277.469802:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4c50 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x21e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dbc expref: 316 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.469810:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21e:0x0].0x0 (ffff9401f6696400) 00010000:00010000:0.0:1763343277.469812:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343277.469815:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a4c50 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dbc expref: 316 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.469827:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a400, rc 0) 00000100:00100000:0.0:1763343277.469882:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57179:x1848998399970048:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 415us (749us total) trans 4294973852 rc 301/301 00000100:00100000:0.0:1763343277.469889:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10941 00000100:00100000:3.0:1763343277.475330:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.475486:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c372b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998413007616:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343277.475518:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4c49 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000100:00100000:3.0:1763343277.475950:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.476002:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399970432 00000100:00100000:2.0:1763343277.476009:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399970176 00000100:00100000:0.0:1763343277.476009:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399970432 00000100:00100000:2.0:1763343277.476013:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399970176 00010000:00010000:2.0:1763343277.476067:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4c34 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dae expref: 316 pid: 6525 timeout: 1170 lvb_type: 0 00000100:00100000:0.0:1763343277.476082:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3860 00000100:00100000:0.0:1763343277.476091:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57179:x1848998399970432:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343277.476096:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3568 00000100:00100000:2.0:1763343277.476101:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:2410:x1848998399970176:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343277.476116:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343277.476122:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4c34 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dae expref: 316 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.476134:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4c34 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dae expref: 316 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.476162:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4c34 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dae expref: 316 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.476176:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21e:0x0].0x0 (ffff9401f6696400) 00010000:00010000:2.0:1763343277.476181:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4c49 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.476190:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4c49 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.476197:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4c49 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.476215:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343277.476344:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4c49 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.476356:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4c49 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:1.0:1763343277.476378:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21e:0x0]: returning size 0 00000004:00080000:1.0:1763343277.476517:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2d8:0x0], index 0: 0 00000004:00080000:1.0:1763343277.476524:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2d9:0x0], index 1: 0 00000004:00080000:1.0:1763343277.476529:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2da:0x0], index 1: 0 00000004:00080000:1.0:1763343277.476533:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2d9:0x0], index 0: 0 00010000:00010000:1.0:1763343277.476614:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4c49 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.476622:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4c49 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.476628:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4c49 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.476633:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.476637:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4c49 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.476644:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4c49 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.476653:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21e:0x0].0x0 (ffff9401f6696400) 00010000:00010000:1.0:1763343277.476656:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343277.476660:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4c49 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.476669:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4c49 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.476705:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4c42 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x21e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49db5 expref: 317 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.476714:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21e:0x0].0x0 (ffff9401f6696400) 00010000:00010000:1.0:1763343277.476717:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343277.476720:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4c42 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49db5 expref: 317 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.476735:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176600, rc 0) 00000100:00100000:2.0:1763343277.476829:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:2410:x1848998399970176:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 725us (1508us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.476829:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57179:x1848998399970432:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 738us (878us total) trans 4294973853 rc 0/0 00000100:00100000:2.0:1763343277.476838:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3568 00000100:00100000:0.0:1763343277.476838:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3860 00000100:00100000:1.0:1763343277.476908:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57178:x1848998399969792:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 9976us (10516us total) trans 4294973854 rc 301/301 00000100:00100000:1.0:1763343277.476915:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10940 00000100:00100000:1.0:1763343277.480676:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.480745:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.480818:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399970944 00000100:00100000:0.0:1763343277.480829:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399970944 00000100:00100000:0.0:1763343277.480887:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10942 00000100:00100000:0.0:1763343277.480896:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57179:x1848998399970944:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343277.480922:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343277.480948:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a4c6c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49dc3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.481043:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4c73 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343277.481058:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4c73 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.481070:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4c73 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.481082:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4c7a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343277.481089:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4c7a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.481094:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4c7a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.481212:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a4c81 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343277.481228:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a4c81 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.481235:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a4c81 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.481319:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4c73 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.481326:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4c73 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.481332:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4c73 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.481338:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4c73 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.481344:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343277.481353:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4c73 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.481364:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4c73 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.481375:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53e00) 00010000:00010000:0.0:1763343277.481380:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343277.481384:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4c73 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.481390:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a4c73 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.481403:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4c7a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.481408:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4c7a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.481413:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4c7a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.481417:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501be00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343277.481419:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4c7a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.481424:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4c7a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.481429:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4300) 00010000:00010000:0.0:1763343277.481431:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343277.481433:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4c7a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.481438:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a4c7a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.481470:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a4c6c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dc3 expref: 317 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.481489:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a4c81 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dc3 expref: 316 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.481496:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21e:0x0].0x0 (ffff9401edc53500) 00010000:00010000:0.0:1763343277.481498:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343277.481500:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501bc00, rc 0) 00000100:00100000:0.0:1763343277.481620:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57179:x1848998399970944:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 663us (893us total) trans 4294973855 rc 0/0 00000100:00100000:0.0:1763343277.481630:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10942 00000100:00100000:2.0:1763343277.482561:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399970688 00000100:00100000:2.0:1763343277.482572:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399970688 00000100:00100000:0.0:1763343277.482665:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3861 00000100:00100000:0.0:1763343277.482674:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8546050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57178:x1848998399970688:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343277.482929:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8546050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57178:x1848998399970688:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 254us (2182us total) trans 4294973856 rc 0/0 00000100:00100000:0.0:1763343277.482936:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3861 00000100:00100000:3.0:1763343277.486433:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.486478:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.487159:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399971072 00000100:00100000:0.0:1763343277.487169:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399971072 00000100:00100000:3.0:1763343277.487238:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.487281:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399971456 00000100:00100000:1.0:1763343277.487285:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399971456 00000100:00100000:1.0:1763343277.487323:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3862 00000100:00100000:1.0:1763343277.487331:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57178:x1848998399971456:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343277.487554:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+318:57178:x1848998399971456:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 222us (314us total) trans 4294973857 rc 0/0 00000100:00100000:1.0:1763343277.487562:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3862 00000100:00100000:0.0:1763343277.488305:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399971200 00000100:00100000:0.0:1763343277.488312:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399971200 00000100:00100000:2.0:1763343277.490992:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7478 00000100:00100000:2.0:1763343277.491016:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998399971072:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.491047:0:35281:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1763343277.491059:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7479 00000100:00100000:0.0:1763343277.491069:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5953100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2408:x1848998399971200:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.491072:0:35281:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4c8f lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49dca expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.491077:0:8413:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343277.491088:0:8413:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c501a400/0x9104b1ba770a4c96 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49dd1 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343277.491095:0:35281:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1763343277.491105:0:8413:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343277.491117:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.491117:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.491119:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.491124:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.491130:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4c8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dca expref: 17 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343277.491130:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501a400/0x9104b1ba770a4c96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dd1 expref: 23 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343277.491148:0:35281:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4c8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dca expref: 17 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343277.491148:0:8413:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c501a400/0x9104b1ba770a4c96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dd1 expref: 23 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343277.491162:0:35281:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f400, rc 0) 00010000:00010000:0.0:1763343277.491162:0:8413:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a400, rc 0) 00000100:00100000:2.0:1763343277.491234:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998399971072:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 227us (4810us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.491241:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7478 00000100:00100000:0.0:1763343277.491297:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5953100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2408:x1848998399971200:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 229us (4817us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.491303:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7479 00000100:00100000:0.0:1763343277.492713:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.494562:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399971712 00000100:00100000:1.0:1763343277.494578:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399971712 00000100:00100000:1.0:1763343277.494646:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10943 00000100:00100000:1.0:1763343277.494656:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+318:55884:x1848998399971712:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343277.494684:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.494688:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343277.494714:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a4c81 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dc3 expref: 318 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.494734:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21e:0x0].0x0 (ffff9401edc53500) 00010000:00010000:1.0:1763343277.494745:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343277.494761:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4c9d lrc: 2/0,0 mode: --/CW res: [0x240000404:0x21e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49dd8 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.494875:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4ca4 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x21e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343277.494888:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4ca4 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x21e:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.494899:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4ca4 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x21e:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:1.0:1763343277.494914:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21e:0x0]: returning size 0 00010000:00010000:1.0:1763343277.495047:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4c9d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x21e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dd8 expref: 320 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.495062:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4ca4 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x21e:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dd8 expref: 319 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.495069:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21e:0x0].0x0 (ffff9401f6696400) 00010000:00010000:1.0:1763343277.495072:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:1.0:1763343277.495074:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177200, rc 0) 00000100:00100000:1.0:1763343277.495153:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:55884:x1848998399971712:12345-192.168.201.40@tcp:101:bash.0 Request processed in 498us (2444us total) trans 4294973858 rc 0/0 00000100:00100000:1.0:1763343277.495161:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10943 00000100:00100000:3.0:1763343277.496852:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.497871:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399971840 00000100:00100000:1.0:1763343277.497882:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399971840 00000100:00100000:3.0:1763343277.498480:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.498777:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399971968 00000100:00100000:1.0:1763343277.498783:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399971968 00000100:00100000:2.0:1763343277.498824:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10944 00000100:00100000:2.0:1763343277.498836:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+320:57179:x1848998399971840:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.498857:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.498879:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4cb2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x21e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49ddf expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.498933:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4cb2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ddf expref: 321 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.498948:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4cb2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ddf expref: 321 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.498965:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21e:0x0].0x0 (ffff9401f6696400) 00010000:00010000:2.0:1763343277.498969:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343277.498972:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583ea00, rc 0) 00000100:00100000:1.0:1763343277.499113:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10945 00000100:00100000:1.0:1763343277.499123:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:55884:x1848998399971968:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343277.499134:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.499143:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4cb9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49de6 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.499164:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4cc0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343277.499173:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4cc0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.499181:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4cc0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.499294:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4cb9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49de6 expref: 323 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.499310:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4cc0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49de6 expref: 322 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.499316:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21e:0x0].0x0 (ffff9401f6696400) 00010000:00010000:1.0:1763343277.499319:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343277.499321:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176200, rc 0) 00000100:00100000:2.0:1763343277.499531:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+322:57179:x1848998399971840:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 696us (2685us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.499542:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10944 00000100:00100000:1.0:1763343277.499744:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:55884:x1848998399971968:12345-192.168.201.40@tcp:101:bash.0 Request processed in 622us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.499750:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10945 00000100:00100000:3.0:1763343277.503446:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.503492:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.503603:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399972480 00000100:00100000:2.0:1763343277.503613:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399972480 00000100:00100000:2.0:1763343277.503670:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10946 00000100:00100000:2.0:1763343277.503680:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:55884:x1848998399972480:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:2.0:1763343277.503733:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343277.503758:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4ca4 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x21e:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dd8 expref: 321 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.503776:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21e:0x0].0x0 (ffff9401f6696400) 00010000:00010000:2.0:1763343277.503781:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343277.503957:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4cc7 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x21e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343277.503971:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4cc7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.503981:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4cc7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000001:00080000:2.0:1763343277.504021:0:9827:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973859 00000004:00010000:2.0:1763343277.504081:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000f1ff6b0 reply state 000000001006a695 transno 4294973860 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4cc7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.504093:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4cc7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x21e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.504099:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21e:0x0].0x0 (ffff9401f6696400) 00010000:00010000:2.0:1763343277.504101:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343277.504104:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343277.504191:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:55884:x1848998399972480:12345-192.168.201.40@tcp:36:bash.0 Request processed in 511us (697us total) trans 4294973860 rc 0/0 00000100:00100000:2.0:1763343277.504198:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10946 00000020:00080000:2.0:1763343277.504203:0:9827:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343277.504468:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399972224 00000100:00100000:1.0:1763343277.504473:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399972224 00000100:00100000:1.0:1763343277.504510:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3863 00000100:00100000:1.0:1763343277.504517:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:57179:x1848998399972224:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343277.504613:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+324:57179:x1848998399972224:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 96us (1179us total) trans 4294973861 rc 0/0 00000100:00100000:1.0:1763343277.504620:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3863 00000100:00100000:2.0:1763343277.508479:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.508908:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.509469:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399972736 00000100:00100000:1.0:1763343277.509485:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399972736 00000100:00100000:1.0:1763343277.509558:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399972992 00000100:00100000:1.0:1763343277.509562:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399972992 00000100:00100000:1.0:1763343277.509593:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10947 00000100:00100000:1.0:1763343277.509602:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+325:57179:x1848998399972736:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343277.509628:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.509656:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4cce lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49ded expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.509744:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4cd5 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343277.509758:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4cd5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.509770:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4cd5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.509780:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4cdc lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343277.509788:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4cdc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.509795:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4cdc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.509932:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4ce3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343277.509942:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4ce3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.509949:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4ce3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343277.509962:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21e:0x0]: returning size 0 00010000:00010000:1.0:1763343277.510081:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4cd5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.510089:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4cd5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.510095:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4cd5 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.510102:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4cd5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.510108:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.510112:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4cd5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.510119:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4cd5 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.510136:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6696500) 00010000:00010000:1.0:1763343277.510140:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.510145:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4cd5 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.510151:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4cd5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.510163:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4cdc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.510169:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4cdc lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.510174:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4cdc lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.510179:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.510181:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4cdc lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.510187:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4cdc lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.510194:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4300) 00010000:00010000:1.0:1763343277.510197:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.510200:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4cdc lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.510205:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4cdc lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.510259:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4cce lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ded expref: 328 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.510295:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4ce3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ded expref: 327 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.510303:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21e:0x0].0x0 (ffff9401f6696400) 00010000:00010000:1.0:1763343277.510306:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343277.510308:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176400, rc 0) 00000100:00100000:1.0:1763343277.510378:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+327:57179:x1848998399972736:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 776us (1910us total) trans 4294973862 rc 0/0 00000100:00100000:1.0:1763343277.510386:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10947 00000100:00100000:1.0:1763343277.510410:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10948 00000100:00100000:1.0:1763343277.510418:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+326:55884:x1848998399972992:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343277.510428:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.510430:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343277.510443:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4cb2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ddf expref: 326 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.510453:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21e:0x0].0x0 (ffff9401f6696400) 00010000:00010000:1.0:1763343277.510456:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343277.510463:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4cf1 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49df4 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.510491:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a4cf8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343277.510502:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4ce3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ded expref: 326 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.510515:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a4cf8 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x21e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.510550:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4ce3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ded expref: 326 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.510565:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4ce3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ded expref: 326 pid: 7641 timeout: 1170 lvb_type: 0 00000100:00100000:1.0:1763343277.510582:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7918380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998413007744:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343277.510649:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc6d600 going to sleep for 11 seconds 00000100:00100000:2.0:1763343277.515204:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7918380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998413007744:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343277.515243:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a4cf8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:1.0:1763343277.516091:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.516240:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399973248 00000100:00100000:2.0:1763343277.516250:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399973248 00000100:00100000:2.0:1763343277.516414:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3864 00000100:00100000:2.0:1763343277.516426:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+327:57179:x1848998399973248:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343277.517099:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+328:57179:x1848998399973248:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 601us (940us total) trans 4294973863 rc 0/0 00000100:00100000:2.0:1763343277.517109:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3864 00000100:00100000:0.0:1763343277.519776:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.519867:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.519988:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399973504 00000100:00100000:2.0:1763343277.519998:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399973504 00000100:00100000:3.0:1763343277.520162:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399973376 00000100:00100000:3.0:1763343277.520169:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399973376 00010000:00010000:3.0:1763343277.520204:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4ce3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ded expref: 329 pid: 7641 timeout: 1170 lvb_type: 0 00000100:00100000:2.0:1763343277.520489:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3865 00000100:00100000:2.0:1763343277.520500:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+329:57179:x1848998399973504:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:2.0:1763343277.520640:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+329:57179:x1848998399973504:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 142us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.520648:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3865 00000100:00100000:3.0:1763343277.520726:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3569 00000100:00100000:3.0:1763343277.520734:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9831500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+328:2410:x1848998399973376:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343277.520745:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343277.520751:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4ce3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ded expref: 328 pid: 7641 timeout: 1170 lvb_type: 0 00010000:00010000:3.0:1763343277.520763:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4ce3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ded expref: 328 pid: 7641 timeout: 1170 lvb_type: 0 00010000:00010000:3.0:1763343277.520788:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4ce3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ded expref: 328 pid: 7641 timeout: 1170 lvb_type: 0 00010000:00010000:3.0:1763343277.520804:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21e:0x0].0x0 (ffff9401f6696400) 00010000:00010000:3.0:1763343277.520809:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a4cf8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.520818:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a4cf8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.520826:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a4cf8 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x21e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.521443:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343277.521480:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9831500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+327:2410:x1848998399973376:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 745us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343277.521488:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3569 00010000:00010000:0.0:1763343277.521622:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a4cf8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.521630:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a4cf8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000040:00080000:0.0:1763343277.521827:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1796, 88 off149176 00000004:00080000:0.0:1763343277.521835:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1070645809961ns, next at 1071106445174ns, rc = 0 00000040:00080000:0.0:1763343277.521867:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1805, 88 off149936 00000004:00080000:0.0:1763343277.521872:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1070645847306ns, next at 1071106415333ns, rc = 0 00000040:00080000:0.0:1763343277.521891:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1806, 88 off150024 00000004:00080000:0.0:1763343277.521895:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1070645870326ns, next at 1071106415333ns, rc = 0 00000040:00080000:0.0:1763343277.521904:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1797, 88 off149264 00000004:00080000:0.0:1763343277.521906:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1070645882024ns, next at 1071106445174ns, rc = 0 00000001:00080000:1.0:1763343277.528230:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973864 is committed 00000004:00080000:1.0:1763343277.528245:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1151 committed 00000004:00080000:1.0:1763343277.528265:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1159 committed 00000100:00100000:3.0:1763343277.528451:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413007872:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343277.528525:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343277.528643:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343277.528649:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413008256:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343277.528671:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343277.528699:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413008128:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343277.528717:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343277.528732:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343277.528736:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6276d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413008000:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343277.528752:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343277.528778:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413007872 00000100:00100000:3.0:1763343277.528784:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413007872 00000100:00100000:3.0:1763343277.528824:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413008256 00000100:00100000:3.0:1763343277.528827:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413008256 00000100:00100000:3.0:1763343277.528843:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413008128 00000100:00100000:3.0:1763343277.528845:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413008128 00000100:00100000:3.0:1763343277.528858:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413008000 00000100:00100000:3.0:1763343277.528860:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413008000 00000100:00100000:3.0:1763343277.528874:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7480 00000100:00100000:3.0:1763343277.528882:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+37:3662:x1848998413007872:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343277.528908:0:8626:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:726 count 1 00010000:00010000:3.0:1763343277.528931:0:8626:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a4cff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.528951:0:8626:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c583e600/0x9104b1ba770a4b2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d68 expref: 22 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.528959:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343277.528961:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343277.528965:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a4cff lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.528991:0:8626:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c583e600/0x9104b1ba770a4b2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d68 expref: 22 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.529004:0:8626:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c583e600/0x9104b1ba770a4b2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d68 expref: 22 pid: 35281 timeout: 1170 lvb_type: 0 00000100:00100000:3.0:1763343277.529015:0:8626:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b9ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8626:1848998413008384:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343277.529090:0:8626:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c8284840 going to sleep for 11 seconds 00000100:00100000:3.0:1763343277.529106:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7481 00000100:00100000:3.0:1763343277.529113:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+37:3662:x1848998413008256:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763343277.529259:0:28561:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2d9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343277.529262:0:28561:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2d9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343277.529265:0:28561:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2d9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343277.529266:0:28561:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2d9:0x0] updating lvb ctime from disk: 0 -> 0 00000004:00080000:1.0:1763343277.529362:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1158 committed 00000004:00080000:1.0:1763343277.529365:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1150 committed 00010000:00010000:0.0:1763343277.529510:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a4cf8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49df4 expref: 305 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.529521:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21e:0x0].0x0 (ffff9401f6696400) 00010000:00010000:0.0:1763343277.529524:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343277.529538:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4cf1 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49df4 expref: 305 pid: 7641 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763343277.529554:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a4cf8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49df4 expref: 304 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.529580:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21e:0x0].0x0 (ffff9401f6696400) 00010000:00010000:0.0:1763343277.529583:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343277.529585:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177e00, rc 0) 00000100:00100000:0.0:1763343277.529617:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:55884:x1848998399972992:12345-192.168.201.40@tcp:101:bash.0 Request processed in 19199us (20710us total) trans 4294973864 rc 0/0 00000100:00100000:0.0:1763343277.529624:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10948 00000100:00100000:0.0:1763343277.529654:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7482 00000100:00100000:0.0:1763343277.529660:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+38:3660:x1848998413008128:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343277.529744:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+39:3660:x1848998413008128:12345-0@lo:2:osp-syn-0-1.0 Request processed in 84us (1025us total) trans 21474839302 rc 0/0 00000100:00100000:0.0:1763343277.529750:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7482 00000100:00100000:0.0:1763343277.529763:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7483 00000100:00100000:0.0:1763343277.529768:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+38:3660:x1848998413008000:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763343277.529778:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:727 count 1 00002000:00010000:0.0:1763343277.529795:0:8413:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343277.529800:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c501be00/0x9104b1ba770a4d06 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.529808:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.529809:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.529813:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501be00/0x9104b1ba770a4d06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.529823:0:8413:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c501be00/0x9104b1ba770a4d06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.529831:0:8413:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c501be00/0x9104b1ba770a4d06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.529838:0:8413:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501be00/0x9104b1ba770a4d06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.529853:0:8413:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343277.529988:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+39:3660:x1848998413008000:12345-0@lo:6:osp-syn-0-1.0 Request processed in 219us (1234us total) trans 21474839303 rc 0/0 00000100:00100000:0.0:1763343277.529994:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7483 00010000:00010000:2.0:1763343277.530601:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a4bbd lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.530612:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a4bbd lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.530621:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a4bbd lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.530626:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121fc00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.530631:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a4bbd lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.530637:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a4bbd lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.530649:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4300) 00010000:00010000:2.0:1763343277.530651:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.530655:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a4bbd lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.530660:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a4bbd lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343277.530674:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4c2d lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.530680:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4c2d lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.530686:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4c2d lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.530690:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.530693:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4c2d lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.530698:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4c2d lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.530705:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4300) 00010000:00010000:2.0:1763343277.530708:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.530711:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4c2d lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.530716:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4c2d lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.530730:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4cc7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x21e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.530736:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4cc7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x21e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.530740:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4cc7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x21e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.530745:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583fe00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.530747:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4cc7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x21e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.530753:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4cc7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x21e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.530760:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21e:0x0].0x0 (ffff9401f6696400) 00010000:00010000:2.0:1763343277.530762:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.530765:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4cc7 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x21e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.530769:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4cc7 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x21e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.530804:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343277.530811:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c501be00/0x9104b1ba770a4d06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.530818:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501be00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343277.530821:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c501be00/0x9104b1ba770a4d06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.530828:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c501be00/0x9104b1ba770a4d06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.530839:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c501be00/0x9104b1ba770a4d06 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.530847:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c501be00/0x9104b1ba770a4d06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.530861:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343277.530863:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343277.530864:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1763343277.530999:0:28561:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2d9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343277.532645:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f648b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413008512:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343277.533055:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343277.534265:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6489500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413008640:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343277.534319:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343277.534350:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763343277.534355:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413008768:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343277.534372:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343277.534750:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413008512 00000100:00100000:1.0:1763343277.534758:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413008512 00000100:00100000:1.0:1763343277.534807:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413008640 00000100:00100000:1.0:1763343277.534810:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413008640 00000100:00100000:1.0:1763343277.534825:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413008768 00000100:00100000:1.0:1763343277.534827:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413008768 00000100:00100000:1.0:1763343277.534844:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7484 00000100:00100000:1.0:1763343277.534852:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+19:3662:x1848998413008512:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343277.534879:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:727 count 1 00002000:00010000:1.0:1763343277.534914:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2d7:0x0] initial LVB size: 5, mtime: 0x691a7bac, atime: 0x0, ctime: 0x691a7bac, blocks: 0x8 00010000:00010000:1.0:1763343277.534923:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4d0d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.534936:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343277.534938:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343277.534944:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4d0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.534957:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4d0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.534966:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4d0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.534972:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4d0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.534985:0:35266:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343277.535329:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+20:3662:x1848998413008512:12345-0@lo:6:osp-syn-1-1.0 Request processed in 476us (2273us total) trans 17179872031 rc 0/0 00000100:00100000:1.0:1763343277.535337:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7484 00000100:00100000:1.0:1763343277.535361:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7485 00000100:00100000:1.0:1763343277.535368:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+19:3659:x1848998413008640:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343277.535380:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:728 count 1 00002000:00010000:1.0:1763343277.535397:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343277.535401:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4d14 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.535408:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343277.535409:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343277.535412:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4d14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.535421:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4d14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.535428:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4d14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.535435:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4d14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.535447:0:35266:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763343277.535512:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+38:3662:x1848998413008256:12345-0@lo:2:osp-syn-0-1.0 Request processed in 6396us (6835us total) trans 21474839301 rc 0/0 00000100:00100000:3.0:1763343277.535521:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7481 00000100:00100000:3.0:1763343277.535541:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7486 00000100:00100000:3.0:1763343277.535549:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+20:3659:x1848998413008768:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343277.535558:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+20:3659:x1848998413008640:12345-0@lo:6:osp-syn-1-1.0 Request processed in 190us (1237us total) trans 17179872032 rc 0/0 00000100:00100000:1.0:1763343277.535566:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7485 00000004:00080000:1.0:1763343277.535608:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6489500/2, rc 0, transno 17179872032 00000100:00100000:1.0:1763343277.535615:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6489500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413008640:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343277.535663:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+20:3659:x1848998413008768:12345-0@lo:2:osp-syn-1-1.0 Request processed in 115us (1288us total) trans 17179872033 rc 0/0 00000100:00100000:3.0:1763343277.535669:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7486 00000004:00080000:3.0:1763343277.535704:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6276d80/2, rc 0, transno 21474839303 00000100:00100000:3.0:1763343277.535709:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6276d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413008000:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1763343277.535721:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6488380/2, rc 0, transno 21474839302 00000100:00100000:3.0:1763343277.535724:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413008128:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1763343277.535838:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763343277.535846:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4d0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.535854:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343277.535859:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4d0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.535868:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4d0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.535884:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4d0d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.535892:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4d0d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.535907:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343277.535911:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4d14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.535917:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343277.535920:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4d14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.535927:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4d14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.535935:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4d14 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.535942:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4d14 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.535957:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343277.535959:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343277.535960:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343277.535966:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343277.536185:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413008896:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343277.536236:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343277.536271:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413008896 00000100:00100000:0.0:1763343277.536276:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413008896 00000100:00100000:0.0:1763343277.536310:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7487 00000100:00100000:0.0:1763343277.536317:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+20:3661:x1848998413008896:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1763343277.536406:0:8414:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2da:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343277.536410:0:8414:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2da:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343277.536412:0:8414:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343277.536415:0:8414:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2da:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343277.536417:0:8414:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2da:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343277.536433:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b9ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8626:1848998413008384:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343277.536454:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+21:3661:x1848998413008896:12345-0@lo:2:osp-syn-1-1.0 Request processed in 136us (216us total) trans 17179872034 rc 0/0 00000100:00100000:0.0:1763343277.536461:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7487 00000004:00080000:0.0:1763343277.536493:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b2e300/2, rc 0, transno 17179872034 00000100:00100000:0.0:1763343277.536498:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413008896:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1763343277.536520:0:8626:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a4cff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1763343277.536690:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6488000/2, rc 0, transno 21474839301 00000100:00100000:2.0:1763343277.536695:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413008256:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763343277.536708:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f648b480/2, rc 0, transno 17179872031 00000100:00100000:2.0:1763343277.536711:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f648b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413008512:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1763343277.536785:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b2dc00/2, rc 0, transno 17179872033 00000100:00100000:1.0:1763343277.536789:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413008768:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343277.536835:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.538094:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399973632 00000100:00100000:2.0:1763343277.538103:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399973632 00010000:00010000:2.0:1763343277.538140:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583e600/0x9104b1ba770a4b2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d68 expref: 23 pid: 35281 timeout: 1170 lvb_type: 0 00000100:00100000:2.0:1763343277.538178:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3570 00000100:00100000:2.0:1763343277.538186:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2407:x1848998399973632:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343277.538199:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343277.538204:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c583e600/0x9104b1ba770a4b2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d68 expref: 23 pid: 35281 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.538227:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c583e600/0x9104b1ba770a4b2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d68 expref: 23 pid: 35281 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.538251:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c583e600/0x9104b1ba770a4b2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49d68 expref: 23 pid: 35281 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.538265:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.538266:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.538271:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a4cff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.538281:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a4cff lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.538303:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343277.538359:0:8626:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a4cff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.538373:0:8626:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a4cff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.538381:0:8626:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a4cff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.538388:0:8626:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a4cff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.538403:0:8626:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343277.539152:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399973632:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 964us (2314us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.539161:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3570 00010000:00010000:2.0:1763343277.539196:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343277.539203:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a4cff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.539211:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8693e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343277.539215:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a4cff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.539235:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a4cff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.539250:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a4cff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.539256:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a4cff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.539273:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343277.539275:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343277.539277:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343277.539981:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+38:3662:x1848998413007872:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11094us (11451us total) trans 21474839304 rc 0/0 00000100:00100000:3.0:1763343277.539992:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7480 00000004:00080000:2.0:1763343277.540159:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5a3c700/2, rc 0, transno 21474839304 00000100:00100000:2.0:1763343277.540165:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413007872:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343277.540261:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.540452:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399973760 00000100:00100000:3.0:1763343277.540458:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399973760 00000100:00100000:3.0:1763343277.540499:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7488 00000100:00100000:3.0:1763343277.540506:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:55884:x1848998399973760:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343277.540521:0:8626:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343277.540541:0:8626:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a4d1b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49dfb expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343277.540562:0:8626:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343277.540581:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343277.540583:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343277.540590:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a4d1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dfb expref: 23 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.540610:0:8626:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a4d1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dfb expref: 23 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.540621:0:8626:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8692c00, rc 0) 00000100:00100000:3.0:1763343277.540663:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:55884:x1848998399973760:12345-192.168.201.40@tcp:101:bash.0 Request processed in 157us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343277.540670:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7488 00000100:00100000:0.0:1763343277.542511:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.542659:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399974016 00000100:00100000:2.0:1763343277.542669:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399974016 00000100:00100000:2.0:1763343277.542720:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10949 00000100:00100000:2.0:1763343277.542729:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7f55050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+301:57180:x1848998399974016:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.542753:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.542773:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4d22 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49e02 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.542850:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4d29 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343277.542863:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4d29 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.542873:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4d29 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.542884:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4d30 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343277.542889:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4d30 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.542895:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4d30 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.542992:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4d37 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343277.543001:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4d37 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.543007:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4d37 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343277.543017:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21e:0x0]: returning size 2 00010000:00010000:2.0:1763343277.543143:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4d29 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.543150:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4d29 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.543160:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4d29 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.543166:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4d29 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.543172:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583ee00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.543176:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4d29 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.543182:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4d29 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.543193:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758400) 00010000:00010000:2.0:1763343277.543196:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.543201:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4d29 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.543206:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4d29 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.543252:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4d30 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.543258:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4d30 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.543263:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4d30 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.543267:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583e000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.543278:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4d30 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.543287:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4d30 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.543294:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758600) 00010000:00010000:2.0:1763343277.543296:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.543299:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4d30 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.543304:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4d30 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.543341:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4d22 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e02 expref: 304 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.543354:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4d37 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e02 expref: 303 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.543360:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21e:0x0].0x0 (ffff9401f6696400) 00010000:00010000:2.0:1763343277.543363:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343277.543365:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f200, rc 0) 00000100:00100000:2.0:1763343277.543415:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7f55050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57180:x1848998399974016:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 688us (911us total) trans 4294973865 rc 0/0 00000100:00100000:2.0:1763343277.543423:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10949 00000100:00100000:1.0:1763343277.549927:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.549975:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.550059:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399974144 00000100:00100000:2.0:1763343277.550060:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399974400 00000100:00100000:2.0:1763343277.550069:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399974400 00000100:00100000:0.0:1763343277.550069:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399974144 00000100:00100000:2.0:1763343277.550120:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3866 00000100:00100000:0.0:1763343277.550121:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7489 00000100:00100000:2.0:1763343277.550130:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57180:x1848998399974400:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343277.550130:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:55884:x1848998399974144:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343277.550149:0:8413:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343277.550170:0:8413:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4d45 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49e09 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343277.550191:0:8413:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343277.550208:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.550210:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.550231:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4d45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e09 expref: 18 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.550248:0:8413:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4d45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e09 expref: 18 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.550261:0:8413:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b600, rc 0) 00000100:00100000:2.0:1763343277.550376:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57180:x1848998399974400:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 247us (398us total) trans 4294973866 rc 0/0 00000100:00100000:2.0:1763343277.550385:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3866 00000100:00100000:0.0:1763343277.550460:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:55884:x1848998399974144:12345-192.168.201.40@tcp:101:bash.0 Request processed in 331us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.550465:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7489 00000100:00100000:1.0:1763343277.553108:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.553165:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.553166:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399974528 00000100:00100000:3.0:1763343277.553176:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399974528 00002000:00010000:3.0:1763343277.553214:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/728 (0->18446744073709551615) 00002000:00100000:3.0:1763343277.553229:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400cc5ded80 with x1848998399974528 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343277.553241:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400cc5ded80. 00000100:00100000:0.0:1763343277.553266:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399974656 00000100:00100000:3.0:1763343277.553276:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1775 00000100:00100000:3.0:1763343277.553285:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2410:x1848998399974528:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:3.0:1763343277.553466:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2d8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343277.553470:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2d8:0x0] updating lvb mtime from disk: 0 -> 1763343276 00002000:00010000:3.0:1763343277.553473:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2d8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343277.553476:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2d8:0x0] updating lvb ctime from disk: 0 -> 1763343276 00002000:00010000:3.0:1763343277.553478:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2d8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343277.553535:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2410:x1848998399974528:12345-192.168.201.40@tcp:10:bash.0 Request processed in 250us (438us total) trans 21474839305 rc 0/0 00000100:00100000:3.0:1763343277.553543:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1775 00002000:00010000:3.0:1763343277.553546:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/728 (0->18446744073709551615) 00002000:00100000:3.0:1763343277.553549:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400cc5ded80 with x1848998399974528 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343277.553554:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400cc5ded80. 00000100:00100000:0.0:1763343277.554405:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399974656 00002000:00010000:0.0:1763343277.554437:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/729 (0->18446744073709551615) 00002000:00100000:0.0:1763343277.554442:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400cc5df800 with x1848998399974656 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343277.554449:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400cc5df800. 00000100:00100000:0.0:1763343277.554489:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1776 00000100:00100000:0.0:1763343277.554498:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2410:x1848998399974656:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:0.0:1763343277.554619:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2d9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343277.554622:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2d9:0x0] updating lvb mtime from disk: 0 -> 1763343276 00002000:00010000:0.0:1763343277.554624:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2d9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343277.554627:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2d9:0x0] updating lvb ctime from disk: 0 -> 1763343276 00002000:00010000:0.0:1763343277.554629:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2d9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343277.554663:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2410:x1848998399974656:12345-192.168.201.40@tcp:10:bash.0 Request processed in 165us (1497us total) trans 17179872035 rc 0/0 00000100:00100000:0.0:1763343277.554669:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1776 00002000:00010000:0.0:1763343277.554673:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/729 (0->18446744073709551615) 00002000:00100000:0.0:1763343277.554675:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400cc5df800 with x1848998399974656 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343277.554679:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400cc5df800. 00000100:00100000:2.0:1763343277.560893:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.561916:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399974912 00000100:00100000:1.0:1763343277.561929:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399974912 00000100:00100000:0.0:1763343277.562213:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3867 00000100:00100000:0.0:1763343277.562238:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8545050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:55884:x1848998399974912:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:0.0:1763343277.562752:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8545050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:55884:x1848998399974912:12345-192.168.201.40@tcp:35:bash.0 Request processed in 515us (1868us total) trans 4294973867 rc 0/0 00000100:00100000:0.0:1763343277.562760:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3867 00000100:00100000:1.0:1763343277.565999:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.566378:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399975168 00000100:00100000:0.0:1763343277.566390:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399975168 00000100:00100000:0.0:1763343277.566449:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10950 00000100:00100000:0.0:1763343277.566460:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57181:x1848998399975168:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343277.566487:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343277.566510:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4d4c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x21e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49e10 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.566621:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4d53 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x21e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343277.566638:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4d53 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x21e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.566651:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4d53 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x21e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:0.0:1763343277.566664:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21e:0x0]: returning size 5 00010000:00010000:0.0:1763343277.566785:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4d4c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e10 expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.566807:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4d53 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e10 expref: 307 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.566818:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21e:0x0].0x0 (ffff9401f6696400) 00010000:00010000:0.0:1763343277.566821:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1763343277.566825:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b800, rc 0) 00000100:00100000:0.0:1763343277.566910:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57181:x1848998399975168:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 451us (925us total) trans 4294973868 rc 0/0 00000100:00100000:0.0:1763343277.566918:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10950 00000100:00100000:1.0:1763343277.569066:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.569125:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399975424 00000100:00100000:2.0:1763343277.569135:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399975424 00000100:00100000:2.0:1763343277.569300:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10951 00000100:00100000:2.0:1763343277.569311:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57182:x1848998399975424:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:2.0:1763343277.569367:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763343277.569396:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a4cf8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49df4 expref: 307 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.569423:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4d37 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e02 expref: 306 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.569436:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4cc0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49de6 expref: 305 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.569446:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21e:0x0].0x0 (ffff9401f6696400) 00010000:00010000:2.0:1763343277.569451:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343277.569483:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4d61 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343277.569495:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4d61 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.569504:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4d61 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.569515:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4d68 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343277.569525:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4d68 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.569531:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4d68 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.569605:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4d6f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343277.569616:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4d53 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x21e:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e10 expref: 304 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.569624:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4d6f lrc: 4/0,1 mode: --/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.569657:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4d53 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21e:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e10 expref: 304 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.569671:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4d53 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x21e:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e10 expref: 304 pid: 6525 timeout: 1170 lvb_type: 0 00000100:00100000:2.0:1763343277.569685:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4788700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998413009024:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343277.569776:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc440a80 going to sleep for 11 seconds 00000100:00100000:3.0:1763343277.569895:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.570087:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399975552 00000100:00100000:0.0:1763343277.570094:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399975552 00000100:00100000:0.0:1763343277.570133:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10952 00000100:00100000:0.0:1763343277.570141:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57181:x1848998399975552:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343277.570155:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343277.570172:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4d76 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x21e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49e17 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.570255:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4d7d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343277.570264:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4d6f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.570271:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4d7d lrc: 4/1,0 mode: --/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.570283:0:6525:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4d6f lrc: 4/0,1 mode: --/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.570291:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4d7d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000100:00100000:2.0:1763343277.571484:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4788700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998413009024:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343277.571507:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4d6f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343277.571755:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.571815:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399975680 00000100:00100000:2.0:1763343277.571821:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399975680 00010000:00010000:2.0:1763343277.571850:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4d53 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x21e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e10 expref: 307 pid: 6525 timeout: 1170 lvb_type: 0 00000100:00100000:2.0:1763343277.571996:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3571 00000100:00100000:2.0:1763343277.572006:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401d84f2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:2408:x1848998399975680:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343277.572109:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343277.572120:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4d53 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x21e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e10 expref: 307 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.572133:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4d53 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e10 expref: 307 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.572154:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4d53 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e10 expref: 307 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.572171:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21e:0x0].0x0 (ffff9401f6696400) 00010000:00010000:2.0:1763343277.572175:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4d6f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.572182:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4d6f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.572186:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4d6f lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.572191:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4d7d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.572194:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4d7d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.572197:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4d7d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.572227:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343277.572245:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4d6f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.572253:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4d6f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343277.572286:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401d84f2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:2408:x1848998399975680:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 280us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.572294:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3571 00000004:00080000:0.0:1763343277.572710:0:7641:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x21e:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1763343277.572799:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4d6f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.572807:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4d6f lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.572813:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4d6f lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.572818:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583e800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343277.572821:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4d6f lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.572828:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4d6f lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.572837:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21e:0x0].0x0 (ffff9401f6696400) 00010000:00010000:0.0:1763343277.572840:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763343277.572843:0:7641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4d7d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.572849:0:7641:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4d7d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.572854:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4d7d lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.572884:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4d6f lrc: 2/0,0 mode: --/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.572890:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4d6f lrc: 0/0,0 mode: --/EX res: [0x240000404:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.572903:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4d61 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.572908:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4d61 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.572913:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4d61 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.572918:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4d61 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.572923:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583ee00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343277.572926:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4d61 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.572930:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4d61 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.572937:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758400) 00010000:00010000:0.0:1763343277.572940:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343277.572943:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4d61 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.572949:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4d61 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00010000:0.0:1763343277.572963:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006c8b2508 reply state 00000000ae61504e transno 4294973869 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4d68 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.572973:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4d68 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.572980:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758600) 00010000:00010000:0.0:1763343277.572982:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343277.572985:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343277.573089:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57182:x1848998399975424:12345-192.168.201.40@tcp:36:rm.0 Request processed in 3778us (4030us total) trans 4294973869 rc 0/0 00000100:00100000:0.0:1763343277.573097:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10951 00010000:00010000:2.0:1763343277.573160:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4d7d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.573167:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4d7d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:2.0:1763343277.573194:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21e:0x0]: returning size 5 00000004:00200000:2.0:1763343277.573199:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343277.573214:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4d7d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.573254:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4d76 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e17 expref: 307 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.573274:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a000/0x9104b1ba770a4d7d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e17 expref: 306 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.573282:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21e:0x0].0x0 (ffff9401f6696400) 00010000:00010000:2.0:1763343277.573284:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343277.573287:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a000, rc 0) 00000100:00100000:2.0:1763343277.573494:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57181:x1848998399975552:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3352us (3598us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.573501:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10952 00000100:00100000:1.0:1763343277.577200:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.578134:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399975936 00000100:00100000:0.0:1763343277.578147:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399975936 00000100:00100000:0.0:1763343277.578197:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3868 00000100:00100000:0.0:1763343277.578206:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57181:x1848998399975936:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:0.0:1763343277.578448:0:6528:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x21e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763343277.578522:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1798, 64 off149328 00000040:00080000:0.0:1763343277.578545:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1807, 64 off150088 00000040:00080000:0.0:1763343277.578555:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1808, 64 off150152 00000040:00080000:0.0:1763343277.578565:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1799, 64 off149392 00010000:00010000:0.0:1763343277.578625:0:6528:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4d84 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x21e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 00010000:00010000:0.0:1763343277.578644:0:6528:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4d84 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343277.578660:0:6528:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4d84 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343277.578668:0:6528:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4d84 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343277.578674:0:6528:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4d84 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343277.578680:0:6528:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4d84 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT1 00010000:00010000:0.0:1763343277.578710:0:6528:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343277.578917:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57181:x1848998399975936:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 710us (1725us total) trans 4294973870 rc 0/0 00000100:00100000:0.0:1763343277.578925:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3868 00010000:00010000:2.0:1763343277.579239:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343277.579247:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4d84 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343277.579254:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ba00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343277.579258:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4d84 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343277.579266:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4d84 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343277.579281:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21e:0x0].0x0 (ffff9401f6696400) 00010000:00010000:2.0:1763343277.579283:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763343277.579288:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4d84 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343277.579293:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4d84 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT1 00010000:00010000:2.0:1763343277.579307:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343277.579309:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343277.579310:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343277.584925:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.584998:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399976064 00000100:00100000:2.0:1763343277.585009:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399976064 00000100:00100000:2.0:1763343277.585097:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10953 00000100:00100000:2.0:1763343277.585109:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57181:x1848998399976064:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.585139:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.585164:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4d8b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49e1e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.585242:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4d92 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343277.585256:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4d92 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.585276:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4d92 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.585287:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4d99 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343277.585294:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4d99 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.585302:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4d99 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.585342:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4d92 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.585349:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4d92 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.585355:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4d92 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.585362:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4d92 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.585367:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583fc00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.585371:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4d92 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.585377:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4d92 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.585388:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758300) 00010000:00010000:2.0:1763343277.585391:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.585396:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4d92 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.585402:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4d92 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.585414:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4d99 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.585420:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4d99 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.585426:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4d99 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.585431:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.585433:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4d99 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.585438:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4d99 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.585444:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758600) 00010000:00010000:2.0:1763343277.585446:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.585449:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4d99 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.585454:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4d99 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.585477:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4d8b lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e1e expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.585487:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758300) 00010000:00010000:2.0:1763343277.585489:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.585493:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4d8b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e1e expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.585506:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f200, rc 0) 00000100:00100000:2.0:1763343277.585555:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57181:x1848998399976064:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 449us (640us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343277.585562:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10953 00000100:00100000:3.0:1763343277.587288:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.587337:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399976192 00000100:00100000:2.0:1763343277.587347:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399976192 00000100:00100000:2.0:1763343277.587405:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10954 00000100:00100000:2.0:1763343277.587416:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57183:x1848998399976192:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.587435:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.587460:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4da0 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49e25 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.587527:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4da7 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343277.587540:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4da7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.587551:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4da7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.587560:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4dae lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343277.587566:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4dae lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.587572:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4dae lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.587605:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4da7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.587612:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4da7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.587617:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4da7 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.587622:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4da7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.587627:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583e000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.587631:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4da7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.587638:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4da7 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.587648:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758200) 00010000:00010000:2.0:1763343277.587652:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.587656:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4da7 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.587661:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4da7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.587673:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4dae lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.587679:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4dae lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.587685:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4dae lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.587689:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583fe00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.587692:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4dae lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.587698:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4dae lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.587704:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758600) 00010000:00010000:2.0:1763343277.587707:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.587710:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4dae lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.587716:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4dae lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.587740:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4da0 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e25 expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.587751:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758200) 00010000:00010000:2.0:1763343277.587753:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.587757:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4da0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e25 expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.587769:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583ec00, rc 0) 00000100:00100000:2.0:1763343277.587825:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57183:x1848998399976192:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 411us (545us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343277.587833:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10954 00000100:00100000:1.0:1763343277.589832:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.589902:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399976320 00000100:00100000:0.0:1763343277.589911:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399976320 00000100:00100000:0.0:1763343277.589963:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10955 00000100:00100000:0.0:1763343277.589971:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57183:x1848998399976320:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343277.589988:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343277.590006:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a4db5 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49e2c expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.590100:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4dbc lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343277.590114:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4dbc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.590125:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4dbc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.590135:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4dc3 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343277.590142:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4dc3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.590148:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4dc3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.590187:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4dbc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.590193:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4dbc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.590199:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4dbc lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.590206:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4dbc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.590212:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343277.590226:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4dbc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.590234:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4dbc lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.590245:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53200) 00010000:00010000:0.0:1763343277.590248:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343277.590252:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4dbc lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.590257:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a4dbc lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.590269:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4dc3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.590274:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4dc3 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.590279:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4dc3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.590284:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343277.590286:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4dc3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.590292:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4dc3 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.590298:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758600) 00010000:00010000:0.0:1763343277.590300:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343277.590303:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4dc3 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.590307:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4dc3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.590331:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a4db5 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e2c expref: 308 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.590340:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401edc53200) 00010000:00010000:0.0:1763343277.590342:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343277.590345:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a4db5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e2c expref: 308 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.590361:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b200, rc 0) 00000100:00100000:0.0:1763343277.590419:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57183:x1848998399976320:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 448us (599us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343277.590426:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10955 00000100:00100000:1.0:1763343277.592330:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.592403:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399976448 00000100:00100000:2.0:1763343277.592413:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399976448 00000100:00100000:2.0:1763343277.592461:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10956 00000100:00100000:2.0:1763343277.592471:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57183:x1848998399976448:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.592490:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.592510:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4dca lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49e33 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.592567:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4dd1 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343277.592579:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4dd1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.592590:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4dd1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:2.0:1763343277.592633:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763343277.592639:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763343277.592670:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4dca lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e33 expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.592686:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4dd1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e33 expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.592694:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:2.0:1763343277.592697:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763343277.592700:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f600, rc 0) 00000100:00100000:2.0:1763343277.593409:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57183:x1848998399976448:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 934us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.593419:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10956 00000100:00100000:3.0:1763343277.597394:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.597497:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399976576 00000100:00100000:2.0:1763343277.597508:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399976576 00000100:00100000:2.0:1763343277.597566:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10957 00000100:00100000:2.0:1763343277.597577:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57183:x1848998399976576:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.597597:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.597618:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4dd8 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49e3a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.597682:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4ddf lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343277.597696:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4ddf lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.597707:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4ddf lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.597716:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4de6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343277.597721:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4de6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.597727:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4de6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.597762:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4ddf lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.597768:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4ddf lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.597773:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4ddf lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.597783:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4ddf lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.597788:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.597792:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4ddf lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.597798:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4ddf lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.597808:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:2.0:1763343277.597811:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.597815:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4ddf lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.597821:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f000/0x9104b1ba770a4ddf lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.597833:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4de6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.597838:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4de6 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.597842:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4de6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.597846:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583fc00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.597848:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4de6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.597853:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4de6 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.597863:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758600) 00010000:00010000:2.0:1763343277.597865:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.597867:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4de6 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.597871:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4de6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.597892:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4dd8 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e3a expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.597901:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:2.0:1763343277.597903:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.597906:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4dd8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e3a expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.597912:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f200, rc 0) 00000100:00100000:2.0:1763343277.597974:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57183:x1848998399976576:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 399us (588us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343277.597981:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10957 00000100:00100000:1.0:1763343277.602714:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.602855:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399976832 00000100:00100000:2.0:1763343277.602865:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399976832 00000100:00100000:2.0:1763343277.602925:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10958 00000100:00100000:2.0:1763343277.603148:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57183:x1848998399976832:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.603170:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.603173:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343277.603349:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4dd1 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e33 expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.603516:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:2.0:1763343277.603539:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343277.603557:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4ded lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49e41 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.603666:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4df4 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343277.603679:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4df4 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.603689:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4df4 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.603698:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4dfb lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343277.603704:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4dfb lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.603709:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4dfb lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.604255:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4e02 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343277.604266:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4e02 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.604273:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4e02 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:2.0:1763343277.604283:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21f:0x0]: returning size 0 00010000:00010000:2.0:1763343277.604307:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4df4 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.604313:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4df4 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.604318:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4df4 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.604324:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4df4 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.604329:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583fe00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.604332:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4df4 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.604339:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4df4 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.604348:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758200) 00010000:00010000:2.0:1763343277.604351:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.604354:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4df4 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.604359:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4df4 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00000004:00010000:2.0:1763343277.604368:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000072554894 reply state 00000000c283c476 transno 4294973871 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4dfb lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.604377:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4dfb lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.604382:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758600) 00010000:00010000:2.0:1763343277.604384:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343277.604387:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343277.604414:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4ded lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e41 expref: 310 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.604429:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4e02 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e41 expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.604436:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c4758300) 00010000:00010000:2.0:1763343277.604438:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343277.604440:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583fa00, rc 0) 00000100:00100000:2.0:1763343277.604520:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57183:x1848998399976832:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1585us (1815us total) trans 4294973871 rc 0/0 00000100:00100000:2.0:1763343277.604809:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10958 00000100:00100000:1.0:1763343277.608843:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.609335:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.609449:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399977088 00000100:00100000:2.0:1763343277.609462:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399977088 00000100:00100000:2.0:1763343277.609579:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399977344 00000100:00100000:2.0:1763343277.609583:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399977344 00000100:00100000:1.0:1763343277.609620:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10959 00000100:00100000:1.0:1763343277.609663:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57183:x1848998399977088:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343277.609693:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1763343277.609712:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10960 00010000:00010000:1.0:1763343277.609716:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4e10 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49e48 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343277.609727:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57184:x1848998399977344:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343277.609739:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343277.609750:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a4e17 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49e4f expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.609840:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4e1e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343277.609841:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4e25 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343277.609864:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4e1e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.609876:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4e1e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343277.609888:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21f:0x0]: returning size 0 00010000:00010000:1.0:1763343277.609917:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4e02 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e41 expref: 313 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.609927:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4e1e lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.609938:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4e25 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.609956:0:9827:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4e1e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.609982:0:9827:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4e02 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e41 expref: 314 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.609997:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4e02 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e41 expref: 314 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:0.0:1763343277.610017:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a4e17 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e4f expref: 315 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.610060:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4e1e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e4f expref: 314 pid: 7641 timeout: 1170 lvb_type: 0 00010000:00010000:0.0:1763343277.610069:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4e1e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e4f expref: 314 pid: 7641 timeout: 1170 lvb_type: 0 00010000:00010000:0.0:1763343277.610081:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b000, rc 0) 00000100:00100000:0.0:1763343277.610153:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57184:x1848998399977344:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 430us (818us total) trans 4294973872 rc 0/0 00000100:00100000:0.0:1763343277.610161:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10960 00000100:00100000:1.0:1763343277.610807:0:9827:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc18700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998413009152:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343277.610869:0:9827:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc6d780 going to sleep for 11 seconds 00000100:00100000:1.0:1763343277.614387:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.614423:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.614460:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.614713:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399977472 00000100:00100000:3.0:1763343277.614725:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399977472 00010000:00010000:3.0:1763343277.614771:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4e1e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e4f expref: 314 pid: 7641 timeout: 1170 lvb_type: 0 00000100:00100000:3.0:1763343277.614815:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399977600 00000100:00100000:3.0:1763343277.614819:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399977600 00010000:00010000:3.0:1763343277.614831:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4e02 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e41 expref: 315 pid: 6525 timeout: 1170 lvb_type: 0 00000100:00100000:3.0:1763343277.614854:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3572 00000100:00100000:3.0:1763343277.614862:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:2408:x1848998399977472:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343277.614889:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343277.614898:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4e1e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e4f expref: 315 pid: 7641 timeout: 1170 lvb_type: 0 00010000:00010000:3.0:1763343277.614910:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4e1e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e4f expref: 315 pid: 7641 timeout: 1170 lvb_type: 0 00010000:00010000:3.0:1763343277.614935:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a4e1e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e4f expref: 315 pid: 7641 timeout: 1170 lvb_type: 0 00010000:00010000:3.0:1763343277.614955:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c4758300) 00010000:00010000:3.0:1763343277.614961:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4e25 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343277.614971:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343277.615051:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:2408:x1848998399977472:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 161us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343277.615059:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3572 00000100:00100000:3.0:1763343277.615078:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3573 00000100:00100000:3.0:1763343277.615085:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:2408:x1848998399977600:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343277.615093:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343277.615098:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4e02 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e41 expref: 313 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:3.0:1763343277.615109:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4e02 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e41 expref: 313 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:3.0:1763343277.615120:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c4758300) 00010000:00010000:3.0:1763343277.615124:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4e25 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343277.615131:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4e25 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343277.615138:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4e25 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343277.615156:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343277.615177:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:2408:x1848998399977600:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 92us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343277.615184:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3573 00000100:00100000:0.0:1763343277.615390:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399977856 00000100:00100000:0.0:1763343277.615396:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399977856 00000100:00100000:0.0:1763343277.615428:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3869 00000100:00100000:0.0:1763343277.615436:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57184:x1848998399977856:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343277.615656:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57184:x1848998399977856:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 221us (1231us total) trans 4294973873 rc 0/0 00000100:00100000:0.0:1763343277.615663:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3869 00010000:00010000:2.0:1763343277.619928:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4e02 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e41 expref: 313 pid: 6525 timeout: 1170 lvb_type: 0 00000100:00100000:2.0:1763343277.619954:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc18700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998413009152:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343277.619979:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4e25 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.619989:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4e25 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.619994:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4e25 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:2.0:1763343277.620060:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21f:0x0]: returning size 0 00000004:00080000:2.0:1763343277.620271:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2db:0x0], index 1: 0 00000004:00080000:2.0:1763343277.620279:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2da:0x0], index 0: 0 00000004:00080000:2.0:1763343277.620285:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2db:0x0], index 0: 0 00000004:00080000:2.0:1763343277.620290:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2dc:0x0], index 1: 0 00010000:00010000:2.0:1763343277.620425:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4e25 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.620434:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4e25 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.620442:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4e25 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.620448:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.620453:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4e25 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.620460:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4e25 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.620477:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c4758300) 00010000:00010000:2.0:1763343277.620480:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343277.620486:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4e25 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.620491:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4e25 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.620565:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4e10 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e48 expref: 313 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.620579:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c4758300) 00010000:00010000:2.0:1763343277.620582:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343277.620587:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4e10 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e48 expref: 313 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.620603:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177a00, rc 0) 00000100:00100000:1.0:1763343277.620660:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.620683:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57183:x1848998399977088:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 11022us (11850us total) trans 4294973874 rc 301/301 00000100:00100000:2.0:1763343277.620696:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10959 00000100:00100000:2.0:1763343277.620732:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399978112 00000100:00100000:2.0:1763343277.620741:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399978112 00000100:00100000:2.0:1763343277.620799:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10961 00000100:00100000:2.0:1763343277.620808:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57184:x1848998399978112:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.620828:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.620848:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4e3a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49e56 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.620913:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4e41 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343277.620925:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4e41 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.620933:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4e41 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.620943:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4e48 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343277.620950:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4e48 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.620957:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4e48 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.621053:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4e4f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343277.621063:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4e4f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.621070:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4e4f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.621121:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4e41 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.621128:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4e41 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.621133:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4e41 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.621141:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4e41 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.621146:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583fe00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.621149:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4e41 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.621155:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4e41 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.621162:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758200) 00010000:00010000:2.0:1763343277.621164:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.621167:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4e41 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.621172:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4e41 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.621182:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4e48 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.621188:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4e48 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.621193:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4e48 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.621197:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.621200:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4e48 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.621205:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4e48 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.621211:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758600) 00010000:00010000:2.0:1763343277.621214:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.621230:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4e48 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.621236:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4e48 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.621262:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4e3a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e56 expref: 315 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.621277:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4e4f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e56 expref: 314 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.621284:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:2.0:1763343277.621286:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343277.621289:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583fc00, rc 0) 00000100:00100000:2.0:1763343277.621333:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57184:x1848998399978112:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 525us (675us total) trans 4294973875 rc 0/0 00000100:00100000:2.0:1763343277.621339:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10961 00000100:00100000:1.0:1763343277.623415:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.623505:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399978368 00000100:00100000:0.0:1763343277.623516:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399978368 00000100:00100000:0.0:1763343277.623582:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3870 00000100:00100000:0.0:1763343277.623592:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57183:x1848998399978368:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343277.623863:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57183:x1848998399978368:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 271us (455us total) trans 4294973876 rc 0/0 00000100:00100000:0.0:1763343277.623870:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3870 00000100:00100000:0.0:1763343277.625683:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.625723:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.625781:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399978496 00000100:00100000:2.0:1763343277.625790:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399978496 00000100:00100000:2.0:1763343277.625839:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399978624 00000100:00100000:2.0:1763343277.625842:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399978624 00000100:00100000:2.0:1763343277.625873:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7490 00000100:00100000:2.0:1763343277.625882:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2410:x1848998399978496:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.625897:0:8413:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.625920:0:8413:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c583f000/0x9104b1ba770a4e5d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49e5d expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343277.625942:0:8413:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343277.625962:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.625964:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.625973:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583f000/0x9104b1ba770a4e5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e5d expref: 25 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343277.625990:0:8413:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c583f000/0x9104b1ba770a4e5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e5d expref: 25 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343277.626003:0:8413:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f000, rc 0) 00000100:00100000:2.0:1763343277.626077:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2410:x1848998399978496:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 196us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.626084:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7490 00000100:00100000:2.0:1763343277.626100:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7491 00000100:00100000:2.0:1763343277.626107:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2410:x1848998399978624:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.626114:0:8413:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.626124:0:8413:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4e64 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49e64 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343277.626136:0:8413:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343277.626144:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.626146:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.626150:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4e64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e64 expref: 20 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343277.626160:0:8413:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4e64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e64 expref: 20 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343277.626169:0:8413:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583ea00, rc 0) 00000100:00100000:2.0:1763343277.626186:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2410:x1848998399978624:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 80us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.626197:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7491 00000100:00100000:3.0:1763343277.626898:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.626975:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399978880 00000100:00100000:1.0:1763343277.626982:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399978880 00000100:00100000:1.0:1763343277.627051:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3871 00000100:00100000:1.0:1763343277.627061:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57183:x1848998399978880:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343277.627280:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57183:x1848998399978880:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 220us (383us total) trans 4294973877 rc 0/0 00000100:00100000:1.0:1763343277.627287:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3871 00000100:00100000:1.0:1763343277.628482:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.628938:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399979136 00000100:00100000:0.0:1763343277.628947:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399979136 00000100:00100000:1.0:1763343277.629175:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3872 00000100:00100000:1.0:1763343277.629187:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57184:x1848998399979136:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343277.631145:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57184:x1848998399979136:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1951us (2660us total) trans 4294973878 rc 0/0 00000100:00100000:1.0:1763343277.631159:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3872 00000100:00100000:3.0:1763343277.634571:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.634624:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.634688:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399979392 00000100:00100000:0.0:1763343277.634704:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399979392 00000100:00100000:0.0:1763343277.634906:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399979648 00000100:00100000:0.0:1763343277.634911:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399979648 00000100:00100000:1.0:1763343277.635006:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10962 00000100:00100000:1.0:1763343277.635018:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+318:57184:x1848998399979392:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343277.635089:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.635118:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4e6b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49e6b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.635264:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4e72 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00000100:00100000:2.0:1763343277.635544:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10963 00000100:00100000:2.0:1763343277.635555:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:55884:x1848998399979648:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343277.635564:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.635566:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343277.635588:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4e4f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e56 expref: 319 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.635604:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:2.0:1763343277.635610:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343277.635617:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4e79 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49e72 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.635662:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4e80 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343277.635674:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4e80 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.635684:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4e80 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:2.0:1763343277.635697:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21f:0x0]: returning size 0 00010000:00010000:1.0:1763343277.635732:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4e72 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.635741:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4e72 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:1.0:1763343277.635749:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21f:0x0]: returning size 0 00010000:00010000:2.0:1763343277.635804:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4e79 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e72 expref: 323 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.635804:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4e6b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e6b expref: 323 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.635819:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4e80 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e72 expref: 321 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.635819:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4e72 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e6b expref: 321 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.635827:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:1.0:1763343277.635830:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:1.0:1763343277.635833:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176400, rc 0) 00010000:00010000:2.0:1763343277.635835:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:2.0:1763343277.635837:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:2.0:1763343277.635839:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583fe00, rc 0) 00000100:00100000:2.0:1763343277.636382:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:55884:x1848998399979648:12345-192.168.201.40@tcp:101:bash.0 Request processed in 826us (1754us total) trans 4294973879 rc 0/0 00000100:00100000:1.0:1763343277.636382:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:57184:x1848998399979392:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1364us (1818us total) trans 4294973880 rc 0/0 00000100:00100000:1.0:1763343277.636389:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10962 00000100:00100000:2.0:1763343277.636728:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10963 00000100:00100000:2.0:1763343277.639007:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.639482:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399979776 00000100:00100000:1.0:1763343277.639493:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399979776 00000100:00100000:1.0:1763343277.639551:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10964 00000100:00100000:1.0:1763343277.639562:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+320:55884:x1848998399979776:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343277.639583:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.639603:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4e95 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49e79 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.639637:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4e9c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343277.639651:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4e9c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.639663:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4e9c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.639784:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4e95 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e79 expref: 322 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.639801:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4e9c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e79 expref: 321 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.639810:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:1.0:1763343277.639813:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343277.639817:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176e00, rc 0) 00000100:00100000:1.0:1763343277.639958:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:55884:x1848998399979776:12345-192.168.201.40@tcp:101:bash.0 Request processed in 396us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.640049:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10964 00000100:00100000:3.0:1763343277.640248:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.640294:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399979904 00000100:00100000:2.0:1763343277.640300:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399979904 00000100:00100000:1.0:1763343277.640337:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.640356:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 456 00000100:00100000:2.0:1763343277.640365:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:2409:x1848998399979904:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343277.640376:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1763343277.640378:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399980160 00000100:00100000:3.0:1763343277.640384:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399980160 00010000:00010000:2.0:1763343277.640394:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4e72 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e6b expref: 322 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.640408:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:2.0:1763343277.640412:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343277.640442:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:2409:x1848998399979904:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 78us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.640449:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 456 00000100:00100000:3.0:1763343277.640515:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3873 00000100:00100000:3.0:1763343277.640524:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8545450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+320:57184:x1848998399980160:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343277.640687:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8545450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:57184:x1848998399980160:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 166us (351us total) trans 4294973881 rc 0/0 00000100:00100000:3.0:1763343277.640692:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3873 00000100:00100000:1.0:1763343277.644292:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.644373:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.644493:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399980416 00000100:00100000:2.0:1763343277.644503:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399980416 00000100:00100000:2.0:1763343277.644564:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10965 00000100:00100000:2.0:1763343277.644574:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:55884:x1848998399980416:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:2.0:1763343277.644631:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343277.644658:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4e80 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e72 expref: 321 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.644678:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:2.0:1763343277.644683:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343277.644869:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4ea3 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343277.644885:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4ea3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.644896:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4ea3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000001:00080000:2.0:1763343277.644940:0:9827:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973882 00000004:00010000:2.0:1763343277.644963:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001c422c97 reply state 000000001006a695 transno 4294973883 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4ea3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.644976:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4ea3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.644982:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:2.0:1763343277.644985:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343277.644988:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343277.645115:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:55884:x1848998399980416:12345-192.168.201.40@tcp:36:bash.0 Request processed in 540us (847us total) trans 4294973883 rc 0/0 00000100:00100000:2.0:1763343277.645123:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10965 00000020:00080000:2.0:1763343277.645129:0:9827:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343277.645722:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399980544 00000100:00100000:3.0:1763343277.645729:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399980544 00000100:00100000:3.0:1763343277.645775:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3874 00000100:00100000:3.0:1763343277.645785:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:57184:x1848998399980544:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:3.0:1763343277.645877:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:57184:x1848998399980544:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 93us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343277.645884:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3874 00000100:00100000:0.0:1763343277.651924:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.652804:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399980672 00000100:00100000:1.0:1763343277.652816:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399980672 00000100:00100000:1.0:1763343277.652887:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10966 00000100:00100000:1.0:1763343277.652897:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:55884:x1848998399980672:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343277.652923:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.652945:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4eaa lrc: 2/0,0 mode: --/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49e80 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.653005:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4eaa lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e80 expref: 324 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.653020:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4eaa lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e80 expref: 324 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.653065:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:1.0:1763343277.653068:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343277.653072:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176000, rc 0) 00000100:00100000:1.0:1763343277.653131:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+324:55884:x1848998399980672:12345-192.168.201.40@tcp:101:bash.0 Request processed in 235us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.653138:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10966 00000100:00100000:0.0:1763343277.660693:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.660872:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399980928 00000100:00100000:1.0:1763343277.660890:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399980928 00000100:00100000:1.0:1763343277.660956:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10967 00000100:00100000:1.0:1763343277.660967:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+324:55884:x1848998399980928:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343277.660987:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.660990:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343277.661017:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4eaa lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e80 expref: 324 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.661374:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:1.0:1763343277.661380:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343277.661396:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4eb1 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49e87 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.661447:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4eb8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343277.661461:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4eb8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.661472:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4eb8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000040:00080000:1.0:1763343277.661677:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1809, 88 off150240 00000004:00080000:1.0:1763343277.661683:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1070785658645ns, next at 1071106415333ns, rc = 0 00000040:00080000:1.0:1763343277.662203:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1800, 88 off149480 00000004:00080000:1.0:1763343277.662210:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1070786185115ns, next at 1071106445174ns, rc = 0 00000040:00080000:1.0:1763343277.662769:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1801, 88 off149568 00000004:00080000:1.0:1763343277.662777:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1070786751829ns, next at 1071106445174ns, rc = 0 00000040:00080000:1.0:1763343277.662793:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1810, 88 off150328 00000004:00080000:1.0:1763343277.662796:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1070786771934ns, next at 1071106415333ns, rc = 0 00000001:00080000:3.0:1763343277.664962:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973884 is committed 00000004:00080000:3.0:1763343277.664975:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1161 committed 00000004:00080000:3.0:1763343277.664993:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1153 committed 00000004:00080000:3.0:1763343277.665014:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1152 committed 00000004:00080000:3.0:1763343277.665018:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1160 committed 00000100:00100000:0.0:1763343277.665173:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413009664:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343277.665183:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413009408:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343277.665260:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343277.665296:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763343277.665301:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413009280:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343277.665319:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343277.665342:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413009536:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343277.665358:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343277.665382:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413009664 00000100:00100000:0.0:1763343277.665389:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413009664 00000100:00100000:0.0:1763343277.665436:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413009280 00000100:00100000:0.0:1763343277.665439:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413009280 00000100:00100000:0.0:1763343277.665450:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413009536 00000100:00100000:0.0:1763343277.665452:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413009536 00000100:00100000:0.0:1763343277.665468:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7492 00000100:00100000:0.0:1763343277.665475:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+23:3661:x1848998413009664:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343277.665625:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413009792:0@lo:6:osp-syn-0-1.0 00002000:00010000:0.0:1763343277.665634:0:35281:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2dc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343277.665639:0:35281:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2dc:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343277.665641:0:35281:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2dc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343277.665643:0:35281:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2dc:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343277.665646:0:35281:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2dc:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343277.665659:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343277.665689:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+24:3661:x1848998413009664:12345-0@lo:2:osp-syn-1-1.0 Request processed in 213us (429us total) trans 17179872036 rc 0/0 00000100:00100000:0.0:1763343277.665698:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7492 00000100:00100000:3.0:1763343277.665700:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413009792 00000100:00100000:3.0:1763343277.665705:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413009792 00000100:00100000:0.0:1763343277.665720:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7493 00000100:00100000:0.0:1763343277.665728:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+23:3661:x1848998413009280:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763343277.665742:0:35281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:729 count 1 00010000:00010000:0.0:1763343277.665763:0:35281:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4ebf lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.665783:0:35281:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4d45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e09 expref: 19 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.665791:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343277.665793:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1763343277.665923:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7494 00000100:00100000:3.0:1763343277.665932:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+23:3660:x1848998413009536:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1763343277.665986:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4ebf lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343277.666020:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+24:3660:x1848998413009536:12345-0@lo:2:osp-syn-1-1.0 Request processed in 88us (659us total) trans 17179872037 rc 0/0 00010000:00010000:0.0:1763343277.666021:0:35281:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4d45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e09 expref: 19 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.666053:0:35281:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4d45 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e09 expref: 19 pid: 8413 timeout: 1170 lvb_type: 0 00000100:00100000:3.0:1763343277.666067:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7494 00000100:00100000:0.0:1763343277.666074:0:35281:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6402a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35281:1848998413010304:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343277.666087:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7495 00000100:00100000:3.0:1763343277.666096:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+38:3662:x1848998413009792:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343277.666109:0:28561:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:728 count 1 00010000:00010000:3.0:1763343277.666124:0:28561:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a4ec6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343277.666136:0:35281:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401d84de780 going to sleep for 11 seconds 00010000:00010000:3.0:1763343277.666138:0:28561:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a4d1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dfb expref: 24 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.666147:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343277.666149:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343277.666152:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a4ec6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.666172:0:28561:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a4d1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dfb expref: 24 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.666180:0:28561:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a4d1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dfb expref: 24 pid: 8626 timeout: 1170 lvb_type: 0 00000100:00100000:3.0:1763343277.666191:0:28561:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c2f86d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28561:1848998413010432:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343277.666226:0:28561:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c8284180 going to sleep for 11 seconds 00000100:00100000:1.0:1763343277.666352:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413010048:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343277.666379:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1763343277.666424:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b19c00/2, rc 0, transno 17179872037 00000100:00100000:1.0:1763343277.666429:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413009536:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343277.666437:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763343277.666441:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c791bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413009920:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343277.666458:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343277.666484:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343277.666502:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763343277.666507:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c791ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413010176:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343277.666533:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343277.666552:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413010048 00000100:00100000:1.0:1763343277.666555:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413010048 00000100:00100000:1.0:1763343277.666573:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413009920 00000100:00100000:1.0:1763343277.666575:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413009920 00000100:00100000:1.0:1763343277.666586:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413009408 00000100:00100000:1.0:1763343277.666588:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413009408 00000100:00100000:1.0:1763343277.666599:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413010176 00000100:00100000:1.0:1763343277.666601:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413010176 00000100:00100000:1.0:1763343277.666610:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7496 00000100:00100000:1.0:1763343277.666615:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+41:3660:x1848998413010048:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343277.666705:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+42:3660:x1848998413010048:12345-0@lo:2:osp-syn-0-1.0 Request processed in 88us (323us total) trans 21474839306 rc 0/0 00000100:00100000:1.0:1763343277.666711:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7496 00000100:00100000:1.0:1763343277.666724:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7497 00000100:00100000:1.0:1763343277.666731:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+41:3660:x1848998413009920:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763343277.666742:0:28562:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:729 count 1 00010000:00010000:1.0:1763343277.666753:0:28562:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a4ecd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.666764:0:28562:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c501a400/0x9104b1ba770a4c96 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dd1 expref: 24 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343277.666771:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343277.666773:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343277.666776:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a4ecd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.666795:0:28562:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c501a400/0x9104b1ba770a4c96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dd1 expref: 24 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343277.666805:0:28562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c501a400/0x9104b1ba770a4c96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dd1 expref: 24 pid: 8413 timeout: 1170 lvb_type: 1 00000100:00100000:1.0:1763343277.666815:0:28562:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c39b7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28562:1848998413010560:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343277.666847:0:28562:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc6dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1763343277.666865:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7498 00000100:00100000:1.0:1763343277.666872:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+24:3659:x1848998413009408:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343277.666884:0:8414:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:730 count 1 00010000:00010000:2.0:1763343277.666891:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4d68 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.666897:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4ed4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.666904:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4d68 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.666914:0:8414:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4c8f lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dca expref: 19 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343277.666915:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4d68 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.666933:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583e600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.666941:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4d68 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.666941:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343277.666945:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343277.666949:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4ed4 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.666953:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4d68 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.666973:0:8414:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4c8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dca expref: 19 pid: 35281 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343277.666974:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758600) 00010000:00010000:2.0:1763343277.666980:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.666986:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4d68 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.666990:0:8414:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4c8f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dca expref: 19 pid: 35281 timeout: 1170 lvb_type: 1 00010000:00010000:2.0:1763343277.667010:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4d68 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000100:00100000:1.0:1763343277.667014:0:8414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c39b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8414:1848998413010688:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343277.667062:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4dfb lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.667070:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4dfb lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.667076:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4dfb lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.667081:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583e000 already unused, calling callback (ffffffffc18dd550) 00000100:00100000:1.0:1763343277.667082:0:8414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc6d780 going to sleep for 11 seconds 00010000:00010000:2.0:1763343277.667084:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4dfb lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.667092:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4dfb lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.667101:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758600) 00000100:00100000:1.0:1763343277.667102:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7499 00010000:00010000:2.0:1763343277.667106:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.667111:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4dfb lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00000100:00100000:1.0:1763343277.667114:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+41:3662:x1848998413010176:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1763343277.667124:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e000/0x9104b1ba770a4dfb lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.667140:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4ea3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00002000:00010000:1.0:1763343277.667179:0:11289:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2db:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343277.667182:0:11289:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2db:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343277.667184:0:11289:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2db:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343277.667186:0:11289:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2db:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763343277.667188:0:11289:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2db:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343277.667230:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+42:3662:x1848998413010176:12345-0@lo:2:osp-syn-0-1.0 Request processed in 119us (704us total) trans 21474839307 rc 0/0 00000100:00100000:1.0:1763343277.667237:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7499 00000004:00080000:1.0:1763343277.667270:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c791ad80/2, rc 0, transno 21474839307 00000100:00100000:1.0:1763343277.667276:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c791ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413010176:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763343277.667291:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c7919c00/2, rc 0, transno 21474839306 00000100:00100000:1.0:1763343277.667295:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413010048:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763343277.667314:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b1a680/2, rc 0, transno 17179872036 00000100:00100000:1.0:1763343277.667318:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413009664:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1763343277.669315:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4ea3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.669333:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4ea3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.670353:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4eb8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e87 expref: 304 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.670369:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:1.0:1763343277.670373:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343277.670394:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4eb1 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e87 expref: 304 pid: 6525 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343277.670413:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4eb8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21f:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e87 expref: 303 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.670446:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c4758d00) 00000100:00100000:0.0:1763343277.670617:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.670643:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399981056 00000100:00100000:0.0:1763343277.670652:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399981056 00010000:00010000:0.0:1763343277.670686:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4d45 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e09 expref: 20 pid: 8413 timeout: 1170 lvb_type: 0 00000100:00100000:0.0:1763343277.670723:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3574 00000100:00100000:0.0:1763343277.670734:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2408:x1848998399981056:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343277.670750:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1763343277.670757:0:28561:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c2f86d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28561:1848998413010432:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343277.670758:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4d45 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e09 expref: 20 pid: 8413 timeout: 1170 lvb_type: 0 00010000:00010000:0.0:1763343277.670777:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4d45 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e09 expref: 20 pid: 8413 timeout: 1170 lvb_type: 0 00010000:00010000:3.0:1763343277.670790:0:28561:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a4ec6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.670801:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.670805:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.670811:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4ebf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.670820:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4ebf lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.670826:0:35281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c501b600/0x9104b1ba770a4d45 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e09 expref: 20 pid: 8413 timeout: 1170 lvb_type: 0 00000100:00100000:3.0:1763343277.670841:0:35281:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6402a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35281:1848998413010304:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343277.670844:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343277.670855:0:35281:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4ebf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.670866:0:35281:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4ebf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.670873:0:35281:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4ebf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.670883:0:35281:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4ebf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.670891:0:35281:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4ebf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343277.670900:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2408:x1848998399981056:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 166us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.670910:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3574 00010000:00010000:3.0:1763343277.670913:0:35281:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343277.670936:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343277.670943:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4ebf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.670950:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343277.670955:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4ebf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.670964:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4ebf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.670977:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4ebf lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.670985:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c501a200/0x9104b1ba770a4ebf lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.671004:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343277.671006:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343277.671008:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343277.671105:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343277.671110:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176200, rc 0) 00000100:00100000:1.0:1763343277.671142:0:28562:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c39b7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28562:1848998413010560:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343277.671154:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:1.0:1763343277.671158:0:28562:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a4ecd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343277.671174:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399981184 00000100:00100000:0.0:1763343277.671180:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399981184 00000100:00100000:3.0:1763343277.671183:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+25:3661:x1848998413009280:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5454us (5860us total) trans 17179872038 rc 0/0 00000100:00100000:3.0:1763343277.671193:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7493 00010000:00010000:0.0:1763343277.671198:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a4d1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dfb expref: 25 pid: 8626 timeout: 1170 lvb_type: 0 00000100:00100000:0.0:1763343277.671241:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3575 00000100:00100000:0.0:1763343277.671249:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6402680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2408:x1848998399981184:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343277.671258:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343277.671262:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a4d1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dfb expref: 25 pid: 8626 timeout: 1170 lvb_type: 0 00010000:00010000:0.0:1763343277.671272:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a4d1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dfb expref: 25 pid: 8626 timeout: 1170 lvb_type: 0 00010000:00010000:0.0:1763343277.671288:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a4d1b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dfb expref: 25 pid: 8626 timeout: 1170 lvb_type: 0 00000004:00080000:1.0:1763343277.671293:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b1b480/2, rc 0, transno 17179872038 00000100:00100000:1.0:1763343277.671302:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413009280:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1763343277.671308:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.671312:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.671316:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a4ec6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.671325:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a4ec6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.671344:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343277.671352:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:55884:x1848998399980928:12345-192.168.201.40@tcp:101:bash.0 Request processed in 10385us (10667us total) trans 4294973884 rc 0/0 00000100:00100000:1.0:1763343277.671367:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10967 00000100:00100000:0.0:1763343277.671368:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6402680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2408:x1848998399981184:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 116us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.671378:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3575 00010000:00010000:0.0:1763343277.671405:0:28561:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a4ec6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.671413:0:28561:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a4ec6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.671420:0:28561:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a4ec6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.671426:0:28561:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a4ec6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.671449:0:28561:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343277.671541:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.671614:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+42:3662:x1848998413009792:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5518us (5954us total) trans 21474839308 rc 0/0 00000100:00100000:3.0:1763343277.671623:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.671632:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7495 00000100:00100000:0.0:1763343277.671656:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399981440 00000100:00100000:0.0:1763343277.671661:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399981440 00010000:00010000:1.0:1763343277.671676:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343277.671677:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4c8f lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dca expref: 19 pid: 35281 timeout: 1170 lvb_type: 1 00010000:00010000:1.0:1763343277.671684:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a4ec6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.671694:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8693c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343277.671697:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a4ec6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.671705:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a4ec6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343277.671707:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399981312 00000100:00100000:0.0:1763343277.671713:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399981312 00010000:00010000:1.0:1763343277.671722:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a4ec6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.671727:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501a400/0x9104b1ba770a4c96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dd1 expref: 24 pid: 8413 timeout: 1170 lvb_type: 1 00010000:00010000:1.0:1763343277.671738:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c8693c00/0x9104b1ba770a4ec6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343277.671750:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3576 00000100:00100000:0.0:1763343277.671758:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2407:x1848998399981440:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343277.671766:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343277.671770:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343277.671771:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4c8f lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x2da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dca expref: 19 pid: 35281 timeout: 1170 lvb_type: 1 00010000:00010000:1.0:1763343277.671775:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343277.671778:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343277.671785:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4c8f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dca expref: 19 pid: 35281 timeout: 1170 lvb_type: 1 00010000:00010000:0.0:1763343277.671800:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.671802:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343277.671806:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4c8f lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dca expref: 19 pid: 35281 timeout: 1170 lvb_type: 1 00010000:00010000:0.0:1763343277.671808:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4ed4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.671828:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4ed4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343277.671830:0:8414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c39b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8414:1848998413010688:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343277.671851:0:8414:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4ed4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.671853:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343277.671863:0:8414:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4ed4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.671870:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4ed4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.671878:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4ed4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343277.671880:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2407:x1848998399981440:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 122us (339us total) trans 0 rc 0/0 00010000:00010000:1.0:1763343277.671895:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4ed4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343277.671897:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3576 00000100:00100000:0.0:1763343277.671916:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3577 00010000:00010000:1.0:1763343277.671918:0:8414:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343277.671925:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401eac76850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2407:x1848998399981312:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343277.671933:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343277.671938:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c501a400/0x9104b1ba770a4c96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dd1 expref: 24 pid: 8413 timeout: 1170 lvb_type: 1 00010000:00010000:0.0:1763343277.671947:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c501a400/0x9104b1ba770a4c96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dd1 expref: 24 pid: 8413 timeout: 1170 lvb_type: 1 00010000:00010000:0.0:1763343277.671961:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c501a400/0x9104b1ba770a4c96 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49dd1 expref: 24 pid: 8413 timeout: 1170 lvb_type: 1 00010000:00010000:0.0:1763343277.671970:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.671972:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.671975:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a4ecd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.671982:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a4ecd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.672000:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343277.672020:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401eac76850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2407:x1848998399981312:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 97us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.672052:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3577 00000100:00100000:1.0:1763343277.672088:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+25:3659:x1848998413009408:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5214us (5601us total) trans 17179872039 rc 0/0 00000100:00100000:1.0:1763343277.672096:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7498 00000004:00080000:0.0:1763343277.672121:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c7918700/2, rc 0, transno 21474839308 00000100:00100000:0.0:1763343277.672128:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413009792:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1763343277.672136:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b1b800/2, rc 0, transno 17179872039 00000100:00100000:1.0:1763343277.672143:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413009408:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1763343277.672161:0:28562:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a4ecd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.672170:0:28562:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a4ecd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.672179:0:28562:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a4ecd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.672186:0:28562:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a4ecd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.672205:0:28562:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1763343277.672321:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+42:3660:x1848998413009920:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5589us (5860us total) trans 21474839309 rc 0/0 00000100:00100000:1.0:1763343277.672327:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7497 00000004:00080000:1.0:1763343277.672354:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c791bb80/2, rc 0, transno 21474839309 00000100:00100000:1.0:1763343277.672359:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c791bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413009920:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1763343277.672922:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583fa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.672932:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4ea3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.672944:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4ea3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.672960:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:2.0:1763343277.672963:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.672968:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4ea3 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.672974:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4ea3 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.673002:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763343277.673008:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4ed4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.673016:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343277.673019:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4ed4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.673044:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4ed4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.673057:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4ed4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.673065:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4ed4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.673081:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343277.673084:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a4ecd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.673090:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343277.673093:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a4ecd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.673099:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a4ecd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.673109:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a4ecd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.673115:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a4ecd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.673127:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343277.673129:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343277.673130:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343277.673711:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.673876:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399981696 00000100:00100000:1.0:1763343277.673886:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399981696 00000100:00100000:1.0:1763343277.673932:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10968 00000100:00100000:1.0:1763343277.673940:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57185:x1848998399981696:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343277.673959:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.673979:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4edb lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49e8e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.674076:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4ee2 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343277.674089:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4ee2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.674098:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4ee2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.674109:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a4ee9 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343277.674116:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a4ee9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.674122:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a4ee9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.674239:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4ef0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343277.674248:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4ef0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.674255:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4ef0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:1.0:1763343277.674266:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21f:0x0]: returning size 2 00010000:00010000:1.0:1763343277.674360:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4ee2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.674366:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4ee2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.674372:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4ee2 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.674378:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4ee2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.674383:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.674387:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4ee2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.674394:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4ee2 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.674408:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5600) 00010000:00010000:1.0:1763343277.674411:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.674415:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4ee2 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.674421:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a4ee2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.674432:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a4ee9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.674437:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a4ee9 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.674443:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a4ee9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.674448:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.674450:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a4ee9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.674456:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a4ee9 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.674463:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5700) 00010000:00010000:1.0:1763343277.674465:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.674468:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a4ee9 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.674473:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a4ee9 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.674512:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a4edb lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e8e expref: 305 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.674526:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4ef0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e8e expref: 304 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.674533:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:1.0:1763343277.674535:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343277.674537:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176c00, rc 0) 00010000:00010000:0.0:1763343277.674894:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343277.675586:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57185:x1848998399981696:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1642us (1874us total) trans 4294973885 rc 0/0 00000100:00100000:1.0:1763343277.675595:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10968 00000100:00100000:0.0:1763343277.676792:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.677060:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399981824 00000100:00100000:1.0:1763343277.677070:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399981824 00000100:00100000:1.0:1763343277.677119:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7500 00000100:00100000:1.0:1763343277.677129:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:55884:x1848998399981824:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343277.677147:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.677170:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4efe lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49e95 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343277.677194:0:28562:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343277.677231:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343277.677233:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343277.677242:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4efe lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e95 expref: 19 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.677257:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4efe lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e95 expref: 19 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.677285:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176000, rc 0) 00000100:00100000:1.0:1763343277.677340:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:55884:x1848998399981824:12345-192.168.201.40@tcp:101:bash.0 Request processed in 212us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.677347:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7500 00000100:00100000:2.0:1763343277.681353:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.681501:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399981952 00000100:00100000:1.0:1763343277.681514:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399981952 00000100:00100000:1.0:1763343277.681584:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7501 00000100:00100000:1.0:1763343277.681596:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2407:x1848998399981952:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343277.681616:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.681638:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4f05 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49e9c expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343277.681703:0:28562:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c39b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28562:1848998413010816:192.168.201.40@tcp:106: 00000100:00100000:1.0:1763343277.682178:0:28562:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc6d780 going to sleep for 11 seconds 00000100:00100000:0.0:1763343277.682274:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.682763:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399982080 00000100:00100000:2.0:1763343277.682771:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399982080 00000100:00100000:2.0:1763343277.682813:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7502 00000100:00100000:2.0:1763343277.682823:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:55884:x1848998399982080:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343277.682837:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.684146:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c583e000/0x9104b1ba770a4f0c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49ea3 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343277.684180:0:8414:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343277.684209:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.684212:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.684234:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583e000/0x9104b1ba770a4f0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ea3 expref: 24 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.684256:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c583e000/0x9104b1ba770a4f0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ea3 expref: 24 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.684269:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583e000, rc 0) 00000100:00100000:2.0:1763343277.684350:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:55884:x1848998399982080:12345-192.168.201.40@tcp:101:bash.0 Request processed in 1527us (2076us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.684366:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7502 00002000:00010000:1.0:1763343277.685305:0:28562:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb mtime: 0 -> 1763343276 00002000:00010000:1.0:1763343277.685313:0:28562:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb atime: 0 -> 1763343276 00002000:00010000:1.0:1763343277.685315:0:28562:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb ctime: 0 -> 1763343276 00000100:00100000:1.0:1763343277.685337:0:28562:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c39b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28562:1848998413010816:192.168.201.40@tcp:106: 00010000:00010000:1.0:1763343277.685372:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4f05 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e9c expref: 20 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343277.685391:0:28562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a4f05 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e9c expref: 20 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343277.685403:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177c00, rc 0) 00000100:00100000:1.0:1763343277.685446:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2407:x1848998399981952:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3852us (4102us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343277.685454:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7501 00000100:00100000:3.0:1763343277.686678:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.686704:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.686733:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399982208 00000100:00100000:3.0:1763343277.686743:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399982208 00002000:00010000:3.0:1763343277.686780:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/731 (0->18446744073709551615) 00000100:00100000:0.0:1763343277.686783:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399982336 00002000:00100000:3.0:1763343277.686785:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c2f85880 with x1848998399982208 ext(0->18446744073709551615) 00000100:00100000:0.0:1763343277.686787:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399982336 00002000:00010000:3.0:1763343277.686796:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c2f85880. 00002000:00010000:0.0:1763343277.686801:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/730 (0->18446744073709551615) 00002000:00100000:0.0:1763343277.686805:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c2f84a80 with x1848998399982336 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343277.686810:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c2f84a80. 00000100:00100000:3.0:1763343277.686818:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1777 00000100:00100000:0.0:1763343277.686827:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1778 00000100:00100000:3.0:1763343277.686828:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2407:x1848998399982208:12345-192.168.201.40@tcp:10:bash.0 00000100:00100000:0.0:1763343277.686832:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2407:x1848998399982336:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:3.0:1763343277.686988:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343277.686988:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2da:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343277.686992:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb mtime from disk: 1763343276 -> 1763343276 00002000:00010000:0.0:1763343277.686992:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2da:0x0] updating lvb mtime from disk: 0 -> 1763343276 00002000:00010000:3.0:1763343277.686995:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb atime from disk: 1763343276 -> 0 00002000:00010000:0.0:1763343277.686995:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343277.686998:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb ctime from disk: 1763343276 -> 1763343276 00002000:00010000:0.0:1763343277.686998:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2da:0x0] updating lvb ctime from disk: 0 -> 1763343276 00002000:00010000:3.0:1763343277.687001:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1763343277.687001:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2da:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343277.687707:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2407:x1848998399982336:12345-192.168.201.40@tcp:10:bash.0 Request processed in 868us (995us total) trans 21474839310 rc 0/0 00000100:00100000:0.0:1763343277.687716:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1778 00002000:00010000:0.0:1763343277.687720:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/730 (0->18446744073709551615) 00002000:00100000:0.0:1763343277.687723:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c2f84a80 with x1848998399982336 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343277.687727:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c2f84a80. 00000100:00100000:3.0:1763343277.688059:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399982208:12345-192.168.201.40@tcp:10:bash.0 Request processed in 1230us (1387us total) trans 17179872040 rc 0/0 00000100:00100000:3.0:1763343277.688065:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1777 00002000:00010000:3.0:1763343277.688069:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/731 (0->18446744073709551615) 00002000:00100000:3.0:1763343277.688071:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c2f85880 with x1848998399982208 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343277.688077:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c2f85880. 00000100:00100000:1.0:1763343277.693473:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.693807:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399982592 00000100:00100000:0.0:1763343277.693817:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399982592 00000100:00100000:0.0:1763343277.693867:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3875 00000100:00100000:0.0:1763343277.693876:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57185:x1848998399982592:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343277.694052:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.694148:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57185:x1848998399982592:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 271us (684us total) trans 4294973886 rc 0/0 00000100:00100000:0.0:1763343277.694157:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3875 00000100:00100000:0.0:1763343277.694174:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399982848 00000100:00100000:0.0:1763343277.694177:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399982848 00000100:00100000:0.0:1763343277.694207:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3876 00000100:00100000:0.0:1763343277.694224:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:55884:x1848998399982848:12345-192.168.201.40@tcp:35:bash.0 00000001:00080000:0.0:1763343277.694356:0:6528:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973887 00000100:00100000:0.0:1763343277.694410:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:55884:x1848998399982848:12345-192.168.201.40@tcp:35:bash.0 Request processed in 195us (358us total) trans 4294973888 rc 0/0 00000100:00100000:0.0:1763343277.694417:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3876 00000020:00080000:0.0:1763343277.694421:0:6528:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343277.700678:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.700821:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399983104 00000100:00100000:2.0:1763343277.700831:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399983104 00000100:00100000:2.0:1763343277.700891:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10969 00000100:00100000:2.0:1763343277.700902:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57185:x1848998399983104:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.700929:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.700950:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4f13 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49eaa expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.701087:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4f1a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343277.701102:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4ef0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e8e expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.701112:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4f1a lrc: 4/0,1 mode: --/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.701147:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4ef0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e8e expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.701161:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4ef0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e8e expref: 308 pid: 6525 timeout: 1170 lvb_type: 0 00000100:00100000:2.0:1763343277.701175:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4788000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998413010944:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343277.701273:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc526c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343277.704305:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.704453:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399983232 00000100:00100000:3.0:1763343277.704462:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399983232 00010000:00010000:3.0:1763343277.704499:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4ef0 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e8e expref: 309 pid: 6525 timeout: 1170 lvb_type: 0 00000100:00100000:3.0:1763343277.704546:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3578 00000100:00100000:3.0:1763343277.704556:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:2408:x1848998399983232:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343277.704569:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343277.704576:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4ef0 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e8e expref: 309 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:3.0:1763343277.704588:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4ef0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e8e expref: 309 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:3.0:1763343277.704611:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:3.0:1763343277.704617:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4f1a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.704627:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4f1a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.704635:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4f1a lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.704652:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343277.705365:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:2408:x1848998399983232:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 805us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343277.705376:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3578 00010000:00010000:2.0:1763343277.705807:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a4ef0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e8e expref: 308 pid: 6525 timeout: 1170 lvb_type: 0 00000100:00100000:2.0:1763343277.705826:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4788000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998413010944:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343277.705846:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4f1a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.705855:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4f1a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.705860:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4f1a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:2.0:1763343277.705886:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21f:0x0]: returning size 5 00010000:00010000:2.0:1763343277.706013:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4f13 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49eaa expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.706072:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4f1a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49eaa expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.706081:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:2.0:1763343277.706084:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1763343277.706086:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583f600, rc 0) 00000100:00100000:2.0:1763343277.706126:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57185:x1848998399983104:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 5226us (5460us total) trans 4294973889 rc 0/0 00000100:00100000:2.0:1763343277.706135:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10969 00000100:00100000:1.0:1763343277.706315:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.706456:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399983360 00000100:00100000:2.0:1763343277.706462:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399983360 00000100:00100000:2.0:1763343277.706495:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10970 00000100:00100000:2.0:1763343277.706502:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57186:x1848998399983360:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:2.0:1763343277.706518:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.706534:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4f28 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49eb1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.706583:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4f2f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343277.706594:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4f2f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.706603:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4f2f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.706613:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4f36 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343277.706619:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4f36 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.706624:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4f36 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.706681:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4f3d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343277.706690:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4f1a lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49eaa expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.706697:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4f3d lrc: 4/1,0 mode: --/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.706725:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4f1a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49eaa expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.706739:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4f1a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49eaa expref: 309 pid: 6525 timeout: 1170 lvb_type: 0 00000100:00100000:2.0:1763343277.706752:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4788000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998413011072:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343277.706808:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc52240 going to sleep for 11 seconds 00000100:00100000:1.0:1763343277.713874:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.713948:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399983488 00000100:00100000:2.0:1763343277.713959:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399983488 00000100:00100000:2.0:1763343277.714021:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10971 00000100:00100000:2.0:1763343277.714054:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57185:x1848998399983488:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.714080:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.714101:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4f44 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49eb8 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.714196:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4f4b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343277.714211:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4f4b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.714232:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4f4b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:2.0:1763343277.716301:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4788000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998413011072:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343277.716332:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4f3d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000100:00100000:1.0:1763343277.716450:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.719411:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399983616 00000100:00100000:0.0:1763343277.719425:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399983616 00010000:00010000:0.0:1763343277.719476:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4f1a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49eaa expref: 312 pid: 6525 timeout: 1170 lvb_type: 0 00000100:00100000:0.0:1763343277.719528:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3579 00000100:00100000:0.0:1763343277.719538:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:2407:x1848998399983616:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343277.719555:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343277.719562:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4f1a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49eaa expref: 312 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:0.0:1763343277.719580:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4f1a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49eaa expref: 312 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:0.0:1763343277.719602:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f600/0x9104b1ba770a4f1a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x21f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49eaa expref: 312 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:0.0:1763343277.719619:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:0.0:1763343277.719624:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4f3d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.719633:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4f3d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.719640:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4f3d lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.719649:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4f4b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343277.719655:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4f4b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343277.719661:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4f4b lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343277.719702:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343277.719764:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:2407:x1848998399983616:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 226us (3314us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.719772:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3579 00010000:00010000:1.0:1763343277.719973:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4f3d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.719981:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4f3d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:1.0:1763343277.720068:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21f:0x0]: returning size 5 00000004:00200000:1.0:1763343277.720073:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343277.720096:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4f3d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.720107:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4f3d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.720117:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4f2f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.720123:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4f2f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.720129:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4f2f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.720135:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4f2f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.720142:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583ec00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.720147:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4f2f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.720153:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4f2f lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.720162:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758e00) 00010000:00010000:1.0:1763343277.720165:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.720168:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4f2f lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.720174:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ec00/0x9104b1ba770a4f2f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.720185:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4f36 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.720190:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4f36 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.720196:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4f36 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.720200:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.720203:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4f36 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.720209:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4f36 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.720224:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758200) 00010000:00010000:1.0:1763343277.720227:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.720230:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4f36 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.720235:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f200/0x9104b1ba770a4f36 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.720274:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fc00/0x9104b1ba770a4f28 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49eb1 expref: 311 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.720289:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4f3d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49eb1 expref: 310 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.720296:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:1.0:1763343277.720298:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343277.720301:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583ee00, rc 0) 00000100:00100000:1.0:1763343277.720340:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57186:x1848998399983360:12345-192.168.201.40@tcp:101:rm.0 Request processed in 13838us (14025us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.720347:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10970 00010000:00010000:2.0:1763343277.720662:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4f4b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.720670:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4f4b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:2.0:1763343277.720696:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21f:0x0]: returning size 5 00000004:00200000:2.0:1763343277.720698:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343277.720709:0:9827:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4f4b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.720730:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e800/0x9104b1ba770a4f44 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49eb8 expref: 310 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.720741:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4f4b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49eb8 expref: 309 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.720748:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:2.0:1763343277.720750:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343277.720752:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c583e600, rc 0) 00000100:00100000:2.0:1763343277.720791:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57185:x1848998399983488:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 6739us (6929us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.720798:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10971 00000100:00100000:0.0:1763343277.725358:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.725424:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399984000 00000100:00100000:2.0:1763343277.725434:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399984000 00000100:00100000:2.0:1763343277.725501:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10972 00000100:00100000:2.0:1763343277.725512:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57186:x1848998399984000:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:2.0:1763343277.725570:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1763343277.725597:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4eb8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21f:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e87 expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.725618:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583e600/0x9104b1ba770a4f4b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49eb8 expref: 308 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.725631:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583ee00/0x9104b1ba770a4f3d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49eb1 expref: 307 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.725643:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4e9c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e79 expref: 306 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.725657:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:2.0:1763343277.725668:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343277.725737:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4f52 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343277.725751:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4f52 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.725822:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4f52 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:0.0:1763343277.725827:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.725868:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399983872 00000100:00100000:1.0:1763343277.725872:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399983872 00000100:00100000:1.0:1763343277.725908:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10973 00000100:00100000:1.0:1763343277.725915:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57185:x1848998399983872:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343277.725925:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.725938:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4f60 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49ebf expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.725976:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4f60 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ebf expref: 307 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.725988:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4f60 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ebf expref: 307 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.726002:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c38f5600) 00010000:00010000:1.0:1763343277.726006:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343277.726008:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176400, rc 0) 00000100:00100000:1.0:1763343277.726090:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57185:x1848998399983872:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 175us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.726098:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10973 00010000:00010000:2.0:1763343277.728530:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4f59 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343277.728559:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4f59 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.728572:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4f59 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.728669:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4f67 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343277.728679:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4f67 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.728686:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4f67 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00080000:2.0:1763343277.728911:0:9827:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x21f:0x0] is inserted into orphan list, open count = 1 00010000:00010000:2.0:1763343277.728998:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4f67 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.729007:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4f67 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.729014:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4f67 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.729057:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583fa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.729062:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4f67 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.729070:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4f67 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.729084:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c38f5600) 00010000:00010000:2.0:1763343277.729088:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763343277.729093:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4f67 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.729100:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fa00/0x9104b1ba770a4f67 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.729119:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4f52 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.729126:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4f52 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.729137:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4f52 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00000100:00100000:0.0:1763343277.729137:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:2.0:1763343277.729146:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4f52 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.729152:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583fe00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.729155:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4f52 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.729162:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4f52 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.729175:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758300) 00010000:00010000:2.0:1763343277.729177:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.729180:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4f52 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.729186:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583fe00/0x9104b1ba770a4f52 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000004:00010000:2.0:1763343277.729200:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000081660761 reply state 00000000aceacbf6 transno 4294973890 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4f59 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.729211:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4f59 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.729231:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758b00) 00010000:00010000:2.0:1763343277.729233:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343277.729236:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343277.729314:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57186:x1848998399984000:12345-192.168.201.40@tcp:36:rm.0 Request processed in 3802us (3965us total) trans 4294973890 rc 0/0 00000100:00100000:2.0:1763343277.729324:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10972 00000100:00100000:2.0:1763343277.729350:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399984256 00000100:00100000:2.0:1763343277.729357:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399984256 00000100:00100000:2.0:1763343277.729400:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10974 00000100:00100000:2.0:1763343277.729410:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57185:x1848998399984256:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.729427:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.729439:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a4f6e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49ec6 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.729510:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a4f75 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343277.729521:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a4f75 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.729529:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a4f75 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:2.0:1763343277.729539:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21f:0x0]: returning size 5 00010000:00010000:2.0:1763343277.729601:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a4f6e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ec6 expref: 311 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.729615:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a4f75 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ec6 expref: 310 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.729623:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c38f5600) 00010000:00010000:2.0:1763343277.729626:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343277.729629:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fd600, rc 0) 00000100:00100000:2.0:1763343277.729665:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57185:x1848998399984256:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 256us (536us total) trans 4294973891 rc 0/0 00000100:00100000:2.0:1763343277.729673:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10974 00000100:00100000:0.0:1763343277.741951:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.742044:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399984384 00000100:00100000:3.0:1763343277.742055:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399984384 00000100:00100000:3.0:1763343277.742120:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7503 00000100:00100000:3.0:1763343277.742129:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998399984384:12345-192.168.201.40@tcp:1:lfs.0 00010000:00010000:3.0:1763343277.742177:0:28561:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a4f83 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.742198:0:28561:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4efe lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e95 expref: 20 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.742206:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343277.742209:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343277.742213:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a4f83 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.742260:0:28561:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4efe lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e95 expref: 20 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.742285:0:28561:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4efe lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e95 expref: 20 pid: 28562 timeout: 1170 lvb_type: 0 00000100:00100000:3.0:1763343277.742300:0:28561:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c2f84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998413011200:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343277.742625:0:28561:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c8284840 going to sleep for 11 seconds 00000100:00100000:0.0:1763343277.744796:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.744901:0:28561:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c2f84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998413011200:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343277.744933:0:28561:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a4f83 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343277.745000:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399984512 00000100:00100000:3.0:1763343277.745007:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399984512 00002000:00100000:3.0:1763343277.745259:0:28390:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x2c0000400:0x2db:0x0] (0->4) req@ffff9401f6403b80 x1848998399984512/t0(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:18/0 lens 496/0 e 0 to 0 dl 1763343288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343277.745269:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401f6403b80 with x1848998399984512 ext(0->4) 00010000:00010000:3.0:1763343277.745277:0:28390:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4efe lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e95 expref: 21 pid: 28562 timeout: 1170 lvb_type: 0 00010000:00010000:3.0:1763343277.745291:0:28390:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4efe lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e95 expref: 21 pid: 28562 timeout: 1170 lvb_type: 0 00002000:00010000:3.0:1763343277.745299:0:28390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9401f6403b80 00000100:00100000:3.0:1763343277.745455:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 125 00000100:00100000:3.0:1763343277.745466:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2409:x1848998399984512:12345-192.168.201.40@tcp:4:bash.0 00000100:00100000:0.0:1763343277.745669:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.745742:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399984640 00000100:00100000:1.0:1763343277.745747:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399984640 00000100:00100000:1.0:1763343277.745787:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10975 00000100:00100000:1.0:1763343277.745794:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57187:x1848998399984640:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343277.745811:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.745832:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4f8a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49ecd expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.745891:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4f91 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343277.745903:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4f91 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.745913:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4f91 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.745922:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a4f98 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343277.745930:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a4f98 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.745935:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a4f98 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.745966:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4f91 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.745973:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4f91 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.745978:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4f91 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.745983:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4f91 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.745988:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.745992:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4f91 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.745998:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4f91 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.746009:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5700) 00010000:00010000:1.0:1763343277.746012:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.746016:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4f91 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.746188:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4f91 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.746204:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a4f98 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.746210:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a4f98 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.746226:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a4f98 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.746232:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.746235:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a4f98 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.746241:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a4f98 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.746249:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758b00) 00010000:00010000:1.0:1763343277.746251:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.746254:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a4f98 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.746260:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a4f98 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.746340:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4f8a lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ecd expref: 311 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.746351:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5700) 00010000:00010000:1.0:1763343277.746354:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.746357:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4f8a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ecd expref: 311 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.746370:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177a00, rc 0) 00000100:00100000:1.0:1763343277.746425:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57187:x1848998399984640:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 631us (756us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343277.746432:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10975 00000100:00100000:3.0:1763343277.747121:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2409:x1848998399984512:12345-192.168.201.40@tcp:4:bash.0 Request processed in 1654us (2331us total) trans 17179872041 rc 0/0 00000100:00100000:3.0:1763343277.747129:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 125 00002000:00100000:3.0:1763343277.747138:0:28390:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x2c0000400:0x2db:0x0] (0->4) req@ffff9401f6403b80 x1848998399984512/t17179872041(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:18/0 lens 496/448 e 0 to 0 dl 1763343288 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343277.747146:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401f6403b80 with x1848998399984512 ext(0->4) 00010000:00010000:3.0:1763343277.747153:0:28390:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4efe lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e95 expref: 23 pid: 28562 timeout: 1170 lvb_type: 0 00010000:00010000:3.0:1763343277.747165:0:28390:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4efe lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e95 expref: 23 pid: 28562 timeout: 1170 lvb_type: 0 00002000:00010000:3.0:1763343277.747173:0:28390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9401f6403b80 00000100:00100000:0.0:1763343277.747933:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.748284:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399984768 00000100:00100000:1.0:1763343277.748293:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399984768 00000100:00100000:1.0:1763343277.748337:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10976 00000100:00100000:1.0:1763343277.748345:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57187:x1848998399984768:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343277.748362:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.748381:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4f9f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49ed4 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.748444:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4fa6 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343277.748457:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4fa6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.748473:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4fa6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.748483:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4fad lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343277.748491:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4fad lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.748497:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4fad lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.748532:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4fa6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.748539:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4fa6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.748545:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4fa6 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.748551:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4fa6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.748558:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.748562:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4fa6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.748569:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4fa6 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.748579:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5a00) 00010000:00010000:1.0:1763343277.748582:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.748586:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4fa6 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.748592:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4fa6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.748603:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4fad lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.748609:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4fad lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.748614:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4fad lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.748619:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.748621:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4fad lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.748626:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4fad lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.748632:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758b00) 00010000:00010000:1.0:1763343277.748635:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.748638:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4fad lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.748644:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4fad lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.748668:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4f9f lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ed4 expref: 311 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.748678:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5a00) 00010000:00010000:1.0:1763343277.748680:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.748683:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4f9f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ed4 expref: 311 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.748696:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176e00, rc 0) 00000100:00100000:1.0:1763343277.748744:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57187:x1848998399984768:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 399us (813us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343277.748750:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10976 00000100:00100000:3.0:1763343277.749201:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.749474:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399984896 00000100:00100000:2.0:1763343277.749484:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399984896 00010000:00010000:2.0:1763343277.749508:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4efe lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e95 expref: 23 pid: 28562 timeout: 1170 lvb_type: 0 00000100:00100000:2.0:1763343277.749596:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3580 00000100:00100000:2.0:1763343277.749605:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2407:x1848998399984896:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343277.749617:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1763343277.749632:0:14071:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:2.0:1763343277.749635:0:14071:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb mtime from disk: 1763343276 -> 1763343277 00002000:00010000:2.0:1763343277.749638:0:14071:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb atime from disk: 0 -> 1763343276 00002000:00010000:2.0:1763343277.749640:0:14071:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb ctime from disk: 1763343276 -> 1763343277 00002000:00010000:2.0:1763343277.749642:0:14071:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1763343277.749648:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4efe lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e95 expref: 23 pid: 28562 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.749661:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4efe lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e95 expref: 23 pid: 28562 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.749682:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a4efe lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e95 expref: 23 pid: 28562 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.749696:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.749698:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343277.749703:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a4f83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.749713:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a4f83 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.749743:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343277.749763:0:28561:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a4f83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.749772:0:28561:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a4f83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343277.749777:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998399984896:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 175us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.749783:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3580 00010000:00010000:0.0:1763343277.749790:0:28561:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a4f83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.749797:0:28561:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a4f83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.749805:0:28561:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a4f83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.749811:0:28561:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8692c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343277.749815:0:28561:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a4f83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.749823:0:28561:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a4f83 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.749840:0:28561:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a4f83 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.749848:0:28561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a4f83 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343277.749891:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998399984384:12345-192.168.201.40@tcp:1:lfs.0 Request processed in 7762us (7951us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.749898:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7503 00000100:00100000:0.0:1763343277.751765:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.751805:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.751867:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399985024 00000100:00100000:2.0:1763343277.751876:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399985024 00000100:00100000:1.0:1763343277.751888:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399985280 00000100:00100000:1.0:1763343277.751893:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399985280 00000100:00100000:2.0:1763343277.751926:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10977 00000100:00100000:1.0:1763343277.751931:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10978 00000100:00100000:2.0:1763343277.751935:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57187:x1848998399985024:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:1.0:1763343277.751937:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57185:x1848998399985280:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:2.0:1763343277.751952:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.751973:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a4fb4 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49edb expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.751974:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343277.751991:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a4f60 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ebf expref: 312 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.752005:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c38f5600) 00010000:00010000:1.0:1763343277.752009:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343277.752014:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a4fbb lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343277.752048:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a4fbb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.752056:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4fc2 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343277.752058:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a4fbb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343277.752065:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4fc2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.752071:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4fc2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:2.0:1763343277.752093:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763343277.752098:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763343277.752126:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a4fb4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49edb expref: 312 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.752139:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a4fbb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49edb expref: 311 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.752145:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758300) 00010000:00010000:2.0:1763343277.752148:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763343277.752151:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fca00, rc 0) 00000100:00100000:2.0:1763343277.752196:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57187:x1848998399985024:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 263us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.752203:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10977 00000040:00080000:1.0:1763343277.752295:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1811, 88 off150416 00000004:00080000:1.0:1763343277.752302:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1070876277262ns, next at 1071106415333ns, rc = 0 00000040:00080000:1.0:1763343277.752333:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1802, 88 off149656 00000004:00080000:1.0:1763343277.752338:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1070876313164ns, next at 1071106445174ns, rc = 0 00000040:00080000:1.0:1763343277.752361:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1803, 88 off149744 00000004:00080000:1.0:1763343277.752366:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1070876341255ns, next at 1071106445174ns, rc = 0 00000040:00080000:1.0:1763343277.752376:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1812, 88 off150504 00000004:00080000:1.0:1763343277.752380:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1070876355372ns, next at 1071106415333ns, rc = 0 00000100:00100000:3.0:1763343277.754548:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.754683:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399985408 00000100:00100000:0.0:1763343277.754693:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399985408 00000100:00100000:0.0:1763343277.754774:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10979 00000100:00100000:0.0:1763343277.754784:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57187:x1848998399985408:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343277.754804:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343277.754822:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4fc9 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49ee2 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.754883:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4fd0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343277.754897:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4fd0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.754908:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4fd0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.754921:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4fd7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343277.754928:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4fd7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.754934:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4fd7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.754971:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4fd0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.754978:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4fd0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.754984:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4fd0 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.754990:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4fd0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.754996:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ac00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343277.755001:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4fd0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.755007:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4fd0 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.755019:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758300) 00010000:00010000:0.0:1763343277.755172:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343277.755178:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4fd0 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.755183:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a4fd0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.755193:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4fd7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.755197:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4fd7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.755200:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4fd7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.755203:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343277.755204:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4fd7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.755208:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4fd7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.755212:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758b00) 00010000:00010000:0.0:1763343277.755225:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343277.755228:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4fd7 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.755232:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a4fd7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.755256:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4fc9 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ee2 expref: 313 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.755263:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758300) 00010000:00010000:0.0:1763343277.755265:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343277.755267:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a4fc9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ee2 expref: 313 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.755334:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501ba00, rc 0) 00000100:00100000:0.0:1763343277.755384:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57187:x1848998399985408:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 602us (845us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343277.755392:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10979 00000001:00080000:1.0:1763343277.756582:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973892 is committed 00000004:00080000:1.0:1763343277.756592:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1163 committed 00000004:00080000:1.0:1763343277.757200:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1155 committed 00000004:00080000:1.0:1763343277.757224:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1154 committed 00000004:00080000:1.0:1763343277.757227:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1162 committed 00000004:00010000:1.0:1763343277.757285:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c3f5b8de reply state 00000000c7bbde40 transno 4294973892 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4fc2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.757305:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4fc2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.757318:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c38f5600) 00010000:00010000:1.0:1763343277.757321:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1763343277.757326:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343277.757343:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4f59 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.757354:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4f59 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.757362:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4f59 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.757368:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c583f400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.757371:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4f59 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.757377:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4f59 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.757386:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758b00) 00010000:00010000:2.0:1763343277.757388:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.757391:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4f59 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343277.757395:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c583f400/0x9104b1ba770a4f59 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00080000:1.0:1763343277.757429:0:6525:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00010000:00010000:2.0:1763343277.757449:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4fc2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00000100:00100000:1.0:1763343277.757450:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:57185:x1848998399985280:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 5508us (5640us total) trans 4294973892 rc 0/0 00010000:00010000:2.0:1763343277.757460:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4fc2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00000100:00100000:1.0:1763343277.757467:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10978 00010000:00010000:2.0:1763343277.757471:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4fc2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.757475:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.757477:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4fc2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.757480:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4fc2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.757485:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c38f5600) 00010000:00010000:2.0:1763343277.757487:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343277.757489:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4fc2 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.757492:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a4fc2 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00000100:00100000:2.0:1763343277.757751:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1763343277.757772:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413011456:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343277.757824:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343277.758017:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413011328:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343277.758152:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763343277.758162:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413011584:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343277.758201:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413011456 00000100:00100000:0.0:1763343277.758208:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413011456 00000100:00100000:0.0:1763343277.758255:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7504 00000100:00100000:0.0:1763343277.758262:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+42:3660:x1848998413011456:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763343277.758384:0:28561:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2db:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343277.758387:0:28561:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2db:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343277.758390:0:28561:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2db:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343277.758392:0:28561:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2db:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343277.758394:0:28561:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2db:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343277.758424:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+43:3660:x1848998413011456:12345-0@lo:2:osp-syn-0-1.0 Request processed in 162us (600us total) trans 21474839311 rc 0/0 00000100:00100000:0.0:1763343277.758430:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7504 00000100:00100000:1.0:1763343277.758517:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1763343277.758524:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401edc1ad80/2, rc 0, transno 21474839311 00000100:00100000:2.0:1763343277.758531:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413011456:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343277.758559:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763343277.758568:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413011712:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343277.758576:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.758604:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343277.758630:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413011328 00000100:00100000:2.0:1763343277.758634:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413011328 00000100:00100000:1.0:1763343277.758653:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399985664 00000100:00100000:2.0:1763343277.758660:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413011712 00000100:00100000:1.0:1763343277.758660:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399985664 00000100:00100000:2.0:1763343277.758665:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413011712 00000100:00100000:2.0:1763343277.758689:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7505 00000100:00100000:2.0:1763343277.758695:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+43:3662:x1848998413011328:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343277.758703:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10980 00000100:00100000:1.0:1763343277.758713:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+302:57187:x1848998399985664:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343277.758726:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.758729:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00002000:00010000:2.0:1763343277.758747:0:28561:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2da:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343277.758750:0:28561:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2da:0x0] updating lvb mtime from disk: 1763343276 -> 1763343276 00002000:00010000:2.0:1763343277.758752:0:28561:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343277.758753:0:28561:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2da:0x0] updating lvb ctime from disk: 1763343276 -> 1763343276 00002000:00010000:2.0:1763343277.758755:0:28561:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2da:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1763343277.758761:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a4fbb lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49edb expref: 302 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.758779:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758300) 00000100:00100000:2.0:1763343277.758782:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+44:3662:x1848998413011328:12345-0@lo:2:osp-syn-0-1.0 Request processed in 88us (700us total) trans 21474839312 rc 0/0 00000100:00100000:2.0:1763343277.758788:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7505 00010000:00010000:1.0:1763343277.758791:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343277.758801:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7506 00000100:00100000:2.0:1763343277.758806:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+25:3662:x1848998413011712:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1763343277.758814:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4fde lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49ee9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343277.758863:0:28561:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2dc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343277.758866:0:28561:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2dc:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763343277.758867:0:28561:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2dc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343277.758869:0:28561:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2dc:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763343277.758870:0:28561:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2dc:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1763343277.758912:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4fe5 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00000100:00100000:2.0:1763343277.758913:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+26:3662:x1848998413011712:12345-0@lo:2:osp-syn-1-1.0 Request processed in 106us (309us total) trans 17179872042 rc 0/0 00000100:00100000:2.0:1763343277.758928:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7506 00010000:00010000:1.0:1763343277.758934:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4fe5 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.758944:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4fe5 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.758961:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4fec lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00000004:00080000:2.0:1763343277.758966:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6505180/2, rc 0, transno 17179872042 00010000:00010000:1.0:1763343277.758969:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4fec lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00000100:00100000:2.0:1763343277.758975:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413011712:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1763343277.758980:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4fec lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00080000:2.0:1763343277.758989:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400cc5df480/2, rc 0, transno 21474839312 00000100:00100000:2.0:1763343277.758993:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413011328:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343277.759365:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343277.759398:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4ff3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x220:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343277.759409:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4ff3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x220:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.759417:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4ff3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x220:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:1.0:1763343277.759426:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x220:0x0]: returning size 0 00010000:00010000:1.0:1763343277.759448:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4fe5 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.759455:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4fe5 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.759461:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4fe5 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.759468:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4fe5 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.759474:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.759478:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4fe5 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.759489:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4fe5 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.759498:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5a00) 00010000:00010000:1.0:1763343277.759501:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.759504:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4fe5 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.759510:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a4fe5 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00000004:00010000:1.0:1763343277.759520:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006e6112e0 reply state 000000009b7f4fec transno 4294973893 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4fec lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.759530:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4fec lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.759535:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5700) 00010000:00010000:1.0:1763343277.759538:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343277.759539:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343277.759563:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a4fde lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ee9 expref: 304 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.759578:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4ff3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x220:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ee9 expref: 303 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.759585:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x220:0x0].0x0 (ffff9400c38f5000) 00010000:00010000:1.0:1763343277.759587:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343277.759589:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177800, rc 0) 00000100:00100000:1.0:1763343277.759638:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57187:x1848998399985664:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 927us (1066us total) trans 4294973893 rc 0/0 00000100:00100000:1.0:1763343277.759648:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10980 00000100:00100000:3.0:1763343277.759802:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413011584 00000100:00100000:3.0:1763343277.759809:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413011584 00000100:00100000:3.0:1763343277.759846:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7507 00000100:00100000:3.0:1763343277.759853:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+26:3659:x1848998413011584:12345-0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763343277.760162:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6507800/2, rc 0, transno 17179872043 00000100:00100000:0.0:1763343277.760169:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413011584:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343277.760204:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+27:3659:x1848998413011584:12345-0@lo:2:osp-syn-1-1.0 Request processed in 350us (839us total) trans 17179872043 rc 0/0 00000100:00100000:3.0:1763343277.760228:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7507 00000100:00100000:1.0:1763343277.760306:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.760364:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399985792 00000100:00100000:0.0:1763343277.760368:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399985792 00000100:00100000:0.0:1763343277.760540:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10981 00000100:00100000:0.0:1763343277.760549:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57185:x1848998399985792:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343277.760565:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343277.760578:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a5001 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49ef0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.760616:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a5001 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ef0 expref: 305 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.760628:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a5001 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ef0 expref: 305 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.760644:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c38f5600) 00010000:00010000:0.0:1763343277.760647:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343277.760649:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501be00, rc 0) 00000100:00100000:0.0:1763343277.760686:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57185:x1848998399985792:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 138us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.760693:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10981 00000100:00100000:0.0:1763343277.762787:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.763092:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399985920 00000100:00100000:1.0:1763343277.763104:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399985920 00000100:00100000:1.0:1763343277.763179:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10982 00000100:00100000:1.0:1763343277.763189:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57185:x1848998399985920:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343277.763240:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.763265:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a5008 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49ef7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.763520:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a500f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343277.763534:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a500f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.763545:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a500f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:1.0:1763343277.763588:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x21f:0x0]: returning size 5 00000004:00200000:1.0:1763343277.763593:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343277.763609:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a500f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.763633:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a5008 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ef7 expref: 307 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.763650:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a500f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ef7 expref: 306 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.763661:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c38f5600) 00010000:00010000:1.0:1763343277.763664:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1763343277.763667:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177200, rc 0) 00000100:00100000:1.0:1763343277.763729:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57185:x1848998399985920:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 541us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.763737:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10982 00000100:00100000:3.0:1763343277.763963:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.764124:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399986176 00000100:00100000:1.0:1763343277.764129:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399986176 00000100:00100000:1.0:1763343277.764397:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10983 00000100:00100000:1.0:1763343277.764407:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57187:x1848998399986176:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343277.764419:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.764429:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5016 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x220:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49efe expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.764495:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a501d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x220:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343277.764508:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4ff3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x220:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ee9 expref: 307 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.764516:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a501d lrc: 4/0,1 mode: --/EX res: [0x240000404:0x220:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.764548:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4ff3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x220:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ee9 expref: 307 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.764562:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4ff3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x220:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ee9 expref: 307 pid: 6525 timeout: 1170 lvb_type: 0 00000100:00100000:1.0:1763343277.764581:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998413011840:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343277.764647:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc6d780 going to sleep for 11 seconds 00000100:00100000:1.0:1763343277.767226:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998413011840:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343277.767258:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a501d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x220:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000100:00100000:3.0:1763343277.767481:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.767570:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.767593:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399986304 00000100:00100000:2.0:1763343277.767601:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399986304 00010000:00010000:2.0:1763343277.767636:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4ff3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x220:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ee9 expref: 308 pid: 6525 timeout: 1170 lvb_type: 0 00000100:00100000:0.0:1763343277.767658:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399986432 00000100:00100000:0.0:1763343277.767664:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399986432 00000100:00100000:0.0:1763343277.767727:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7508 00000100:00100000:0.0:1763343277.767738:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2410:x1848998399986432:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343277.767766:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343277.767790:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5024 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49f05 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343277.767818:0:28562:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2db:0x0] initial LVB size: 5, mtime: 0x691a7bad, atime: 0x691a7bac, ctime: 0x691a7bad, blocks: 0x8 00010000:00010000:0.0:1763343277.767843:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.767846:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.767856:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5024 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f05 expref: 22 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343277.767873:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5024 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f05 expref: 22 pid: 28562 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1763343277.767876:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3581 00010000:00010000:0.0:1763343277.767890:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501ba00, rc 0) 00000100:00100000:2.0:1763343277.767895:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:2408:x1848998399986304:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343277.767909:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343277.767917:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4ff3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x220:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ee9 expref: 308 pid: 6525 timeout: 1170 lvb_type: 0 00010000:00010000:2.0:1763343277.767932:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4ff3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x220:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ee9 expref: 308 pid: 6525 timeout: 1170 lvb_type: 0 00000100:00100000:0.0:1763343277.767952:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2410:x1848998399986432:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 214us (380us total) trans 0 rc 0/0 00010000:00010000:2.0:1763343277.767958:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a4ff3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x220:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ee9 expref: 308 pid: 6525 timeout: 1170 lvb_type: 0 00000100:00100000:0.0:1763343277.767965:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7508 00010000:00010000:2.0:1763343277.767995:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x220:0x0].0x0 (ffff9400c38f5000) 00010000:00010000:2.0:1763343277.768000:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a501d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x220:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.768009:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a501d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x220:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.768017:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a501d lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x220:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.768071:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343277.768086:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a501d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x220:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.768094:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a501d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x220:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000100:00100000:2.0:1763343277.768104:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:2408:x1848998399986304:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 213us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.768111:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3581 00000004:00200000:3.0:1763343277.768122:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x220:0x0]: returning size 0 00000004:00080000:3.0:1763343277.768337:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2dc:0x0], index 0: 0 00000004:00080000:3.0:1763343277.768345:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2dd:0x0], index 1: 0 00000004:00080000:3.0:1763343277.768350:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2de:0x0], index 1: 0 00000004:00080000:3.0:1763343277.768354:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2dd:0x0], index 0: 0 00010000:00010000:3.0:1763343277.768465:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a501d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x220:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.768474:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a501d lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x220:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.768480:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a501d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x220:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.768486:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343277.768491:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a501d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x220:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.768500:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a501d lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x220:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.768513:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x220:0x0].0x0 (ffff9400c38f5000) 00010000:00010000:3.0:1763343277.768516:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343277.768520:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a501d lrc: 2/0,0 mode: --/EX res: [0x240000404:0x220:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.768525:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a501d lrc: 0/0,0 mode: --/EX res: [0x240000404:0x220:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.768575:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5016 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x220:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49efe expref: 307 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.768585:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x220:0x0].0x0 (ffff9400c38f5000) 00010000:00010000:3.0:1763343277.768587:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343277.768670:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5016 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x220:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49efe expref: 307 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.768686:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176c00, rc 0) 00000100:00100000:3.0:1763343277.768735:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57187:x1848998399986176:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 4329us (4772us total) trans 4294973894 rc 301/301 00000100:00100000:3.0:1763343277.768743:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10983 00000100:00100000:3.0:1763343277.771191:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.771437:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399986688 00000100:00100000:2.0:1763343277.771447:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399986688 00000100:00100000:2.0:1763343277.771510:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3877 00000100:00100000:2.0:1763343277.771522:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57187:x1848998399986688:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343277.772702:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57187:x1848998399986688:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1174us (1513us total) trans 4294973895 rc 0/0 00000100:00100000:2.0:1763343277.772716:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3877 00000100:00100000:2.0:1763343277.777658:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.779186:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399986944 00000100:00100000:3.0:1763343277.779201:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399986944 00000100:00100000:0.0:1763343277.779950:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3878 00000100:00100000:0.0:1763343277.779964:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57187:x1848998399986944:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343277.780446:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57187:x1848998399986944:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 482us (2793us total) trans 4294973896 rc 0/0 00000100:00100000:0.0:1763343277.780455:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3878 00000100:00100000:0.0:1763343277.784915:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.785003:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399987200 00000100:00100000:3.0:1763343277.785015:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399987200 00000100:00100000:3.0:1763343277.785092:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10984 00000100:00100000:3.0:1763343277.785103:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:55884:x1848998399987200:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343277.785127:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343277.785153:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5032 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49f0c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.785330:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5039 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343277.785344:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5039 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.785356:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5039 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.785366:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5040 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343277.785373:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5040 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.785379:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5040 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.785438:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5047 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x220:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343277.785446:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5047 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x220:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.785453:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5047 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x220:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:3.0:1763343277.785463:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x220:0x0]: returning size 0 00010000:00010000:3.0:1763343277.785562:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5039 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.785571:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5039 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.785577:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5039 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.785584:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5039 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.785590:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343277.785594:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5039 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.785601:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5039 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.785613:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4759100) 00010000:00010000:3.0:1763343277.785615:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343277.785621:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5039 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.785626:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5039 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.785639:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5040 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.785645:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5040 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.785649:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5040 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.785655:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121e800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343277.785657:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5040 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.785667:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5040 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.785673:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5700) 00010000:00010000:3.0:1763343277.785675:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343277.785678:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5040 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.785683:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5040 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.785720:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5032 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f0c expref: 311 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.785738:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5047 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x220:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f0c expref: 310 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.785746:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x220:0x0].0x0 (ffff9400c4759600) 00010000:00010000:3.0:1763343277.785748:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343277.785750:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8692c00, rc 0) 00000100:00100000:3.0:1763343277.785817:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:55884:x1848998399987200:12345-192.168.201.40@tcp:101:bash.0 Request processed in 715us (915us total) trans 4294973897 rc 0/0 00000100:00100000:3.0:1763343277.785826:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10984 00000100:00100000:2.0:1763343277.789510:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.789998:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399987328 00000100:00100000:0.0:1763343277.790015:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399987328 00000100:00100000:0.0:1763343277.790417:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10985 00000100:00100000:0.0:1763343277.790428:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:55884:x1848998399987328:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343277.790452:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343277.790473:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a5055 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x220:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49f13 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.790506:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a505c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x220:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343277.790525:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a505c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x220:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.790536:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a505c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x220:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.790648:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a5055 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x220:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f13 expref: 312 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.790665:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a505c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x220:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f13 expref: 311 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.790673:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x220:0x0].0x0 (ffff9400c4759600) 00010000:00010000:0.0:1763343277.790675:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343277.790679:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b400, rc 0) 00000100:00100000:0.0:1763343277.790748:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:55884:x1848998399987328:12345-192.168.201.40@tcp:101:bash.0 Request processed in 322us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.790755:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10985 00000100:00100000:2.0:1763343277.793420:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.794074:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399987584 00000100:00100000:0.0:1763343277.794088:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399987584 00000100:00100000:0.0:1763343277.794150:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10986 00000100:00100000:0.0:1763343277.794160:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:55884:x1848998399987584:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:0.0:1763343277.794222:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343277.794247:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5047 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x220:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f0c expref: 311 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.794267:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x220:0x0].0x0 (ffff9400c4759600) 00010000:00010000:0.0:1763343277.794281:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343277.794458:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5063 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x220:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343277.794471:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5063 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x220:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.794480:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5063 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x220:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000001:00080000:0.0:1763343277.794521:0:7641:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973898 00000004:00010000:0.0:1763343277.794548:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b2818aac reply state 000000005193a2d4 transno 4294973899 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5063 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x220:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.794558:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5063 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x220:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.794564:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x220:0x0].0x0 (ffff9400c4759600) 00010000:00010000:0.0:1763343277.794567:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343277.794570:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343277.794668:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:55884:x1848998399987584:12345-192.168.201.40@tcp:36:bash.0 Request processed in 508us (1256us total) trans 4294973899 rc 0/0 00000100:00100000:0.0:1763343277.794675:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10986 00000020:00080000:0.0:1763343277.794680:0:7641:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763343277.797047:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.797326:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399987712 00000100:00100000:3.0:1763343277.797341:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399987712 00000100:00100000:3.0:1763343277.797416:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10987 00000100:00100000:3.0:1763343277.797429:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:55884:x1848998399987712:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343277.797460:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343277.797486:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a506a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x220:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49f1a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.797552:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a506a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x220:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f1a expref: 314 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.797570:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a506a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x220:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f1a expref: 314 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.797592:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x220:0x0].0x0 (ffff9400c4759600) 00010000:00010000:3.0:1763343277.797595:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343277.797599:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8693e00, rc 0) 00000100:00100000:3.0:1763343277.797677:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:55884:x1848998399987712:12345-192.168.201.40@tcp:101:bash.0 Request processed in 250us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343277.797686:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10987 00000100:00100000:2.0:1763343277.804664:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.804798:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399987968 00000100:00100000:0.0:1763343277.804811:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399987968 00000100:00100000:0.0:1763343277.804879:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10988 00000100:00100000:0.0:1763343277.804888:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:55884:x1848998399987968:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343277.804909:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343277.804912:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343277.804937:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a506a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x220:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f1a expref: 314 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.804962:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x220:0x0].0x0 (ffff9400c4759600) 00010000:00010000:0.0:1763343277.804968:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343277.804981:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a5071 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x220:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49f21 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.805082:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5078 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x220:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343277.805098:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5078 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x220:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343277.805109:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5078 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x220:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000040:00080000:1.0:1763343277.805439:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1804, 88 off149832 00000004:00080000:1.0:1763343277.805448:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1070929422644ns, next at 1071106445174ns, rc = 0 00000040:00080000:1.0:1763343277.805484:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1813, 88 off150592 00000004:00080000:1.0:1763343277.805489:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1070929463985ns, next at 1071106415333ns, rc = 0 00000040:00080000:1.0:1763343277.805510:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1814, 88 off150680 00000004:00080000:1.0:1763343277.805514:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1070929489397ns, next at 1071106415333ns, rc = 0 00000040:00080000:1.0:1763343277.805526:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1805, 88 off149920 00000004:00080000:1.0:1763343277.805530:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1070929505567ns, next at 1071106445174ns, rc = 0 00000001:00080000:3.0:1763343277.808282:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973900 is committed 00000004:00080000:3.0:1763343277.808299:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1157 committed 00000004:00080000:3.0:1763343277.808319:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1165 committed 00000004:00080000:3.0:1763343277.808340:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1164 committed 00000004:00080000:3.0:1763343277.808343:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1156 committed 00000100:00100000:1.0:1763343277.808450:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763343277.808480:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c3729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413011968:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343277.808481:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c3728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413012096:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343277.808605:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763343277.808634:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4fec lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.808645:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4fec lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.808653:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4fec lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.808659:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.808664:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4fec lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.808673:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4fec lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00000100:00100000:1.0:1763343277.808693:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413012352:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1763343277.808694:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5700) 00010000:00010000:2.0:1763343277.808701:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.808706:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4fec lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.808716:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a4fec lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00000100:00100000:1.0:1763343277.808725:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763343277.808745:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5063 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x220:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.808752:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5063 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x220:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.808758:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5063 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x220:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00000100:00100000:1.0:1763343277.808759:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413011968 00010000:00010000:2.0:1763343277.808766:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a600 already unused, calling callback (ffffffffc18dd550) 00000100:00100000:1.0:1763343277.808769:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413011968 00010000:00010000:2.0:1763343277.808771:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5063 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x220:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.808778:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5063 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x220:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.808788:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x220:0x0].0x0 (ffff9400c4759600) 00010000:00010000:2.0:1763343277.808791:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.808795:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5063 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x220:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.808800:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5063 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x220:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000100:00100000:1.0:1763343277.808827:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413012352 00000100:00100000:1.0:1763343277.808830:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413012352 00000100:00100000:0.0:1763343277.808853:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343277.808861:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7509 00000100:00100000:1.0:1763343277.808872:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+44:3661:x1848998413011968:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343277.808882:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763343277.808891:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413012224:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343277.808917:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343277.808950:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413012096 00000100:00100000:0.0:1763343277.808954:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413012096 00000100:00100000:0.0:1763343277.808980:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413012224 00000100:00100000:0.0:1763343277.808983:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413012224 00000100:00100000:0.0:1763343277.809005:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7510 00000100:00100000:0.0:1763343277.809013:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edde6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+28:3661:x1848998413012352:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343277.809088:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+46:3661:x1848998413011968:12345-0@lo:2:osp-syn-0-1.0 Request processed in 218us (483us total) trans 21474839313 rc 0/0 00000100:00100000:1.0:1763343277.809096:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7509 00000100:00100000:1.0:1763343277.809115:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7511 00000100:00100000:1.0:1763343277.809123:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+45:3659:x1848998413012096:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343277.809149:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edde6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+29:3661:x1848998413012352:12345-0@lo:2:osp-syn-1-1.0 Request processed in 136us (423us total) trans 17179872044 rc 0/0 00000100:00100000:0.0:1763343277.809157:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7510 00000100:00100000:1.0:1763343277.809207:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+46:3659:x1848998413012096:12345-0@lo:2:osp-syn-0-1.0 Request processed in 84us (354us total) trans 21474839314 rc 0/0 00000100:00100000:1.0:1763343277.809227:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7511 00000100:00100000:1.0:1763343277.809248:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7512 00000100:00100000:1.0:1763343277.809256:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c372b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+28:3659:x1848998413012224:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343277.809322:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c372b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+29:3659:x1848998413012224:12345-0@lo:2:osp-syn-1-1.0 Request processed in 68us (403us total) trans 17179872045 rc 0/0 00000100:00100000:1.0:1763343277.809328:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7512 00000004:00080000:1.0:1763343277.809560:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bfd500/2, rc 0, transno 17179872044 00000100:00100000:1.0:1763343277.809567:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413012352:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763343277.809580:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c3729180/2, rc 0, transno 21474839313 00000100:00100000:1.0:1763343277.809586:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c3729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413011968:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763343277.809609:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bfd880/2, rc 0, transno 17179872045 00000100:00100000:0.0:1763343277.809616:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413012224:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763343277.809626:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c3728e00/2, rc 0, transno 21474839314 00000100:00100000:0.0:1763343277.809629:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c3728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413012096:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1763343277.809641:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5078 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x220:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f21 expref: 306 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.809653:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x220:0x0].0x0 (ffff9400c4759600) 00010000:00010000:1.0:1763343277.809655:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343277.809667:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a5071 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x220:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f21 expref: 306 pid: 7641 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343277.809686:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5078 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x220:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f21 expref: 305 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.809711:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x220:0x0].0x0 (ffff9400c4759600) 00010000:00010000:1.0:1763343277.809714:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343277.809716:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501bc00, rc 0) 00000100:00100000:1.0:1763343277.809768:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:55884:x1848998399987968:12345-192.168.201.40@tcp:101:bash.0 Request processed in 4881us (5118us total) trans 4294973900 rc 0/0 00000100:00100000:1.0:1763343277.809776:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10988 00000100:00100000:2.0:1763343277.815129:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.815168:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.815203:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.815224:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399988352 00000100:00100000:0.0:1763343277.815237:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399988352 00000100:00100000:2.0:1763343277.815248:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.815306:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399988480 00000100:00100000:0.0:1763343277.815309:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399988480 00000100:00100000:0.0:1763343277.815335:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 747 00000100:00100000:0.0:1763343277.815345:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2408:x1848998399988352:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:1.0:1763343277.815350:0:32304:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399988096 00000100:00100000:1.0:1763343277.815357:0:32304:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399988096 00000100:00100000:1.0:1763343277.815397:0:32304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 148 00000100:00100000:1.0:1763343277.815406:0:32304:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c487c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:115d5667-a2e7-4faf-8d77-45fb38721d60+9:2408:x1848998399988096:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:0.0:1763343277.815436:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2408:x1848998399988352:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 91us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.815443:0:32304:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c487c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:115d5667-a2e7-4faf-8d77-45fb38721d60+9:2408:x1848998399988096:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 36us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.815450:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 747 00000100:00100000:1.0:1763343277.815456:0:32304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 148 00000100:00100000:0.0:1763343277.815475:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7513 00000100:00100000:0.0:1763343277.815485:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:55884:x1848998399988480:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343277.815496:0:8413:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343277.815519:0:8413:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c501b800/0x9104b1ba770a507f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49f28 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343277.815542:0:8413:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343277.815559:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.815561:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.815569:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501b800/0x9104b1ba770a507f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f28 expref: 26 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.815584:0:8413:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c501b800/0x9104b1ba770a507f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f28 expref: 26 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.815600:0:8413:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b800, rc 0) 00000100:00100000:0.0:1763343277.815621:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:55884:x1848998399988480:12345-192.168.201.40@tcp:101:bash.0 Request processed in 138us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.815626:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7513 00000100:00100000:3.0:1763343277.815675:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399988224 00000100:00100000:3.0:1763343277.815680:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399988224 00000100:00100000:3.0:1763343277.815737:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1274 00000100:00100000:3.0:1763343277.815745:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998399988224:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:3.0:1763343277.815779:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998399988224:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 35us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343277.815785:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1274 00000100:00080000:1.0:1763343277.815849:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1763343277.818489:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.818703:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399988608 00000100:00100000:3.0:1763343277.818713:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399988608 00000100:00100000:3.0:1763343277.818773:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7514 00000100:00100000:3.0:1763343277.818784:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:55884:x1848998399988608:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343277.818802:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343277.818825:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5086 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49f2f expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343277.818849:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343277.818871:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343277.818873:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343277.818883:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5086 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f2f expref: 23 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.818899:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5086 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f2f expref: 23 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.818912:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8693c00, rc 0) 00000100:00100000:3.0:1763343277.818977:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:55884:x1848998399988608:12345-192.168.201.40@tcp:101:bash.0 Request processed in 194us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343277.818983:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7514 00010000:00010000:1.0:1763343277.823081:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343277.823925:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.823974:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.824015:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.824405:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399988864 00000100:00100000:0.0:1763343277.824416:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399988864 00002000:00010000:0.0:1763343277.824459:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/732 (0->18446744073709551615) 00002000:00100000:0.0:1763343277.824463:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c4788000 with x1848998399988864 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343277.824476:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c4788000. 00000100:00100000:0.0:1763343277.824506:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399988992 00000100:00100000:0.0:1763343277.824510:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399988992 00002000:00010000:0.0:1763343277.824523:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/733 (0->18446744073709551615) 00002000:00100000:0.0:1763343277.824526:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b2a300 with x1848998399988992 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343277.824532:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5b2a300. 00000100:00100000:0.0:1763343277.824551:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1779 00000100:00100000:0.0:1763343277.824559:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2408:x1848998399988864:12345-192.168.201.40@tcp:10:bash.0 00000100:00100000:2.0:1763343277.824595:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1780 00000100:00100000:2.0:1763343277.824608:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2407:x1848998399988992:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:2.0:1763343277.824757:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2dd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343277.824757:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2dc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343277.824762:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2dd:0x0] updating lvb mtime from disk: 0 -> 1763343277 00002000:00010000:0.0:1763343277.824764:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2dc:0x0] updating lvb mtime from disk: 0 -> 1763343277 00002000:00010000:2.0:1763343277.824768:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2dd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343277.824769:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2dc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343277.824772:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2dd:0x0] updating lvb ctime from disk: 0 -> 1763343277 00002000:00010000:0.0:1763343277.824774:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2dc:0x0] updating lvb ctime from disk: 0 -> 1763343277 00002000:00010000:2.0:1763343277.824777:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2dd:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1763343277.824780:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2dc:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343277.824848:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2407:x1848998399988992:12345-192.168.201.40@tcp:10:bash.0 Request processed in 242us (830us total) trans 17179872046 rc 0/0 00000100:00100000:0.0:1763343277.824850:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2408:x1848998399988864:12345-192.168.201.40@tcp:10:bash.0 Request processed in 289us (871us total) trans 21474839315 rc 0/0 00000100:00100000:2.0:1763343277.824865:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1780 00002000:00010000:2.0:1763343277.824871:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/733 (0->18446744073709551615) 00000100:00100000:0.0:1763343277.824874:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1779 00002000:00100000:2.0:1763343277.824876:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5b2a300 with x1848998399988992 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343277.824881:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/732 (0->18446744073709551615) 00002000:00010000:2.0:1763343277.824884:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5b2a300. 00002000:00100000:0.0:1763343277.824887:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c4788000 with x1848998399988864 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343277.824895:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c4788000. 00000100:00100000:3.0:1763343277.824918:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399988736 00000100:00100000:3.0:1763343277.824924:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399988736 00000100:00100000:3.0:1763343277.824962:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7515 00000100:00100000:3.0:1763343277.824971:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2407:x1848998399988736:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:3.0:1763343277.825087:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2407:x1848998399988736:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 117us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343277.825094:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7515 00000100:00100000:2.0:1763343277.833118:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.833163:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.833171:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399989120 00000100:00100000:3.0:1763343277.833182:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399989120 00000100:00100000:0.0:1763343277.833412:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399989376 00000100:00100000:0.0:1763343277.833417:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399989376 00000100:00100000:0.0:1763343277.833471:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3879 00000100:00100000:0.0:1763343277.833480:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8545850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:55884:x1848998399989376:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:0.0:1763343277.835229:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8545850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:55884:x1848998399989376:12345-192.168.201.40@tcp:35:bash.0 Request processed in 1732us (2048us total) trans 4294973901 rc 0/0 00000100:00100000:0.0:1763343277.835244:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3879 00000100:00100000:2.0:1763343277.836170:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7516 00000100:00100000:2.0:1763343277.836196:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2408:x1848998399989120:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:2.0:1763343277.836315:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2408:x1848998399989120:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 135us (3209us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343277.836323:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7516 00000100:00100000:2.0:1763343277.845128:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.846867:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399989504 00000100:00100000:0.0:1763343277.847097:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399989504 00000100:00100000:0.0:1763343277.848295:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1781 00000100:00100000:0.0:1763343277.848313:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5953100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2410:x1848998399989504:12345-192.168.201.40@tcp:3:lfs.0 00010000:00010000:0.0:1763343277.848359:0:28390:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a508d lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.848376:0:28390:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.848378:0:28390:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.848384:0:28390:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a508d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.848399:0:28390:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a508d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.848512:0:28390:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a508d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.848526:0:28390:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a508d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.848535:0:28390:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a508d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.848542:0:28390:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501aa00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343277.848547:0:28390:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a508d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.848556:0:28390:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a508d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.848575:0:28390:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a508d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.848585:0:28390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a508d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28390 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343277.848672:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5953100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2410:x1848998399989504:12345-192.168.201.40@tcp:3:lfs.0 Request processed in 366us (3554us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763343277.848681:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1781 00000100:00100000:3.0:1763343277.850370:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.850784:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399989632 00000100:00100000:1.0:1763343277.850805:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399989632 00000100:00100000:1.0:1763343277.850867:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10989 00000100:00100000:1.0:1763343277.850877:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57188:x1848998399989632:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:1.0:1763343277.850899:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.850922:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a5094 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49f36 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.850996:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a509b lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343277.851009:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a509b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.851019:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a509b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.851055:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a50a2 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343277.851062:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a50a2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.851069:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a50a2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.851146:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a50a9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x220:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343277.851154:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a50a9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x220:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.851160:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a50a9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x220:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343277.851196:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x220:0x0]: returning size 5 00000004:00200000:1.0:1763343277.851200:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343277.851230:0:7641:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a50a9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x220:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.851242:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a50a9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x220:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.851250:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a509b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.851256:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a509b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.851262:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a509b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.851267:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a509b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.851273:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.851277:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a509b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.851284:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a509b lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.851294:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5a00) 00010000:00010000:1.0:1763343277.851298:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.851302:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a509b lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.851307:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a509b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.851318:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a50a2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.851323:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a50a2 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.851328:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a50a2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.851333:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.851335:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a50a2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.851340:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a50a2 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.851346:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5b00) 00010000:00010000:1.0:1763343277.851348:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.851351:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a50a2 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.851357:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a50a2 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.851399:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a5094 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f36 expref: 308 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.851414:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a50a9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x220:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f36 expref: 307 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.851421:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x220:0x0].0x0 (ffff9400c4759600) 00010000:00010000:1.0:1763343277.851427:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343277.851430:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177c00, rc 0) 00000100:00100000:1.0:1763343277.851489:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57188:x1848998399989632:12345-192.168.201.40@tcp:101:rm.0 Request processed in 613us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.851496:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10989 00000100:00100000:3.0:1763343277.854437:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.854531:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399989760 00000100:00100000:0.0:1763343277.854540:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399989760 00000100:00100000:0.0:1763343277.854603:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10990 00000100:00100000:0.0:1763343277.854614:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57185:x1848998399989760:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343277.854635:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343277.854658:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a50b0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49f3d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.854693:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a200/0x9104b1ba770a50b7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343277.854709:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a200/0x9104b1ba770a50b7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.854721:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a200/0x9104b1ba770a50b7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.854834:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a50b0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f3d expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.854852:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a200/0x9104b1ba770a50b7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f3d expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.854863:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c38f5600) 00010000:00010000:0.0:1763343277.854866:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343277.854870:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a200, rc 0) 00000100:00100000:0.0:1763343277.862093:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57185:x1848998399989760:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 7466us (7650us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.862106:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10990 00000100:00100000:2.0:1763343277.862778:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.863484:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399990016 00000100:00100000:0.0:1763343277.863495:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399990016 00000100:00100000:1.0:1763343277.864231:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10991 00000100:00100000:1.0:1763343277.864247:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57188:x1848998399990016:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:1.0:1763343277.864310:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763343277.864349:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5078 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x220:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f21 expref: 308 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.864373:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a50a9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x220:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f36 expref: 307 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.864386:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a505c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x220:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f13 expref: 306 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.864396:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x220:0x0].0x0 (ffff9400c4759600) 00010000:00010000:1.0:1763343277.864406:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343277.864432:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a50be lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343277.864444:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a50be lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.864454:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a50be lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.864467:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a50c5 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343277.864474:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a50c5 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.864480:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a50c5 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.864559:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a50cc lrc: 3/0,1 mode: --/EX res: [0x240000404:0x220:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343277.864572:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a50cc lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x220:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.864579:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a50cc lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x220:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000040:00080000:1.0:1763343277.864808:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1806, 64 off149984 00000040:00080000:1.0:1763343277.864835:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1815, 64 off150744 00000040:00080000:1.0:1763343277.864846:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1816, 64 off150808 00000040:00080000:1.0:1763343277.864856:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1807, 64 off150048 00010000:00010000:1.0:1763343277.864902:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a50d3 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x220:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343277.864911:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a50d3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x220:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.864918:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a50d3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x220:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.864925:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a50d3 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x220:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.864931:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a50d3 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x220:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.864937:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a50d3 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x220:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.864963:0:7641:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343277.864981:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a50cc lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x220:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.864987:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a50cc lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x220:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.864996:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a50cc lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x220:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.865001:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.865005:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a50cc lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x220:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.865012:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a50cc lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x220:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.865020:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x220:0x0].0x0 (ffff9400c38f5000) 00010000:00010000:1.0:1763343277.865046:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343277.865051:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a50cc lrc: 2/0,0 mode: --/EX res: [0x240000404:0x220:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.865068:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a50cc lrc: 0/0,0 mode: --/EX res: [0x240000404:0x220:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.865172:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a50be lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.865179:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a50be lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.865185:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a50be lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.865190:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a50be lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.865195:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.865198:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a50be lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.865207:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a50be lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.865224:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5800) 00010000:00010000:1.0:1763343277.865227:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.865230:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a50be lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.865235:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a50be lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00010000:1.0:1763343277.865246:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000809c96a5 reply state 000000008a4c5a71 transno 4294973902 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a50c5 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.865256:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a50c5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.865261:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5700) 00010000:00010000:1.0:1763343277.865263:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343277.865266:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343277.865338:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57188:x1848998399990016:12345-192.168.201.40@tcp:36:rm.0 Request processed in 1096us (2561us total) trans 4294973902 rc 0/0 00000100:00100000:1.0:1763343277.865346:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10991 00010000:00010000:2.0:1763343277.865561:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343277.865568:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a50d3 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x220:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.865573:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343277.865576:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a50d3 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x220:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.865581:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a50d3 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x220:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.865590:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x220:0x0].0x0 (ffff9400c38f5000) 00010000:00010000:2.0:1763343277.865592:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763343277.865595:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a50d3 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x220:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.865600:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a50d3 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x220:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.865613:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343277.865614:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343277.865616:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343277.868427:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.868493:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399990144 00000100:00100000:0.0:1763343277.868504:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399990144 00000100:00100000:0.0:1763343277.868574:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1782 00000100:00100000:0.0:1763343277.868585:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2407:x1848998399990144:12345-192.168.201.40@tcp:4:lfs.0 00010000:00010000:0.0:1763343277.868621:0:8419:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c501aa00/0x9104b1ba770a50da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.868641:0:8419:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c583f000/0x9104b1ba770a4e5d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e5d expref: 27 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343277.868891:0:8419:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.868894:0:8419:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.868898:0:8419:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501aa00/0x9104b1ba770a50da lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.868935:0:8419:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c583f000/0x9104b1ba770a4e5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e5d expref: 27 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343277.868950:0:8419:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c583f000/0x9104b1ba770a4e5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e5d expref: 27 pid: 8413 timeout: 1170 lvb_type: 1 00000100:00100000:0.0:1763343277.868966:0:8419:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4789500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8419:1848998413012480:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343277.871460:0:8419:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401ca046480 going to sleep for 11 seconds 00000100:00100000:1.0:1763343277.874554:0:8419:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4789500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8419:1848998413012480:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343277.874586:0:8419:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c501aa00/0x9104b1ba770a50da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343277.875930:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.876354:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399990272 00000100:00100000:3.0:1763343277.876362:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399990272 00010000:00010000:3.0:1763343277.876398:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583f000/0x9104b1ba770a4e5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e5d expref: 28 pid: 8413 timeout: 1170 lvb_type: 1 00000100:00100000:3.0:1763343277.876449:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3582 00000100:00100000:3.0:1763343277.876469:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5950380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2410:x1848998399990272:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343277.876485:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343277.876505:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c583f000/0x9104b1ba770a4e5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e5d expref: 28 pid: 8413 timeout: 1170 lvb_type: 1 00010000:00010000:3.0:1763343277.876517:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c583f000/0x9104b1ba770a4e5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e5d expref: 28 pid: 8413 timeout: 1170 lvb_type: 1 00010000:00010000:3.0:1763343277.876540:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c583f000/0x9104b1ba770a4e5d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e5d expref: 28 pid: 8413 timeout: 1170 lvb_type: 1 00010000:00010000:3.0:1763343277.876555:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343277.876556:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343277.876561:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c501aa00/0x9104b1ba770a50da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.876571:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501aa00/0x9104b1ba770a50da lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.877384:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343277.877469:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5950380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2410:x1848998399990272:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1001us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343277.877478:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3582 00010000:00010000:1.0:1763343277.878036:0:8419:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c501aa00/0x9104b1ba770a50da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.878053:0:8419:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c501aa00/0x9104b1ba770a50da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343277.882966:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.883069:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399990400 00000100:00100000:3.0:1763343277.883080:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399990400 00000100:00100000:3.0:1763343277.883130:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10992 00000100:00100000:3.0:1763343277.883139:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57189:x1848998399990400:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343277.883178:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343277.883203:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a50e1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49f44 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.883281:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a50e8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343277.883297:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a50e8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.883311:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a50e8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.883323:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a50ef lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343277.883331:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a50ef lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.883337:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a50ef lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.883387:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a50e8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.883394:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a50e8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.883399:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a50e8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.883419:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a50e8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.883425:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8693e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343277.883429:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a50e8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.883437:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a50e8 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.883449:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4900) 00010000:00010000:3.0:1763343277.883452:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343277.883468:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a50e8 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.883475:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a50e8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.883487:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a50ef lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.883494:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a50ef lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.883500:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a50ef lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.883505:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121e200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343277.883508:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a50ef lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.883513:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a50ef lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.883519:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5700) 00010000:00010000:3.0:1763343277.883521:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343277.883524:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a50ef lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.883528:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a50ef lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.883555:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a50e1 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f44 expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.883565:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4900) 00010000:00010000:3.0:1763343277.883568:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343277.883571:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a50e1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f44 expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.883584:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8692c00, rc 0) 00000100:00100000:3.0:1763343277.883649:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57189:x1848998399990400:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 510us (693us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343277.883656:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10992 00000001:00080000:0.0:1763343277.886653:0:24675:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839316 is committed 00000001:00080000:0.0:1763343277.886677:0:24675:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839314 is committed 00002000:00010000:1.0:1763343277.887067:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2db:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:1.0:1763343277.887072:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2db:0x0] updating lvb mtime from disk: 0 -> 1763343277 00002000:00010000:1.0:1763343277.887075:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2db:0x0] updating lvb ctime from disk: 0 -> 1763343277 00002000:00010000:1.0:1763343277.887077:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2db:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1763343277.887090:0:8419:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c501aa00/0x9104b1ba770a50da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.887102:0:8419:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501aa00/0x9104b1ba770a50da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.887111:0:8419:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c501aa00/0x9104b1ba770a50da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.887118:0:8419:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501aa00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343277.887122:0:8419:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c501aa00/0x9104b1ba770a50da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.887130:0:8419:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c501aa00/0x9104b1ba770a50da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.887148:0:8419:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c501aa00/0x9104b1ba770a50da lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.887155:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c501aa00/0x9104b1ba770a50da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343277.887257:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:2407:x1848998399990144:12345-192.168.201.40@tcp:4:lfs.0 Request processed in 18669us (18833us total) trans 21474839316 rc 0/0 00000100:00100000:1.0:1763343277.887267:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1782 00000100:00100000:1.0:1763343277.890327:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.890394:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399990528 00000100:00100000:3.0:1763343277.890405:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399990528 00000100:00100000:3.0:1763343277.890459:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10993 00000100:00100000:3.0:1763343277.890469:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57189:x1848998399990528:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343277.890490:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343277.890691:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a50f6 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49f4b expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.890776:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a50fd lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343277.890790:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a50fd lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.890803:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a50fd lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.890813:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5104 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343277.890819:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5104 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.890824:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5104 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.890864:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a50fd lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.890871:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a50fd lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.890876:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a50fd lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.890883:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a50fd lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.890889:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343277.890893:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a50fd lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.890899:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a50fd lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.890911:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4f00) 00010000:00010000:3.0:1763343277.890914:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343277.890919:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a50fd lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.890925:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a50fd lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.890937:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5104 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.890943:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5104 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.890949:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5104 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.890954:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121fc00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343277.890957:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5104 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.890962:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5104 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.890969:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5700) 00010000:00010000:3.0:1763343277.890971:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343277.890975:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5104 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.890980:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5104 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.891007:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a50f6 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f4b expref: 308 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.891017:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4f00) 00010000:00010000:3.0:1763343277.891020:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343277.891048:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a50f6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f4b expref: 308 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.891809:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121e800, rc 0) 00000100:00100000:3.0:1763343277.891879:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57189:x1848998399990528:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1410us (1561us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343277.891888:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10993 00000100:00100000:2.0:1763343277.899489:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.899842:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399990656 00000100:00100000:3.0:1763343277.899853:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399990656 00000100:00100000:3.0:1763343277.899914:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10994 00000100:00100000:3.0:1763343277.899924:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57189:x1848998399990656:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343277.899944:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343277.899967:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a510b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49f52 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.900058:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5112 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343277.900074:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5112 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343277.900087:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5112 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:3.0:1763343277.900148:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763343277.900154:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1763343277.900189:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a510b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f52 expref: 309 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.900206:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5112 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f52 expref: 308 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.900225:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4900) 00010000:00010000:3.0:1763343277.900228:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763343277.900231:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8692c00, rc 0) 00000100:00100000:3.0:1763343277.900295:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57189:x1848998399990656:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 373us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343277.900304:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10994 00000100:00100000:2.0:1763343277.907714:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.908244:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399990912 00000100:00100000:3.0:1763343277.908257:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399990912 00000100:00100000:2.0:1763343277.908497:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10995 00000100:00100000:2.0:1763343277.908509:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57185:x1848998399990912:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:2.0:1763343277.908569:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343277.908597:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a500f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x21f:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ef7 expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.908620:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c38f5600) 00010000:00010000:2.0:1763343277.908624:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343277.908699:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a5119 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343277.908713:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a5119 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.908723:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a5119 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00010000:2.0:1763343277.908831:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004b2057f3 reply state 000000009b0df3bd transno 4294973903 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a5119 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.908843:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a5119 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.908849:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c38f5600) 00010000:00010000:2.0:1763343277.908852:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343277.908855:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343277.908952:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57185:x1848998399990912:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 444us (1246us total) trans 4294973903 rc 0/0 00000100:00100000:2.0:1763343277.909666:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10995 00000100:00100000:1.0:1763343277.913177:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.913267:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399991040 00000100:00100000:2.0:1763343277.913278:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399991040 00000100:00100000:2.0:1763343277.913341:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10996 00000100:00100000:2.0:1763343277.913352:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57189:x1848998399991040:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.913372:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.913394:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5120 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49f59 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.913466:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5127 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343277.913481:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5127 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.913493:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5127 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.913504:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a512e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343277.913511:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a512e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.913517:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a512e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.913557:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5127 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.913565:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5127 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.913571:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5127 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.913576:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5127 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.913582:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.913586:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5127 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.913597:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5127 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.913608:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4900) 00010000:00010000:2.0:1763343277.913611:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.913616:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5127 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.913621:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5127 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.913642:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a512e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.913648:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a512e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.913653:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a512e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.913659:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.913662:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a512e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.913667:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a512e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.913674:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5700) 00010000:00010000:2.0:1763343277.913677:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.913680:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a512e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.913684:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a512e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.913712:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5120 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f59 expref: 310 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.913721:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4900) 00010000:00010000:2.0:1763343277.913723:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.913726:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5120 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f59 expref: 310 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.913735:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3000, rc 0) 00000100:00100000:2.0:1763343277.913800:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57189:x1848998399991040:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 451us (634us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343277.915520:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.915926:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399991168 00000100:00100000:0.0:1763343277.915935:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399991168 00000100:00100000:0.0:1763343277.915994:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7517 00000100:00100000:0.0:1763343277.916005:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:57185:x1848998399991168:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343277.916046:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343277.916071:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c501b200/0x9104b1ba770a5135 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49f60 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343277.916094:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2db:0x0] initial LVB size: 4096, mtime: 0x691a7bad, atime: 0x0, ctime: 0x691a7bad, blocks: 0x8 00010000:00010000:0.0:1763343277.916118:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.916121:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.916129:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501b200/0x9104b1ba770a5135 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f60 expref: 13 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.916146:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c501b200/0x9104b1ba770a5135 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f60 expref: 13 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.916157:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b200, rc 0) 00000100:00100000:0.0:1763343277.916206:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:57185:x1848998399991168:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 204us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.916221:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7517 00000100:00100000:2.0:1763343277.916296:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10996 00000100:00100000:0.0:1763343277.919785:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.919835:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.920055:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399991296 00000100:00100000:1.0:1763343277.920066:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399991296 00000100:00100000:1.0:1763343277.920116:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7518 00000100:00100000:1.0:1763343277.920126:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:57185:x1848998399991296:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343277.920146:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.920168:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a513c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49f67 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.920200:0:28562:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4e64 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e64 expref: 25 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343277.920208:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343277.920221:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343277.920226:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a513c lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f67 expref: 25 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.920262:0:28562:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4e64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e64 expref: 25 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343277.920277:0:28562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4e64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e64 expref: 25 pid: 8413 timeout: 1171 lvb_type: 1 00000100:00100000:1.0:1763343277.920296:0:28562:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28562:1848998413012608:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343277.920378:0:28562:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc6dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1763343277.920839:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399991552 00000100:00100000:2.0:1763343277.920845:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399991552 00000100:00100000:2.0:1763343277.920878:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10997 00000100:00100000:2.0:1763343277.920885:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57189:x1848998399991552:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.920901:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.920903:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343277.920926:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5112 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f52 expref: 309 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.920942:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4900) 00010000:00010000:2.0:1763343277.920950:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343277.920962:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a5143 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49f6e expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.921093:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a514a lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343277.921105:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a514a lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.921113:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a514a lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.921123:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5151 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343277.921129:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5151 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.921134:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5151 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.921504:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5158 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x222:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343277.921512:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5158 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x222:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.921519:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5158 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x222:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343277.921527:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x222:0x0]: returning size 0 00010000:00010000:2.0:1763343277.921549:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a514a lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.921555:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a514a lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.921560:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a514a lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.921565:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a514a lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.921572:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fd800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.921577:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a514a lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.921585:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a514a lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.921593:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758b00) 00010000:00010000:2.0:1763343277.921596:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.921600:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a514a lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.921605:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a514a lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00010000:2.0:1763343277.921632:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000005157483 reply state 0000000060163d6d transno 4294973904 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5151 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.921644:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5151 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343277.921649:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5700) 00010000:00010000:2.0:1763343277.921651:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343277.921654:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343277.921682:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a5143 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f6e expref: 311 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.921710:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5158 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x222:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f6e expref: 310 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.921717:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x222:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:2.0:1763343277.921719:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343277.921722:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c508aa00, rc 0) 00000100:00100000:2.0:1763343277.921790:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57189:x1848998399991552:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 904us (1954us total) trans 4294973904 rc 0/0 00000100:00100000:2.0:1763343277.921799:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10997 00000100:00100000:0.0:1763343277.924016:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.924199:0:28562:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28562:1848998413012608:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343277.924237:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a513c lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f67 expref: 25 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.924255:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176200, rc 0) 00000100:00100000:1.0:1763343277.924313:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:57185:x1848998399991296:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 4188us (4537us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.924321:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7518 00000100:00100000:3.0:1763343277.924678:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399991680 00000100:00100000:3.0:1763343277.924686:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399991680 00010000:00010000:3.0:1763343277.924719:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4e64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e64 expref: 25 pid: 8413 timeout: 1171 lvb_type: 1 00000100:00100000:3.0:1763343277.924756:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3583 00000100:00100000:3.0:1763343277.924766:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2407:x1848998399991680:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343277.924782:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343277.924807:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4e64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e64 expref: 25 pid: 8413 timeout: 1171 lvb_type: 1 00010000:00010000:3.0:1763343277.924821:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4e64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e64 expref: 25 pid: 8413 timeout: 1171 lvb_type: 1 00010000:00010000:3.0:1763343277.924850:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c583ea00/0x9104b1ba770a4e64 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49e64 expref: 25 pid: 8413 timeout: 1171 lvb_type: 1 00010000:00010000:3.0:1763343277.924865:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343277.924867:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343277.924873:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a513c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f67 expref: 24 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.924883:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a513c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f67 expref: 24 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.924918:0:14071:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a513c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f67 expref: 24 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343277.924932:0:14071:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dcb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:14071:1848998413012736:192.168.201.40@tcp:105: 00000100:00100000:3.0:1763343277.924998:0:14071:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c8284540 going to sleep for 11 seconds 00000100:00100000:0.0:1763343277.926901:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.928229:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399991936 00000100:00100000:3.0:1763343277.928239:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399991936 00000100:00100000:2.0:1763343277.928451:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10998 00000100:00100000:2.0:1763343277.928463:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57189:x1848998399991936:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343277.928491:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.928514:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a5166 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x222:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49f75 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.928734:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a516d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x222:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343277.928749:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5158 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x222:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f6e expref: 312 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.928757:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a516d lrc: 4/0,1 mode: --/EX res: [0x240000404:0x222:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.928791:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5158 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x222:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f6e expref: 312 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.928806:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5158 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x222:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f6e expref: 312 pid: 7641 timeout: 1171 lvb_type: 0 00000100:00100000:2.0:1763343277.928818:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998413012864:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343277.929084:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c53049c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343277.929264:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.929516:0:14071:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dcb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:14071:1848998413012736:192.168.201.40@tcp:105: 00010000:00010000:0.0:1763343277.929535:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343277.929574:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2407:x1848998399991680:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 4808us (5565us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.929583:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3583 00000100:00100000:2.0:1763343277.930544:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.931819:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399992064 00000100:00100000:3.0:1763343277.931830:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399992064 00002000:00010000:3.0:1763343277.931866:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/731 (5->18446744073709551615) 00002000:00100000:3.0:1763343277.931871:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c390fb80 with x1848998399992064 ext(5->18446744073709551615) 00002000:00010000:3.0:1763343277.931884:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c390fb80. 00000100:00100000:3.0:1763343277.931903:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399992192 00000100:00100000:3.0:1763343277.931906:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399992192 00002000:00010000:3.0:1763343277.931918:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/732 (0->18446744073709551615) 00002000:00100000:3.0:1763343277.931921:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c390d180 with x1848998399992192 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343277.931927:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c390d180. 00000100:00100000:3.0:1763343277.931955:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1783 00000100:00100000:3.0:1763343277.931965:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2407:x1848998399992064:12345-192.168.201.40@tcp:10:lfs.0 00002000:00010000:3.0:1763343277.932381:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2db:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:3.0:1763343277.932386:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2db:0x0] updating lvb mtime from disk: 1763343277 -> 1763343277 00002000:00010000:3.0:1763343277.932388:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2db:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343277.932390:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2db:0x0] updating lvb ctime from disk: 1763343277 -> 1763343277 00002000:00010000:3.0:1763343277.932392:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2db:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343277.932447:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399992064:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 483us (3183us total) trans 21474839317 rc 0/0 00000100:00100000:3.0:1763343277.932456:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1783 00002000:00010000:3.0:1763343277.932460:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/731 (5->18446744073709551615) 00002000:00100000:3.0:1763343277.932463:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c390fb80 with x1848998399992064 ext(5->18446744073709551615) 00002000:00010000:3.0:1763343277.932467:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c390fb80. 00000100:00100000:3.0:1763343277.932485:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1784 00000100:00100000:3.0:1763343277.932493:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2407:x1848998399992192:12345-192.168.201.40@tcp:10:lfs.0 00002000:00010000:3.0:1763343277.932589:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2dc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343277.932592:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2dc:0x0] updating lvb mtime from disk: 0 -> 1763343277 00002000:00010000:3.0:1763343277.932594:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2dc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343277.932596:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2dc:0x0] updating lvb ctime from disk: 0 -> 1763343277 00002000:00010000:3.0:1763343277.932599:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2dc:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343277.932622:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2407:x1848998399992192:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 130us (2080us total) trans 17179872047 rc 0/0 00000100:00100000:3.0:1763343277.932628:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1784 00002000:00010000:3.0:1763343277.932631:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/732 (0->18446744073709551615) 00002000:00100000:3.0:1763343277.932634:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c390d180 with x1848998399992192 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343277.932638:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c390d180. 00000100:00100000:2.0:1763343277.932944:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.933046:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399992320 00000100:00100000:3.0:1763343277.933052:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399992320 00000100:00100000:0.0:1763343277.933070:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998413012864:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343277.933074:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5158 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x222:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f6e expref: 313 pid: 7641 timeout: 1171 lvb_type: 0 00010000:00010000:0.0:1763343277.933092:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a516d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x222:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000100:00100000:3.0:1763343277.933108:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3584 00000100:00100000:3.0:1763343277.933116:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:2408:x1848998399992320:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343277.933127:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343277.933133:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5158 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x222:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f6e expref: 313 pid: 7641 timeout: 1171 lvb_type: 0 00010000:00010000:3.0:1763343277.933146:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5158 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x222:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f6e expref: 313 pid: 7641 timeout: 1171 lvb_type: 0 00010000:00010000:3.0:1763343277.933168:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5158 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x222:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f6e expref: 313 pid: 7641 timeout: 1171 lvb_type: 0 00010000:00010000:3.0:1763343277.933182:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x222:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:3.0:1763343277.933187:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a516d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x222:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.933200:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a516d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x222:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.933207:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a516d lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x222:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.933246:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343277.933268:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a516d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x222:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.933280:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a516d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x222:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000100:00100000:3.0:1763343277.933284:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:2408:x1848998399992320:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 169us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343277.933290:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3584 00000004:00200000:0.0:1763343277.933309:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x222:0x0]: returning size 0 00000004:00080000:0.0:1763343277.933461:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2df:0x0], index 1: 0 00000004:00080000:0.0:1763343277.933468:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2de:0x0], index 0: 0 00000004:00080000:0.0:1763343277.933473:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2df:0x0], index 0: 0 00000004:00080000:0.0:1763343277.933477:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2e0:0x0], index 1: 0 00010000:00010000:0.0:1763343277.933567:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a516d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x222:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.933575:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a516d lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x222:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.933580:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a516d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x222:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.933586:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a7e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343277.933590:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a516d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x222:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.933597:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a516d lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x222:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.933606:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x222:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:0.0:1763343277.933608:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343277.933611:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a516d lrc: 2/0,0 mode: --/EX res: [0x240000404:0x222:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.933616:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a516d lrc: 0/0,0 mode: --/EX res: [0x240000404:0x222:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.933665:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a5166 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x222:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f75 expref: 312 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.933674:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x222:0x0].0x0 (ffff9400c4758d00) 00010000:00010000:0.0:1763343277.933676:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343277.933680:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a5166 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x222:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f75 expref: 312 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.933694:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a6a00, rc 0) 00000100:00100000:0.0:1763343277.933737:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57189:x1848998399991936:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 5276us (6843us total) trans 4294973905 rc 301/301 00000100:00100000:0.0:1763343277.933744:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10998 00000100:00100000:2.0:1763343277.936178:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.936275:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399992576 00000100:00100000:0.0:1763343277.936286:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399992576 00000100:00100000:0.0:1763343277.936435:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 10999 00000100:00100000:0.0:1763343277.936445:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57185:x1848998399992576:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:0.0:1763343277.936534:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a517b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343277.936550:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a517b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.936560:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a517b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00010000:0.0:1763343277.936673:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004945da3f reply state 00000000b47f70ae transno 4294973906 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a517b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.936686:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a517b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.936694:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c38f5600) 00010000:00010000:0.0:1763343277.936704:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343277.936708:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343277.936803:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57185:x1848998399992576:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 359us (631us total) trans 4294973906 rc 0/0 00000100:00100000:0.0:1763343277.936811:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 10999 00000100:00100000:3.0:1763343277.937633:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.937705:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399992832 00000100:00100000:0.0:1763343277.937712:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399992832 00000100:00100000:0.0:1763343277.937748:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3880 00000100:00100000:0.0:1763343277.937756:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57189:x1848998399992832:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343277.937956:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57189:x1848998399992832:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 199us (325us total) trans 4294973907 rc 0/0 00000100:00100000:0.0:1763343277.937963:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3880 00000100:00100000:2.0:1763343277.939474:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.940166:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.940271:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399993216 00000100:00100000:3.0:1763343277.940281:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399993216 00000100:00100000:3.0:1763343277.940329:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3881 00000100:00100000:3.0:1763343277.940338:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57189:x1848998399993216:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343277.940591:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57189:x1848998399993216:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 253us (427us total) trans 4294973908 rc 0/0 00000100:00100000:3.0:1763343277.940600:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3881 00000100:00100000:1.0:1763343277.940714:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399992960 00000100:00100000:1.0:1763343277.940720:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399992960 00000100:00100000:1.0:1763343277.940772:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7519 00000100:00100000:1.0:1763343277.940781:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:57185:x1848998399992960:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343277.940793:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.940811:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5182 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49f7c expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.940837:0:28562:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5024 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f05 expref: 26 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343277.940845:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343277.940847:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343277.940857:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5182 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f7c expref: 26 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.940890:0:28562:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5024 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f05 expref: 26 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343277.940905:0:28562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5024 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f05 expref: 26 pid: 28562 timeout: 1171 lvb_type: 1 00000100:00100000:1.0:1763343277.940919:0:28562:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28562:1848998413012992:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343277.940977:0:28562:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc6dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1763343277.945240:0:28562:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28562:1848998413012992:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343277.945278:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5182 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f7c expref: 26 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.945300:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177c00, rc 0) 00000100:00100000:1.0:1763343277.945364:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:57185:x1848998399992960:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 4583us (5896us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.945374:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7519 00000100:00100000:3.0:1763343277.946208:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.946352:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399993344 00000100:00100000:1.0:1763343277.946360:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399993344 00010000:00010000:1.0:1763343277.946391:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5024 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f05 expref: 26 pid: 28562 timeout: 1171 lvb_type: 1 00000100:00100000:1.0:1763343277.946445:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3585 00000100:00100000:1.0:1763343277.946455:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2407:x1848998399993344:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343277.946471:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343277.946494:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5024 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f05 expref: 26 pid: 28562 timeout: 1171 lvb_type: 1 00010000:00010000:1.0:1763343277.946507:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5024 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f05 expref: 26 pid: 28562 timeout: 1171 lvb_type: 1 00010000:00010000:1.0:1763343277.946537:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5024 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f05 expref: 26 pid: 28562 timeout: 1171 lvb_type: 1 00010000:00010000:1.0:1763343277.946552:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343277.946554:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343277.946562:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5182 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f7c expref: 25 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.946571:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5182 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f7c expref: 25 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.946735:0:35278:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5182 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f7c expref: 25 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343277.946749:0:35278:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:35278:1848998413013120:192.168.201.40@tcp:105: 00000100:00100000:1.0:1763343277.946815:0:35278:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc6dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1763343277.947416:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.948085:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399993600 00000100:00100000:2.0:1763343277.948094:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399993600 00000100:00100000:3.0:1763343277.948136:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413013248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1763343277.948152:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11000 00000100:00100000:2.0:1763343277.948161:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:55884:x1848998399993600:12345-192.168.201.40@tcp:101:bash.0 00000100:00100000:3.0:1763343277.948179:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763343277.948181:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343277.948202:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a5189 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49f83 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343277.948300:0:14179:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413013248 00000100:00100000:1.0:1763343277.948305:0:14179:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413013248 00000100:00100000:1.0:1763343277.948346:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:1.0:1763343277.948354:0:14179:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+29:3662:x1848998413013248:12345-0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1763343277.948364:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a5190 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00002000:00000024:1.0:1763343277.948378:0:14179:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484952768 pending 57344 free 3920220160 avail 3688697856 00010000:00010000:2.0:1763343277.948380:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a5190 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.948394:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a5190 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.948408:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5197 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343277.948416:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5197 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.948423:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5197 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000100:00100000:1.0:1763343277.948445:0:14179:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+29:3662:x1848998413013248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.948454:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00010000:00010000:2.0:1763343277.948479:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a519e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x222:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343277.948489:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a519e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x222:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.948497:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a519e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x222:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:2.0:1763343277.948506:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x222:0x0]: returning size 0 00010000:00010000:2.0:1763343277.948586:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a5190 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.948594:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a5190 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.948600:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a5190 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.948606:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a5190 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.948612:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fd800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.948615:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a5190 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.948622:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a5190 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.948634:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758b00) 00010000:00010000:2.0:1763343277.948637:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.948642:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a5190 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.948647:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a5190 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.948662:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5197 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.948668:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5197 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.948673:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5197 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.948678:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.948681:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5197 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.948686:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5197 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.948692:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5700) 00010000:00010000:2.0:1763343277.948695:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343277.948698:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5197 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343277.948703:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5197 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00000100:00100000:3.0:1763343277.948720:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413013248:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1763343277.948737:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fca00/0x9104b1ba770a5189 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f83 expref: 318 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.948753:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a519e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x222:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f83 expref: 317 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.948770:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x222:0x0].0x0 (ffff9400c4758f00) 00010000:00010000:2.0:1763343277.948772:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343277.948775:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3200, rc 0) 00000100:00100000:2.0:1763343277.948817:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:55884:x1848998399993600:12345-192.168.201.40@tcp:101:bash.0 Request processed in 656us (1402us total) trans 4294973909 rc 0/0 00000100:00100000:2.0:1763343277.948824:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11000 00000100:00100000:1.0:1763343277.950996:0:35278:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:35278:1848998413013120:192.168.201.40@tcp:105: 00010000:00010000:1.0:1763343277.951058:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343277.951114:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2407:x1848998399993344:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 4660us (4907us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.951124:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3585 00000100:00100000:3.0:1763343277.951221:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.952067:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399993728 00000100:00100000:1.0:1763343277.952076:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399993728 00000100:00100000:1.0:1763343277.952127:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7520 00000100:00100000:1.0:1763343277.952136:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2408:x1848998399993728:12345-192.168.201.40@tcp:2:lfs.0 00002000:00010000:1.0:1763343277.952307:0:28562:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763343277.952310:0:28562:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb mtime from disk: 1763343277 -> 1763343277 00002000:00010000:1.0:1763343277.952313:0:28562:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb atime from disk: 1763343276 -> 1763343276 00002000:00010000:1.0:1763343277.952316:0:28562:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb ctime from disk: 1763343277 -> 1763343277 00002000:00010000:1.0:1763343277.952319:0:28562:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763343277.952366:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2408:x1848998399993728:12345-192.168.201.40@tcp:2:lfs.0 Request processed in 230us (1154us total) trans 17179872048 rc 0/0 00000100:00100000:1.0:1763343277.952374:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7520 00000100:00100000:2.0:1763343277.952557:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.952613:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399993856 00000100:00100000:3.0:1763343277.952619:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399993856 00000100:00100000:3.0:1763343277.952647:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11001 00000100:00100000:3.0:1763343277.952654:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:55884:x1848998399993856:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343277.952671:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343277.952691:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a51ac lrc: 2/0,0 mode: --/PR res: [0x240000404:0x222:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49f8a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.952727:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a51b3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x222:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343277.952742:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a51b3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x222:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.952753:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a51b3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x222:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343277.952862:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a51ac lrc: 0/0,0 mode: --/PR res: [0x240000404:0x222:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f8a expref: 319 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.952878:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a51b3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x222:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f8a expref: 318 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.952886:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x222:0x0].0x0 (ffff9400c4758f00) 00010000:00010000:3.0:1763343277.952889:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343277.952893:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a6a00, rc 0) 00000100:00100000:3.0:1763343277.952932:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+318:55884:x1848998399993856:12345-192.168.201.40@tcp:101:bash.0 Request processed in 278us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343277.952937:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11001 00000100:00100000:2.0:1763343277.956761:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.957082:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399994112 00000100:00100000:3.0:1763343277.957093:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399994112 00000100:00100000:3.0:1763343277.957157:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11002 00000100:00100000:3.0:1763343277.957167:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+318:55884:x1848998399994112:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:3.0:1763343277.957237:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343277.957265:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a519e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x222:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f83 expref: 318 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.957284:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x222:0x0].0x0 (ffff9400c4758f00) 00010000:00010000:3.0:1763343277.957289:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343277.957898:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:0.0:1763343277.958090:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a51ba lrc: 3/0,1 mode: --/PW res: [0x240000404:0x222:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343277.958106:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a51ba lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x222:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.958116:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a51ba lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x222:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000001:00080000:0.0:1763343277.958162:0:6525:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973910 00000100:00100000:2.0:1763343277.958181:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399994368 00000004:00010000:0.0:1763343277.958186:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f97904ee reply state 00000000709914ee transno 4294973911 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a51ba lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x222:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000100:00100000:2.0:1763343277.958187:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399994368 00010000:00010000:0.0:1763343277.958196:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a51ba lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x222:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343277.958206:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x222:0x0].0x0 (ffff9400c4758f00) 00010000:00010000:0.0:1763343277.958209:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343277.958225:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343277.958231:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3882 00000100:00100000:2.0:1763343277.958239:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+320:57185:x1848998399994368:12345-192.168.201.40@tcp:35:lfs.0 00000004:00010000:2.0:1763343277.958274:0:6527:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x21f:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a4f75 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ec6 expref: 321 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.958300:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a51c1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343277.958309:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a5001 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ef0 expref: 321 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.958318:0:6527:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a51c1 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT1 00000100:00100000:0.0:1763343277.958331:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:55884:x1848998399994112:12345-192.168.201.40@tcp:36:bash.0 Request processed in 1165us (1580us total) trans 4294973911 rc 0/0 00000100:00100000:0.0:1763343277.958338:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11002 00000020:00080000:0.0:1763343277.958343:0:6525:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1763343277.958350:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a5001 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ef0 expref: 321 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.958362:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a5001 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ef0 expref: 320 pid: 6525 timeout: 1171 lvb_type: 0 00000100:00100000:2.0:1763343277.958375:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6527:1848998413013376:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343277.958426:0:6527:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c5304480 going to sleep for 11 seconds 00000100:00100000:2.0:1763343277.961638:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.961678:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.961778:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6527:1848998413013376:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343277.961806:0:6527:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a51c1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00000100:00100000:1.0:1763343277.962017:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399994624 00000100:00100000:1.0:1763343277.962059:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399994624 00000100:00100000:1.0:1763343277.962107:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11003 00000100:00100000:1.0:1763343277.962116:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:55884:x1848998399994624:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343277.962137:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.962156:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a51c8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x222:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49f91 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.962208:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a51c8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x222:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f91 expref: 322 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.962235:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a51c8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x222:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f91 expref: 322 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.962254:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x222:0x0].0x0 (ffff9400c4758f00) 00010000:00010000:1.0:1763343277.962258:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343277.962262:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176600, rc 0) 00000100:00100000:1.0:1763343277.962330:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+322:55884:x1848998399994624:12345-192.168.201.40@tcp:101:bash.0 Request processed in 215us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.962337:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11003 00000100:00100000:3.0:1763343277.962447:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399994496 00000100:00100000:3.0:1763343277.962453:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399994496 00010000:00010000:3.0:1763343277.962476:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a5001 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ef0 expref: 322 pid: 6525 timeout: 1171 lvb_type: 0 00000100:00100000:3.0:1763343277.962516:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3586 00000100:00100000:3.0:1763343277.962524:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+322:2407:x1848998399994496:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343277.962533:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343277.962538:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a5001 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ef0 expref: 322 pid: 6525 timeout: 1171 lvb_type: 0 00010000:00010000:3.0:1763343277.962551:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a5001 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ef0 expref: 322 pid: 6525 timeout: 1171 lvb_type: 0 00010000:00010000:3.0:1763343277.962569:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a5001 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ef0 expref: 322 pid: 6525 timeout: 1171 lvb_type: 0 00010000:00010000:3.0:1763343277.962581:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c38f5600) 00010000:00010000:3.0:1763343277.962585:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a51c1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343277.962597:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a51c1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343277.962603:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a51c1 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343277.962674:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343277.962703:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:2407:x1848998399994496:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 178us (1023us total) trans 0 rc 0/0 00010000:00010000:0.0:1763343277.962704:0:6527:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a51c1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343277.962713:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a51c1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00000100:00100000:3.0:1763343277.962746:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3586 00000040:00080000:0.0:1763343277.962984:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1817, 88 off150896 00000004:00080000:0.0:1763343277.962992:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1071086966738ns, next at 1071106415333ns, rc = 0 00000040:00080000:0.0:1763343277.963047:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1808, 88 off150136 00000004:00080000:0.0:1763343277.963053:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1071087027900ns, next at 1071106445174ns, rc = 0 00000040:00080000:0.0:1763343277.963073:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1809, 88 off150224 00000004:00080000:0.0:1763343277.963077:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1071087052440ns, next at 1071106445174ns, rc = 0 00000040:00080000:0.0:1763343277.963089:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1818, 88 off150984 00000004:00080000:0.0:1763343277.963094:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1071087068880ns, next at 1071106415333ns, rc = 0 00000001:00080000:2.0:1763343277.966827:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973912 is committed 00000004:00080000:2.0:1763343277.966842:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1167 committed 00000004:00080000:2.0:1763343277.966862:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1159 committed 00000004:00080000:2.0:1763343277.966877:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1158 committed 00000004:00080000:2.0:1763343277.966880:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1166 committed 00000004:00010000:2.0:1763343277.966954:0:6527:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007fcfcaf8 reply state 0000000064b077fd transno 4294973912 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a51c1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343277.966977:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a51c1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343277.966988:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c38f5600) 00010000:00010000:2.0:1763343277.966993:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1763343277.966998:0:6527:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343277.967007:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c38f5600) 00010000:00010000:2.0:1763343277.967010:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343277.967021:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a4f75 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ec6 expref: 309 pid: 9827 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343277.967055:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413013504:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343277.967126:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1763343277.967165:0:6527:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763343277.967176:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763343277.967180:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57185:x1848998399994368:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 8939us (9419us total) trans 4294973912 rc 0/0 00000100:00100000:0.0:1763343277.967186:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413013632:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763343277.967197:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3882 00010000:00010000:2.0:1763343277.967244:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a51c1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343277.967253:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a51c1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343277.967265:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a51c1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343277.967280:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3bcc200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343277.967285:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a51c1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343277.967293:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a51c1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343277.967304:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c38f5600) 00010000:00010000:2.0:1763343277.967306:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343277.967310:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a51c1 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343277.967315:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a51c1 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT1 00000100:00100000:0.0:1763343277.967530:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343277.967563:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413013760:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343277.967775:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343277.967855:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763343277.967864:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413013888:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343277.967890:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343277.967921:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413013504 00000100:00100000:0.0:1763343277.967929:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413013504 00000100:00100000:0.0:1763343277.967970:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413013632 00000100:00100000:0.0:1763343277.967974:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413013632 00000100:00100000:0.0:1763343277.967991:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413013760 00000100:00100000:0.0:1763343277.967994:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413013760 00000100:00100000:0.0:1763343277.968011:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413013888 00000100:00100000:0.0:1763343277.968013:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413013888 00000100:00100000:0.0:1763343277.968055:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7521 00000100:00100000:0.0:1763343277.968065:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+8:3659:x1848998413013504:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763343277.968097:0:8412:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:732 count 1 00010000:00010000:0.0:1763343277.968130:0:8412:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c501ae00/0x9104b1ba770a51cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343277.968142:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7522 00010000:00010000:0.0:1763343277.968151:0:8412:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c501b800/0x9104b1ba770a507f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f28 expref: 13 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343277.968157:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+8:3659:x1848998413013632:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763343277.968164:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343277.968168:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343277.968172:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501ae00/0x9104b1ba770a51cf lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1763343277.968174:0:8414:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:733 count 1 00002000:00010000:3.0:1763343277.968201:0:8414:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343277.968207:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a51d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.968228:0:8412:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c501b800/0x9104b1ba770a507f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f28 expref: 13 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.968229:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343277.968232:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343277.968238:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a51d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.968250:0:8412:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c501b800/0x9104b1ba770a507f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f28 expref: 13 pid: 8413 timeout: 1171 lvb_type: 0 00010000:00010000:3.0:1763343277.968251:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a51d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.968272:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a51d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.968286:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a51d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343277.968287:0:8412:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998413014016:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343277.968313:0:8414:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343277.968348:0:8412:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401cb9fdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343277.968367:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7523 00000100:00100000:0.0:1763343277.968375:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+8:3661:x1848998413013760:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763343277.968474:0:35266:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2da:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343277.968477:0:35266:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2da:0x0] updating lvb mtime from disk: 1763343276 -> 1763343276 00002000:00010000:0.0:1763343277.968481:0:35266:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343277.968483:0:35266:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2da:0x0] updating lvb ctime from disk: 1763343276 -> 1763343276 00002000:00010000:0.0:1763343277.968486:0:35266:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2da:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343277.968527:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+10:3661:x1848998413013760:12345-0@lo:2:osp-syn-0-1.0 Request processed in 153us (750us total) trans 21474839319 rc 0/0 00000100:00100000:0.0:1763343277.968534:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7523 00000100:00100000:0.0:1763343277.968553:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7524 00000100:00100000:3.0:1763343277.968559:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+9:3659:x1848998413013632:12345-0@lo:6:osp-syn-0-1.0 Request processed in 406us (1027us total) trans 21474839318 rc 0/0 00000100:00100000:0.0:1763343277.968563:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3661:x1848998413013888:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343277.968573:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7522 00010000:00010000:3.0:1763343277.968599:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343277.968606:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a51d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.968615:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a7e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343277.968619:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a51d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343277.968620:0:35266:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2db:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763343277.968627:0:35266:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2db:0x0] updating lvb mtime from disk: 1763343277 -> 1763343277 00002000:00010000:0.0:1763343277.968633:0:35266:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2db:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:3.0:1763343277.968635:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a51d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343277.968636:0:35266:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2db:0x0] updating lvb ctime from disk: 1763343277 -> 1763343277 00002000:00010000:0.0:1763343277.968643:0:35266:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2db:0x0] updating lvb blocks from disk: 8 -> 8 00010000:00010000:3.0:1763343277.968660:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a51d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.968668:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a51d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343277.968675:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3661:x1848998413013888:12345-0@lo:2:osp-syn-0-1.0 Request processed in 114us (782us total) trans 21474839320 rc 0/0 00000100:00100000:0.0:1763343277.968687:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7524 00010000:00010000:3.0:1763343277.968688:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343277.968692:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343277.968695:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343277.968745:0:3661:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474839314 gen 2 00000004:00080000:0.0:1763343277.968751:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6282d80, transno 21474839264 00000004:00080000:0.0:1763343277.968763:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6e8e300, transno 21474839265 00000004:00080000:0.0:1763343277.968768:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400cc5de680, transno 21474839266 00000004:00080000:0.0:1763343277.968772:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9dc9c00, transno 21474839267 00000004:00080000:0.0:1763343277.968777:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c4b21f80, transno 21474839268 00000004:00080000:0.0:1763343277.968780:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c4b23480, transno 21474839269 00000004:00080000:0.0:1763343277.968784:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c4b23800, transno 21474839270 00000004:00080000:0.0:1763343277.968788:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c4b21500, transno 21474839271 00000100:00100000:3.0:1763343277.968789:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413014272:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1763343277.968792:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6b56680, transno 21474839273 00000004:00080000:0.0:1763343277.968811:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6b57b80, transno 21474839274 00000004:00080000:0.0:1763343277.968815:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6b56a00, transno 21474839275 00000004:00080000:0.0:1763343277.968819:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5951c00, transno 21474839276 00000004:00080000:0.0:1763343277.968822:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c8bc1180, transno 21474839279 00000004:00080000:0.0:1763343277.968826:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c8bc3b80, transno 21474839280 00000100:00100000:3.0:1763343277.968829:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1763343277.968844:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9dc9500, transno 21474839282 00000004:00080000:0.0:1763343277.968849:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6280380, transno 21474839283 00000004:00080000:0.0:1763343277.968852:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c372b800, transno 21474839287 00000004:00080000:0.0:1763343277.968854:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c3729c00, transno 21474839288 00000100:00100000:3.0:1763343277.968857:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:0.0:1763343277.968858:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6401500, transno 21474839289 00000004:00080000:0.0:1763343277.968864:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c3728a80, transno 21474839290 00000100:00100000:3.0:1763343277.968867:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413014144:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1763343277.968869:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bfc380, transno 21474839291 00000004:00080000:0.0:1763343277.968876:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bff800, transno 21474839292 00000004:00080000:0.0:1763343277.968878:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6401180, transno 21474839293 00000004:00080000:0.0:1763343277.968882:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bfe680, transno 21474839294 00000004:00080000:0.0:1763343277.968886:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6488700, transno 21474839296 00000004:00080000:0.0:1763343277.968890:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f648a680, transno 21474839297 00000004:00080000:0.0:1763343277.968894:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c372aa00, transno 21474839298 00000100:00100000:3.0:1763343277.968900:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1763343277.968900:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bfc700, transno 21474839299 00000004:00080000:0.0:1763343277.968906:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6488000, transno 21474839301 00000004:00080000:0.0:1763343277.968909:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6488380, transno 21474839302 00000004:00080000:0.0:1763343277.968913:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6276d80, transno 21474839303 00000004:00080000:0.0:1763343277.968917:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5a3c700, transno 21474839304 00000004:00080000:0.0:1763343277.968920:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c7919c00, transno 21474839306 00000004:00080000:0.0:1763343277.968924:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c791ad80, transno 21474839307 00000004:00080000:0.0:1763343277.968927:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c7918700, transno 21474839308 00000004:00080000:0.0:1763343277.968931:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c791bb80, transno 21474839309 00000100:00100000:3.0:1763343277.968934:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413014272 00000004:00080000:0.0:1763343277.968936:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc1ad80, transno 21474839311 00000100:00100000:3.0:1763343277.968941:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413014272 00000004:00080000:0.0:1763343277.968942:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400cc5df480, transno 21474839312 00000004:00080000:0.0:1763343277.968947:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c3729180, transno 21474839313 00000004:00080000:0.0:1763343277.968950:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c3728e00, transno 21474839314 00000100:00100000:0.0:1763343277.968957:0:3661:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9400cc5dc380 x1848998413013888/t21474839320(21474839320) o2->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763343293 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1763343277.968967:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400cc5dc380/2, rc 0, transno 21474839320 00000100:00100000:3.0:1763343277.968968:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413014144 00000100:00100000:3.0:1763343277.968972:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413014144 00000100:00100000:0.0:1763343277.968974:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413013888:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763343277.968992:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400cc5de300/2, rc 0, transno 21474839319 00000100:00100000:3.0:1763343277.968996:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7525 00000100:00100000:0.0:1763343277.969000:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413013760:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343277.969007:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+30:3660:x1848998413014272:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343277.969013:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413014400:0@lo:2:osp-syn-1-1.0 00002000:00080000:3.0:1763343277.969058:0:28561:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:734 count 1 00000100:00100000:0.0:1763343277.969064:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1763343277.969083:0:28561:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1763343277.969086:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1763343277.969090:0:28561:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a51dd lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343277.969094:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5950380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413014528:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1763343277.969107:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343277.969109:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343277.969113:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a51dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.969123:0:28561:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a51dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343277.969130:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343277.969139:0:28561:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a51dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.969146:0:28561:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a51dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.969160:0:28561:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343277.969163:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413014400 00000100:00100000:0.0:1763343277.969168:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413014400 00000100:00100000:0.0:1763343277.969190:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413014528 00000100:00100000:0.0:1763343277.969194:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413014528 00000100:00100000:0.0:1763343277.969209:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7526 00000100:00100000:0.0:1763343277.969230:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+33:3660:x1848998413014144:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763343277.969243:0:8626:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:733 count 1 00010000:00010000:0.0:1763343277.969257:0:8626:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a51e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.969270:0:8626:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5086 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f2f expref: 25 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.969277:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343277.969279:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343277.969282:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a51e4 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.969306:0:8626:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5086 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f2f expref: 25 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.969318:0:8626:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5086 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f2f expref: 25 pid: 8412 timeout: 1171 lvb_type: 0 00000100:00100000:3.0:1763343277.969325:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+33:3660:x1848998413014272:12345-0@lo:6:osp-syn-1-1.0 Request processed in 319us (497us total) trans 17179872049 rc 0/0 00000100:00100000:3.0:1763343277.969336:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7525 00000100:00100000:0.0:1763343277.969345:0:8626:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c2f85c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998413014656:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343277.969357:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7527 00000100:00100000:3.0:1763343277.969364:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+32:3661:x1848998413014400:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343277.969388:0:8626:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c45320c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343277.969406:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7528 00000100:00100000:0.0:1763343277.969416:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+33:3661:x1848998413014528:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763343277.969421:0:28561:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763343277.969426:0:28561:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb mtime from disk: 1763343277 -> 1763343277 00002000:00010000:3.0:1763343277.969429:0:28561:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb atime from disk: 1763343276 -> 1763343276 00002000:00010000:3.0:1763343277.969431:0:28561:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb ctime from disk: 1763343277 -> 1763343277 00002000:00010000:3.0:1763343277.969434:0:28561:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343277.969468:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+34:3661:x1848998413014400:12345-0@lo:2:osp-syn-1-1.0 Request processed in 105us (404us total) trans 17179872050 rc 0/0 00000100:00100000:3.0:1763343277.969476:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7527 00002000:00010000:0.0:1763343277.969481:0:8413:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2dc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343277.969486:0:8413:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2dc:0x0] updating lvb mtime from disk: 1763343277 -> 1763343277 00002000:00010000:0.0:1763343277.969490:0:8413:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2dc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343277.969492:0:8413:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2dc:0x0] updating lvb ctime from disk: 1763343277 -> 1763343277 00002000:00010000:0.0:1763343277.969495:0:8413:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2dc:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1763343277.970263:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a50c5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.970282:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a50c5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00000100:00100000:0.0:1763343277.970290:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+33:3661:x1848998413014528:12345-0@lo:2:osp-syn-1-1.0 Request processed in 874us (1165us total) trans 17179872051 rc 0/0 00010000:00010000:1.0:1763343277.970292:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a50c5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.970305:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177e00 already unused, calling callback (ffffffffc18dd550) 00000100:00100000:0.0:1763343277.970306:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7528 00010000:00010000:1.0:1763343277.970312:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a50c5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.970320:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a50c5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.970336:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5700) 00010000:00010000:1.0:1763343277.970340:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.970344:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a50c5 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.970350:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a50c5 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.970367:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a5119 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.970373:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a5119 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.970378:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a5119 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.970383:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.970386:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a5119 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.970392:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a5119 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.970401:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c38f5600) 00010000:00010000:1.0:1763343277.970403:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.970407:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a5119 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.970412:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a5119 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.970424:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5151 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.970430:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5151 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.970436:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5151 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.970441:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508b200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.970444:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5151 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.970450:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5151 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.970458:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5700) 00010000:00010000:1.0:1763343277.970461:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.970464:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5151 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.970470:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5151 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.970489:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a517b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.970496:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a517b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.970501:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a517b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.970507:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.970510:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a517b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.970515:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a517b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.970523:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c38f5600) 00010000:00010000:1.0:1763343277.970526:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.970528:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a517b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.970533:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a517b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x21f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.970544:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a51ba lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x222:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.970549:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a51ba lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x222:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.970555:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a51ba lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x222:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.970560:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.970563:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a51ba lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x222:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.970569:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a51ba lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x222:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00000004:00080000:0.0:1763343277.970572:0:8616:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 4 in progress, 2 in flight, 40 done 00010000:00010000:1.0:1763343277.970577:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x222:0x0].0x0 (ffff9400c4758f00) 00010000:00010000:1.0:1763343277.970581:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.970584:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a51ba lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x222:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.970589:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a51ba lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x222:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343277.970609:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343277.970615:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a51dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.970631:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a7200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343277.970634:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a51dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.970644:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a51dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.970655:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a51dd lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.970665:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a51dd lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.970679:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343277.970681:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343277.970682:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343277.970737:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.970858:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399994880 00000100:00100000:1.0:1763343277.970864:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399994880 00000100:00100000:1.0:1763343277.970896:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11004 00000100:00100000:1.0:1763343277.970902:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+303:55884:x1848998399994880:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343277.970916:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.970918:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343277.970932:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a51c8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x222:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f91 expref: 303 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.970947:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x222:0x0].0x0 (ffff9400c4758f00) 00010000:00010000:1.0:1763343277.970950:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343277.970960:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a51eb lrc: 2/0,0 mode: --/EX res: [0x240000404:0x222:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49f98 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.971000:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a51f2 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x222:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343277.971011:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a51f2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x222:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.971018:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a51f2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x222:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000040:00080000:1.0:1763343277.972308:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1819, 88 off151072 00000004:00080000:1.0:1763343277.972320:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1071096294614ns, next at 1071106415333ns, rc = 0 00000040:00080000:1.0:1763343277.972354:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1810, 88 off150312 00000004:00080000:1.0:1763343277.972358:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1071096333899ns, next at 1071106445174ns, rc = 0 00000040:00080000:1.0:1763343277.972411:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1811, 88 off150400 00000004:00080000:1.0:1763343277.972415:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1071096390794ns, next at 1071106445174ns, rc = 0 00000040:00080000:1.0:1763343277.972444:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1820, 88 off151160 00000004:00080000:1.0:1763343277.972449:0:7641:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1071096424276ns, next at 1071106415333ns, rc = 0 00000004:00080000:2.0:1763343277.973121:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b9d500/2, rc 0, transno 21474839318 00000100:00100000:2.0:1763343277.973137:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413013632:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1763343277.973648:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5dcb800/2, rc 0, transno 17179872049 00000004:00080000:0.0:1763343277.973651:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5950380/2, rc 0, transno 17179872051 00000100:00100000:3.0:1763343277.973672:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413014272:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343277.973672:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5950380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413014528:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763343277.973701:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401edc1b480/2, rc 0, transno 17179872050 00000100:00100000:0.0:1763343277.973705:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413014400:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343277.973999:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.974393:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399995008 00000100:00100000:1.0:1763343277.974402:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399995008 00000100:00100000:1.0:1763343277.974461:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11005 00000100:00100000:1.0:1763343277.974471:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57185:x1848998399995008:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343277.974498:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.974524:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a51f9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49f9f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.974583:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a51f9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f9f expref: 306 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.974598:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176800/0x9104b1ba770a51f9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x21f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f9f expref: 306 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.974617:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c38f5600) 00010000:00010000:1.0:1763343277.974620:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343277.974624:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176800, rc 0) 00000100:00100000:1.0:1763343277.974681:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57185:x1848998399995008:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 212us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343277.974689:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11005 00000100:00100000:3.0:1763343277.977797:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c2f85c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998413014656:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343277.977797:0:8412:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998413014016:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343277.977829:0:8626:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a51e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.977829:0:8412:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c501ae00/0x9104b1ba770a51cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343277.980881:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343277.980918:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.980981:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399995264 00000100:00100000:0.0:1763343277.980992:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399995264 00000100:00100000:3.0:1763343277.981143:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399995136 00000100:00100000:3.0:1763343277.981149:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399995136 00010000:00010000:3.0:1763343277.981173:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501b800/0x9104b1ba770a507f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f28 expref: 14 pid: 8413 timeout: 1171 lvb_type: 0 00000100:00100000:3.0:1763343277.981232:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3587 00000100:00100000:3.0:1763343277.981242:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998399995136:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343277.981258:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343277.981263:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c501b800/0x9104b1ba770a507f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f28 expref: 14 pid: 8413 timeout: 1171 lvb_type: 0 00010000:00010000:3.0:1763343277.981277:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c501b800/0x9104b1ba770a507f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f28 expref: 14 pid: 8413 timeout: 1171 lvb_type: 0 00010000:00010000:3.0:1763343277.981300:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c501b800/0x9104b1ba770a507f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f28 expref: 14 pid: 8413 timeout: 1171 lvb_type: 0 00010000:00010000:3.0:1763343277.981563:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.981594:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5086 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f2f expref: 26 pid: 8412 timeout: 1171 lvb_type: 0 00000100:00100000:0.0:1763343277.981625:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3588 00000100:00100000:0.0:1763343277.981634:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2408:x1848998399995264:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343277.981644:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343277.981648:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.981651:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5086 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f2f expref: 26 pid: 8412 timeout: 1171 lvb_type: 0 00010000:00010000:3.0:1763343277.981655:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c501ae00/0x9104b1ba770a51cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.981667:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5086 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f2f expref: 26 pid: 8412 timeout: 1171 lvb_type: 0 00010000:00010000:3.0:1763343277.981670:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501ae00/0x9104b1ba770a51cf lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.981694:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5086 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f2f expref: 26 pid: 8412 timeout: 1171 lvb_type: 0 00010000:00010000:3.0:1763343277.981707:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343277.981707:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.981709:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.981715:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a51e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.981723:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a51e4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.981746:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343277.981759:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2407:x1848998399995136:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 517us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343277.981766:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3587 00010000:00010000:3.0:1763343277.981792:0:8626:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a51e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.981805:0:8626:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a51e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.981816:0:8626:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a51e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.981823:0:8626:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a51e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343277.981844:0:8626:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343277.981847:0:8412:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c501ae00/0x9104b1ba770a51cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.981859:0:8412:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c501ae00/0x9104b1ba770a51cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.981867:0:8412:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c501ae00/0x9104b1ba770a51cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.981874:0:8412:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501ae00/0x9104b1ba770a51cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.981892:0:8412:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000001:00080000:2.0:1763343277.982130:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973913 is committed 00000004:00080000:2.0:1763343277.982136:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1169 committed 00000004:00080000:2.0:1763343277.982146:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1161 committed 00000004:00080000:2.0:1763343277.982152:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1160 committed 00000004:00080000:2.0:1763343277.982154:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1168 committed 00000100:00100000:0.0:1763343277.982475:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2408:x1848998399995264:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 842us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.982484:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3588 00010000:00010000:2.0:1763343277.982555:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763343277.982561:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a51e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.982570:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343277.982574:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a51e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.982584:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a51e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.982597:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a51e4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.982604:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a51e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.982619:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343277.982623:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c501ae00/0x9104b1ba770a51cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.982629:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ae00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343277.982632:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c501ae00/0x9104b1ba770a51cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.982639:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c501ae00/0x9104b1ba770a51cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.982647:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c501ae00/0x9104b1ba770a51cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.982660:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c501ae00/0x9104b1ba770a51cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343277.982671:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343277.982673:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343277.982675:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343277.982690:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413014784:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343277.983995:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+33:3660:x1848998413014144:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14759us (15089us total) trans 17179872052 rc 0/0 00000100:00100000:1.0:1763343277.983995:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+9:3659:x1848998413013504:12345-0@lo:6:osp-syn-0-1.0 Request processed in 15923us (16860us total) trans 21474839321 rc 0/0 00000100:00100000:3.0:1763343277.984015:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7526 00010000:00010000:3.0:1763343277.984063:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343277.984079:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413014912:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343277.984086:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343277.984123:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763343277.984176:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5dcbb80/2, rc 0, transno 17179872052 00000100:00100000:3.0:1763343277.984183:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413014144:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343277.984204:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413014912 00000100:00100000:3.0:1763343277.984223:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413014912 00000100:00100000:1.0:1763343277.984343:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7521 00000100:00100000:1.0:1763343277.984433:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413015168:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343277.984456:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343277.984473:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763343277.984478:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413015040:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343277.984492:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343277.984510:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413015168 00000100:00100000:1.0:1763343277.984513:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413015168 00000100:00100000:1.0:1763343277.984530:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413015040 00000100:00100000:1.0:1763343277.984532:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413015040 00000100:00100000:1.0:1763343277.984546:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7529 00000100:00100000:1.0:1763343277.984552:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+10:3662:x1848998413015168:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343277.984704:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+11:3662:x1848998413015168:12345-0@lo:2:osp-syn-0-1.0 Request processed in 152us (246us total) trans 21474839322 rc 0/0 00000100:00100000:1.0:1763343277.984711:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7529 00000100:00100000:1.0:1763343277.984724:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7530 00000100:00100000:1.0:1763343277.984729:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+10:3662:x1848998413015040:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343277.984812:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+11:3662:x1848998413015040:12345-0@lo:2:osp-syn-0-1.0 Request processed in 83us (318us total) trans 21474839323 rc 0/0 00000100:00100000:1.0:1763343277.984818:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7530 00000004:00080000:1.0:1763343277.984852:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bfc380/2, rc 0, transno 21474839323 00000100:00100000:1.0:1763343277.984857:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413015040:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763343277.984865:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bff800/2, rc 0, transno 21474839322 00000100:00100000:1.0:1763343277.984868:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413015168:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1763343277.984923:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a51f2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x222:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f98 expref: 305 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.984934:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x222:0x0].0x0 (ffff9400c4758f00) 00010000:00010000:1.0:1763343277.984937:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343277.984952:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a51eb lrc: 0/0,0 mode: --/EX res: [0x240000404:0x222:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f98 expref: 305 pid: 7641 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343277.984969:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a51f2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x222:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f98 expref: 304 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.984993:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x222:0x0].0x0 (ffff9400c4758f00) 00010000:00010000:1.0:1763343277.984996:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343277.984998:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177a00, rc 0) 00000100:00100000:1.0:1763343277.985049:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:55884:x1848998399994880:12345-192.168.201.40@tcp:101:bash.0 Request processed in 14146us (14311us total) trans 4294973913 rc 0/0 00000100:00100000:1.0:1763343277.985056:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11004 00000100:00100000:2.0:1763343277.985107:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1763343277.985145:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b9c700/2, rc 0, transno 21474839321 00000100:00100000:2.0:1763343277.985149:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413013504:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343277.986928:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413014784 00000100:00100000:3.0:1763343277.986942:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413014784 00000100:00100000:2.0:1763343277.986945:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7531 00000100:00100000:2.0:1763343277.986959:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+34:3660:x1848998413014912:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343277.986990:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7532 00000100:00100000:3.0:1763343277.987000:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+34:3659:x1848998413014784:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343277.987182:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+36:3660:x1848998413014912:12345-0@lo:2:osp-syn-1-1.0 Request processed in 227us (3058us total) trans 17179872053 rc 0/0 00000100:00100000:2.0:1763343277.987189:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7531 00000100:00100000:3.0:1763343277.987294:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+35:3659:x1848998413014784:12345-0@lo:2:osp-syn-1-1.0 Request processed in 295us (2185us total) trans 17179872054 rc 0/0 00000100:00100000:3.0:1763343277.987302:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7532 00000004:00080000:3.0:1763343277.987357:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6b56a00/2, rc 0, transno 17179872053 00000100:00100000:3.0:1763343277.987365:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413014912:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343277.987526:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399995520 00000100:00100000:0.0:1763343277.987532:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399995520 00000100:00100000:0.0:1763343277.987564:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3883 00000100:00100000:0.0:1763343277.987571:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+304:57185:x1848998399995520:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:0.0:1763343277.987789:0:6527:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x21f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763343277.987846:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1821, 64 off151224 00000004:00080000:0.0:1763343277.987854:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1071111829320ns, next at 1072111826735ns, rc = 0 00000040:00080000:0.0:1763343277.987874:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1812, 64 off150464 00000004:00080000:0.0:1763343277.987878:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1071111853852ns, next at 1072111852630ns, rc = 0 00000040:00080000:0.0:1763343277.987888:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1813, 64 off150528 00000040:00080000:0.0:1763343277.987897:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1822, 64 off151288 00010000:00010000:0.0:1763343277.987946:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5200 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343277.987968:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5200 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343277.987979:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5200 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343277.987988:0:6527:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5200 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343277.987993:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5200 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343277.987998:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5200 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343277.988049:0:6527:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1763343277.988134:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6b57b80/2, rc 0, transno 17179872054 00000100:00100000:2.0:1763343277.988149:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413014784:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343277.988270:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57185:x1848998399995520:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 698us (4188us total) trans 4294973914 rc 0/0 00000100:00100000:0.0:1763343277.988278:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3883 00010000:00010000:3.0:1763343277.988732:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343277.988739:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5200 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343277.988746:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501aa00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343277.988750:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5200 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343277.988756:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5200 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343277.988769:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x21f:0x0].0x0 (ffff9400c38f5600) 00010000:00010000:3.0:1763343277.988772:0:7451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343277.988776:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5200 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343277.988783:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5200 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x21f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343277.988793:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343277.989241:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343277.989244:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343277.991728:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.991825:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399995648 00000100:00100000:1.0:1763343277.991837:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399995648 00000100:00100000:0.0:1763343277.992535:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7533 00000100:00100000:0.0:1763343277.992551:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:55884:x1848998399995648:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343277.992571:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343277.992596:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5207 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49fa6 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343277.992621:0:28562:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343277.992642:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.992645:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.992654:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5207 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fa6 expref: 26 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.992673:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5207 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fa6 expref: 26 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.992686:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b400, rc 0) 00000100:00100000:0.0:1763343277.994138:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:55884:x1848998399995648:12345-192.168.201.40@tcp:101:bash.0 Request processed in 1585us (2410us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.994149:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7533 00000100:00100000:2.0:1763343277.996165:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343277.996309:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399995904 00000100:00100000:1.0:1763343277.996320:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399995904 00000100:00100000:1.0:1763343277.996375:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11006 00000100:00100000:1.0:1763343277.996385:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57185:x1848998399995904:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343277.996413:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343277.996439:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a520e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49fad expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.996523:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a5215 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343277.996536:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a5215 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.996547:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a5215 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.996558:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a521c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343277.996564:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a521c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.996569:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a521c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.996672:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5223 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x222:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343277.996681:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5223 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x222:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.996689:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5223 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x222:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343277.996698:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x222:0x0]: returning size 2 00010000:00010000:1.0:1763343277.996778:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a5215 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.996786:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a5215 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.996796:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a5215 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.996802:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a5215 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.996808:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.996811:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a5215 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.996818:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a5215 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.996829:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5700) 00010000:00010000:1.0:1763343277.996831:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.996835:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a5215 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.996840:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a5215 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.996852:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a521c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.996857:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a521c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.996863:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a521c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.996867:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343277.996870:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a521c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.996879:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a521c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.996885:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5800) 00010000:00010000:1.0:1763343277.996888:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343277.996890:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a521c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.996896:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a521c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343277.996941:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a520e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fad expref: 308 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.996956:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5223 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x222:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fad expref: 307 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343277.996963:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x222:0x0].0x0 (ffff9400c4758f00) 00010000:00010000:1.0:1763343277.996965:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343277.996968:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176000, rc 0) 00000100:00100000:1.0:1763343277.997077:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57185:x1848998399995904:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 693us (920us total) trans 4294973915 rc 0/0 00000100:00100000:1.0:1763343277.997084:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11006 00000100:00100000:2.0:1763343277.997750:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343277.998367:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399996032 00000100:00100000:0.0:1763343277.998375:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399996032 00000100:00100000:0.0:1763343277.998423:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7534 00000100:00100000:0.0:1763343277.998433:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:55884:x1848998399996032:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343277.998446:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343277.998463:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c501bc00/0x9104b1ba770a5231 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49fb4 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343277.998485:0:28562:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343277.998502:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.998504:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343277.998512:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501bc00/0x9104b1ba770a5231 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fb4 expref: 14 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.998526:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c501bc00/0x9104b1ba770a5231 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fb4 expref: 14 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343277.998536:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501bc00, rc 0) 00000100:00100000:0.0:1763343277.998575:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:55884:x1848998399996032:12345-192.168.201.40@tcp:101:bash.0 Request processed in 144us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343277.998582:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7534 00000100:00100000:3.0:1763343278.000393:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.000509:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399996288 00000100:00100000:0.0:1763343278.000519:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399996288 00000100:00100000:0.0:1763343278.000572:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3884 00000100:00100000:0.0:1763343278.000581:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82d4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57185:x1848998399996288:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343278.000788:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82d4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57185:x1848998399996288:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 208us (402us total) trans 4294973916 rc 0/0 00000100:00100000:0.0:1763343278.000796:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3884 00000100:00100000:2.0:1763343278.001583:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.001611:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.001810:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399996416 00000100:00100000:1.0:1763343278.001817:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399996416 00002000:00010000:1.0:1763343278.001846:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/735 (0->18446744073709551615) 00002000:00100000:1.0:1763343278.001850:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6b54e00 with x1848998399996416 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343278.001861:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c6b54e00. 00000100:00100000:1.0:1763343278.001887:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399996544 00000100:00100000:1.0:1763343278.001891:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399996544 00002000:00010000:1.0:1763343278.001906:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/734 (0->18446744073709551615) 00002000:00100000:1.0:1763343278.001909:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6b54380 with x1848998399996544 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343278.001915:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c6b54380. 00000100:00100000:1.0:1763343278.001937:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1785 00000100:00100000:1.0:1763343278.001944:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2408:x1848998399996416:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:1.0:1763343278.002127:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2df:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1763343278.002132:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1786 00002000:00010000:1.0:1763343278.002133:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2df:0x0] updating lvb mtime from disk: 0 -> 1763343277 00002000:00010000:1.0:1763343278.002138:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2df:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343278.002141:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2df:0x0] updating lvb ctime from disk: 0 -> 1763343277 00002000:00010000:1.0:1763343278.002143:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2df:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343278.002148:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998399996544:12345-192.168.201.40@tcp:10:bash.0 00000100:00100000:1.0:1763343278.002183:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2408:x1848998399996416:12345-192.168.201.40@tcp:10:bash.0 Request processed in 237us (600us total) trans 17179872055 rc 0/0 00000100:00100000:1.0:1763343278.002190:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1785 00002000:00010000:1.0:1763343278.002193:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/735 (0->18446744073709551615) 00002000:00100000:1.0:1763343278.002195:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6b54e00 with x1848998399996416 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343278.002200:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c6b54e00. 00002000:00010000:0.0:1763343278.002254:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2de:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343278.002257:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2de:0x0] updating lvb mtime from disk: 0 -> 1763343277 00002000:00010000:0.0:1763343278.002259:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2de:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343278.002260:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2de:0x0] updating lvb ctime from disk: 0 -> 1763343277 00002000:00010000:0.0:1763343278.002261:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2de:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343278.002283:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998399996544:12345-192.168.201.40@tcp:10:bash.0 Request processed in 140us (670us total) trans 21474839324 rc 0/0 00000100:00100000:0.0:1763343278.002289:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1786 00002000:00010000:0.0:1763343278.002292:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/734 (0->18446744073709551615) 00002000:00100000:0.0:1763343278.002296:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6b54380 with x1848998399996544 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343278.002301:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c6b54380. 00000100:00100000:2.0:1763343278.005562:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.005642:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399996672 00000100:00100000:3.0:1763343278.005651:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399996672 00000100:00100000:3.0:1763343278.005708:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3885 00000100:00100000:3.0:1763343278.005719:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57185:x1848998399996672:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:3.0:1763343278.005881:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57185:x1848998399996672:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 163us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343278.005889:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3885 00000100:00100000:3.0:1763343278.008945:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.009052:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399997184 00000100:00100000:2.0:1763343278.009062:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399997184 00000100:00100000:0.0:1763343278.009323:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.009976:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399996928 00000100:00100000:1.0:1763343278.009984:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399996928 00000100:00100000:1.0:1763343278.010051:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11007 00000100:00100000:1.0:1763343278.010063:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57190:x1848998399997184:12345-192.168.201.40@tcp:36:rm.0 00000100:00100000:3.0:1763343278.010093:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11008 00000100:00100000:3.0:1763343278.010103:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57185:x1848998399996928:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343278.010113:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.010120:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763343278.010135:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a5238 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x222:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49fbb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.010144:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a51f2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x222:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f98 expref: 309 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.010161:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5223 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x222:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fad expref: 309 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.010172:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a51b3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x222:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f8a expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.010182:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x222:0x0].0x0 (ffff9400c4758f00) 00010000:00010000:1.0:1763343278.010187:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343278.010222:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a523f lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343278.010234:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a523f lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343278.010235:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a5246 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x222:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343278.010242:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a5246 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x222:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.010245:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a523f lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343278.010249:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a5246 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x222:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.010255:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a524d lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00000004:00200000:3.0:1763343278.010260:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x222:0x0]: returning size 2 00010000:00010000:1.0:1763343278.010261:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a524d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.010266:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a524d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343278.010380:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a5238 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x222:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fbb expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.010392:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a5246 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x222:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fbb expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.010399:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x222:0x0].0x0 (ffff9400c4758f00) 00010000:00010000:3.0:1763343278.010401:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763343278.010411:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a7200, rc 0) 00010000:00010000:1.0:1763343278.010438:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a525b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x222:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343278.010447:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a525b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x222:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.010454:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a525b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x222:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00080000:1.0:1763343278.010697:0:9827:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x222:0x0] is inserted into orphan list, open count = 2 00000100:00100000:2.0:1763343278.010849:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57185:x1848998399996928:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 746us (1524us total) trans 4294973917 rc 0/0 00000100:00100000:2.0:1763343278.010857:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11008 00010000:00010000:1.0:1763343278.010924:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a525b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x222:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.010931:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a525b lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x222:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.010937:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a525b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x222:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.010942:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.010946:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a525b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x222:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.010952:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a525b lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x222:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.010959:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x222:0x0].0x0 (ffff9400c4758f00) 00010000:00010000:1.0:1763343278.010962:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343278.010965:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a525b lrc: 2/0,0 mode: --/EX res: [0x240000404:0x222:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.010970:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a525b lrc: 0/0,0 mode: --/EX res: [0x240000404:0x222:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.010982:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a523f lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.010987:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a523f lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.010992:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a523f lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.010997:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a523f lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.011005:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.011008:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a523f lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.011013:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a523f lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.011020:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5700) 00010000:00010000:1.0:1763343278.011185:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.011189:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a523f lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.011195:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a523f lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000004:00010000:1.0:1763343278.011486:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004bf7df29 reply state 00000000deb37b60 transno 4294973918 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a524d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.011499:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a524d lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.011506:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5800) 00010000:00010000:1.0:1763343278.011508:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343278.011510:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343278.011563:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57190:x1848998399997184:12345-192.168.201.40@tcp:36:rm.0 Request processed in 1502us (2626us total) trans 4294973918 rc 0/0 00000100:00100000:1.0:1763343278.011569:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11007 00000100:00100000:0.0:1763343278.015153:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.015728:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399997440 00000100:00100000:2.0:1763343278.015743:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399997440 00000100:00100000:2.0:1763343278.015949:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3886 00000100:00100000:2.0:1763343278.015959:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57185:x1848998399997440:12345-192.168.201.40@tcp:35:lfs.0 00000004:00010000:2.0:1763343278.016060:0:6527:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x222:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a5246 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x222:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fbb expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.016102:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a5262 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x222:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343278.016114:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a5262 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x222:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343278.016124:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a5262 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x222:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00000004:00020000:2.0:1763343278.016287:0:6527:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0001-mdtlov: can not set all stale mirrors for [0x240000404:0x222:0x0]: rc = -1 00010000:00010000:2.0:1763343278.016318:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a5262 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x222:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343278.016325:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a5262 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x222:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343278.016333:0:6527:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a5262 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x222:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343278.016339:0:6527:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3bcc200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.016343:0:6527:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a5262 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x222:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343278.016350:0:6527:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a5262 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x222:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343278.016359:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x222:0x0].0x0 (ffff9400c4758f00) 00010000:00010000:2.0:1763343278.016362:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1763343278.016366:0:6527:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a5262 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x222:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343278.016372:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a5262 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x222:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343278.016382:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x222:0x0].0x0 (ffff9400c4758f00) 00010000:00010000:2.0:1763343278.016384:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343278.016388:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc4a7200/0x9104b1ba770a5246 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x222:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fbb expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343278.016569:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57185:x1848998399997440:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 610us (1425us total) trans 4294973919 rc -1/-1 00000100:00100000:2.0:1763343278.016577:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3886 00000100:00100000:3.0:1763343278.019175:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.019239:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399997568 00000100:00100000:1.0:1763343278.019249:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399997568 00000100:00100000:1.0:1763343278.019317:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11009 00000100:00100000:1.0:1763343278.019328:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57185:x1848998399997568:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343278.019355:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.019379:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a5269 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x222:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49fc2 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.019432:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a5269 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x222:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fc2 expref: 310 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.019446:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176600/0x9104b1ba770a5269 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x222:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fc2 expref: 310 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.019463:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x222:0x0].0x0 (ffff9400c38f5a00) 00010000:00010000:1.0:1763343278.019466:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343278.019472:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176600, rc 0) 00000100:00100000:1.0:1763343278.019532:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57185:x1848998399997568:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 206us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343278.019541:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11009 00000100:00100000:2.0:1763343278.023476:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.023539:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399997824 00000100:00100000:3.0:1763343278.023550:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399997824 00000100:00100000:3.0:1763343278.023614:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3887 00000100:00100000:3.0:1763343278.023625:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57185:x1848998399997824:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:0.0:1763343278.024188:0:6527:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x222:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763343278.024260:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1823, 64 off151352 00000040:00080000:0.0:1763343278.024286:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1814, 64 off150592 00000040:00080000:0.0:1763343278.024297:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1815, 64 off150656 00000040:00080000:0.0:1763343278.024305:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1824, 64 off151416 00010000:00010000:0.0:1763343278.024368:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a5270 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x222:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343278.024384:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a5270 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x222:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343278.024395:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a5270 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x222:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343278.024403:0:6527:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a5270 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x222:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343278.024407:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a5270 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x222:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343278.024411:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a5270 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x222:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343278.024457:0:6527:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343278.024633:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57185:x1848998399997824:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1008us (1167us total) trans 4294973920 rc 0/0 00000100:00100000:0.0:1763343278.024641:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3887 00010000:00010000:2.0:1763343278.024687:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343278.024694:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a5270 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x222:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343278.024701:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ac00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343278.024705:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a5270 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x222:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343278.024713:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a5270 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x222:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343278.024730:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x222:0x0].0x0 (ffff9400c38f5a00) 00010000:00010000:2.0:1763343278.024733:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763343278.024739:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a5270 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x222:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343278.024743:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a5270 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x222:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343278.024755:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343278.024757:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343278.024759:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343278.024896:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.025055:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399997952 00000100:00100000:1.0:1763343278.025063:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399997952 00000100:00100000:1.0:1763343278.025108:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11010 00000100:00100000:1.0:1763343278.025117:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57191:x1848998399997952:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343278.025131:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.025146:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5277 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49fc9 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.025199:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a527e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343278.025221:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a527e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.025231:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a527e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.025241:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5285 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343278.025252:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5285 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.025258:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5285 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.025292:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a527e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.025299:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a527e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.025304:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a527e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.025310:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a527e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.025315:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.025318:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a527e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.025324:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a527e lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.025332:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5700) 00010000:00010000:1.0:1763343278.025334:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.025338:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a527e lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.025343:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a527e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.025352:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5285 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.025358:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5285 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.025363:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5285 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.025367:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.025369:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5285 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.025374:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5285 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.025381:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5800) 00010000:00010000:1.0:1763343278.025384:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.025387:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5285 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.025392:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5285 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.025415:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5277 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fc9 expref: 312 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.025425:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5700) 00010000:00010000:1.0:1763343278.025428:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.025432:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5277 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fc9 expref: 312 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.025443:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177800, rc 0) 00000100:00100000:1.0:1763343278.025487:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57191:x1848998399997952:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 371us (592us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343278.025493:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11010 00000100:00100000:3.0:1763343278.027677:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.028008:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399998080 00000100:00100000:1.0:1763343278.028017:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399998080 00000100:00100000:1.0:1763343278.028295:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11011 00000100:00100000:1.0:1763343278.028307:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57191:x1848998399998080:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343278.028330:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.028351:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a528c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49fd0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.028415:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5293 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343278.028429:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5293 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.028441:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5293 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.028450:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a529a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343278.028456:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a529a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.028462:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a529a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.028500:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5293 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.028507:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5293 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.028512:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5293 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.028518:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5293 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.028587:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.028593:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5293 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.028600:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5293 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.028611:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5b00) 00010000:00010000:1.0:1763343278.028614:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.028619:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5293 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.028625:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5293 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.028637:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a529a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.028642:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a529a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.028647:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a529a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.028652:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.028654:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a529a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.028659:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a529a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.028665:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5800) 00010000:00010000:1.0:1763343278.028667:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.028670:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a529a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.028675:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a529a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.028700:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a528c lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fd0 expref: 312 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.028710:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5b00) 00010000:00010000:1.0:1763343278.028712:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.028716:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a528c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fd0 expref: 312 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.028729:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176a00, rc 0) 00000100:00100000:1.0:1763343278.028794:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57191:x1848998399998080:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 489us (1124us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343278.028801:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11011 00000100:00100000:2.0:1763343278.032850:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.032951:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399998208 00000100:00100000:1.0:1763343278.032961:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399998208 00000100:00100000:1.0:1763343278.033044:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11012 00000100:00100000:1.0:1763343278.033054:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57191:x1848998399998208:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343278.033075:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.033100:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a52a1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49fd7 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.033161:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a52a8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343278.033175:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a52a8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.033187:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a52a8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343278.033251:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763343278.033257:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763343278.033292:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a52a1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fd7 expref: 313 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.033311:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a52a8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fd7 expref: 312 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.033320:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5500) 00010000:00010000:1.0:1763343278.033323:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343278.033327:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177000, rc 0) 00000100:00100000:1.0:1763343278.033379:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57191:x1848998399998208:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 327us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343278.033387:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11012 00000100:00100000:0.0:1763343278.037541:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.037629:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399998464 00000100:00100000:2.0:1763343278.037639:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399998464 00000100:00100000:1.0:1763343278.037864:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11013 00000100:00100000:1.0:1763343278.037878:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57192:x1848998399998464:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343278.037899:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.037922:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a52af lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49fde expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.038001:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a52b6 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343278.038014:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a52b6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.038084:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a52b6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.038096:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a52bd lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343278.038104:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a52bd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.038111:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a52bd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.038148:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a52b6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.038155:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a52b6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.038161:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a52b6 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.038167:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a52b6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.038176:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.038180:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a52b6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.038187:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a52b6 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.038199:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5500) 00010000:00010000:1.0:1763343278.038202:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.038206:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a52b6 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.038222:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a52b6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.038234:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a52bd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.038239:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a52bd lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.038245:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a52bd lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.038250:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.038253:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a52bd lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.038258:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a52bd lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.038265:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5800) 00010000:00010000:1.0:1763343278.038268:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.038330:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a52bd lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.038336:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a52bd lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.038368:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a52af lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fde expref: 313 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.038378:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5500) 00010000:00010000:1.0:1763343278.038380:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343278.038383:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a52af lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fde expref: 313 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.038391:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176a00, rc 0) 00000100:00100000:1.0:1763343278.038457:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57192:x1848998399998464:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 582us (926us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343278.038464:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11013 00000100:00100000:3.0:1763343278.041668:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.041768:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399998720 00000100:00100000:1.0:1763343278.041779:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399998720 00000100:00100000:1.0:1763343278.041841:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11014 00000100:00100000:1.0:1763343278.041852:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57191:x1848998399998720:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343278.041871:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.041874:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343278.041898:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a52a8 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fd7 expref: 312 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.041917:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5500) 00010000:00010000:1.0:1763343278.041926:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343278.041941:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a52c4 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49fe5 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.042066:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a52cb lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343278.042079:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a52cb lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.042092:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a52cb lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.042103:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a52d2 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343278.042110:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a52d2 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.042116:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a52d2 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.042523:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a52d9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x224:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343278.042533:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a52d9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.042539:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a52d9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343278.042548:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x224:0x0]: returning size 0 00010000:00010000:1.0:1763343278.042573:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a52cb lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.042580:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a52cb lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.042586:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a52cb lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.042591:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a52cb lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.042596:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.042600:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a52cb lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.042606:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a52cb lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.042614:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5b00) 00010000:00010000:1.0:1763343278.042616:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.042620:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a52cb lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.042625:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a52cb lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00010000:1.0:1763343278.042634:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f03b6f41 reply state 0000000090137522 transno 4294973921 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a52d2 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.042643:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a52d2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.042648:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5800) 00010000:00010000:1.0:1763343278.042651:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343278.042653:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343278.042678:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a52c4 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fe5 expref: 314 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.042697:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a52d9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fe5 expref: 313 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.042703:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x224:0x0].0x0 (ffff9400c38f5700) 00010000:00010000:1.0:1763343278.042705:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343278.042707:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176000, rc 0) 00000100:00100000:1.0:1763343278.042773:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57191:x1848998399998720:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 922us (1114us total) trans 4294973921 rc 0/0 00000100:00100000:1.0:1763343278.042780:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11014 00000100:00100000:2.0:1763343278.047473:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.047850:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399998976 00000100:00100000:1.0:1763343278.047861:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399998976 00000100:00100000:1.0:1763343278.047919:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11015 00000100:00100000:1.0:1763343278.047929:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57191:x1848998399998976:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343278.047953:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.047974:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a52e7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x224:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49fec expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.049233:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a52ee lrc: 3/0,1 mode: --/EX res: [0x240000404:0x224:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343278.049255:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a52d9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fe5 expref: 315 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.049265:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a52ee lrc: 4/0,1 mode: --/EX res: [0x240000404:0x224:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.049299:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a52d9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fe5 expref: 315 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.049317:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a52d9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fe5 expref: 315 pid: 7641 timeout: 1171 lvb_type: 0 00000100:00100000:1.0:1763343278.049331:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998413015296:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343278.049422:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c3a8acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343278.054822:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.054904:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.054931:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399999360 00000100:00100000:0.0:1763343278.054940:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399999360 00010000:00010000:0.0:1763343278.054978:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a52d9 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fe5 expref: 316 pid: 7641 timeout: 1171 lvb_type: 0 00000100:00100000:0.0:1763343278.055020:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3589 00000100:00100000:0.0:1763343278.055051:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5951c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:2408:x1848998399999360:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343278.055064:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343278.055071:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a52d9 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fe5 expref: 316 pid: 7641 timeout: 1171 lvb_type: 0 00010000:00010000:0.0:1763343278.055085:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a52d9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fe5 expref: 316 pid: 7641 timeout: 1171 lvb_type: 0 00010000:00010000:0.0:1763343278.055107:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x224:0x0].0x0 (ffff9400c38f5700) 00010000:00010000:0.0:1763343278.055112:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a52ee lrc: 3/0,1 mode: --/EX res: [0x240000404:0x224:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.055122:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a52ee lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x224:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.055128:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a52ee lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x224:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.055145:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343278.055204:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5951c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:2408:x1848998399999360:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 155us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343278.055221:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3589 00000100:00100000:1.0:1763343278.055381:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399999232 00000100:00100000:1.0:1763343278.055387:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399999232 00000100:00100000:1.0:1763343278.055426:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11016 00000100:00100000:1.0:1763343278.055433:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57193:x1848998399999232:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343278.055452:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.055471:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a52f5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x224:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49ff3 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.055569:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a52fc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x224:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343278.055579:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a52fc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.055587:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a52fc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343278.055598:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x224:0x0]: returning size 0 00010000:00010000:1.0:1763343278.055684:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a52fc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.055695:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a52fc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.055701:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a52fc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.055707:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.055712:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a52fc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.055718:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a52fc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.055726:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x224:0x0].0x0 (ffff9400c38f5700) 00010000:00010000:1.0:1763343278.055729:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1763343278.055732:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a52fc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x224:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.055738:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a52fc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x224:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.055774:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a52f5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x224:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ff3 expref: 318 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.055783:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x224:0x0].0x0 (ffff9400c38f5700) 00010000:00010000:1.0:1763343278.055785:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343278.055789:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917000/0x9104b1ba770a52f5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x224:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ff3 expref: 318 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.055797:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917000, rc 0) 00000100:00100000:1.0:1763343278.055828:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57193:x1848998399999232:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 396us (1017us total) trans 4294973922 rc 301/301 00000100:00100000:1.0:1763343278.055835:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11016 00010000:00010000:3.0:1763343278.056159:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a52d9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fe5 expref: 316 pid: 7641 timeout: 1171 lvb_type: 0 00000100:00100000:3.0:1763343278.056170:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998413015296:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343278.056187:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a52ee lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x224:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.056194:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a52ee lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x224:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.056199:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a52ee lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x224:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:3.0:1763343278.056224:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x224:0x0]: returning size 0 00000004:00080000:3.0:1763343278.056375:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2e0:0x0], index 0: 0 00000004:00080000:3.0:1763343278.056382:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2e1:0x0], index 1: 0 00000004:00080000:3.0:1763343278.056387:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2e2:0x0], index 1: 0 00000004:00080000:3.0:1763343278.056391:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2e1:0x0], index 0: 0 00010000:00010000:3.0:1763343278.056460:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a52ee lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x224:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.056470:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a52ee lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x224:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.056475:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a52ee lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x224:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.056480:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3916200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343278.056482:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a52ee lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x224:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.056488:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a52ee lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x224:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.056497:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x224:0x0].0x0 (ffff9400c38f5700) 00010000:00010000:3.0:1763343278.056499:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343278.056502:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a52ee lrc: 2/0,0 mode: --/EX res: [0x240000404:0x224:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.056508:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3916200/0x9104b1ba770a52ee lrc: 0/0,0 mode: --/EX res: [0x240000404:0x224:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.056537:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a52e7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x224:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fec expref: 316 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.056545:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x224:0x0].0x0 (ffff9400c38f5700) 00010000:00010000:3.0:1763343278.056548:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343278.056551:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a52e7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x224:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fec expref: 316 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.056563:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176c00, rc 0) 00000100:00100000:3.0:1763343278.056597:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57191:x1848998399998976:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 8669us (9133us total) trans 4294973923 rc 301/301 00000100:00100000:3.0:1763343278.056604:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11015 00000100:00100000:2.0:1763343278.060885:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.060931:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.061053:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399999616 00000100:00100000:1.0:1763343278.061064:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399999616 00000100:00100000:1.0:1763343278.061118:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3888 00000100:00100000:1.0:1763343278.061127:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57191:x1848998399999616:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343278.061480:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998399999744 00000100:00100000:3.0:1763343278.061486:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998399999744 00000100:00100000:3.0:1763343278.061527:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11017 00000100:00100000:3.0:1763343278.061536:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57193:x1848998399999744:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343278.061547:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343278.061572:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5311 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x224:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b49ffa expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.061642:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5318 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x224:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343278.061655:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5318 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.061665:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5318 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:3.0:1763343278.061686:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343278.061705:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5318 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.061732:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5311 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x224:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ffa expref: 318 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.061747:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5318 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ffa expref: 317 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.061754:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x224:0x0].0x0 (ffff9401fd0d4f00) 00010000:00010000:3.0:1763343278.061757:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343278.061761:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c508be00, rc 0) 00000100:00100000:3.0:1763343278.061816:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57193:x1848998399999744:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 282us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343278.061822:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11017 00000100:00100000:1.0:1763343278.062019:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57191:x1848998399999616:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 892us (1171us total) trans 4294973924 rc 0/0 00000100:00100000:1.0:1763343278.062052:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3888 00000100:00100000:2.0:1763343278.064976:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.065768:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.065817:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.065894:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400000128 00000100:00100000:1.0:1763343278.065905:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400000128 00000100:00100000:1.0:1763343278.065958:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400000256 00000100:00100000:1.0:1763343278.065962:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400000256 00000100:00100000:3.0:1763343278.065983:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7535 00000100:00100000:1.0:1763343278.065993:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7536 00000100:00100000:3.0:1763343278.065998:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2408:x1848998400000128:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:1.0:1763343278.066006:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998400000256:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343278.066020:0:27798:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343278.066021:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343278.066084:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5326 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a001 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.066085:0:27798:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a531f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a008 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343278.066122:0:28562:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1763343278.066122:0:27798:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343278.066147:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.066147:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.066150:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343278.066151:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343278.066162:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5326 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a001 expref: 28 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343278.066163:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a531f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a008 expref: 16 pid: 27798 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343278.066193:0:27798:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a531f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a008 expref: 16 pid: 27798 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343278.066194:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5326 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a001 expref: 28 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343278.066229:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c508aa00, rc 0) 00010000:00010000:1.0:1763343278.066229:0:27798:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176a00, rc 0) 00000100:00100000:3.0:1763343278.066289:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2408:x1848998400000128:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 295us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343278.066298:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7535 00000100:00100000:0.0:1763343278.066300:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400000000 00000100:00100000:0.0:1763343278.066306:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400000000 00000100:00100000:0.0:1763343278.066341:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3889 00000100:00100000:0.0:1763343278.066349:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82d6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57191:x1848998400000000:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343278.067177:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998400000256:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1174us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343278.067189:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7536 00000100:00100000:0.0:1763343278.068161:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82d6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+318:57191:x1848998400000000:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1808us (3189us total) trans 4294973925 rc 0/0 00000100:00100000:0.0:1763343278.068172:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3889 00000100:00100000:2.0:1763343278.070618:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.070747:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400000512 00000100:00100000:0.0:1763343278.070757:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400000512 00000100:00100000:0.0:1763343278.071795:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3890 00000100:00100000:0.0:1763343278.071812:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+318:57193:x1848998400000512:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343278.072020:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:57193:x1848998400000512:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 214us (1410us total) trans 4294973926 rc 0/0 00000100:00100000:0.0:1763343278.072058:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3890 00000100:00100000:3.0:1763343278.074791:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.074890:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400000768 00000100:00100000:0.0:1763343278.074901:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400000768 00000100:00100000:0.0:1763343278.074961:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11018 00000100:00100000:0.0:1763343278.074971:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:55884:x1848998400000768:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343278.074995:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.075020:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a532d lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a00f expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.075201:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5334 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343278.075228:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5334 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.075242:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5334 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.075252:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a533b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343278.075260:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a533b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.075265:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a533b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.075319:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a5342 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x224:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343278.075328:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a5342 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.075334:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a5342 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343278.075344:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x224:0x0]: returning size 0 00010000:00010000:0.0:1763343278.075424:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5334 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.075431:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5334 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.075436:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5334 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.075442:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5334 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.075447:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.075451:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5334 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.075458:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5334 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.075475:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5000) 00010000:00010000:0.0:1763343278.075478:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.075483:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5334 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.075489:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5334 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.075501:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a533b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.075507:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a533b lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.075513:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a533b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.075518:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ba00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.075521:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a533b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.075526:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a533b lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.075533:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5800) 00010000:00010000:0.0:1763343278.075536:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.075539:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a533b lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.075544:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a533b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.075579:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a532d lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a00f expref: 322 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.075597:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a5342 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a00f expref: 321 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.075605:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x224:0x0].0x0 (ffff9401fd0d4f00) 00010000:00010000:0.0:1763343278.075607:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343278.075610:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b800, rc 0) 00000100:00100000:0.0:1763343278.075678:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:55884:x1848998400000768:12345-192.168.201.40@tcp:101:bash.0 Request processed in 709us (897us total) trans 4294973927 rc 0/0 00000100:00100000:0.0:1763343278.075686:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11018 00000100:00100000:2.0:1763343278.079555:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.079650:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.079733:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400000896 00000100:00100000:0.0:1763343278.079742:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400000896 00000100:00100000:0.0:1763343278.079797:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400001152 00000100:00100000:0.0:1763343278.079801:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400001152 00000100:00100000:0.0:1763343278.079829:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11019 00000100:00100000:0.0:1763343278.079839:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+322:55884:x1848998400000896:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343278.079863:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.079884:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a5350 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x224:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a016 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.079917:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5357 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x224:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343278.079931:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5357 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.079942:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5357 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.080085:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a5350 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x224:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a016 expref: 324 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.080104:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5357 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a016 expref: 323 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.080112:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x224:0x0].0x0 (ffff9401fd0d4f00) 00010000:00010000:0.0:1763343278.080115:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343278.080119:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b600, rc 0) 00000100:00100000:0.0:1763343278.080183:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:55884:x1848998400000896:12345-192.168.201.40@tcp:101:bash.0 Request processed in 345us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343278.080190:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11019 00000100:00100000:0.0:1763343278.080223:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11020 00000100:00100000:0.0:1763343278.080230:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+322:57193:x1848998400001152:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343278.080238:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.080247:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a535e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x224:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a01d expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.080314:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5365 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x224:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343278.080323:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5365 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x224:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.080330:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5365 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x224:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:0.0:1763343278.080340:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x224:0x0]: returning size 0 00010000:00010000:0.0:1763343278.080438:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a535e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x224:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a01d expref: 325 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.080450:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5365 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x224:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a01d expref: 324 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.080456:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x224:0x0].0x0 (ffff9401fd0d4f00) 00010000:00010000:0.0:1763343278.080459:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1763343278.080461:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501ae00, rc 0) 00000100:00100000:0.0:1763343278.080480:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+324:57193:x1848998400001152:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 251us (831us total) trans 4294973928 rc 0/0 00000100:00100000:0.0:1763343278.080486:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11020 00000100:00100000:3.0:1763343278.081160:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.081333:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400001280 00000100:00100000:1.0:1763343278.081342:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400001280 00000100:00100000:1.0:1763343278.081394:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 457 00000100:00100000:1.0:1763343278.081401:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+324:2407:x1848998400001280:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343278.081413:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343278.081432:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a5342 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a00f expref: 324 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.081447:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x224:0x0].0x0 (ffff9401fd0d4f00) 00010000:00010000:1.0:1763343278.081450:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343278.081479:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:2407:x1848998400001280:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 79us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343278.081486:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 457 00000100:00100000:3.0:1763343278.084997:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.085060:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.085126:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400001664 00000100:00100000:2.0:1763343278.085137:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400001664 00000100:00100000:2.0:1763343278.085197:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11021 00000100:00100000:2.0:1763343278.085222:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:55884:x1848998400001664:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:2.0:1763343278.085301:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343278.085329:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5318 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ffa expref: 323 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.085345:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x224:0x0].0x0 (ffff9401fd0d4f00) 00010000:00010000:2.0:1763343278.085350:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343278.085831:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a5373 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x224:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343278.085845:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a5373 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x224:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.085854:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a5373 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x224:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000001:00080000:2.0:1763343278.085901:0:9827:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973929 00000004:00010000:2.0:1763343278.085925:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000014219aeb reply state 000000007d32b5c8 transno 4294973930 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a5373 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x224:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.085937:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a5373 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x224:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.085943:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x224:0x0].0x0 (ffff9401fd0d4f00) 00010000:00010000:2.0:1763343278.085946:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343278.085948:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343278.086145:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400001408 00000100:00100000:0.0:1763343278.086153:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400001408 00000100:00100000:2.0:1763343278.087116:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+326:55884:x1848998400001664:12345-192.168.201.40@tcp:36:bash.0 Request processed in 1904us (2049us total) trans 4294973930 rc 0/0 00000100:00100000:2.0:1763343278.087126:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11021 00000020:00080000:2.0:1763343278.087131:0:9827:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343278.087331:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3891 00000100:00100000:1.0:1763343278.087347:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+325:57193:x1848998400001408:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:1.0:1763343278.087479:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+325:57193:x1848998400001408:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 138us (2492us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343278.087486:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3891 00000100:00100000:3.0:1763343278.090001:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.090844:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400001920 00000100:00100000:0.0:1763343278.090855:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400001920 00000100:00100000:1.0:1763343278.091178:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3892 00000100:00100000:1.0:1763343278.091190:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+325:55884:x1848998400001920:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:1.0:1763343278.091716:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+326:55884:x1848998400001920:12345-192.168.201.40@tcp:35:bash.0 Request processed in 527us (1723us total) trans 4294973931 rc 0/0 00000100:00100000:1.0:1763343278.091725:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3892 00000100:00100000:2.0:1763343278.094084:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.094288:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400002176 00000100:00100000:1.0:1763343278.094298:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400002176 00000100:00100000:1.0:1763343278.094424:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11022 00000100:00100000:1.0:1763343278.094437:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+326:55884:x1848998400002176:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343278.094457:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.094461:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343278.094487:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5365 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x224:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a01d expref: 326 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.094505:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x224:0x0].0x0 (ffff9401fd0d4f00) 00010000:00010000:1.0:1763343278.094510:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343278.094522:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a537a lrc: 2/0,0 mode: --/EX res: [0x240000404:0x224:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a024 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.094566:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5381 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x224:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343278.094579:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5381 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x224:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.094588:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5381 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x224:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000040:00080000:1.0:1763343278.094812:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1816, 88 off150744 00000004:00080000:1.0:1763343278.094820:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1071218794684ns, next at 1072111852630ns, rc = 0 00000040:00080000:1.0:1763343278.094859:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1825, 88 off151504 00000004:00080000:1.0:1763343278.094864:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1071218838898ns, next at 1072111826735ns, rc = 0 00000040:00080000:1.0:1763343278.094902:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1826, 88 off151592 00000004:00080000:1.0:1763343278.094906:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1071218881504ns, next at 1072111826735ns, rc = 0 00000040:00080000:1.0:1763343278.094915:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1817, 88 off150832 00000004:00080000:1.0:1763343278.094919:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1071218894685ns, next at 1072111852630ns, rc = 0 00010000:00010000:0.0:1763343278.097387:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a524d lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.097404:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a524d lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.097411:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a524d lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.097417:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.097422:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a524d lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.097430:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a524d lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.097451:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5800) 00010000:00010000:0.0:1763343278.097454:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.097458:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a524d lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.097464:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a524d lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.097484:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a52d2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.097490:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a52d2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.097496:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a52d2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.097501:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.097504:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a52d2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.097509:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a52d2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.097515:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5800) 00010000:00010000:0.0:1763343278.097517:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.097519:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a52d2 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.097524:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a52d2 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.097541:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a5373 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x224:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.097548:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a5373 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x224:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.097553:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a5373 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x224:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.097557:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3bcc200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.097560:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a5373 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x224:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.097565:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a5373 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x224:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.097572:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x224:0x0].0x0 (ffff9401fd0d4f00) 00010000:00010000:0.0:1763343278.097575:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.097578:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a5373 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x224:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.097583:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3bcc200/0x9104b1ba770a5373 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x224:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000001:00080000:2.0:1763343278.097640:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973932 is committed 00000004:00080000:2.0:1763343278.097647:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1164 committed 00000004:00080000:2.0:1763343278.097662:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1172 committed 00000004:00080000:2.0:1763343278.097678:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1171 committed 00000004:00080000:2.0:1763343278.097681:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1163 committed 00000004:00080000:2.0:1763343278.097709:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1162 committed 00000004:00080000:2.0:1763343278.097712:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1170 committed 00000100:00100000:3.0:1763343278.097944:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413015552:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343278.098052:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413015424:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343278.098055:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413015680:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343278.098184:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343278.098219:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343278.098231:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763343278.098237:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413015936:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343278.098237:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413015808:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343278.098257:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343278.098291:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413015680 00000100:00100000:2.0:1763343278.098298:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413015680 00000100:00100000:1.0:1763343278.098333:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413016320:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763343278.098336:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413015424 00000100:00100000:2.0:1763343278.098338:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413015424 00000100:00100000:2.0:1763343278.098352:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413015936 00000100:00100000:2.0:1763343278.098355:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413015936 00000100:00100000:1.0:1763343278.098358:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343278.098376:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c7ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413016832:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343278.098394:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763343278.098807:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5381 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x224:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a024 expref: 306 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.098819:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x224:0x0].0x0 (ffff9401fd0d4f00) 00010000:00010000:0.0:1763343278.098822:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343278.098836:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a537a lrc: 0/0,0 mode: --/EX res: [0x240000404:0x224:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a024 expref: 306 pid: 9827 timeout: 0 lvb_type: 3 00000100:00100000:1.0:1763343278.098989:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1763343278.099046:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413016320 00000100:00100000:3.0:1763343278.099051:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413016320 00000100:00100000:1.0:1763343278.099109:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413016192:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763343278.099109:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5381 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x224:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a024 expref: 305 pid: 9827 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343278.099135:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343278.099153:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c7ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413016704:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343278.099167:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413016832 00000100:00100000:2.0:1763343278.099171:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413016832 00000100:00100000:1.0:1763343278.099173:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343278.099268:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413016192 00000100:00100000:0.0:1763343278.099272:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413016192 00000100:00100000:1.0:1763343278.099282:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413016704 00000100:00100000:1.0:1763343278.099286:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413016704 00000100:00100000:0.0:1763343278.099293:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7537 00000100:00100000:0.0:1763343278.099300:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+37:3661:x1848998413015680:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343278.099301:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7538 00000100:00100000:1.0:1763343278.099306:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+37:3659:x1848998413015424:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343278.099323:0:8414:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:731 count 1 00002000:00080000:0.0:1763343278.099323:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:735 count 1 00010000:00010000:1.0:1763343278.099343:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5388 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.099343:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c501a400/0x9104b1ba770a538f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.099361:0:8414:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5182 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f7c expref: 27 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.099361:0:35266:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5207 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fa6 expref: 27 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.099370:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343278.099370:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343278.099372:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343278.099372:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343278.099377:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5388 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.099377:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501a400/0x9104b1ba770a538f lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.099401:0:8414:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5182 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f7c expref: 27 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.099401:0:35266:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5207 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fa6 expref: 27 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.099416:0:8414:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5182 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f7c expref: 27 pid: 28562 timeout: 1171 lvb_type: 0 00010000:00010000:0.0:1763343278.099416:0:35266:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5207 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fa6 expref: 27 pid: 28562 timeout: 1171 lvb_type: 0 00000100:00100000:1.0:1763343278.099429:0:8414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9dc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8414:1848998413016960:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343278.099429:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998413017088:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343278.099483:0:8414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401cb9fdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343278.099501:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7539 00000100:00100000:1.0:1763343278.099508:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+37:3659:x1848998413015936:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343278.099675:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7540 00000100:00100000:2.0:1763343278.099682:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+14:3662:x1848998413016832:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1763343278.099768:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2e1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343278.099772:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2e1:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763343278.099775:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2e1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343278.099777:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2e1:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763343278.099779:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2e1:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343278.099786:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7541 00000100:00100000:3.0:1763343278.099796:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+15:3662:x1848998413016320:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343278.099810:0:28562:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:731 count 1 00010000:00010000:3.0:1763343278.099823:0:28562:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a5396 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.099835:0:28562:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c501b200/0x9104b1ba770a5135 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f60 expref: 15 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.099841:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343278.099843:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343278.099845:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a5396 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.099865:0:28562:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c501b200/0x9104b1ba770a5135 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f60 expref: 15 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.099875:0:28562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c501b200/0x9104b1ba770a5135 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f60 expref: 15 pid: 8412 timeout: 1171 lvb_type: 0 00000100:00100000:3.0:1763343278.099885:0:28562:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6282d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28562:1848998413017216:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343278.099902:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1763343278.099918:0:28562:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c8284840 going to sleep for 11 seconds 00010000:00010000:0.0:1763343278.099931:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x224:0x0].0x0 (ffff9401fd0d4f00) 00010000:00010000:0.0:1763343278.099936:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343278.099940:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176e00, rc 0) 00000100:00100000:1.0:1763343278.099953:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+38:3659:x1848998413015936:12345-0@lo:2:osp-syn-1-1.0 Request processed in 444us (1692us total) trans 17179872056 rc 0/0 00000100:00100000:3.0:1763343278.099957:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7542 00000100:00100000:3.0:1763343278.099970:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+15:3662:x1848998413016192:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343278.099977:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7539 00002000:00080000:3.0:1763343278.099982:0:11289:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:730 count 1 00010000:00010000:3.0:1763343278.099994:0:11289:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a539d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343278.100001:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7543 00010000:00010000:3.0:1763343278.100008:0:11289:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c583e000/0x9104b1ba770a4f0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ea3 expref: 15 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343278.100012:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+15:3662:x1848998413016704:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1763343278.100048:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343278.100051:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343278.100054:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a539d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.100078:0:11289:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c583e000/0x9104b1ba770a4f0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ea3 expref: 15 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.100088:0:11289:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c583e000/0x9104b1ba770a4f0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ea3 expref: 15 pid: 8414 timeout: 1171 lvb_type: 0 00000100:00100000:3.0:1763343278.100099:0:11289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6280380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11289:1848998413017344:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343278.100132:0:11289:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c8284480 going to sleep for 11 seconds 00000100:00100000:3.0:1763343278.100179:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343278.100201:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+16:3662:x1848998413016832:12345-0@lo:2:osp-syn-0-1.0 Request processed in 516us (1801us total) trans 21474839325 rc 0/0 00000100:00100000:3.0:1763343278.100207:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413016064:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343278.100247:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:55884:x1848998400002176:12345-192.168.201.40@tcp:101:bash.0 Request processed in 5532us (5889us total) trans 4294973932 rc 0/0 00000100:00100000:0.0:1763343278.100256:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11022 00000100:00100000:1.0:1763343278.100261:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+16:3662:x1848998413016704:12345-0@lo:2:osp-syn-0-1.0 Request processed in 250us (1084us total) trans 21474839326 rc 0/0 00000100:00100000:3.0:1763343278.100263:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343278.100272:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7543 00000100:00100000:1.0:1763343278.100286:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413015552 00000100:00100000:1.0:1763343278.100291:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413015552 00000100:00100000:3.0:1763343278.100298:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c7ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413016576:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343278.100307:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413016064 00000100:00100000:1.0:1763343278.100311:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413016064 00000100:00100000:3.0:1763343278.100327:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343278.100331:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7544 00000100:00100000:1.0:1763343278.100340:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+39:3660:x1848998413015552:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343278.100343:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00002000:00080000:1.0:1763343278.100352:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:732 count 1 00000100:00100000:3.0:1763343278.100353:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413016448:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1763343278.100368:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a53a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343278.100378:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343278.100382:0:8413:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a513c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f67 expref: 27 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.100390:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343278.100392:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343278.100396:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a53a4 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.100416:0:8413:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a513c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f67 expref: 27 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.100424:0:8413:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a513c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f67 expref: 27 pid: 28562 timeout: 1171 lvb_type: 0 00000100:00100000:1.0:1763343278.100433:0:8413:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9dc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8413:1848998413017472:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343278.100462:0:8413:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401ca046480 going to sleep for 11 seconds 00000100:00100000:1.0:1763343278.100482:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413016576 00000100:00100000:1.0:1763343278.100486:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413016576 00000100:00100000:1.0:1763343278.100500:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413016448 00000100:00100000:1.0:1763343278.100503:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413016448 00000100:00100000:1.0:1763343278.100513:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7545 00000100:00100000:1.0:1763343278.100519:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6282a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+39:3660:x1848998413016064:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763343278.100593:0:35281:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2e2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343278.100597:0:35281:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2e2:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343278.100599:0:35281:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2e2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343278.100601:0:35281:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2e2:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763343278.100603:0:35281:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2e2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343278.100652:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6282a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+40:3660:x1848998413016064:12345-0@lo:2:osp-syn-1-1.0 Request processed in 133us (393us total) trans 17179872057 rc 0/0 00000100:00100000:1.0:1763343278.100658:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7545 00000100:00100000:1.0:1763343278.100671:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7546 00000100:00100000:1.0:1763343278.100677:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+17:3660:x1848998413016576:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763343278.100687:0:35281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:735 count 1 00002000:00010000:1.0:1763343278.100704:0:35281:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343278.100708:0:35281:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a53ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.100715:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.100716:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.100721:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a53ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.100732:0:35281:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a53ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.100741:0:35281:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a53ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.100747:0:35281:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a53ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.100778:0:35281:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343278.100803:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343278.100810:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a53ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.100817:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343278.100821:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a53ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.100830:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a53ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.100845:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a53ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.100851:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a53ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.100868:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343278.100870:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343278.100872:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343278.100927:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7540 00000100:00100000:1.0:1763343278.100939:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+18:3660:x1848998413016576:12345-0@lo:6:osp-syn-0-1.0 Request processed in 259us (610us total) trans 21474839327 rc 0/0 00000100:00100000:2.0:1763343278.100947:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7547 00000100:00100000:1.0:1763343278.100958:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7546 00000100:00100000:2.0:1763343278.100959:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+17:3660:x1848998413016448:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763343278.100973:0:8412:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:734 count 1 00010000:00010000:2.0:1763343278.100985:0:8412:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a53b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.100997:0:8412:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c501bc00/0x9104b1ba770a5231 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fb4 expref: 15 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.101004:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343278.101006:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343278.101008:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a53b2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763343278.101014:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c59b5500/2, rc 0, transno 17179872056 00000100:00100000:1.0:1763343278.101045:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413015936:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1763343278.101048:0:8412:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c501bc00/0x9104b1ba770a5231 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fb4 expref: 15 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.101061:0:8412:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c501bc00/0x9104b1ba770a5231 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fb4 expref: 15 pid: 28562 timeout: 1171 lvb_type: 0 00000100:00100000:1.0:1763343278.101070:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343278.101076:0:8412:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998413017600:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343278.101084:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413015808 00000100:00100000:0.0:1763343278.101090:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413015808 00000100:00100000:2.0:1763343278.101122:0:8412:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c5304c00 going to sleep for 11 seconds 00000004:00080000:1.0:1763343278.101123:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c7ef6300/2, rc 0, transno 21474839326 00000100:00100000:0.0:1763343278.101123:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7548 00000100:00100000:1.0:1763343278.101131:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c7ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413016704:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343278.101133:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edde4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+40:3661:x1848998413015808:12345-0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1763343278.101141:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c7ef7480/2, rc 0, transno 21474839325 00000100:00100000:1.0:1763343278.101146:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c7ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413016832:0@lo:2:osp-syn-0-1.0 00002000:00080000:0.0:1763343278.101148:0:27798:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:736 count 1 00002000:00010000:0.0:1763343278.101163:0:27798:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343278.101168:0:27798:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c501be00/0x9104b1ba770a53b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.101175:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343278.101177:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343278.101180:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501be00/0x9104b1ba770a53b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.101189:0:27798:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c501be00/0x9104b1ba770a53b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.101196:0:27798:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c501be00/0x9104b1ba770a53b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.101203:0:27798:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501be00/0x9104b1ba770a53b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.101236:0:27798:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343278.101276:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343278.101283:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c501be00/0x9104b1ba770a53b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.101291:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501be00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343278.101295:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c501be00/0x9104b1ba770a53b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.101303:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c501be00/0x9104b1ba770a53b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.101317:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c501be00/0x9104b1ba770a53b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.101324:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c501be00/0x9104b1ba770a53b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.101339:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343278.101341:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343278.101343:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343278.101367:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edde4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+41:3661:x1848998413015808:12345-0@lo:6:osp-syn-1-1.0 Request processed in 235us (299us total) trans 17179872058 rc 0/0 00000100:00100000:0.0:1763343278.101375:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7548 00000004:00080000:3.0:1763343278.101532:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c7ef7b80/2, rc 0, transno 21474839327 00000100:00100000:3.0:1763343278.101536:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c7ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413016576:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1763343278.101545:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c59b4700/2, rc 0, transno 17179872057 00000100:00100000:3.0:1763343278.101548:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413016064:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343278.101752:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.102675:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400002432 00000100:00100000:0.0:1763343278.102685:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400002432 00000100:00100000:0.0:1763343278.102737:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11023 00000100:00100000:0.0:1763343278.102745:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+305:57194:x1848998400002432:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343278.102765:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.102788:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a53c0 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a02b expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.102872:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a53c7 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343278.102885:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a53c7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.102896:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a53c7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.102910:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a53ce lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343278.102917:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a53ce lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.102923:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a53ce lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.103067:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a53d5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x224:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343278.103077:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a53d5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.103084:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a53d5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:0.0:1763343278.103093:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x224:0x0]: returning size 2 00010000:00010000:0.0:1763343278.103189:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a53c7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.103198:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a53c7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.103204:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a53c7 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.103223:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a53c7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.103228:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ba00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.103232:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a53c7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.103239:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a53c7 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.103250:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5900) 00010000:00010000:0.0:1763343278.103253:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.103257:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a53c7 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.103263:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a53c7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.103277:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a53ce lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.103283:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a53ce lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.103288:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a53ce lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.103293:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.103296:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a53ce lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.103305:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a53ce lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.103312:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401cc2f5f00) 00010000:00010000:0.0:1763343278.103314:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.103316:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a53ce lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.103322:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a53ce lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.103361:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a53c0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a02b expref: 308 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.103375:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a53d5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a02b expref: 307 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.103382:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x224:0x0].0x0 (ffff9401fd0d4f00) 00010000:00010000:0.0:1763343278.103385:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343278.103387:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501aa00, rc 0) 00000100:00100000:0.0:1763343278.103442:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57194:x1848998400002432:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 697us (1690us total) trans 4294973933 rc 0/0 00000100:00100000:0.0:1763343278.103449:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11023 00000100:00100000:2.0:1763343278.104307:0:8414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9dc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8414:1848998413016960:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343278.104332:0:8414:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5388 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763343278.105506:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c59b6a00/2, rc 0, transno 17179872058 00000100:00100000:1.0:1763343278.105516:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413015808:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343278.106204:0:8413:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9dc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8413:1848998413017472:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343278.106219:0:8412:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998413017600:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343278.106246:0:8412:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a53b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.106246:0:8413:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a53a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343278.106334:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.106341:0:28562:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6282d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28562:1848998413017216:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343278.106361:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:1.0:1763343278.106361:0:28562:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a5396 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343278.106390:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400002944 00000100:00100000:2.0:1763343278.106396:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.106396:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400002944 00000100:00100000:2.0:1763343278.106417:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:1.0:1763343278.106434:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5207 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fa6 expref: 28 pid: 28562 timeout: 1171 lvb_type: 0 00000100:00100000:2.0:1763343278.106439:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400002688 00000100:00100000:2.0:1763343278.106445:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400002688 00010000:00010000:2.0:1763343278.106465:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5182 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f7c expref: 29 pid: 28562 timeout: 1171 lvb_type: 0 00000100:00100000:1.0:1763343278.106467:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400002560 00000100:00100000:1.0:1763343278.106472:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400002560 00010000:00010000:1.0:1763343278.106489:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c583e000/0x9104b1ba770a4f0c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ea3 expref: 16 pid: 8414 timeout: 1171 lvb_type: 0 00000100:00100000:2.0:1763343278.106499:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400003200 00000100:00100000:2.0:1763343278.106504:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400003200 00000100:00100000:1.0:1763343278.106509:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3590 00010000:00010000:2.0:1763343278.106522:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501b200/0x9104b1ba770a5135 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f60 expref: 17 pid: 8412 timeout: 1171 lvb_type: 0 00000100:00100000:1.0:1763343278.106522:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82dc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:2408:x1848998400002944:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343278.106539:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343278.106545:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5207 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fa6 expref: 29 pid: 28562 timeout: 1171 lvb_type: 0 00000100:00100000:2.0:1763343278.106548:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3591 00000100:00100000:2.0:1763343278.106558:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:2409:x1848998400002688:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343278.106571:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343278.106576:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5207 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fa6 expref: 29 pid: 28562 timeout: 1171 lvb_type: 0 00010000:00010000:2.0:1763343278.106581:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5182 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f7c expref: 29 pid: 28562 timeout: 1171 lvb_type: 0 00010000:00010000:2.0:1763343278.106596:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5182 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f7c expref: 29 pid: 28562 timeout: 1171 lvb_type: 0 00010000:00010000:1.0:1763343278.106605:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.106609:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.106612:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5182 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f7c expref: 29 pid: 28562 timeout: 1171 lvb_type: 0 00010000:00010000:1.0:1763343278.106614:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c501a400/0x9104b1ba770a538f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.106632:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.106636:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.106639:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501a400/0x9104b1ba770a538f lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.106645:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5388 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.106655:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5388 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.106658:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343278.106679:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343278.106699:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82dc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2408:x1848998400002944:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 181us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.106707:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2409:x1848998400002688:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 148us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343278.106715:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3590 00000100:00100000:2.0:1763343278.106723:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3591 00000100:00100000:2.0:1763343278.106745:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3592 00000100:00100000:2.0:1763343278.106754:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998400002560:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343278.106764:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343278.106769:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c583e000/0x9104b1ba770a4f0c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ea3 expref: 17 pid: 8414 timeout: 1171 lvb_type: 0 00000100:00100000:1.0:1763343278.106772:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3593 00000100:00100000:1.0:1763343278.106783:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2409:x1848998400003200:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343278.106786:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c583e000/0x9104b1ba770a4f0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ea3 expref: 17 pid: 8414 timeout: 1171 lvb_type: 0 00010000:00010000:1.0:1763343278.106792:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343278.106802:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.106805:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.106809:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c501b200/0x9104b1ba770a5135 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f60 expref: 17 pid: 8412 timeout: 1171 lvb_type: 0 00010000:00010000:2.0:1763343278.106811:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a539d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.106829:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c501b200/0x9104b1ba770a5135 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f60 expref: 17 pid: 8412 timeout: 1171 lvb_type: 0 00010000:00010000:2.0:1763343278.106837:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a539d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.106845:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c501b200/0x9104b1ba770a5135 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f60 expref: 17 pid: 8412 timeout: 1171 lvb_type: 0 00010000:00010000:2.0:1763343278.106855:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343278.106857:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.106861:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.106864:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a5396 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.106871:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a5396 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343278.106880:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998400002560:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 126us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.106893:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3592 00010000:00010000:1.0:1763343278.106897:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343278.106918:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2409:x1848998400003200:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 136us (500us total) trans 0 rc 0/0 00010000:00010000:2.0:1763343278.106923:0:8414:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5388 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343278.106926:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3593 00010000:00010000:2.0:1763343278.106936:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5388 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.106946:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5388 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.106953:0:28562:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a5396 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.106955:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5388 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.106971:0:28562:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a5396 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.106982:0:28562:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a5396 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.106983:0:8414:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343278.106994:0:28562:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a5396 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.107012:0:28562:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1763343278.107054:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763343278.107060:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5388 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.107068:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343278.107071:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5388 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.107079:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5388 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.107092:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5388 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.107099:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5388 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.107123:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343278.107127:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a5396 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.107133:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a7200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343278.107136:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a5396 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.107143:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a5396 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.107152:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a5396 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.107159:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a5396 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.107171:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343278.107172:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343278.107175:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343278.107227:0:11289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c583e000/0x9104b1ba770a4f0c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49ea3 expref: 14 pid: 8414 timeout: 1171 lvb_type: 0 00000100:00100000:2.0:1763343278.107362:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+41:3659:x1848998413015424:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8054us (9151us total) trans 17179872059 rc 0/0 00000100:00100000:2.0:1763343278.107371:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7538 00000004:00080000:1.0:1763343278.107379:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b26300/2, rc 0, transno 17179872059 00000100:00100000:1.0:1763343278.107386:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413015424:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1763343278.107394:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343278.107426:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.107469:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+17:3662:x1848998413016320:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7673us (9108us total) trans 21474839328 rc 0/0 00000100:00100000:1.0:1763343278.107477:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7541 00000100:00100000:2.0:1763343278.107498:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000004:00080000:1.0:1763343278.107512:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bfdf80/2, rc 0, transno 21474839328 00000100:00100000:1.0:1763343278.107519:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413016320:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343278.107537:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400003072 00000100:00100000:1.0:1763343278.107541:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400003072 00010000:00010000:1.0:1763343278.107559:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501bc00/0x9104b1ba770a5231 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fb4 expref: 15 pid: 28562 timeout: 1171 lvb_type: 0 00000100:00100000:1.0:1763343278.107581:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400002816 00000100:00100000:1.0:1763343278.107585:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400002816 00010000:00010000:1.0:1763343278.107597:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a513c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f67 expref: 27 pid: 28562 timeout: 1171 lvb_type: 0 00000100:00100000:1.0:1763343278.107623:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3594 00000100:00100000:1.0:1763343278.107630:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998400003072:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343278.107637:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343278.107642:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c501bc00/0x9104b1ba770a5231 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fb4 expref: 15 pid: 28562 timeout: 1171 lvb_type: 0 00010000:00010000:1.0:1763343278.107651:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c501bc00/0x9104b1ba770a5231 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fb4 expref: 15 pid: 28562 timeout: 1171 lvb_type: 0 00010000:00010000:1.0:1763343278.107664:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c501bc00/0x9104b1ba770a5231 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fb4 expref: 15 pid: 28562 timeout: 1171 lvb_type: 0 00010000:00010000:1.0:1763343278.107674:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.107676:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.107678:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a53b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.107691:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a53b2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.107708:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343278.107737:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998400003072:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 106us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343278.107744:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3594 00000100:00100000:1.0:1763343278.107763:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3595 00000100:00100000:1.0:1763343278.107770:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2409:x1848998400002816:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343278.107778:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343278.107782:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a513c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f67 expref: 27 pid: 28562 timeout: 1171 lvb_type: 0 00010000:00010000:0.0:1763343278.107788:0:35266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5207 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49fa6 expref: 27 pid: 28562 timeout: 1171 lvb_type: 0 00010000:00010000:1.0:1763343278.107797:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a513c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f67 expref: 27 pid: 28562 timeout: 1171 lvb_type: 0 00000100:00100000:0.0:1763343278.107805:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998413017088:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343278.107815:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a513c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b49f67 expref: 26 pid: 28562 timeout: 1171 lvb_type: 0 00010000:00010000:0.0:1763343278.107824:0:35266:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c501a400/0x9104b1ba770a538f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.107826:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.107830:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.107834:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a53a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.107839:0:35266:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c501a400/0x9104b1ba770a538f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.107846:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a53a4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.107850:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c501a400/0x9104b1ba770a538f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.107865:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c501a400/0x9104b1ba770a538f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.107871:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343278.107872:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501a400/0x9104b1ba770a538f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343278.107892:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2409:x1848998400002816:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 122us (394us total) trans 0 rc 0/0 00010000:00010000:0.0:1763343278.107893:0:35266:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343278.107905:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3595 00010000:00010000:1.0:1763343278.107927:0:8413:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a53a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.107935:0:8413:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a53a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.107943:0:8413:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a53a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.107951:0:8413:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a53a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.107965:0:8413:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1763343278.108069:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+42:3661:x1848998413015680:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8766us (9882us total) trans 17179872060 rc 0/0 00000100:00100000:0.0:1763343278.108077:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7537 00010000:00010000:0.0:1763343278.108097:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763343278.108103:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c501a400/0x9104b1ba770a538f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.108111:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a400 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343278.108116:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c501a400/0x9104b1ba770a538f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343278.108120:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+41:3660:x1848998413015552:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7779us (7939us total) trans 17179872061 rc 0/0 00010000:00010000:0.0:1763343278.108132:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c501a400/0x9104b1ba770a538f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343278.108133:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7544 00010000:00010000:0.0:1763343278.108154:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c501a400/0x9104b1ba770a538f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.108156:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343278.108164:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a53a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343278.108168:0:11289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6280380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11289:1848998413017344:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343278.108179:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343278.108182:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a53a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.108191:0:11289:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a539d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.108192:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a53a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.108226:0:11289:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a539d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.108231:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a53a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.108239:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a53a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.108253:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c501a400/0x9104b1ba770a538f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.108261:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343278.108265:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343278.108268:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343278.108272:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343278.108276:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343278.108279:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343278.108290:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c59b7480/2, rc 0, transno 17179872060 00000100:00100000:1.0:1763343278.108296:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413015680:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1763343278.108314:0:8412:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a53b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.108323:0:8412:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a53b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.108331:0:8412:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a53b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.108337:0:8412:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a53b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.108366:0:8412:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343278.108456:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+17:3660:x1848998413016448:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7501us (8079us total) trans 21474839329 rc 0/0 00000100:00100000:1.0:1763343278.108463:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7547 00010000:00010000:0.0:1763343278.108489:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343278.108495:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a53b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.108502:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3bcca00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343278.108505:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a53b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.108512:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a53b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.108522:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a53b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.108527:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c3bcca00/0x9104b1ba770a53b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.108541:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343278.108543:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343278.108545:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343278.109238:0:11289:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a539d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.109248:0:11289:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a539d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.109255:0:11289:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a539d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.109272:0:11289:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343278.109434:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+17:3662:x1848998413016192:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9465us (10296us total) trans 21474839330 rc 0/0 00000100:00100000:3.0:1763343278.109442:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7542 00000004:00080000:0.0:1763343278.109469:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bfca80/2, rc 0, transno 21474839330 00000100:00100000:0.0:1763343278.109477:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413016192:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1763343278.109576:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b18000/2, rc 0, transno 21474839329 00000100:00100000:3.0:1763343278.109580:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413016448:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1763343278.109590:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c59b4a80/2, rc 0, transno 17179872061 00000100:00100000:3.0:1763343278.109593:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413015552:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1763343278.111985:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343278.112001:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a539d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.112012:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a6a00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343278.112017:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a539d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.112041:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a539d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.112063:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a539d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.112071:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a539d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.112094:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343278.112096:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343278.112098:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343278.113771:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.113813:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.113883:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400003328 00000100:00100000:1.0:1763343278.113893:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400003328 00000100:00100000:3.0:1763343278.114016:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400003456 00000100:00100000:3.0:1763343278.114037:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400003456 00000100:00100000:2.0:1763343278.114050:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7549 00000100:00100000:2.0:1763343278.114062:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:55884:x1848998400003328:12345-192.168.201.40@tcp:101:bash.0 00000100:00100000:3.0:1763343278.114074:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7550 00010000:00010000:2.0:1763343278.114083:0:8413:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1763343278.114086:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998400003456:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343278.114096:0:11289:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.114105:0:8413:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fca00/0x9104b1ba770a53e3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a032 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.114107:0:11289:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a53ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2e0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a039 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343278.114138:0:8413:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343278.114159:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.114162:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.114170:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fca00/0x9104b1ba770a53e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a032 expref: 16 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343278.114236:0:11289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6282300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11289:1848998413017728:192.168.201.40@tcp:106: 00000100:00100000:3.0:1763343278.114323:0:11289:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c8284480 going to sleep for 11 seconds 00010000:00010000:2.0:1763343278.114779:0:8413:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fca00/0x9104b1ba770a53e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a032 expref: 16 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.114795:0:8413:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fca00, rc 0) 00000100:00100000:2.0:1763343278.114850:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:55884:x1848998400003328:12345-192.168.201.40@tcp:101:bash.0 Request processed in 790us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.114859:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7549 00002000:00010000:3.0:1763343278.116656:0:11289:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x2e0:0x0] updating lvb mtime: 0 -> 1763343277 00002000:00010000:3.0:1763343278.116664:0:11289:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x2e0:0x0] updating lvb atime: 0 -> 1763343277 00002000:00010000:3.0:1763343278.116666:0:11289:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x2e0:0x0] updating lvb ctime: 0 -> 1763343277 00000100:00100000:3.0:1763343278.116685:0:11289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6282300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11289:1848998413017728:192.168.201.40@tcp:106: 00010000:00010000:3.0:1763343278.116722:0:11289:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a53ea lrc: 1/0,0 mode: --/PR res: [0x280000400:0x2e0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a039 expref: 15 pid: 11289 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343278.116743:0:11289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a53ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2e0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a039 expref: 15 pid: 11289 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343278.116759:0:11289:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a7e00, rc 0) 00000100:00100000:3.0:1763343278.116811:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998400003456:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2728us (2997us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343278.116819:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7550 00000100:00100000:3.0:1763343278.118088:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.118465:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400003584 00000100:00100000:2.0:1763343278.118475:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400003584 00000100:00100000:2.0:1763343278.118533:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7551 00000100:00100000:2.0:1763343278.118543:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:55884:x1848998400003584:12345-192.168.201.40@tcp:101:bash.0 00000100:00100000:3.0:1763343278.118686:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:2.0:1763343278.118795:0:11289:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.118818:0:11289:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a53f1 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a040 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343278.118843:0:11289:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343278.118865:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.118867:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.118876:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a53f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a040 expref: 26 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.118891:0:11289:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a53f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a040 expref: 26 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.118901:0:11289:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc3fd800, rc 0) 00000100:00100000:2.0:1763343278.118957:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:55884:x1848998400003584:12345-192.168.201.40@tcp:101:bash.0 Request processed in 415us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.118966:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7551 00000100:00100000:1.0:1763343278.119054:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400003840 00000100:00100000:1.0:1763343278.119059:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400003840 00000100:00100000:1.0:1763343278.119092:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3893 00000100:00100000:1.0:1763343278.119098:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57194:x1848998400003840:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343278.119294:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57194:x1848998400003840:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 194us (607us total) trans 4294973934 rc 0/0 00000100:00100000:1.0:1763343278.119302:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3893 00000100:00100000:2.0:1763343278.123899:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.123945:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.124062:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400004096 00000100:00100000:1.0:1763343278.124073:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400004096 00000100:00100000:0.0:1763343278.124093:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400003968 00000100:00100000:0.0:1763343278.124100:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400003968 00002000:00010000:1.0:1763343278.124117:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/737 (0->18446744073709551615) 00002000:00010000:0.0:1763343278.124121:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/736 (0->18446744073709551615) 00002000:00100000:1.0:1763343278.124124:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c4b21500 with x1848998400004096 ext(0->18446744073709551615) 00002000:00100000:0.0:1763343278.124126:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c4b20000 with x1848998400003968 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343278.124140:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c4b21500. 00002000:00010000:0.0:1763343278.124140:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c4b20000. 00000100:00100000:0.0:1763343278.124178:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1787 00000100:00100000:0.0:1763343278.124191:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998400003968:12345-192.168.201.40@tcp:10:bash.0 00000100:00100000:1.0:1763343278.124193:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1788 00000100:00100000:1.0:1763343278.124253:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2408:x1848998400004096:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:1.0:1763343278.124392:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2e1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343278.124392:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2e0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343278.124398:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2e1:0x0] updating lvb mtime from disk: 0 -> 1763343277 00002000:00010000:0.0:1763343278.124399:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2e0:0x0] updating lvb mtime from disk: 1763343277 -> 1763343277 00002000:00010000:1.0:1763343278.124405:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2e1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343278.124406:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2e0:0x0] updating lvb atime from disk: 1763343277 -> 0 00002000:00010000:1.0:1763343278.124411:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2e1:0x0] updating lvb ctime from disk: 0 -> 1763343277 00002000:00010000:0.0:1763343278.124412:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2e0:0x0] updating lvb ctime from disk: 1763343277 -> 1763343277 00002000:00010000:1.0:1763343278.124418:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2e1:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1763343278.124418:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2e0:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343278.124485:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998400003968:12345-192.168.201.40@tcp:10:bash.0 Request processed in 297us (537us total) trans 21474839331 rc 0/0 00000100:00100000:0.0:1763343278.124493:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1787 00002000:00010000:0.0:1763343278.124497:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/736 (0->18446744073709551615) 00002000:00100000:0.0:1763343278.124501:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c4b20000 with x1848998400003968 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343278.124506:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c4b20000. 00000100:00100000:1.0:1763343278.124507:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2408:x1848998400004096:12345-192.168.201.40@tcp:10:bash.0 Request processed in 255us (625us total) trans 17179872062 rc 0/0 00000100:00100000:1.0:1763343278.124517:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1788 00002000:00010000:1.0:1763343278.124521:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/737 (0->18446744073709551615) 00002000:00100000:1.0:1763343278.124523:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c4b21500 with x1848998400004096 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343278.124529:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c4b21500. 00000100:00100000:0.0:1763343278.128569:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.128627:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400004352 00000100:00100000:2.0:1763343278.128638:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400004352 00000100:00100000:2.0:1763343278.129081:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3894 00000100:00100000:2.0:1763343278.129093:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:55884:x1848998400004352:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:2.0:1763343278.129546:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:55884:x1848998400004352:12345-192.168.201.40@tcp:35:bash.0 Request processed in 454us (984us total) trans 4294973935 rc 0/0 00000100:00100000:2.0:1763343278.129555:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3894 00000100:00100000:0.0:1763343278.141533:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.141575:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.141611:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400004608 00000100:00100000:2.0:1763343278.141623:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400004608 00000100:00100000:2.0:1763343278.141676:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400004864 00000100:00100000:2.0:1763343278.141680:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400004864 00000100:00100000:0.0:1763343278.141700:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11024 00000100:00100000:0.0:1763343278.141714:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57195:x1848998400004608:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:2.0:1763343278.141731:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11025 00000100:00100000:2.0:1763343278.141746:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57196:x1848998400004864:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:0.0:1763343278.141760:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.141784:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a53f8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x224:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a047 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.141792:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763343278.141817:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5381 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x224:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a024 expref: 311 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.141839:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a53d5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a02b expref: 310 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.141854:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5357 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x224:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a016 expref: 309 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.141866:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x224:0x0].0x0 (ffff9401fd0d4f00) 00010000:00010000:2.0:1763343278.141871:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343278.141879:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a53ff lrc: 3/1,0 mode: --/CR res: [0x240000404:0x224:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343278.141894:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a53ff lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x224:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.141906:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a53ff lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x224:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.141907:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a5406 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00000004:00200000:0.0:1763343278.141921:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x224:0x0]: returning size 5 00010000:00010000:2.0:1763343278.141923:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a5406 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.141933:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a5406 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.141947:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a5414 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343278.141954:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a5414 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.141961:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a5414 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.142075:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a53f8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x224:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a047 expref: 310 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.142086:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a541b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x224:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343278.142093:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a53ff lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x224:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a047 expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.142102:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a53ff lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x224:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a047 expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.142112:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a541b lrc: 4/0,1 mode: --/EX res: [0x240000404:0x224:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.142897:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x224:0x0].0x0 (ffff9401fd0d4f00) 00010000:00010000:0.0:1763343278.142903:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1763343278.142906:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a541b lrc: 4/0,1 mode: --/EX res: [0x240000404:0x224:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.142915:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501ba00, rc 0) 00010000:00010000:2.0:1763343278.143008:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a53ff lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x224:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a047 expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.143045:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a53ff lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x224:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a047 expref: 309 pid: 6525 timeout: 1171 lvb_type: 0 00000100:00100000:2.0:1763343278.143064:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c4b20380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998413017856:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343278.143366:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57195:x1848998400004608:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1655us (1841us total) trans 4294973936 rc 0/0 00000100:00100000:0.0:1763343278.143374:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11024 00000100:00100000:2.0:1763343278.143570:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c53043c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343278.146787:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.149903:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400004992 00000100:00100000:3.0:1763343278.149919:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400004992 00000100:00100000:3.0:1763343278.149989:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11026 00000100:00100000:3.0:1763343278.150000:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57195:x1848998400004992:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343278.150053:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343278.150086:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5422 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x224:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a04e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.150187:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a5429 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x224:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343278.150201:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a541b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x224:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.150222:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a5429 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x224:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.150242:0:6525:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a541b lrc: 4/0,1 mode: --/EX res: [0x240000404:0x224:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.150253:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a5429 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x224:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000100:00100000:0.0:1763343278.151235:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c4b20380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998413017856:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343278.151262:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a541b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x224:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343278.152478:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.152575:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400005120 00000100:00100000:3.0:1763343278.152584:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400005120 00010000:00010000:3.0:1763343278.152618:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a53ff lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x224:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a047 expref: 311 pid: 6525 timeout: 1171 lvb_type: 0 00000100:00100000:3.0:1763343278.152661:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3596 00000100:00100000:3.0:1763343278.152671:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:2408:x1848998400005120:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343278.152684:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343278.152690:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a53ff lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x224:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a047 expref: 311 pid: 6525 timeout: 1171 lvb_type: 0 00010000:00010000:3.0:1763343278.152702:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a53ff lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x224:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a047 expref: 311 pid: 6525 timeout: 1171 lvb_type: 0 00010000:00010000:3.0:1763343278.152727:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a53ff lrc: 0/0,0 mode: --/CR res: [0x240000404:0x224:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a047 expref: 311 pid: 6525 timeout: 1171 lvb_type: 0 00010000:00010000:3.0:1763343278.152740:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x224:0x0].0x0 (ffff9401fd0d4f00) 00010000:00010000:3.0:1763343278.152745:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a541b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x224:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.152754:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a541b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x224:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.152760:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a541b lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x224:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.152767:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a5429 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x224:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.152778:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a5429 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x224:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.152783:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a5429 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x224:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.152813:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343278.152850:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a541b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x224:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.152860:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a541b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x224:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00000100:00100000:3.0:1763343278.152876:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:2408:x1848998400005120:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 205us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343278.152886:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3596 00000004:00080000:0.0:1763343278.153960:0:7641:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x224:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1763343278.154698:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a541b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x224:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.154709:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a541b lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x224:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.154716:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a541b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x224:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.154722:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fd2dfa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.154727:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a541b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x224:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.154733:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a541b lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x224:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.154747:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x224:0x0].0x0 (ffff9401fd0d4f00) 00010000:00010000:0.0:1763343278.154750:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763343278.154753:0:7641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a5429 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x224:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.154763:0:7641:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a5429 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.154770:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a5429 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.154797:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a541b lrc: 2/0,0 mode: --/EX res: [0x240000404:0x224:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.154804:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a541b lrc: 0/0,0 mode: --/EX res: [0x240000404:0x224:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.154821:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a5406 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.154827:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a5406 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.154832:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a5406 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.154837:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a5406 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.154842:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc3fd600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.154845:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a5406 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.154852:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a5406 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.154858:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758200) 00010000:00010000:0.0:1763343278.154860:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.154863:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a5406 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.154868:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fc3fd600/0x9104b1ba770a5406 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00010000:0.0:1763343278.154883:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003c0c65df reply state 0000000022f78b9e transno 4294973937 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a5414 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.154894:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a5414 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.154899:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758400) 00010000:00010000:0.0:1763343278.154902:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343278.154905:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343278.154990:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57196:x1848998400004864:12345-192.168.201.40@tcp:36:rm.0 Request processed in 13247us (13409us total) trans 4294973937 rc 0/0 00000100:00100000:0.0:1763343278.154998:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11025 00010000:00010000:3.0:1763343278.155630:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a5429 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.155640:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a5429 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:3.0:1763343278.155671:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x224:0x0]: returning size 5 00000004:00200000:3.0:1763343278.155675:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343278.155691:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a5429 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.155721:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5422 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x224:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a04e expref: 311 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.155734:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3c00/0x9104b1ba770a5429 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a04e expref: 310 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.155742:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x224:0x0].0x0 (ffff9401fd0d4f00) 00010000:00010000:3.0:1763343278.155744:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343278.155747:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3c00, rc 0) 00000100:00100000:3.0:1763343278.155783:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57195:x1848998400004992:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 5785us (9012us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343278.155790:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11026 00000100:00100000:1.0:1763343278.160651:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.160754:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400005376 00000100:00100000:2.0:1763343278.160764:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400005376 00000100:00100000:2.0:1763343278.160926:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3895 00000100:00100000:2.0:1763343278.160939:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82d5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57195:x1848998400005376:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:2.0:1763343278.161966:0:19639:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x224:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1763343278.162136:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1818, 64 off150896 00000040:00080000:2.0:1763343278.162162:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1827, 64 off151656 00000040:00080000:2.0:1763343278.162172:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1828, 64 off151720 00000040:00080000:2.0:1763343278.162182:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1819, 64 off150960 00010000:00010000:2.0:1763343278.162462:0:19639:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a5430 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x224:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19639 initiator: MDT0 00010000:00010000:2.0:1763343278.162479:0:19639:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a5430 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x224:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343278.162490:0:19639:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a5430 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x224:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343278.162497:0:19639:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a5430 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x224:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343278.162503:0:19639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a5430 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x224:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343278.162509:0:19639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a5430 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x224:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343278.163597:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343278.163607:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a5430 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x224:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343278.163617:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fd2df600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343278.163622:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a5430 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x224:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343278.163630:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a5430 lrc: 5/0,0 mode: PW/PW res: [0x240000404:0x224:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343278.163647:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x224:0x0].0x0 (ffff9401fd0d4f00) 00010000:00010000:0.0:1763343278.163650:0:7451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343278.163657:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a5430 lrc: 3/0,0 mode: --/PW res: [0x240000404:0x224:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343278.163666:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343278.163669:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343278.163672:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343278.163889:0:19639:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1763343278.163898:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a5430 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x224:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19639 initiator: MDT1 00000100:00100000:2.0:1763343278.164437:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82d5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57195:x1848998400005376:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 3496us (3793us total) trans 4294973938 rc 0/0 00000100:00100000:2.0:1763343278.164447:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3895 00000100:00100000:3.0:1763343278.169505:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.169611:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400005504 00000100:00100000:0.0:1763343278.169623:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400005504 00000100:00100000:0.0:1763343278.169696:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11027 00000100:00100000:0.0:1763343278.169706:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57195:x1848998400005504:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343278.169729:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.169757:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5437 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a055 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.169825:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a543e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343278.169839:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a543e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.169850:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a543e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.169861:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5445 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343278.169868:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5445 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.169874:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5445 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.169914:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a543e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.169920:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a543e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.169927:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a543e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.169938:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a543e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.169944:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ba00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.169948:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a543e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.169955:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a543e lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.169966:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5600) 00010000:00010000:0.0:1763343278.169969:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.169973:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a543e lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.169979:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a543e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.169992:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5445 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.169997:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5445 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.170001:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5445 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.170006:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.170008:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5445 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.170013:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5445 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.170068:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758400) 00010000:00010000:0.0:1763343278.170071:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.170075:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5445 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.170081:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5445 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.170106:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5437 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a055 expref: 312 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.170116:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5600) 00010000:00010000:0.0:1763343278.170118:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.170121:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5437 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a055 expref: 312 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.170134:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b000, rc 0) 00000100:00100000:0.0:1763343278.170188:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57195:x1848998400005504:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 485us (694us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343278.170196:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11027 00000100:00100000:0.0:1763343278.175179:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.175241:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400005632 00000100:00100000:1.0:1763343278.175252:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400005632 00000100:00100000:1.0:1763343278.175309:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11028 00000100:00100000:1.0:1763343278.175319:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57197:x1848998400005632:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343278.175337:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.175361:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a544c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a05c expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.175427:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5453 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343278.175440:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5453 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.175450:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5453 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.175459:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a545a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343278.175466:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a545a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.175470:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a545a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.175513:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5453 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.175519:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5453 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.175525:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5453 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.175535:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5453 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.175540:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.175544:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5453 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.175551:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5453 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.175561:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5300) 00010000:00010000:1.0:1763343278.175564:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.175568:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5453 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.175574:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5453 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.175678:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a545a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.175683:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a545a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.175688:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a545a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.175693:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.175696:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a545a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.175701:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a545a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.175712:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758400) 00010000:00010000:1.0:1763343278.175714:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.175717:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a545a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.175722:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a545a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.175746:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a544c lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a05c expref: 312 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.175755:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5300) 00010000:00010000:1.0:1763343278.175757:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.175760:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a544c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a05c expref: 312 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.175770:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176c00, rc 0) 00000100:00100000:1.0:1763343278.175829:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57197:x1848998400005632:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 511us (660us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343278.175836:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11028 00000100:00100000:3.0:1763343278.182348:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.183008:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400005760 00000100:00100000:0.0:1763343278.183020:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400005760 00000100:00100000:0.0:1763343278.183111:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11029 00000100:00100000:0.0:1763343278.183121:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57197:x1848998400005760:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343278.183140:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.183164:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5461 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a063 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.183251:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5468 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343278.183266:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5468 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.183278:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5468 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.183288:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a546f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343278.183295:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a546f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.183302:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a546f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.183343:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5468 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.183350:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5468 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.183355:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5468 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.183362:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5468 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.183368:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.183373:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5468 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.183383:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5468 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.183393:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5600) 00010000:00010000:0.0:1763343278.183396:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.183401:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5468 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.183406:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5468 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.183419:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a546f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.183425:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a546f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.183430:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a546f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.183434:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ba00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.183437:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a546f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.183443:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a546f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.183449:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758400) 00010000:00010000:0.0:1763343278.183452:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.183455:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a546f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.183460:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a546f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.183486:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5461 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a063 expref: 312 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.183494:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5600) 00010000:00010000:0.0:1763343278.183496:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.183500:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5461 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a063 expref: 312 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.183510:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b000, rc 0) 00000100:00100000:0.0:1763343278.183582:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57197:x1848998400005760:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 462us (1245us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343278.183589:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11029 00000100:00100000:3.0:1763343278.188131:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.188342:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400005888 00000100:00100000:1.0:1763343278.188353:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400005888 00000100:00100000:1.0:1763343278.188416:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11030 00000100:00100000:1.0:1763343278.188427:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57197:x1848998400005888:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343278.188451:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.188478:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5476 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a06a expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.188547:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a547d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343278.188560:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a547d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.188573:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a547d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343278.188621:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763343278.188627:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763343278.188657:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5476 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a06a expref: 313 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.188673:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a547d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a06a expref: 312 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.188681:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5300) 00010000:00010000:1.0:1763343278.188684:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343278.188687:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176200, rc 0) 00000100:00100000:1.0:1763343278.188748:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57197:x1848998400005888:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 322us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343278.188755:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11030 00000100:00100000:2.0:1763343278.193666:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.193726:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400006016 00000100:00100000:1.0:1763343278.193737:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400006016 00000100:00100000:0.0:1763343278.193870:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11031 00000100:00100000:0.0:1763343278.193883:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57197:x1848998400006016:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343278.193903:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.193924:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5484 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a071 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.193991:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a548b lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343278.194004:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a548b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.194016:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a548b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.194280:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5492 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343278.194290:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5492 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.194297:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5492 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.194339:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a548b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.194346:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a548b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.194352:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a548b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.194358:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a548b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.194363:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ba00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.194367:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a548b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.194375:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a548b lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.194387:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5300) 00010000:00010000:0.0:1763343278.194390:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.194394:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a548b lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.194400:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a548b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.194412:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5492 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.194418:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5492 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.194423:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5492 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.194428:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.194431:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5492 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.194436:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5492 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.194443:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758400) 00010000:00010000:0.0:1763343278.194445:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.194448:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5492 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.194454:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5492 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.194481:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5484 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a071 expref: 313 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.194491:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5300) 00010000:00010000:0.0:1763343278.194493:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.194497:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5484 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a071 expref: 313 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.194506:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b000, rc 0) 00000100:00100000:0.0:1763343278.194573:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57197:x1848998400006016:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 693us (918us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343278.194582:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11031 00000100:00100000:3.0:1763343278.202362:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.202454:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400006272 00000100:00100000:0.0:1763343278.202465:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400006272 00000100:00100000:0.0:1763343278.202533:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11032 00000100:00100000:0.0:1763343278.202543:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57197:x1848998400006272:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343278.202566:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.202570:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343278.202600:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a547d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a06a expref: 312 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.202620:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5300) 00010000:00010000:0.0:1763343278.202630:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343278.202645:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5499 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a078 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.202749:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a54a0 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343278.202761:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a54a0 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.202770:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a54a0 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.202779:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a54a7 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343278.202786:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a54a7 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.202792:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a54a7 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.205686:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a54ae lrc: 3/1,0 mode: --/PR res: [0x240000404:0x226:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343278.205713:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a54ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.205726:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a54ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343278.205738:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x226:0x0]: returning size 0 00010000:00010000:0.0:1763343278.205768:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a54a0 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.205775:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a54a0 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.205781:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a54a0 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.205788:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a54a0 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.205793:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.205797:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a54a0 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.205804:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a54a0 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.205816:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5600) 00010000:00010000:0.0:1763343278.205819:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.205823:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a54a0 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.205833:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a54a0 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00010000:0.0:1763343278.205850:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000008ad0cae reply state 000000008f5b9fce transno 4294973939 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a54a7 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.205861:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a54a7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.205867:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758400) 00010000:00010000:0.0:1763343278.205869:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343278.205873:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343278.207252:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5499 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a078 expref: 314 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.207285:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a54ae lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a078 expref: 313 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.207294:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x226:0x0].0x0 (ffff9401cc2f5300) 00010000:00010000:0.0:1763343278.207297:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343278.207300:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b600, rc 0) 00000100:00100000:0.0:1763343278.207392:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57197:x1848998400006272:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 4850us (5040us total) trans 4294973939 rc 0/0 00000100:00100000:0.0:1763343278.207933:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11032 00000100:00100000:3.0:1763343278.213161:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.213196:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.214672:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400006528 00000100:00100000:0.0:1763343278.214686:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400006528 00000100:00100000:0.0:1763343278.214751:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400006784 00000100:00100000:0.0:1763343278.214755:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400006784 00000100:00100000:0.0:1763343278.214780:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11033 00000100:00100000:0.0:1763343278.214791:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57197:x1848998400006528:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:3.0:1763343278.214801:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11034 00000100:00100000:3.0:1763343278.214816:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57199:x1848998400006784:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343278.214816:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343278.214829:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.214841:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a54bc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x226:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a07f expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.214843:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a54c3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x226:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a086 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.214965:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a54ca lrc: 3/1,0 mode: --/PR res: [0x240000404:0x226:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343278.214965:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a54d1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x226:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343278.214992:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a54ca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343278.215006:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a54ca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:3.0:1763343278.215017:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x226:0x0]: returning size 0 00010000:00010000:0.0:1763343278.216148:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a54ae lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a078 expref: 318 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.216159:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a54ca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.216167:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a54d1 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x226:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.216193:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a54c3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x226:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a086 expref: 319 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.216245:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a54ca lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a086 expref: 318 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.216261:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a54ca lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a086 expref: 318 pid: 9827 timeout: 1171 lvb_type: 0 00000100:00100000:0.0:1763343278.216275:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b57100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998413017984:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343278.216372:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a54ae lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a078 expref: 318 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.216381:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a54ae lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a078 expref: 318 pid: 7641 timeout: 1171 lvb_type: 0 00000100:00100000:0.0:1763343278.216389:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b54a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998413018112:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343278.216413:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9c00 going to sleep for 11 seconds 00010000:00010000:3.0:1763343278.216466:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a54ca lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a086 expref: 318 pid: 9827 timeout: 1171 lvb_type: 0 00010000:00010000:3.0:1763343278.216482:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a54ca lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a086 expref: 318 pid: 9827 timeout: 1171 lvb_type: 0 00010000:00010000:3.0:1763343278.216490:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3000, rc 0) 00000100:00100000:3.0:1763343278.216526:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+318:57199:x1848998400006784:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1714us (3327us total) trans 4294973940 rc 0/0 00000100:00100000:3.0:1763343278.216536:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11034 00000100:00100000:0.0:1763343278.220370:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b57100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998413017984:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343278.220387:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b54a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998413018112:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343278.220418:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a54d1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x226:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343278.222853:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.222895:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.222932:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.223007:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400006912 00000100:00100000:3.0:1763343278.223017:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400006912 00010000:00010000:3.0:1763343278.223144:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a54ae lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a078 expref: 318 pid: 7641 timeout: 1171 lvb_type: 0 00000100:00100000:1.0:1763343278.223250:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400007296 00000100:00100000:1.0:1763343278.223255:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400007296 00000100:00100000:1.0:1763343278.223291:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3896 00000100:00100000:1.0:1763343278.223299:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:57199:x1848998400007296:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343278.223527:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+320:57199:x1848998400007296:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 228us (593us total) trans 4294973941 rc 0/0 00000100:00100000:1.0:1763343278.223534:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3896 00000100:00100000:3.0:1763343278.223671:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400007040 00000100:00100000:3.0:1763343278.223676:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400007040 00010000:00010000:3.0:1763343278.223689:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a54ca lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a086 expref: 320 pid: 9827 timeout: 1171 lvb_type: 0 00000100:00100000:2.0:1763343278.223992:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3597 00000100:00100000:2.0:1763343278.224003:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+320:2410:x1848998400006912:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343278.224013:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343278.224020:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a54ae lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a078 expref: 320 pid: 7641 timeout: 1171 lvb_type: 0 00010000:00010000:2.0:1763343278.224069:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a54ae lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a078 expref: 320 pid: 7641 timeout: 1171 lvb_type: 0 00010000:00010000:2.0:1763343278.224090:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a54ae lrc: 0/0,0 mode: --/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a078 expref: 320 pid: 7641 timeout: 1171 lvb_type: 0 00010000:00010000:2.0:1763343278.224106:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x226:0x0].0x0 (ffff9401cc2f5300) 00010000:00010000:2.0:1763343278.224110:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a54d1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x226:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.224123:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343278.224154:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:2410:x1848998400006912:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 155us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.224160:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3597 00000100:00100000:2.0:1763343278.224216:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3598 00000100:00100000:2.0:1763343278.224223:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+318:2408:x1848998400007040:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343278.224230:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343278.224235:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a54ca lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a086 expref: 318 pid: 9827 timeout: 1171 lvb_type: 0 00010000:00010000:2.0:1763343278.224245:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a54ca lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a086 expref: 318 pid: 9827 timeout: 1171 lvb_type: 0 00010000:00010000:2.0:1763343278.224257:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a54ca lrc: 0/0,0 mode: --/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a086 expref: 318 pid: 9827 timeout: 1171 lvb_type: 0 00010000:00010000:2.0:1763343278.224267:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x226:0x0].0x0 (ffff9401cc2f5300) 00010000:00010000:2.0:1763343278.224271:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a54d1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x226:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.224278:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a54d1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x226:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.224285:0:6511:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a54d1 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x226:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.224310:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343278.224329:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:2408:x1848998400007040:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 107us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.224335:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3598 00010000:00010000:0.0:1763343278.224637:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a54d1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x226:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.224645:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a54d1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x226:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343278.224669:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x226:0x0]: returning size 0 00000004:00080000:0.0:1763343278.224830:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2e3:0x0], index 1: 0 00000004:00080000:0.0:1763343278.224837:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2e2:0x0], index 0: 0 00000004:00080000:0.0:1763343278.224842:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2e3:0x0], index 0: 0 00000004:00080000:0.0:1763343278.224846:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2e4:0x0], index 1: 0 00010000:00010000:0.0:1763343278.224942:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a54d1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x226:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.224950:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a54d1 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x226:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.224956:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a54d1 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x226:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.224962:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.224966:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a54d1 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x226:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.224973:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a54d1 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x226:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.224984:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x226:0x0].0x0 (ffff9401cc2f5300) 00010000:00010000:0.0:1763343278.224987:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343278.224991:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a54d1 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x226:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.224997:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a54d1 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x226:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.226425:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a54bc lrc: 1/0,0 mode: --/CR res: [0x240000404:0x226:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a07f expref: 317 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.226443:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x226:0x0].0x0 (ffff9401cc2f5300) 00010000:00010000:0.0:1763343278.226445:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343278.226450:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a54bc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x226:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a07f expref: 317 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.226469:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501aa00, rc 0) 00000100:00100000:0.0:1763343278.226540:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57197:x1848998400006528:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 11750us (13386us total) trans 4294973942 rc 301/301 00000100:00100000:0.0:1763343278.226549:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11033 00000100:00100000:3.0:1763343278.229968:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.230094:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.230253:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400007808 00000100:00100000:2.0:1763343278.230263:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400007808 00000100:00100000:2.0:1763343278.230320:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3897 00000100:00100000:2.0:1763343278.230331:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57197:x1848998400007808:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343278.230613:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57197:x1848998400007808:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 283us (517us total) trans 4294973943 rc 0/0 00000100:00100000:2.0:1763343278.230620:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3897 00000100:00100000:0.0:1763343278.231325:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400007552 00000100:00100000:0.0:1763343278.231332:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400007552 00000100:00100000:0.0:1763343278.231376:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11035 00000100:00100000:0.0:1763343278.231384:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57199:x1848998400007552:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343278.231398:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.231423:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a54e6 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a08d expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.231498:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a54ed lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343278.231513:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a54ed lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.231524:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a54ed lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.231534:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a54f4 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343278.231541:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a54f4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.231546:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a54f4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.231646:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a54fb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x226:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343278.231653:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a54fb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.231659:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a54fb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343278.231669:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x226:0x0]: returning size 0 00010000:00010000:0.0:1763343278.231736:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a54ed lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.231744:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a54ed lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.231752:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a54ed lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.231758:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a54ed lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.231763:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.231767:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a54ed lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.231774:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a54ed lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.231786:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5600) 00010000:00010000:0.0:1763343278.231789:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.231793:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a54ed lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.231798:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a54ed lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.231812:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a54f4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.231818:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a54f4 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.231823:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a54f4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.231828:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.231831:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a54f4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.231840:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a54f4 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.231848:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758400) 00010000:00010000:0.0:1763343278.231850:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.231853:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a54f4 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.231858:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a54f4 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.231891:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a54e6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a08d expref: 320 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.231909:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a54fb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a08d expref: 319 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.231916:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x226:0x0].0x0 (ffff9401cc2f5900) 00010000:00010000:0.0:1763343278.231918:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343278.231921:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a400, rc 0) 00000100:00100000:0.0:1763343278.231969:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:57199:x1848998400007552:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 586us (2011us total) trans 4294973944 rc 0/0 00000100:00100000:0.0:1763343278.231976:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11035 00000100:00100000:2.0:1763343278.236655:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.237486:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400008064 00000100:00100000:1.0:1763343278.237501:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400008064 00000100:00100000:1.0:1763343278.237567:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3898 00000100:00100000:1.0:1763343278.237579:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:57197:x1848998400008064:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343278.237831:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+320:57197:x1848998400008064:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 253us (1187us total) trans 4294973945 rc 0/0 00000100:00100000:1.0:1763343278.237839:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3898 00000100:00100000:2.0:1763343278.243759:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.243803:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.243892:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400008192 00000100:00100000:1.0:1763343278.243906:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400008192 00000100:00100000:1.0:1763343278.243972:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400008320 00000100:00100000:1.0:1763343278.243975:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400008320 00000100:00100000:1.0:1763343278.244005:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7552 00000100:00100000:1.0:1763343278.244015:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998400008192:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:0.0:1763343278.244067:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7553 00010000:00010000:1.0:1763343278.244076:0:8413:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1763343278.244083:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2408:x1848998400008320:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343278.244094:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.244106:0:8413:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a5509 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a094 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.244113:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5510 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a09b expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343278.244145:0:8413:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1763343278.244145:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343278.244175:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343278.244175:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.244180:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343278.244180:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.244192:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a5509 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a094 expref: 16 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343278.244197:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5510 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a09b expref: 28 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343278.244233:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5510 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a09b expref: 28 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343278.244235:0:8413:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a5509 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a094 expref: 16 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343278.244260:0:8413:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177c00, rc 0) 00010000:00010000:0.0:1763343278.244260:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501aa00, rc 0) 00000100:00100000:1.0:1763343278.244329:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400008192:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 315us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343278.244337:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7552 00000100:00100000:3.0:1763343278.246042:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.246086:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400008576 00000100:00100000:1.0:1763343278.246096:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400008576 00000100:00100000:1.0:1763343278.246149:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11036 00000100:00100000:1.0:1763343278.246159:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+320:55884:x1848998400008576:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343278.246179:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.246182:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343278.246220:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a54fb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a08d expref: 320 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.246242:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x226:0x0].0x0 (ffff9401cc2f5900) 00010000:00010000:1.0:1763343278.246252:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343278.246268:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a5517 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x226:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a0a2 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343278.247005:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2408:x1848998400008320:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2922us (3194us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343278.247016:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7553 00010000:00010000:1.0:1763343278.252014:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a551e lrc: 3/0,1 mode: --/CW res: [0x240000404:0x226:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343278.252059:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a551e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x226:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.252077:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a551e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x226:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343278.252104:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x226:0x0]: returning size 0 00010000:00010000:1.0:1763343278.252267:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a5517 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x226:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0a2 expref: 322 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.252283:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a551e lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x226:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0a2 expref: 321 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.252293:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x226:0x0].0x0 (ffff9400c38f5300) 00010000:00010000:1.0:1763343278.252296:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:1.0:1763343278.252300:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177a00, rc 0) 00000100:00100000:1.0:1763343278.252372:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:55884:x1848998400008576:12345-192.168.201.40@tcp:101:bash.0 Request processed in 6214us (6353us total) trans 4294973946 rc 0/0 00000100:00100000:1.0:1763343278.252381:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11036 00000100:00100000:3.0:1763343278.253091:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.253435:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400008704 00000100:00100000:1.0:1763343278.253444:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400008704 00000100:00100000:1.0:1763343278.253491:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11037 00000100:00100000:1.0:1763343278.253500:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:57199:x1848998400008704:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343278.253687:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.253705:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a552c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x226:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a0a9 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.253754:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a552c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x226:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0a9 expref: 322 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.253766:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a552c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x226:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0a9 expref: 322 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.253783:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x226:0x0].0x0 (ffff9400c38f5300) 00010000:00010000:1.0:1763343278.253786:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343278.253788:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177e00, rc 0) 00000100:00100000:1.0:1763343278.253840:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+322:57199:x1848998400008704:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 340us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343278.253847:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11037 00000100:00100000:2.0:1763343278.256470:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.256614:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400008960 00000100:00100000:3.0:1763343278.256624:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400008960 00000100:00100000:3.0:1763343278.256680:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3899 00000100:00100000:3.0:1763343278.256689:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+322:57199:x1848998400008960:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343278.256909:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:57199:x1848998400008960:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 220us (446us total) trans 4294973947 rc 0/0 00000100:00100000:3.0:1763343278.256920:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3899 00000100:00100000:3.0:1763343278.262467:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.262541:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400009088 00000100:00100000:2.0:1763343278.262554:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400009088 00000100:00100000:2.0:1763343278.262621:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11038 00000100:00100000:2.0:1763343278.262630:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:55884:x1848998400009088:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343278.262656:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.262676:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a5533 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x226:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a0b0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.262734:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89a00/0x9104b1ba770a553a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x226:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343278.262748:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89a00/0x9104b1ba770a553a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.262761:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89a00/0x9104b1ba770a553a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.262870:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a5533 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x226:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0b0 expref: 325 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.262885:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89a00/0x9104b1ba770a553a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0b0 expref: 324 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.262894:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x226:0x0].0x0 (ffff9400c38f5300) 00010000:00010000:2.0:1763343278.262897:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343278.262901:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89a00, rc 0) 00000100:00100000:2.0:1763343278.262973:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+324:55884:x1848998400009088:12345-192.168.201.40@tcp:101:bash.0 Request processed in 343us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.262981:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11038 00000100:00100000:0.0:1763343278.267372:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.268094:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400009344 00000100:00100000:1.0:1763343278.268107:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400009344 00000100:00100000:1.0:1763343278.268164:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11039 00000100:00100000:1.0:1763343278.268174:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+324:55884:x1848998400009344:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:1.0:1763343278.268238:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343278.268267:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a551e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x226:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0a2 expref: 324 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.268286:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x226:0x0].0x0 (ffff9400c38f5300) 00010000:00010000:1.0:1763343278.268291:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343278.268466:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a5541 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x226:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343278.268480:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a5541 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x226:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.268489:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a5541 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x226:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000001:00080000:1.0:1763343278.268533:0:9827:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973948 00000004:00010000:1.0:1763343278.268556:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000079e3cf34 reply state 000000008e3f9458 transno 4294973949 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a5541 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x226:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.268572:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a5541 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x226:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.268578:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x226:0x0].0x0 (ffff9400c38f5300) 00010000:00010000:1.0:1763343278.268581:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343278.268584:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343278.268681:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+326:55884:x1848998400009344:12345-192.168.201.40@tcp:36:bash.0 Request processed in 507us (1320us total) trans 4294973949 rc 0/0 00000100:00100000:1.0:1763343278.268688:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11039 00000020:00080000:1.0:1763343278.268694:0:9827:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343278.270686:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.270728:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.270868:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400009600 00000100:00100000:2.0:1763343278.270882:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400009600 00000100:00100000:2.0:1763343278.270941:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400009856 00000100:00100000:2.0:1763343278.270945:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400009856 00000100:00100000:2.0:1763343278.270969:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11040 00000100:00100000:2.0:1763343278.270978:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+327:57199:x1848998400009600:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343278.271009:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1763343278.271173:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11041 00000100:00100000:0.0:1763343278.271183:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c2f86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+327:55884:x1848998400009856:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343278.271194:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.271197:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343278.271235:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a552c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x226:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0a9 expref: 327 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.271252:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x226:0x0].0x0 (ffff9400c38f5300) 00010000:00010000:0.0:1763343278.271257:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343278.271265:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a554f lrc: 2/0,0 mode: --/EX res: [0x240000404:0x226:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a0be expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.271316:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5556 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x226:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343278.271329:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5556 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x226:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.271338:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5556 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x226:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000040:00080000:0.0:1763343278.271573:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1829, 88 off151808 00000004:00080000:0.0:1763343278.271581:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1071395555940ns, next at 1072111826735ns, rc = 0 00000040:00080000:0.0:1763343278.271620:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1820, 88 off151048 00000004:00080000:0.0:1763343278.271625:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1071395600139ns, next at 1072111852630ns, rc = 0 00000040:00080000:0.0:1763343278.271641:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1821, 88 off151136 00000004:00080000:0.0:1763343278.271645:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1071395620824ns, next at 1072111852630ns, rc = 0 00000040:00080000:0.0:1763343278.271655:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1830, 88 off151896 00000004:00080000:0.0:1763343278.271659:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1071395634319ns, next at 1072111826735ns, rc = 0 00010000:00010000:2.0:1763343278.272169:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88400/0x9104b1ba770a5548 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a0b7 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.272245:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a555d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343278.272256:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a555d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.272264:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a555d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.272274:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5564 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343278.272280:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5564 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.272285:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5564 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.272369:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a556b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x226:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343278.272378:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a556b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.272384:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a556b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343278.272394:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x226:0x0]: returning size 2 00010000:00010000:2.0:1763343278.277258:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a556b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.277288:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a556b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.277296:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a556b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.277302:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.277306:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a556b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.277314:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a556b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.277330:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x226:0x0].0x0 (ffff9400c38f5300) 00010000:00010000:2.0:1763343278.277333:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1763343278.277337:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a556b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x226:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.277343:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a556b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x226:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.277362:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a555d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.277368:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a555d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.277373:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a555d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.277378:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a555d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.277383:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.277385:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a555d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.277390:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a555d lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.277397:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758a00) 00010000:00010000:2.0:1763343278.277399:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.277402:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a555d lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.277407:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a555d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.277416:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5564 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.277422:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5564 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.277428:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5564 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.277432:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.277435:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5564 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.277440:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5564 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.277446:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758400) 00010000:00010000:2.0:1763343278.277448:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.277451:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5564 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.277456:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5564 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.277501:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88400/0x9104b1ba770a5548 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0b7 expref: 330 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.277511:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758a00) 00010000:00010000:2.0:1763343278.277514:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343278.277517:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88400/0x9104b1ba770a5548 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0b7 expref: 330 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.277536:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88400, rc 0) 00000100:00100000:2.0:1763343278.277778:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+329:57199:x1848998400009600:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 6799us (7103us total) trans 4294973951 rc 301/301 00000100:00100000:2.0:1763343278.277789:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11040 00000001:00080000:0.0:1763343278.279529:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973950 is committed 00000004:00080000:0.0:1763343278.279541:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1174 committed 00010000:00010000:1.0:1763343278.279780:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a5414 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.279792:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a5414 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.279800:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a5414 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.279806:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fd2dea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.279810:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a5414 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.279816:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a5414 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.279831:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758400) 00010000:00010000:1.0:1763343278.279833:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.279838:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a5414 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.279843:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a5414 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.279860:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a54a7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.279865:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a54a7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.279870:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a54a7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.279874:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ba00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.279876:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a54a7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.279880:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a54a7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.279886:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758400) 00010000:00010000:1.0:1763343278.279888:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.279891:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a54a7 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.279896:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a54a7 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.279913:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a5541 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x226:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.279919:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a5541 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x226:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.279925:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a5541 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x226:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.279933:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.279936:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a5541 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x226:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.279941:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a5541 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x226:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.279948:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x226:0x0].0x0 (ffff9400c38f5300) 00010000:00010000:1.0:1763343278.279950:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.279952:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a5541 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x226:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.279958:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a5541 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x226:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000100:00100000:1.0:1763343278.282177:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413018240:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343278.282259:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343278.282298:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763343278.282304:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413018368:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343278.282325:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343278.282351:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413018496:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343278.282372:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343278.282388:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763343278.282392:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c8bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413018624:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343278.282410:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343278.282438:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413018240 00000100:00100000:1.0:1763343278.282445:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413018240 00000100:00100000:1.0:1763343278.282487:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413018368 00000100:00100000:1.0:1763343278.282490:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413018368 00000100:00100000:1.0:1763343278.282506:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413018496 00000100:00100000:1.0:1763343278.282508:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413018496 00000100:00100000:1.0:1763343278.282524:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413018624 00000100:00100000:1.0:1763343278.282527:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413018624 00000100:00100000:1.0:1763343278.282549:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7554 00000100:00100000:1.0:1763343278.282557:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+44:3659:x1848998413018240:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343278.282582:0:11289:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:737 count 1 00010000:00010000:1.0:1763343278.282605:0:11289:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5579 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.282631:0:11289:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a53f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a040 expref: 27 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.282641:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343278.282644:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343278.282648:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5579 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.282675:0:11289:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a53f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a040 expref: 27 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.282836:0:11289:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a53f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a040 expref: 27 pid: 11289 timeout: 1171 lvb_type: 0 00000100:00100000:1.0:1763343278.282853:0:11289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dcb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11289:1848998413018752:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343278.282917:0:11289:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c329cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1763343278.282936:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7555 00000100:00100000:1.0:1763343278.282944:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+44:3659:x1848998413018368:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343278.282959:0:27798:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:738 count 1 00010000:00010000:1.0:1763343278.282971:0:27798:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5580 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.282983:0:27798:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5326 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a001 expref: 27 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343278.282990:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.282992:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.282995:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5580 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.283014:0:27798:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5326 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a001 expref: 27 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343278.283053:0:27798:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5326 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a001 expref: 27 pid: 28562 timeout: 1171 lvb_type: 1 00000100:00100000:2.0:1763343278.283167:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7556 00000100:00100000:2.0:1763343278.283176:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+44:3661:x1848998413018496:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343278.283359:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+45:3661:x1848998413018496:12345-0@lo:2:osp-syn-1-1.0 Request processed in 184us (985us total) trans 17179872063 rc 0/0 00000100:00100000:2.0:1763343278.283368:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7556 00000100:00100000:2.0:1763343278.283386:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7557 00000100:00100000:2.0:1763343278.283392:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+44:3661:x1848998413018624:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1763343278.283442:0:8414:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2e4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343278.283446:0:8414:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2e4:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763343278.283448:0:8414:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2e4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343278.283450:0:8414:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2e4:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763343278.283452:0:8414:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2e4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343278.283475:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+45:3661:x1848998413018624:12345-0@lo:2:osp-syn-1-1.0 Request processed in 83us (1063us total) trans 17179872064 rc 0/0 00000100:00100000:2.0:1763343278.283480:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7557 00000004:00080000:2.0:1763343278.283520:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c8bc0000/2, rc 0, transno 17179872064 00000100:00100000:2.0:1763343278.283525:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c8bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413018624:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1763343278.283534:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b2ea00/2, rc 0, transno 17179872063 00000100:00100000:2.0:1763343278.283537:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413018496:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763343278.283965:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1166 committed 00000004:00080000:0.0:1763343278.283975:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1165 committed 00000004:00080000:0.0:1763343278.283978:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1173 committed 00010000:00010000:0.0:1763343278.284150:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5556 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x226:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0be expref: 308 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.284162:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x226:0x0].0x0 (ffff9400c38f5300) 00010000:00010000:0.0:1763343278.284165:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343278.284180:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a554f lrc: 0/0,0 mode: --/EX res: [0x240000404:0x226:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0be expref: 308 pid: 33856 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763343278.284201:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5556 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x226:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0be expref: 307 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.284244:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x226:0x0].0x0 (ffff9400c38f5300) 00010000:00010000:0.0:1763343278.284247:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343278.284249:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a600, rc 0) 00000100:00100000:0.0:1763343278.284284:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c2f86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:55884:x1848998400009856:12345-192.168.201.40@tcp:101:bash.0 Request processed in 13103us (13555us total) trans 4294973950 rc 0/0 00000100:00100000:0.0:1763343278.284291:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11041 00000100:00100000:1.0:1763343278.284679:0:27798:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5dc9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:27798:1848998413018880:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343278.284727:0:27798:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc523c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343278.284746:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413019008:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343278.284779:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343278.284815:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763343278.284822:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413019136:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343278.284831:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413019008 00000100:00100000:0.0:1763343278.284840:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413019008 00000100:00100000:1.0:1763343278.284845:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343278.284880:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413019136 00000100:00100000:0.0:1763343278.284884:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7558 00000100:00100000:1.0:1763343278.284886:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413019136 00000100:00100000:0.0:1763343278.284895:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+18:3659:x1848998413019008:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763343278.284916:0:8626:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:736 count 1 00000100:00100000:1.0:1763343278.284922:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7559 00000100:00100000:1.0:1763343278.284931:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+18:3659:x1848998413019136:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763343278.284937:0:8626:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c501a800/0x9104b1ba770a5587 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1763343278.284945:0:8412:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:737 count 1 00010000:00010000:0.0:1763343278.284955:0:8626:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fca00/0x9104b1ba770a53e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a032 expref: 15 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.284960:0:8412:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a558e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.284965:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343278.284969:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343278.284974:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501a800/0x9104b1ba770a5587 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.284978:0:8412:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a531f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a008 expref: 15 pid: 27798 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343278.284992:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.284996:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.284999:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a558e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.285016:0:8626:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fca00/0x9104b1ba770a53e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a032 expref: 15 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.285046:0:8412:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a531f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a008 expref: 15 pid: 27798 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343278.285060:0:8626:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fca00/0x9104b1ba770a53e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a032 expref: 15 pid: 8413 timeout: 1171 lvb_type: 0 00000100:00100000:0.0:1763343278.285071:0:8626:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8626:1848998413019520:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343278.285102:0:8626:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343278.285409:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413019264:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343278.285436:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343278.286161:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413019392:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343278.286197:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343278.286306:0:11289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dcb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11289:1848998413018752:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343278.286329:0:11289:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5579 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343278.286568:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413019264 00000100:00100000:2.0:1763343278.286575:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413019264 00000100:00100000:2.0:1763343278.286602:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413019392 00000100:00100000:2.0:1763343278.286605:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413019392 00000100:00100000:2.0:1763343278.286619:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7560 00000100:00100000:2.0:1763343278.286626:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+20:3661:x1848998413019264:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343278.286732:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7561 00000100:00100000:0.0:1763343278.286742:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+21:3662:x1848998413019392:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343278.286807:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+22:3661:x1848998413019264:12345-0@lo:2:osp-syn-0-1.0 Request processed in 179us (1368us total) trans 21474839332 rc 0/0 00000100:00100000:2.0:1763343278.286815:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7560 00002000:00010000:0.0:1763343278.286819:0:35281:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2e3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343278.286824:0:35281:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2e3:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343278.286826:0:35281:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343278.286828:0:35281:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2e3:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343278.286831:0:35281:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2e3:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:2.0:1763343278.286855:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6b56680/2, rc 0, transno 21474839332 00000100:00100000:2.0:1763343278.286863:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413019264:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343278.286878:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+21:3662:x1848998413019392:12345-0@lo:2:osp-syn-0-1.0 Request processed in 136us (678us total) trans 21474839333 rc 0/0 00000100:00100000:0.0:1763343278.286888:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7561 00000004:00080000:2.0:1763343278.286899:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6b56300/2, rc 0, transno 21474839333 00000100:00100000:2.0:1763343278.286905:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413019392:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1763343278.287293:0:8412:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a531f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a008 expref: 15 pid: 27798 timeout: 1171 lvb_type: 1 00000100:00100000:1.0:1763343278.287306:0:8412:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b26680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998413019648:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343278.287352:0:8412:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc52240 going to sleep for 11 seconds 00000100:00100000:3.0:1763343278.288068:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.288169:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400009984 00000100:00100000:1.0:1763343278.288176:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400009984 00010000:00010000:1.0:1763343278.288201:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a53f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a040 expref: 28 pid: 11289 timeout: 1171 lvb_type: 0 00000100:00100000:1.0:1763343278.288240:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3599 00000100:00100000:1.0:1763343278.288249:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2407:x1848998400009984:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343278.288262:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343278.288267:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a53f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a040 expref: 28 pid: 11289 timeout: 1171 lvb_type: 0 00010000:00010000:1.0:1763343278.288279:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a53f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a040 expref: 28 pid: 11289 timeout: 1171 lvb_type: 0 00010000:00010000:1.0:1763343278.288299:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401fc3fd800/0x9104b1ba770a53f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a040 expref: 28 pid: 11289 timeout: 1171 lvb_type: 0 00010000:00010000:1.0:1763343278.288313:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.288315:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.288320:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5579 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.288329:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5579 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343278.288669:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.288767:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400010240 00000100:00100000:2.0:1763343278.288772:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400010240 00010000:00010000:1.0:1763343278.288833:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343278.288864:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2407:x1848998400009984:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 616us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343278.288872:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3599 00000100:00100000:3.0:1763343278.289177:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3900 00000100:00100000:3.0:1763343278.289184:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57199:x1848998400010240:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343278.289399:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57199:x1848998400010240:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 214us (730us total) trans 4294973952 rc 0/0 00000100:00100000:3.0:1763343278.289405:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3900 00000100:00100000:1.0:1763343278.291982:0:27798:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5dc9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:27798:1848998413018880:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343278.292018:0:27798:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5580 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.292065:0:11289:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5579 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.292077:0:11289:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5579 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.292088:0:11289:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5579 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.292096:0:11289:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5579 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.292127:0:11289:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343278.292149:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343278.292159:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5579 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.292168:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177a00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343278.292173:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5579 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.292182:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5579 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.292219:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5579 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.292228:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5579 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.292247:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343278.292249:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343278.292251:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343278.292570:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b2c380/2, rc 0, transno 17179872065 00000100:00100000:1.0:1763343278.292577:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413018240:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343278.292772:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.292797:0:8412:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b26680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998413019648:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343278.292804:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400010368 00000100:00100000:0.0:1763343278.292813:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400010368 00010000:00010000:3.0:1763343278.292814:0:8412:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a558e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.292846:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5326 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a001 expref: 27 pid: 28562 timeout: 1171 lvb_type: 1 00000100:00100000:1.0:1763343278.292880:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8626:1848998413019520:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343278.292888:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3600 00000100:00100000:0.0:1763343278.292899:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2409:x1848998400010368:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343278.292902:0:8626:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c501a800/0x9104b1ba770a5587 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.292913:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343278.292920:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5326 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a001 expref: 27 pid: 28562 timeout: 1171 lvb_type: 1 00010000:00010000:0.0:1763343278.292933:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5326 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a001 expref: 27 pid: 28562 timeout: 1171 lvb_type: 1 00010000:00010000:0.0:1763343278.292952:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5326 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a001 expref: 27 pid: 28562 timeout: 1171 lvb_type: 1 00010000:00010000:0.0:1763343278.292969:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343278.292971:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343278.292976:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5580 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.292986:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5580 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.293013:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343278.293065:0:27798:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5580 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.293076:0:27798:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5580 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343278.293083:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2409:x1848998400010368:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 184us (311us total) trans 0 rc 0/0 00010000:00010000:1.0:1763343278.293089:0:27798:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5580 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343278.293095:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3600 00010000:00010000:1.0:1763343278.293104:0:27798:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5580 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.293122:0:27798:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343278.293139:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.293157:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400010624 00000100:00100000:0.0:1763343278.293161:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400010624 00010000:00010000:0.0:1763343278.293174:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a531f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a008 expref: 16 pid: 27798 timeout: 1171 lvb_type: 1 00000100:00100000:0.0:1763343278.293191:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3601 00000100:00100000:0.0:1763343278.293198:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2409:x1848998400010624:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343278.293218:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343278.293224:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a531f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a008 expref: 16 pid: 27798 timeout: 1171 lvb_type: 1 00010000:00010000:0.0:1763343278.293234:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a531f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a008 expref: 16 pid: 27798 timeout: 1171 lvb_type: 1 00010000:00010000:0.0:1763343278.293253:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a531f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a008 expref: 16 pid: 27798 timeout: 1171 lvb_type: 1 00010000:00010000:0.0:1763343278.293264:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343278.293266:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343278.293281:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a558e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.293289:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a558e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343278.293293:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+45:3659:x1848998413018240:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9900us (10198us total) trans 17179872065 rc 0/0 00000100:00100000:2.0:1763343278.293306:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7554 00010000:00010000:0.0:1763343278.293309:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343278.293335:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2409:x1848998400010624:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 137us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343278.293342:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3601 00010000:00010000:3.0:1763343278.293372:0:8412:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a558e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.293392:0:8412:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a558e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.293403:0:8412:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a558e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.293409:0:8412:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a558e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.293433:0:8412:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1763343278.293715:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763343278.293722:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5580 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343278.293722:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+45:3659:x1848998413018368:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10778us (11394us total) trans 17179872066 rc 0/0 00010000:00010000:2.0:1763343278.293730:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177800 already unused, calling callback (ffffffffc0ca3b40) 00000100:00100000:1.0:1763343278.293730:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7555 00010000:00010000:2.0:1763343278.293734:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5580 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.293741:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5580 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.293748:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343278.293752:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a558e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.293753:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5580 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.293761:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5580 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.293765:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343278.293768:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a558e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.293775:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343278.293775:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a558e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.293777:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343278.293778:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343278.293785:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a558e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.293791:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a558e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.293804:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343278.293805:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343278.293807:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343278.293820:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000004:00080000:1.0:1763343278.293831:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b2df80/2, rc 0, transno 17179872066 00000100:00100000:1.0:1763343278.293836:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413018368:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343278.293842:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400010496 00000100:00100000:2.0:1763343278.293846:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400010496 00010000:00010000:2.0:1763343278.293863:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fca00/0x9104b1ba770a53e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a032 expref: 15 pid: 8413 timeout: 1171 lvb_type: 0 00000100:00100000:2.0:1763343278.293889:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3602 00000100:00100000:2.0:1763343278.293901:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6275880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2409:x1848998400010496:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343278.293910:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343278.293914:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fca00/0x9104b1ba770a53e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a032 expref: 15 pid: 8413 timeout: 1171 lvb_type: 0 00010000:00010000:2.0:1763343278.293924:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fca00/0x9104b1ba770a53e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a032 expref: 15 pid: 8413 timeout: 1171 lvb_type: 0 00010000:00010000:2.0:1763343278.293937:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401fc3fca00/0x9104b1ba770a53e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a032 expref: 15 pid: 8413 timeout: 1171 lvb_type: 0 00010000:00010000:2.0:1763343278.293947:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.293948:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.293952:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c501a800/0x9104b1ba770a5587 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.293960:0:6511:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501a800/0x9104b1ba770a5587 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.293976:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343278.293998:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6275880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2409:x1848998400010496:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 102us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.294005:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3602 00010000:00010000:1.0:1763343278.294046:0:8626:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c501a800/0x9104b1ba770a5587 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.294056:0:8626:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c501a800/0x9104b1ba770a5587 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.294074:0:8626:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c501a800/0x9104b1ba770a5587 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.294086:0:8626:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501a800/0x9104b1ba770a5587 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.294106:0:8626:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343278.294217:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343278.294222:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c501a800/0x9104b1ba770a5587 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.294229:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343278.294232:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c501a800/0x9104b1ba770a5587 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.294239:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c501a800/0x9104b1ba770a5587 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.294251:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c501a800/0x9104b1ba770a5587 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.294257:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c501a800/0x9104b1ba770a5587 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.294270:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343278.294272:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343278.294273:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343278.294478:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.294529:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.294585:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400010752 00000100:00100000:2.0:1763343278.294591:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400010752 00000100:00100000:2.0:1763343278.294620:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3901 00000100:00100000:2.0:1763343278.294627:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82d5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57199:x1848998400010752:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:2.0:1763343278.294743:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82d5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57199:x1848998400010752:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 116us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.294752:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3901 00000100:00100000:3.0:1763343278.294825:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+22:3659:x1848998413019136:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9894us (9978us total) trans 21474839334 rc 0/0 00000100:00100000:3.0:1763343278.294833:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7559 00000100:00100000:3.0:1763343278.294847:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400010880 00000100:00100000:3.0:1763343278.294851:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400010880 00000100:00100000:3.0:1763343278.294879:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7562 00000100:00100000:3.0:1763343278.294885:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:55884:x1848998400010880:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343278.294896:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343278.294913:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5595 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a0c5 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343278.294930:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343278.294943:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343278.294945:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343278.294952:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5595 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0c5 expref: 27 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343278.295008:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+21:3659:x1848998413019008:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9990us (10102us total) trans 21474839335 rc 0/0 00000100:00100000:1.0:1763343278.295016:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7558 00010000:00010000:3.0:1763343278.295531:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5595 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0c5 expref: 27 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.295547:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3a00, rc 0) 00000100:00100000:3.0:1763343278.295585:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:55884:x1848998400010880:12345-192.168.201.40@tcp:101:bash.0 Request processed in 700us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343278.295592:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7562 00000004:00080000:3.0:1763343278.295633:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6b55500/2, rc 0, transno 21474839334 00000100:00100000:3.0:1763343278.295638:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413019136:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1763343278.295649:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6b57100/2, rc 0, transno 21474839335 00000100:00100000:3.0:1763343278.295653:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413019008:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343278.299699:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.299802:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400011008 00000100:00100000:2.0:1763343278.299814:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400011008 00000100:00100000:2.0:1763343278.299986:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7563 00000100:00100000:2.0:1763343278.299999:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:55884:x1848998400011008:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343278.300018:0:11289:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.300530:0:11289:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88400/0x9104b1ba770a559c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a0cc expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343278.300558:0:11289:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343278.300582:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.300584:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.300594:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88400/0x9104b1ba770a559c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0cc expref: 15 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.300609:0:11289:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88400/0x9104b1ba770a559c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0cc expref: 15 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.300621:0:11289:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88400, rc 0) 00000100:00100000:2.0:1763343278.300678:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:55884:x1848998400011008:12345-192.168.201.40@tcp:101:bash.0 Request processed in 682us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.300686:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7563 00000100:00100000:3.0:1763343278.304681:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.304723:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.304965:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400011136 00000100:00100000:1.0:1763343278.304969:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400011264 00000100:00100000:0.0:1763343278.304976:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400011136 00000100:00100000:1.0:1763343278.304977:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400011264 00002000:00010000:0.0:1763343278.305020:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/739 (0->18446744073709551615) 00002000:00010000:1.0:1763343278.305021:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/738 (0->18446744073709551615) 00002000:00100000:0.0:1763343278.305055:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5dcb480 with x1848998400011136 ext(0->18446744073709551615) 00002000:00100000:1.0:1763343278.305063:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5dc9c00 with x1848998400011264 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343278.305071:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5dcb480. 00002000:00010000:1.0:1763343278.305073:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5dc9c00. 00000100:00100000:0.0:1763343278.305098:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1789 00000100:00100000:0.0:1763343278.305107:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2408:x1848998400011136:12345-192.168.201.40@tcp:10:bash.0 00000100:00100000:1.0:1763343278.305166:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1790 00000100:00100000:1.0:1763343278.305176:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998400011264:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:0.0:1763343278.305474:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2e3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343278.305478:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2e3:0x0] updating lvb mtime from disk: 0 -> 1763343277 00002000:00010000:0.0:1763343278.305481:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343278.305483:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2e3:0x0] updating lvb ctime from disk: 0 -> 1763343277 00002000:00010000:0.0:1763343278.305486:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2e3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343278.305549:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2408:x1848998400011136:12345-192.168.201.40@tcp:10:bash.0 Request processed in 442us (877us total) trans 17179872067 rc 0/0 00000100:00100000:0.0:1763343278.305558:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1789 00002000:00010000:0.0:1763343278.305562:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/739 (0->18446744073709551615) 00002000:00100000:0.0:1763343278.305565:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5dcb480 with x1848998400011136 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343278.305569:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5dcb480. 00002000:00010000:1.0:1763343278.305723:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2e2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343278.305727:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2e2:0x0] updating lvb mtime from disk: 0 -> 1763343277 00002000:00010000:1.0:1763343278.305730:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2e2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343278.305732:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2e2:0x0] updating lvb ctime from disk: 0 -> 1763343277 00002000:00010000:1.0:1763343278.305734:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2e2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343278.305777:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400011264:12345-192.168.201.40@tcp:10:bash.0 Request processed in 603us (1053us total) trans 21474839336 rc 0/0 00000100:00100000:1.0:1763343278.305785:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1790 00002000:00010000:1.0:1763343278.305789:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/738 (0->18446744073709551615) 00002000:00100000:1.0:1763343278.305791:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5dc9c00 with x1848998400011264 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343278.305795:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5dc9c00. 00000100:00100000:3.0:1763343278.309144:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.309251:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400011520 00000100:00100000:0.0:1763343278.309262:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400011520 00000100:00100000:0.0:1763343278.309326:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3902 00000100:00100000:0.0:1763343278.309337:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:55884:x1848998400011520:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:0.0:1763343278.309612:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:55884:x1848998400011520:12345-192.168.201.40@tcp:35:bash.0 Request processed in 276us (477us total) trans 4294973953 rc 0/0 00000100:00100000:0.0:1763343278.309621:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3902 00000100:00100000:0.0:1763343278.314118:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.314602:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400011776 00000100:00100000:2.0:1763343278.314613:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400011776 00000100:00100000:2.0:1763343278.314712:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11042 00000100:00100000:2.0:1763343278.314723:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57200:x1848998400011776:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343278.314741:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.314765:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a55a3 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a0d3 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.314845:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a55aa lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.314859:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a55aa lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.314869:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a55aa lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.314880:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a55b1 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.314886:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a55b1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.314892:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a55b1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.314986:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a55b8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x226:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.314995:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a55b8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.315002:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a55b8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:2.0:1763343278.315011:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x226:0x0]: returning size 5 00010000:00010000:2.0:1763343278.316163:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a55aa lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.316176:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a55aa lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.316187:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a55aa lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.316192:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.316196:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a55aa lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.316214:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a55aa lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.316228:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758a00) 00010000:00010000:2.0:1763343278.316231:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.316236:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a55aa lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.316241:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a55aa lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.316254:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a55b1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.316260:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a55b1 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.316266:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a55b1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.316281:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.316284:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a55b1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.316290:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a55b1 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.316300:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758700) 00010000:00010000:2.0:1763343278.316303:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.316305:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a55b1 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.316311:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a55b1 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.316355:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a55a3 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0d3 expref: 312 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.316371:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a55b8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0d3 expref: 311 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.316378:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x226:0x0].0x0 (ffff9400c38f5300) 00010000:00010000:2.0:1763343278.316380:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343278.316383:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88e00, rc 0) 00000100:00100000:2.0:1763343278.316452:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57200:x1848998400011776:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1730us (2344us total) trans 4294973954 rc 0/0 00000100:00100000:2.0:1763343278.316461:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11042 00000100:00100000:3.0:1763343278.320257:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.320355:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.320470:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400012032 00000100:00100000:0.0:1763343278.320480:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400012032 00000100:00100000:2.0:1763343278.320588:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400012288 00000100:00100000:2.0:1763343278.320594:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400012288 00000100:00100000:2.0:1763343278.320639:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11043 00000100:00100000:2.0:1763343278.320650:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57201:x1848998400012288:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:2.0:1763343278.320706:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763343278.320731:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5556 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x226:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0be expref: 312 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.320758:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a55b8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0d3 expref: 311 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.320770:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89a00/0x9104b1ba770a553a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x226:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0b0 expref: 310 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.320780:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x226:0x0].0x0 (ffff9400c38f5300) 00010000:00010000:2.0:1763343278.320791:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343278.320818:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a55c6 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.320832:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a55c6 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.320841:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a55c6 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.320853:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a55cd lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.320860:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a55cd lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.320866:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a55cd lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.320939:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a55d4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x226:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.320947:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a55d4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x226:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.320958:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a55d4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x226:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00080000:2.0:1763343278.321202:0:33856:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x226:0x0] is inserted into orphan list, open count = 1 00010000:00010000:2.0:1763343278.321306:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a55d4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x226:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.321315:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a55d4 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x226:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.321321:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a55d4 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x226:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.321328:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.321332:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a55d4 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x226:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.321340:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a55d4 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x226:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.321349:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x226:0x0].0x0 (ffff9400c4758b00) 00010000:00010000:2.0:1763343278.321352:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763343278.321356:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a55d4 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x226:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.321362:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a55d4 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x226:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.321377:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a55c6 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.321383:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a55c6 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.321393:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a55c6 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.321399:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.321402:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a55c6 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.321408:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a55c6 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.321415:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758f00) 00010000:00010000:2.0:1763343278.321418:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.321420:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a55c6 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.321426:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a55c6 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:2.0:1763343278.321436:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b74a3d44 reply state 0000000028373988 transno 4294973955 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a55cd lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.321447:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a55cd lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.321453:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758d00) 00010000:00010000:2.0:1763343278.321455:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343278.321458:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343278.321542:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57201:x1848998400012288:12345-192.168.201.40@tcp:36:rm.0 Request processed in 892us (1185us total) trans 4294973955 rc 0/0 00000100:00100000:2.0:1763343278.321551:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11043 00000100:00100000:0.0:1763343278.321731:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3903 00000100:00100000:0.0:1763343278.321742:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57200:x1848998400012032:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:0.0:1763343278.321862:0:6527:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x226:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763343278.321913:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1831, 64 off151960 00000040:00080000:0.0:1763343278.321938:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1822, 64 off151200 00000040:00080000:0.0:1763343278.321948:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1823, 64 off151264 00000040:00080000:0.0:1763343278.321957:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1832, 64 off152024 00010000:00010000:0.0:1763343278.321994:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a55db lrc: 3/0,1 mode: --/PW res: [0x240000404:0x226:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343278.322005:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a55db lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x226:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343278.322014:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a55db lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x226:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343278.322045:0:6527:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a55db lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x226:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343278.322052:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a55db lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x226:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343278.322058:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a55db lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x226:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343278.322075:0:6527:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343278.322236:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57200:x1848998400012032:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 495us (1988us total) trans 4294973956 rc 0/0 00000100:00100000:0.0:1763343278.322244:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3903 00010000:00010000:2.0:1763343278.324530:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343278.324547:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a55db lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x226:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343278.324559:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ae00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343278.324563:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a55db lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x226:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343278.324571:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a55db lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x226:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343278.324590:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x226:0x0].0x0 (ffff9400c48aa000) 00010000:00010000:2.0:1763343278.324593:0:7451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763343278.324598:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a55db lrc: 1/0,0 mode: --/PW res: [0x240000404:0x226:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343278.324604:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a55db lrc: 0/0,0 mode: --/PW res: [0x240000404:0x226:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343278.324628:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343278.324630:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343278.324632:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343278.331390:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.331510:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400012416 00000100:00100000:2.0:1763343278.331520:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400012416 00000100:00100000:2.0:1763343278.331584:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11044 00000100:00100000:2.0:1763343278.331594:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57200:x1848998400012416:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343278.331619:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.331643:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89a00/0x9104b1ba770a55e2 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a0da expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.331718:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a55e9 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.331733:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a55e9 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.331745:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a55e9 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.331755:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a55f0 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.331762:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a55f0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.331768:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a55f0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.331804:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a55e9 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.331812:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a55e9 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.331818:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a55e9 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.331823:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.331827:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a55e9 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.331834:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a55e9 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.331846:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758a00) 00010000:00010000:2.0:1763343278.331849:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.331853:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a55e9 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.331859:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a55e9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.331869:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a55f0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.331874:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a55f0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.331879:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a55f0 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.331884:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.331887:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a55f0 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.331892:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a55f0 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.331898:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758d00) 00010000:00010000:2.0:1763343278.331900:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.331903:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a55f0 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.331908:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a55f0 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.331933:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89a00/0x9104b1ba770a55e2 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0da expref: 312 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.331942:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758a00) 00010000:00010000:2.0:1763343278.331944:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.331948:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89a00/0x9104b1ba770a55e2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0da expref: 312 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.331964:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89a00, rc 0) 00000100:00100000:2.0:1763343278.332511:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57200:x1848998400012416:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 915us (1131us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343278.332519:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11044 00000100:00100000:1.0:1763343278.336641:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.337040:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400012544 00000100:00100000:2.0:1763343278.337052:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400012544 00000100:00100000:2.0:1763343278.337108:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11045 00000100:00100000:2.0:1763343278.337118:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57202:x1848998400012544:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343278.337140:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.337164:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a55f7 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a0e1 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.337246:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a55fe lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.337260:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a55fe lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.337271:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a55fe lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.337283:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5605 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.337290:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5605 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.337297:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5605 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.337346:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a55fe lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.337354:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a55fe lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.337361:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a55fe lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.337366:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.337371:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a55fe lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.339061:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a55fe lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.339080:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758f00) 00010000:00010000:2.0:1763343278.339084:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.339092:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a55fe lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.339099:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a55fe lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.339114:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5605 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.339120:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5605 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.339126:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5605 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.339132:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.339135:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5605 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.339140:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5605 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.339147:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758d00) 00010000:00010000:2.0:1763343278.339149:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.339152:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5605 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.339157:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5605 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.339198:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a55f7 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0e1 expref: 312 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.339227:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758f00) 00010000:00010000:2.0:1763343278.339230:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.339234:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a55f7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0e1 expref: 312 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.339247:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89000, rc 0) 00000100:00100000:2.0:1763343278.340393:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57202:x1848998400012544:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3270us (3753us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343278.340406:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11045 00000100:00100000:0.0:1763343278.349712:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.349822:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400012672 00000100:00100000:2.0:1763343278.349831:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400012672 00000100:00100000:2.0:1763343278.349884:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11046 00000100:00100000:2.0:1763343278.349894:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c372b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57202:x1848998400012672:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343278.349916:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.349940:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a560c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a0e8 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.350005:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5613 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.350017:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5613 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.350054:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5613 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.350066:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a561a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.350072:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a561a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.350078:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a561a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.350112:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5613 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.350119:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5613 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.350126:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5613 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.350131:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.350135:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5613 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.350145:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5613 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.350155:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758f00) 00010000:00010000:2.0:1763343278.350158:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.350162:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5613 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.350169:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5613 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.350181:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a561a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.350186:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a561a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.350192:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a561a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.350196:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.350198:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a561a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.350215:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a561a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.350223:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758d00) 00010000:00010000:2.0:1763343278.350225:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.350227:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a561a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.350238:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a561a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.350266:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a560c lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0e8 expref: 312 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.350276:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758f00) 00010000:00010000:2.0:1763343278.350279:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.350282:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a560c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0e8 expref: 312 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.350295:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89000, rc 0) 00000100:00100000:2.0:1763343278.350359:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c372b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57202:x1848998400012672:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 466us (657us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343278.350367:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11046 00000100:00100000:0.0:1763343278.359877:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.359930:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.360067:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400013056 00000100:00100000:1.0:1763343278.360077:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400013056 00000100:00100000:1.0:1763343278.360129:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400012928 00000100:00100000:1.0:1763343278.360133:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400012928 00000100:00100000:2.0:1763343278.360146:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11047 00000100:00100000:2.0:1763343278.360161:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57202:x1848998400013056:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343278.360182:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.360219:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5621 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a0f6 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.360292:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a5628 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.360309:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a5628 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.360324:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a5628 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:1.0:1763343278.360359:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11048 00000100:00100000:1.0:1763343278.360369:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57203:x1848998400012928:12345-192.168.201.40@tcp:101:lfs.0 00000004:00200000:2.0:1763343278.360375:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00010000:00010000:1.0:1763343278.360379:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:2.0:1763343278.360383:0:33856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763343278.360391:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a562f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a0ef expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.360424:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5621 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0f6 expref: 315 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.360445:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a5628 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0f6 expref: 314 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.360453:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5636 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343278.360455:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758f00) 00010000:00010000:2.0:1763343278.360462:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763343278.360469:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88200, rc 0) 00010000:00010000:1.0:1763343278.360472:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5636 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.360483:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5636 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.360494:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a563d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343278.360502:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a563d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.360508:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a563d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.360547:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5636 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343278.360551:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57202:x1848998400013056:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 392us (682us total) trans 0 rc 0/0 00010000:00010000:1.0:1763343278.360556:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5636 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343278.360564:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11047 00010000:00010000:1.0:1763343278.360569:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5636 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.360577:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5636 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.360583:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.360587:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5636 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.360595:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5636 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.360604:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758f00) 00010000:00010000:1.0:1763343278.360607:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.360610:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5636 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.360616:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5636 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.360624:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a563d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.360629:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a563d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.360634:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a563d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.360639:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.360641:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a563d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.360649:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a563d lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.360655:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758d00) 00010000:00010000:1.0:1763343278.360658:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.360660:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a563d lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.360666:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a563d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.360688:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a562f lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0ef expref: 313 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.360697:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758f00) 00010000:00010000:1.0:1763343278.360700:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343278.360704:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a562f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0ef expref: 313 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.360712:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176e00, rc 0) 00000100:00100000:1.0:1763343278.360736:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57203:x1848998400012928:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 370us (806us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343278.360743:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11048 00000100:00100000:0.0:1763343278.372617:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.373115:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400013312 00000100:00100000:1.0:1763343278.373127:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400013312 00000100:00100000:1.0:1763343278.373180:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11049 00000100:00100000:1.0:1763343278.373189:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57202:x1848998400013312:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343278.373218:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.373222:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343278.373248:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a5628 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0f6 expref: 312 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.373267:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758f00) 00010000:00010000:1.0:1763343278.373368:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343278.373386:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5644 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a0fd expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.373481:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a564b lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343278.373494:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a564b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.373504:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a564b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.373514:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5652 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343278.373521:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5652 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.373527:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5652 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.373887:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5659 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x227:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343278.373898:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5659 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.373905:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5659 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:1.0:1763343278.373915:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x227:0x0]: returning size 0 00010000:00010000:1.0:1763343278.373937:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a564b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.373944:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a564b lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.373950:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a564b lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.373955:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.373959:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a564b lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.373965:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a564b lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.373973:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5b00) 00010000:00010000:1.0:1763343278.373976:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.373980:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a564b lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.373985:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a564b lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:1.0:1763343278.373994:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c8033bd7 reply state 00000000977f90ff transno 4294973957 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5652 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.374003:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5652 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.374008:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758d00) 00010000:00010000:1.0:1763343278.374011:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343278.374013:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343278.374088:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5644 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0fd expref: 314 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.374104:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5659 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0fd expref: 313 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.374111:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x227:0x0].0x0 (ffff9400c38f5500) 00010000:00010000:1.0:1763343278.374113:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343278.374115:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176c00, rc 0) 00000100:00100000:1.0:1763343278.374168:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57202:x1848998400013312:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 980us (1561us total) trans 4294973957 rc 0/0 00000100:00100000:1.0:1763343278.374175:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11049 00000100:00100000:0.0:1763343278.378128:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.378266:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400013568 00000100:00100000:1.0:1763343278.378278:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400013568 00000100:00100000:1.0:1763343278.378349:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11050 00000100:00100000:1.0:1763343278.378360:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57202:x1848998400013568:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343278.378384:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.378406:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5667 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x227:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a104 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343278.378432:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.378486:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400013824 00000100:00100000:2.0:1763343278.378490:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400013824 00000100:00100000:2.0:1763343278.378528:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11051 00000100:00100000:2.0:1763343278.378536:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57204:x1848998400013824:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343278.378543:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.378552:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a566e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x227:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a10b expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.378628:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5675 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x227:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343278.378643:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5675 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.378655:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5675 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:2.0:1763343278.378670:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x227:0x0]: returning size 0 00010000:00010000:2.0:1763343278.378769:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a566e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x227:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a10b expref: 319 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.378786:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5675 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a10b expref: 318 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.378795:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x227:0x0].0x0 (ffff9400c38f5500) 00010000:00010000:2.0:1763343278.378797:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343278.378801:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89c00, rc 0) 00000100:00100000:2.0:1763343278.378861:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+318:57204:x1848998400013824:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 326us (430us total) trans 4294973958 rc 0/0 00000100:00100000:2.0:1763343278.378870:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11051 00010000:00010000:1.0:1763343278.379065:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5683 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x227:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343278.379079:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5659 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0fd expref: 317 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.379087:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5675 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a10b expref: 317 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.379100:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5683 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x227:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.379132:0:33856:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5675 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a10b expref: 317 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.379145:0:33856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5675 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a10b expref: 317 pid: 9827 timeout: 1171 lvb_type: 0 00000100:00100000:1.0:1763343278.379159:0:33856:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b26680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998413019776:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343278.379243:0:33856:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5659 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0fd expref: 317 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.379252:0:33856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5659 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0fd expref: 317 pid: 33856 timeout: 1171 lvb_type: 0 00000100:00100000:1.0:1763343278.379261:0:33856:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998413019904:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343278.379296:0:33856:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc52240 going to sleep for 11 seconds 00000100:00100000:3.0:1763343278.381095:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.381389:0:33856:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b26680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998413019776:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343278.381399:0:33856:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998413019904:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343278.381424:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5683 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x227:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:0.0:1763343278.381482:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400014080 00000100:00100000:0.0:1763343278.381488:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400014080 00000100:00100000:0.0:1763343278.381531:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3904 00000100:00100000:0.0:1763343278.381539:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+318:57204:x1848998400014080:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343278.381726:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:57204:x1848998400014080:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 187us (636us total) trans 4294973959 rc 0/0 00000100:00100000:0.0:1763343278.381733:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3904 00000100:00100000:0.0:1763343278.383540:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.384132:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.384532:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400014208 00000100:00100000:1.0:1763343278.384542:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400014208 00010000:00010000:1.0:1763343278.384580:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5675 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a10b expref: 319 pid: 9827 timeout: 1171 lvb_type: 0 00000100:00100000:1.0:1763343278.384623:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400014336 00000100:00100000:1.0:1763343278.384627:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400014336 00010000:00010000:1.0:1763343278.384638:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5659 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0fd expref: 320 pid: 33856 timeout: 1171 lvb_type: 0 00000100:00100000:1.0:1763343278.384664:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3603 00000100:00100000:1.0:1763343278.384673:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+320:2407:x1848998400014208:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343278.384686:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343278.384693:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5675 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a10b expref: 320 pid: 9827 timeout: 1171 lvb_type: 0 00010000:00010000:1.0:1763343278.384704:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5675 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a10b expref: 320 pid: 9827 timeout: 1171 lvb_type: 0 00010000:00010000:1.0:1763343278.384728:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5675 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a10b expref: 320 pid: 9827 timeout: 1171 lvb_type: 0 00010000:00010000:1.0:1763343278.384744:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x227:0x0].0x0 (ffff9400c38f5500) 00010000:00010000:1.0:1763343278.384749:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5683 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x227:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.384757:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343278.384801:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:2407:x1848998400014208:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 129us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343278.384808:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3603 00000100:00100000:1.0:1763343278.384825:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3604 00000100:00100000:1.0:1763343278.384831:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+318:2407:x1848998400014336:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343278.384839:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343278.384843:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5659 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0fd expref: 318 pid: 33856 timeout: 1171 lvb_type: 0 00010000:00010000:1.0:1763343278.384852:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5659 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0fd expref: 318 pid: 33856 timeout: 1171 lvb_type: 0 00010000:00010000:1.0:1763343278.384863:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5659 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0fd expref: 318 pid: 33856 timeout: 1171 lvb_type: 0 00010000:00010000:1.0:1763343278.384873:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x227:0x0].0x0 (ffff9400c38f5500) 00010000:00010000:1.0:1763343278.384876:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5683 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x227:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.384884:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5683 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x227:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.384890:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5683 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x227:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.384915:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343278.384936:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:2407:x1848998400014336:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 105us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343278.384942:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3604 00010000:00010000:1.0:1763343278.384993:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5683 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x227:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.385001:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5683 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x227:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:1.0:1763343278.385043:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x227:0x0]: returning size 0 00000004:00080000:1.0:1763343278.385215:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2e4:0x0], index 0: 0 00000004:00080000:1.0:1763343278.385223:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2e5:0x0], index 1: 0 00000004:00080000:1.0:1763343278.385229:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2e6:0x0], index 1: 0 00000004:00080000:1.0:1763343278.385233:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2e5:0x0], index 0: 0 00010000:00010000:1.0:1763343278.385338:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5683 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x227:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.385347:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5683 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x227:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.385354:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5683 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x227:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.385359:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.385363:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5683 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x227:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.385370:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5683 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x227:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.385378:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x227:0x0].0x0 (ffff9400c38f5500) 00010000:00010000:1.0:1763343278.385381:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343278.385384:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5683 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x227:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.385388:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5683 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x227:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.385428:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5667 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x227:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a104 expref: 317 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.385437:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x227:0x0].0x0 (ffff9400c38f5500) 00010000:00010000:1.0:1763343278.385440:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343278.385443:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5667 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x227:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a104 expref: 317 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.385456:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176200, rc 0) 00000100:00100000:1.0:1763343278.385487:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57202:x1848998400013568:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 7129us (8283us total) trans 4294973960 rc 301/301 00000100:00100000:1.0:1763343278.385494:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11050 00000100:00100000:0.0:1763343278.389381:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.390243:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.390363:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400014592 00000100:00100000:2.0:1763343278.390373:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400014592 00000100:00100000:2.0:1763343278.390431:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11052 00000100:00100000:2.0:1763343278.390441:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57204:x1848998400014592:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343278.390463:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.390488:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5691 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a112 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.390568:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89a00/0x9104b1ba770a5698 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343278.390582:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89a00/0x9104b1ba770a5698 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.390593:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89a00/0x9104b1ba770a5698 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.390603:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a569f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343278.390609:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a569f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.390615:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a569f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.390722:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a56a6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x227:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343278.390730:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a56a6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.390736:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a56a6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.390825:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89a00/0x9104b1ba770a5698 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.390832:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89a00/0x9104b1ba770a5698 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.390838:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89a00/0x9104b1ba770a5698 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.390845:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89a00/0x9104b1ba770a5698 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.390850:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.390854:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89a00/0x9104b1ba770a5698 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.390863:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89a00/0x9104b1ba770a5698 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.390875:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758a00) 00010000:00010000:2.0:1763343278.390878:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.390883:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89a00/0x9104b1ba770a5698 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.390889:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89a00/0x9104b1ba770a5698 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.390901:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a569f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.390906:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a569f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.390911:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a569f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.390915:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.390918:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a569f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.390923:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a569f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.390929:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758d00) 00010000:00010000:2.0:1763343278.390932:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.390934:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a569f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.390938:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a569f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.390972:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5691 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a112 expref: 319 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.390990:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a56a6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a112 expref: 318 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.390997:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x227:0x0].0x0 (ffff9400c4758b00) 00010000:00010000:2.0:1763343278.390999:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343278.391001:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88e00, rc 0) 00000100:00100000:2.0:1763343278.391090:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+318:57204:x1848998400014592:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 649us (1717us total) trans 4294973961 rc 0/0 00000100:00100000:2.0:1763343278.391098:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11052 00000100:00100000:3.0:1763343278.391186:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400014848 00000100:00100000:3.0:1763343278.391191:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400014848 00000100:00100000:3.0:1763343278.391241:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3905 00000100:00100000:3.0:1763343278.391263:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+318:57202:x1848998400014848:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343278.391542:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:57202:x1848998400014848:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 294us (1302us total) trans 4294973962 rc 0/0 00000100:00100000:3.0:1763343278.391550:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3905 00000100:00100000:3.0:1763343278.393766:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.393815:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400015104 00000100:00100000:2.0:1763343278.393826:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400015104 00000100:00100000:2.0:1763343278.393880:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3906 00000100:00100000:2.0:1763343278.393889:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:57202:x1848998400015104:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343278.395345:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+320:57202:x1848998400015104:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1450us (1581us total) trans 4294973963 rc 0/0 00000100:00100000:2.0:1763343278.395358:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3906 00000100:00100000:1.0:1763343278.397520:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.397571:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400015232 00000100:00100000:1.0:1763343278.397577:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.397583:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400015232 00000100:00100000:3.0:1763343278.397701:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400015360 00000100:00100000:3.0:1763343278.397706:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400015360 00000100:00100000:2.0:1763343278.397730:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7564 00000100:00100000:3.0:1763343278.397747:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7565 00000100:00100000:2.0:1763343278.397748:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2407:x1848998400015232:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:3.0:1763343278.397760:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400015360:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343278.397767:0:11289:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343278.397770:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.397796:0:11289:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a56bb lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a119 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343278.397825:0:11289:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343278.397846:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.397848:0:11289:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.397856:0:11289:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a56bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a119 expref: 29 pid: 11289 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343278.397872:0:11289:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a56bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a119 expref: 29 pid: 11289 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343278.397885:0:11289:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88a00, rc 0) 00000100:00100000:2.0:1763343278.397936:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:2407:x1848998400015232:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 195us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.397943:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7564 00010000:00010000:3.0:1763343278.397957:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a56b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a120 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343278.397984:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343278.397996:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343278.397998:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343278.398004:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a56b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a120 expref: 17 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343278.398017:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a56b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a120 expref: 17 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343278.398181:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3000, rc 0) 00000100:00100000:3.0:1763343278.398377:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998400015360:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 620us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343278.398384:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7565 00000100:00100000:1.0:1763343278.401541:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.401638:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400015616 00000100:00100000:2.0:1763343278.401647:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400015616 00000100:00100000:2.0:1763343278.402188:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11053 00000100:00100000:2.0:1763343278.402200:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+320:55884:x1848998400015616:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343278.402236:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.402239:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343278.402276:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a56a6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a112 expref: 320 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.402295:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x227:0x0].0x0 (ffff9400c4758b00) 00010000:00010000:2.0:1763343278.402304:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343278.402319:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a56c2 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x227:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a127 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.402426:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a56c9 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x227:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.402439:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a56c9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x227:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.402449:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a56c9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x227:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:2.0:1763343278.402463:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x227:0x0]: returning size 0 00010000:00010000:2.0:1763343278.402563:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a56c2 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x227:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a127 expref: 322 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.402577:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a56c9 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x227:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a127 expref: 321 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.402584:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x227:0x0].0x0 (ffff9400c4758a00) 00010000:00010000:2.0:1763343278.402587:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:2.0:1763343278.402589:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88c00, rc 0) 00000100:00100000:2.0:1763343278.402638:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:55884:x1848998400015616:12345-192.168.201.40@tcp:101:bash.0 Request processed in 440us (1107us total) trans 4294973964 rc 0/0 00000100:00100000:2.0:1763343278.402645:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11053 00000100:00100000:3.0:1763343278.403006:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.406711:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400015744 00000100:00100000:0.0:1763343278.406727:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400015744 00000100:00100000:0.0:1763343278.406843:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11054 00000100:00100000:0.0:1763343278.406854:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:57204:x1848998400015744:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343278.406873:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.406895:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a56d7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x227:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a12e expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.406960:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a56d7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x227:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a12e expref: 322 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.406976:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a56d7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x227:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a12e expref: 322 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.406998:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x227:0x0].0x0 (ffff9400c4758a00) 00010000:00010000:0.0:1763343278.407002:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343278.407005:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501ba00, rc 0) 00000100:00100000:0.0:1763343278.407098:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+322:57204:x1848998400015744:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 245us (4092us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343278.407106:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11054 00000100:00100000:1.0:1763343278.410599:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.410672:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400016000 00000100:00100000:2.0:1763343278.410684:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400016000 00000100:00100000:2.0:1763343278.410746:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3907 00000100:00100000:2.0:1763343278.410756:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82d5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+322:57204:x1848998400016000:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343278.410968:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82d5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:57204:x1848998400016000:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 213us (378us total) trans 4294973965 rc 0/0 00000100:00100000:2.0:1763343278.410979:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3907 00000100:00100000:1.0:1763343278.411870:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.413259:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400016128 00000100:00100000:3.0:1763343278.413278:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400016128 00000100:00100000:3.0:1763343278.414767:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11055 00000100:00100000:3.0:1763343278.414786:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:55884:x1848998400016128:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343278.414812:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343278.414836:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a56de lrc: 2/0,0 mode: --/PR res: [0x240000404:0x227:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a135 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.414875:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a56e5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x227:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343278.414890:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a56e5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x227:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.414902:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a56e5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x227:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.415010:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a56de lrc: 0/0,0 mode: --/PR res: [0x240000404:0x227:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a135 expref: 325 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.415061:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a56e5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x227:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a135 expref: 324 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.415070:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x227:0x0].0x0 (ffff9400c4758a00) 00010000:00010000:3.0:1763343278.415073:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343278.415077:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fd2dea00, rc 0) 00000100:00100000:3.0:1763343278.415136:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+324:55884:x1848998400016128:12345-192.168.201.40@tcp:101:bash.0 Request processed in 358us (3269us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343278.415144:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11055 00000100:00100000:1.0:1763343278.416565:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.416739:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400016384 00000100:00100000:3.0:1763343278.416749:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400016384 00000100:00100000:3.0:1763343278.416802:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11056 00000100:00100000:3.0:1763343278.416811:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+324:57204:x1848998400016384:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343278.416832:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343278.416853:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a56ec lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a13c expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.416927:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a56f3 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343278.416940:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a56f3 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.416951:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a56f3 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.416962:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a56fa lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343278.416970:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a56fa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.416975:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a56fa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.417124:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5701 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x227:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343278.417136:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5701 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x227:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.417142:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5701 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x227:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.417148:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5701 lrc: 3/0,0 mode: --/PR res: [0x240000404:0x227:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.417158:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508b200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343278.417162:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5701 lrc: 3/0,0 mode: --/PR res: [0x240000404:0x227:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.417169:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5701 lrc: 4/0,0 mode: --/PR res: [0x240000404:0x227:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.417179:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x227:0x0].0x0 (ffff9400c4758a00) 00010000:00010000:3.0:1763343278.417185:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5701 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x227:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.417191:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5701 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x227:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00200000:3.0:1763343278.417215:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x227:0x0]: returning size 0 00010000:00010000:3.0:1763343278.417302:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a56f3 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.417309:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a56f3 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.417313:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a56f3 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.417318:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fd2dfa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343278.417321:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a56f3 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.417326:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a56f3 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.417334:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4c00) 00010000:00010000:3.0:1763343278.417336:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343278.417339:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a56f3 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.417345:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a56f3 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.417353:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a56fa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.417359:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a56fa lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.417363:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a56fa lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.417368:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508aa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343278.417370:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a56fa lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.417375:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a56fa lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.417382:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758d00) 00010000:00010000:3.0:1763343278.417385:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343278.417387:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a56fa lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.417393:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a56fa lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.417425:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a56ec lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a13c expref: 326 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.417435:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4c00) 00010000:00010000:3.0:1763343278.417438:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343278.417441:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a56ec lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a13c expref: 326 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.417453:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fd2df600, rc 0) 00000100:00100000:3.0:1763343278.417509:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+325:57204:x1848998400016384:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 699us (950us total) trans 4294973966 rc 301/301 00000100:00100000:3.0:1763343278.417516:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11056 00000100:00100000:1.0:1763343278.424967:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.425081:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.425157:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400016896 00000100:00100000:3.0:1763343278.425167:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400016896 00000100:00100000:3.0:1763343278.425219:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3908 00000100:00100000:3.0:1763343278.425227:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+325:57204:x1848998400016896:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343278.425416:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+326:57204:x1848998400016896:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 188us (334us total) trans 4294973967 rc 0/0 00000100:00100000:3.0:1763343278.425424:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3908 00000100:00100000:2.0:1763343278.425858:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400016640 00000100:00100000:2.0:1763343278.425863:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400016640 00000100:00100000:2.0:1763343278.425901:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11057 00000100:00100000:2.0:1763343278.425910:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+326:55884:x1848998400016640:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:2.0:1763343278.425942:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343278.425968:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a56c9 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x227:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a127 expref: 326 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.425985:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x227:0x0].0x0 (ffff9400c4758a00) 00010000:00010000:2.0:1763343278.425990:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343278.426127:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a570f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x227:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343278.426143:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a570f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x227:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.426152:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a570f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x227:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000001:00080000:2.0:1763343278.426192:0:6525:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973968 00000004:00010000:2.0:1763343278.426226:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001a9c6d98 reply state 0000000011652dba transno 4294973969 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a570f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x227:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.426238:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a570f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x227:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.426244:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x227:0x0].0x0 (ffff9400c4758a00) 00010000:00010000:2.0:1763343278.426247:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343278.426249:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343278.426314:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+328:55884:x1848998400016640:12345-192.168.201.40@tcp:36:bash.0 Request processed in 405us (1356us total) trans 4294973969 rc 0/0 00000100:00100000:2.0:1763343278.426321:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11057 00000020:00080000:2.0:1763343278.426325:0:6525:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343278.432885:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.432956:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400017024 00000100:00100000:2.0:1763343278.432967:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400017024 00000100:00100000:1.0:1763343278.432982:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.433052:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3909 00000100:00100000:2.0:1763343278.433064:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+328:57204:x1848998400017024:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:2.0:1763343278.433231:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+328:57204:x1848998400017024:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 169us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.433238:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3909 00000100:00100000:3.0:1763343278.433634:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400017280 00000100:00100000:3.0:1763343278.433640:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400017280 00000100:00100000:3.0:1763343278.433682:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11058 00000100:00100000:3.0:1763343278.433690:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+328:55884:x1848998400017280:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343278.433705:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343278.433708:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343278.433734:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a56d7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x227:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a12e expref: 328 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.433752:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x227:0x0].0x0 (ffff9400c4758a00) 00010000:00010000:3.0:1763343278.433758:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343278.433770:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5716 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x227:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a143 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.434072:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a571d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x227:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343278.434086:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a571d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x227:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.434095:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a571d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x227:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000040:00080000:3.0:1763343278.434478:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1824, 88 off151352 00000004:00080000:3.0:1763343278.434486:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1071558460959ns, next at 1072111852630ns, rc = 0 00000040:00080000:3.0:1763343278.434573:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1833, 88 off152112 00000004:00080000:3.0:1763343278.434578:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1071558553668ns, next at 1072111826735ns, rc = 0 00000040:00080000:3.0:1763343278.434696:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1834, 88 off152200 00000004:00080000:3.0:1763343278.434701:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1071558676391ns, next at 1072111826735ns, rc = 0 00000040:00080000:3.0:1763343278.434809:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1825, 88 off151440 00000004:00080000:3.0:1763343278.434814:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1071558789478ns, next at 1072111852630ns, rc = 0 00000001:00080000:0.0:1763343278.439588:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973970 is committed 00000004:00080000:0.0:1763343278.439604:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1168 committed 00000004:00080000:0.0:1763343278.439681:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1176 committed 00000004:00080000:0.0:1763343278.439699:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1175 committed 00000004:00080000:0.0:1763343278.439703:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1167 committed 00010000:00010000:2.0:1763343278.439717:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a55cd lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.439731:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a55cd lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.439740:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a55cd lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.439746:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.439752:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a55cd lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.439761:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a55cd lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.439779:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758d00) 00010000:00010000:2.0:1763343278.439783:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.439788:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a55cd lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.439800:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a55cd lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.439821:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5652 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.439827:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5652 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.439832:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5652 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.439837:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.439840:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5652 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.439846:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5652 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.439856:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758d00) 00010000:00010000:2.0:1763343278.439859:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.439861:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5652 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.439867:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5652 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000100:00100000:1.0:1763343278.439870:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413020032:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1763343278.439884:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a570f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x227:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.439892:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a570f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x227:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.439901:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a570f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x227:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.439906:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.439909:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a570f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x227:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.439915:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a570f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x227:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.439924:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x227:0x0].0x0 (ffff9400c4758a00) 00010000:00010000:2.0:1763343278.439926:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.439929:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a570f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x227:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.439934:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a570f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x227:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00000100:00100000:1.0:1763343278.439942:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343278.439962:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413020288:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343278.440000:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413020544:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343278.440009:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343278.440060:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343278.440083:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413020416:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343278.440109:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413020032 00000100:00100000:2.0:1763343278.440116:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343278.440117:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413020032 00000100:00100000:2.0:1763343278.440148:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413020800:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343278.440159:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413020928:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343278.440166:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413020288 00000100:00100000:1.0:1763343278.440171:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413020288 00000100:00100000:2.0:1763343278.440178:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343278.440215:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413020544 00000100:00100000:3.0:1763343278.440220:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343278.440220:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413020544 00000100:00100000:3.0:1763343278.440256:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413020672:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343278.440282:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343278.440677:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763343278.440678:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413020416 00000100:00100000:2.0:1763343278.440680:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413020800 00000100:00100000:0.0:1763343278.440685:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413020416 00000100:00100000:2.0:1763343278.440688:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413020800 00000100:00100000:3.0:1763343278.440689:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413020160:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343278.440719:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413020928 00000100:00100000:0.0:1763343278.440721:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413020672 00000100:00100000:2.0:1763343278.440725:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413020928 00000100:00100000:3.0:1763343278.440726:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343278.440728:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413020672 00000100:00100000:2.0:1763343278.440748:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413020160 00000100:00100000:2.0:1763343278.440753:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413020160 00000100:00100000:0.0:1763343278.440762:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7566 00000100:00100000:0.0:1763343278.440775:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f648a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+24:3659:x1848998413020032:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763343278.440781:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7567 00000100:00100000:2.0:1763343278.440792:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6276d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+24:3660:x1848998413020288:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763343278.440803:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:738 count 1 00010000:00010000:3.0:1763343278.440808:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a571d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x227:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a143 expref: 307 pid: 33856 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1763343278.440810:0:27798:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:739 count 1 00010000:00010000:3.0:1763343278.440831:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x227:0x0].0x0 (ffff9400c4758a00) 00010000:00010000:2.0:1763343278.440831:0:27798:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a572b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.440831:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c501bc00/0x9104b1ba770a5724 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.440838:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763343278.440854:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5716 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x227:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a143 expref: 307 pid: 33856 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763343278.440863:0:27798:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a5509 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a094 expref: 16 pid: 8413 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343278.440864:0:8413:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88400/0x9104b1ba770a559c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0cc expref: 16 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.440872:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a571d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x227:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a143 expref: 306 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.440887:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343278.440888:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343278.440892:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343278.440893:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343278.440898:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a572b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.440898:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501bc00/0x9104b1ba770a5724 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.440916:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x227:0x0].0x0 (ffff9400c4758a00) 00010000:00010000:3.0:1763343278.440921:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763343278.440923:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8693c00, rc 0) 00010000:00010000:0.0:1763343278.440945:0:8413:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88400/0x9104b1ba770a559c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0cc expref: 16 pid: 11289 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.440946:0:27798:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a5509 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a094 expref: 16 pid: 8413 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1763343278.440973:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:55884:x1848998400017280:12345-192.168.201.40@tcp:101:bash.0 Request processed in 7281us (7989us total) trans 4294973970 rc 0/0 00010000:00010000:0.0:1763343278.440975:0:8413:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88400/0x9104b1ba770a559c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0cc expref: 16 pid: 11289 timeout: 1171 lvb_type: 0 00010000:00010000:2.0:1763343278.440976:0:27798:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a5509 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a094 expref: 16 pid: 8413 timeout: 1171 lvb_type: 1 00000100:00100000:3.0:1763343278.440989:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11058 00000100:00100000:0.0:1763343278.441007:0:8413:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5956a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998413021056:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343278.441008:0:27798:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6275880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27798:1848998413021184:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343278.441084:0:27798:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c53043c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343278.441084:0:8413:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343278.441107:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7568 00000100:00100000:0.0:1763343278.441115:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6274700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+24:3661:x1848998413020416:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343278.441249:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7569 00000100:00100000:1.0:1763343278.441257:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+48:3661:x1848998413020800:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343278.441386:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+49:3661:x1848998413020800:12345-0@lo:2:osp-syn-1-1.0 Request processed in 130us (1208us total) trans 17179872068 rc 0/0 00000100:00100000:1.0:1763343278.441393:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7569 00000100:00100000:1.0:1763343278.441408:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7570 00000100:00100000:1.0:1763343278.441414:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+48:3662:x1848998413020928:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763343278.441464:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2e6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343278.441467:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2e6:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343278.441470:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2e6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343278.441472:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2e6:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763343278.441474:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2e6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343278.441518:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+49:3662:x1848998413020928:12345-0@lo:2:osp-syn-1-1.0 Request processed in 103us (1313us total) trans 17179872069 rc 0/0 00000100:00100000:1.0:1763343278.441524:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7570 00000100:00100000:1.0:1763343278.441543:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7571 00000100:00100000:1.0:1763343278.441550:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+48:3660:x1848998413020672:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343278.441562:0:8412:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:740 count 1 00010000:00010000:1.0:1763343278.441574:0:8412:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5732 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.441586:0:8412:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5510 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a09b expref: 28 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343278.441593:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.441594:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.441597:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5732 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.441617:0:8412:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5510 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a09b expref: 28 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343278.441627:0:8412:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5510 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a09b expref: 28 pid: 35266 timeout: 1171 lvb_type: 1 00000100:00100000:1.0:1763343278.441637:0:8412:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6488380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8412:1848998413021312:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343278.441666:0:8412:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc523c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343278.441684:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7572 00000100:00100000:1.0:1763343278.441692:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+48:3660:x1848998413020160:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343278.441704:0:8626:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:739 count 1 00010000:00010000:1.0:1763343278.441714:0:8626:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5739 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.441725:0:8626:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5595 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0c5 expref: 28 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.441731:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343278.441733:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343278.441736:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5739 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.441754:0:8626:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5595 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0c5 expref: 28 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.441762:0:8626:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0c5 expref: 28 pid: 8412 timeout: 1171 lvb_type: 0 00000100:00100000:1.0:1763343278.441772:0:8626:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6489c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998413021440:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343278.441795:0:8626:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc526c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343278.441811:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7573 00000100:00100000:1.0:1763343278.441819:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+24:3662:x1848998413020544:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1763343278.441882:0:28561:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343278.441886:0:28561:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2e5:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343278.441888:0:28561:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2e5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343278.441889:0:28561:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2e5:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763343278.441891:0:28561:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2e5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343278.441921:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+25:3662:x1848998413020544:12345-0@lo:2:osp-syn-0-1.0 Request processed in 102us (1862us total) trans 21474839338 rc 0/0 00000100:00100000:1.0:1763343278.441927:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7573 00000004:00080000:2.0:1763343278.442076:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5a3f100/2, rc 0, transno 17179872068 00000100:00100000:2.0:1763343278.442083:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413020800:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763343278.442158:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bfe680/2, rc 0, transno 17179872069 00000100:00100000:3.0:1763343278.442163:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413020928:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763343278.442173:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6488700/2, rc 0, transno 21474839338 00000100:00100000:3.0:1763343278.442176:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413020544:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343278.442390:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6274700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+25:3661:x1848998413020416:12345-0@lo:2:osp-syn-0-1.0 Request processed in 1274us (2274us total) trans 21474839337 rc 0/0 00000100:00100000:0.0:1763343278.442398:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7568 00000004:00080000:2.0:1763343278.442733:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c9832a00/2, rc 0, transno 21474839337 00000100:00100000:2.0:1763343278.442738:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413020416:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343278.444921:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.445365:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400017536 00000100:00100000:3.0:1763343278.445376:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400017536 00000100:00100000:3.0:1763343278.445429:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11059 00000100:00100000:3.0:1763343278.445443:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f648bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57205:x1848998400017536:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343278.445467:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343278.445493:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5740 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a14a expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343278.445557:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.445573:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:3.0:1763343278.445591:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a5747 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00000100:00100000:0.0:1763343278.445591:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400017664 00000100:00100000:0.0:1763343278.445595:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400017664 00010000:00010000:3.0:1763343278.445605:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a5747 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.445616:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5510 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a09b expref: 29 pid: 35266 timeout: 1171 lvb_type: 1 00010000:00010000:3.0:1763343278.445617:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a5747 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.445630:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a574e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343278.445636:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a574e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00000100:00100000:0.0:1763343278.445637:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3605 00010000:00010000:3.0:1763343278.445643:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a574e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:0.0:1763343278.445643:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5957b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:2408:x1848998400017664:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343278.445653:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343278.445658:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5510 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a09b expref: 29 pid: 35266 timeout: 1171 lvb_type: 1 00010000:00010000:0.0:1763343278.445668:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5510 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a09b expref: 29 pid: 35266 timeout: 1171 lvb_type: 1 00010000:00010000:0.0:1763343278.445692:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343278.445694:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343278.445698:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5732 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.445712:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5732 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.445729:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343278.445753:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a5755 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x227:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343278.445762:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a5755 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.445769:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a5755 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:0.0:1763343278.445772:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5957b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:2408:x1848998400017664:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 129us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343278.445779:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3605 00000004:00200000:3.0:1763343278.445780:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x227:0x0]: returning size 2 00000100:00100000:0.0:1763343278.445797:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400017792 00000100:00100000:0.0:1763343278.445800:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400017792 00010000:00010000:0.0:1763343278.445812:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88400/0x9104b1ba770a559c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0cc expref: 17 pid: 11289 timeout: 1171 lvb_type: 0 00000100:00100000:0.0:1763343278.445830:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3606 00000100:00100000:0.0:1763343278.445835:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5954000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998400017792:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343278.445842:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343278.445846:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88400/0x9104b1ba770a559c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0cc expref: 17 pid: 11289 timeout: 1171 lvb_type: 0 00010000:00010000:0.0:1763343278.445855:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88400/0x9104b1ba770a559c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0cc expref: 17 pid: 11289 timeout: 1171 lvb_type: 0 00010000:00010000:0.0:1763343278.445866:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343278.445868:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343278.445870:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a5747 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.445871:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c501bc00/0x9104b1ba770a5724 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.445877:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a5747 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.445884:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501bc00/0x9104b1ba770a5724 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.445888:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a5747 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.445894:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8693e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.445895:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343278.445898:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a5747 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.445906:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a5747 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00000100:00100000:0.0:1763343278.445911:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5954000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998400017792:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 76us (337us total) trans 0 rc 0/0 00010000:00010000:3.0:1763343278.445915:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4c00) 00000100:00100000:0.0:1763343278.445917:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3606 00010000:00010000:3.0:1763343278.445918:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343278.445922:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a5747 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.445928:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a5747 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.445939:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a574e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.445945:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a574e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.445950:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a574e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00000100:00100000:0.0:1763343278.445953:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:3.0:1763343278.445955:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fd2df600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343278.445958:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a574e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.445963:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a574e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00000100:00100000:0.0:1763343278.445971:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400017920 00010000:00010000:3.0:1763343278.445974:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4900) 00000100:00100000:0.0:1763343278.445974:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400017920 00010000:00010000:3.0:1763343278.445976:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343278.445979:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a574e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.445984:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a574e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.445986:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5595 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0c5 expref: 29 pid: 8412 timeout: 1171 lvb_type: 0 00000100:00100000:0.0:1763343278.446004:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3607 00000100:00100000:0.0:1763343278.446008:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:2408:x1848998400017920:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343278.446015:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343278.446019:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5595 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0c5 expref: 29 pid: 8412 timeout: 1171 lvb_type: 0 00010000:00010000:3.0:1763343278.446052:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5740 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a14a expref: 309 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.446053:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0c5 expref: 29 pid: 8412 timeout: 1171 lvb_type: 0 00010000:00010000:0.0:1763343278.446065:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343278.446067:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343278.446069:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a5755 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a14a expref: 308 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.446071:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5739 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.446076:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x227:0x0].0x0 (ffff9400c4758a00) 00010000:00010000:3.0:1763343278.446078:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343278.446081:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fd2dfa00, rc 0) 00010000:00010000:0.0:1763343278.446083:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5739 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.446094:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343278.446117:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f648bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57205:x1848998400017536:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 681us (1205us total) trans 4294973971 rc 0/0 00000100:00100000:3.0:1763343278.446123:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11059 00000100:00100000:0.0:1763343278.446210:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:2408:x1848998400017920:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 102us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343278.446219:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3607 00010000:00010000:2.0:1763343278.446402:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88400/0x9104b1ba770a559c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0cc expref: 16 pid: 11289 timeout: 1171 lvb_type: 0 00000100:00100000:2.0:1763343278.446415:0:8413:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5956a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8413:1848998413021056:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343278.446433:0:8413:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c501bc00/0x9104b1ba770a5724 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.446442:0:8413:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c501bc00/0x9104b1ba770a5724 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.446448:0:8413:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c501bc00/0x9104b1ba770a5724 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.446456:0:8413:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c501bc00/0x9104b1ba770a5724 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.446463:0:8413:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501bc00/0x9104b1ba770a5724 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.446486:0:8413:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343278.446652:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343278.446659:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c501bc00/0x9104b1ba770a5724 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.446666:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501bc00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343278.446670:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c501bc00/0x9104b1ba770a5724 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343278.446671:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f648a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+25:3659:x1848998413020032:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5900us (6732us total) trans 21474839339 rc 0/0 00010000:00010000:0.0:1763343278.446678:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c501bc00/0x9104b1ba770a5724 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343278.446679:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7566 00010000:00010000:0.0:1763343278.446689:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c501bc00/0x9104b1ba770a5724 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.446696:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c501bc00/0x9104b1ba770a5724 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.446710:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343278.446712:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343278.446714:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343278.446799:0:8626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5595 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a0c5 expref: 28 pid: 8412 timeout: 1171 lvb_type: 0 00000100:00100000:1.0:1763343278.446810:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6489c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998413021440:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343278.446823:0:8626:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5739 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.446831:0:8626:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5739 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763343278.446833:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c9831c00/2, rc 0, transno 21474839339 00010000:00010000:1.0:1763343278.446837:0:8626:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5739 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343278.446838:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413020032:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1763343278.446845:0:8626:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5739 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.446852:0:8626:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5739 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343278.446861:0:27798:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6275880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27798:1848998413021184:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343278.446870:0:8626:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343278.446873:0:27798:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a572b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343278.447020:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+49:3660:x1848998413020160:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5327us (6296us total) trans 17179872070 rc 0/0 00000100:00100000:1.0:1763343278.447048:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7572 00010000:00010000:1.0:1763343278.447079:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5510 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a09b expref: 27 pid: 35266 timeout: 1171 lvb_type: 1 00000100:00100000:1.0:1763343278.447088:0:8412:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6488380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8412:1848998413021312:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343278.447099:0:8412:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5732 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.447106:0:8412:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5732 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.447112:0:8412:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5732 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.447120:0:8412:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5732 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.447131:0:8412:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5732 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.447146:0:8412:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1763343278.447344:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+49:3660:x1848998413020672:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5795us (7061us total) trans 17179872071 rc 0/0 00000100:00100000:1.0:1763343278.447351:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7571 00010000:00010000:1.0:1763343278.447368:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763343278.447374:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5739 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.447381:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343278.447385:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5739 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.447392:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5739 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.447404:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5739 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.447411:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5739 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.447430:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343278.447433:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5732 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.447440:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343278.447443:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5732 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.447450:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5732 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.447457:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343278.447459:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5732 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.447466:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5732 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.447478:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343278.447480:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343278.447482:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343278.447576:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5a3e300/2, rc 0, transno 17179872070 00000100:00100000:3.0:1763343278.447583:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413020160:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1763343278.447593:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5a3ed80/2, rc 0, transno 17179872071 00000100:00100000:3.0:1763343278.447596:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413020672:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343278.448498:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.448570:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400018048 00000100:00100000:2.0:1763343278.448577:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400018048 00010000:00010000:2.0:1763343278.448607:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a5509 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a094 expref: 16 pid: 8413 timeout: 1171 lvb_type: 1 00000100:00100000:2.0:1763343278.448644:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3608 00000100:00100000:2.0:1763343278.448653:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5954a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998400018048:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343278.448667:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343278.448673:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a5509 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a094 expref: 16 pid: 8413 timeout: 1171 lvb_type: 1 00010000:00010000:2.0:1763343278.448684:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a5509 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a094 expref: 16 pid: 8413 timeout: 1171 lvb_type: 1 00010000:00010000:2.0:1763343278.448703:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a5509 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a094 expref: 16 pid: 8413 timeout: 1171 lvb_type: 1 00010000:00010000:2.0:1763343278.448716:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.448718:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.448722:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a572b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.448731:0:6511:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a572b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.448757:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343278.448807:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5954a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998400018048:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 155us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.448814:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3608 00010000:00010000:3.0:1763343278.448948:0:27798:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a572b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.448957:0:27798:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a572b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.448966:0:27798:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a572b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.448974:0:27798:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a572b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343278.449103:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:3.0:1763343278.449381:0:27798:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343278.449536:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400018176 00000100:00100000:1.0:1763343278.449541:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400018176 00000100:00100000:3.0:1763343278.449574:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6276d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+25:3660:x1848998413020288:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8784us (9565us total) trans 21474839340 rc 0/0 00000100:00100000:1.0:1763343278.449577:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7574 00000100:00100000:3.0:1763343278.449581:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7567 00000100:00100000:1.0:1763343278.449584:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:55884:x1848998400018176:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343278.449596:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.449612:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a5763 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a151 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763343278.449620:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c9831880/2, rc 0, transno 21474839340 00000100:00100000:3.0:1763343278.449625:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413020288:0@lo:6:osp-syn-0-1.0 00002000:00010000:1.0:1763343278.449630:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343278.449642:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.449645:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.449651:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a5763 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a151 expref: 16 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.449664:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a5763 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a151 expref: 16 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.449674:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177000, rc 0) 00000100:00100000:1.0:1763343278.449712:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:55884:x1848998400018176:12345-192.168.201.40@tcp:101:bash.0 Request processed in 128us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343278.449719:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7574 00010000:00010000:2.0:1763343278.449845:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343278.449853:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a572b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.449860:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343278.449864:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a572b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.449873:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a572b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.449885:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a572b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.449892:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a572b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.449908:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343278.449909:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343278.449911:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343278.450192:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.450255:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400018304 00000100:00100000:1.0:1763343278.450260:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400018304 00000100:00100000:1.0:1763343278.450304:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7575 00000100:00100000:1.0:1763343278.450312:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998400018304:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343278.450320:0:8626:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.450328:0:8626:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5177800/0x9104b1ba770a576a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a158 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343278.450370:0:8626:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6488380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8626:1848998413021568:192.168.201.40@tcp:106: 00000100:00100000:1.0:1763343278.450437:0:8626:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc523c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343278.451337:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.451402:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400018432 00000100:00100000:2.0:1763343278.451409:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400018432 00000100:00100000:2.0:1763343278.451539:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7576 00000100:00100000:2.0:1763343278.451548:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:55884:x1848998400018432:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343278.451559:0:8412:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.451574:0:8412:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5771 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a15f expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343278.451593:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343278.451609:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.451611:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.451618:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5771 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a15f expref: 28 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.451631:0:8412:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5771 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a15f expref: 28 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.451641:0:8412:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89000, rc 0) 00000100:00100000:2.0:1763343278.451689:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:55884:x1848998400018432:12345-192.168.201.40@tcp:101:bash.0 Request processed in 141us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.451695:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7576 00002000:00010000:1.0:1763343278.452451:0:8626:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x2e4:0x0] updating lvb mtime: 0 -> 1763343277 00002000:00010000:1.0:1763343278.452456:0:8626:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x2e4:0x0] updating lvb atime: 0 -> 1763343277 00002000:00010000:1.0:1763343278.452458:0:8626:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x2e4:0x0] updating lvb ctime: 0 -> 1763343277 00000100:00100000:1.0:1763343278.452472:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6488380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8626:1848998413021568:192.168.201.40@tcp:106: 00010000:00010000:1.0:1763343278.452497:0:8626:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177800/0x9104b1ba770a576a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a158 expref: 17 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343278.452517:0:8626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177800/0x9104b1ba770a576a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a158 expref: 17 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343278.452528:0:8626:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177800, rc 0) 00000100:00100000:1.0:1763343278.452703:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998400018304:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2390us (2510us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343278.452710:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7575 00000100:00100000:0.0:1763343278.454931:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.454974:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.455068:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400018688 00000100:00100000:2.0:1763343278.455078:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400018688 00002000:00010000:2.0:1763343278.455114:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/741 (0->18446744073709551615) 00002000:00100000:2.0:1763343278.455119:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5955880 with x1848998400018688 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343278.455131:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5955880. 00000100:00100000:2.0:1763343278.455147:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400018560 00000100:00100000:2.0:1763343278.455150:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400018560 00002000:00010000:2.0:1763343278.455164:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/740 (0->18446744073709551615) 00002000:00100000:2.0:1763343278.455167:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5956680 with x1848998400018560 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343278.455173:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5956680. 00000100:00100000:2.0:1763343278.455195:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1791 00000100:00100000:2.0:1763343278.455215:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2408:x1848998400018688:12345-192.168.201.40@tcp:10:bash.0 00000100:00100000:3.0:1763343278.455333:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00002000:00010000:2.0:1763343278.455409:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343278.455413:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2e5:0x0] updating lvb mtime from disk: 0 -> 1763343277 00002000:00010000:2.0:1763343278.455415:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2e5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343278.455418:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2e5:0x0] updating lvb ctime from disk: 0 -> 1763343277 00002000:00010000:2.0:1763343278.455420:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2e5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343278.455479:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:2408:x1848998400018688:12345-192.168.201.40@tcp:10:bash.0 Request processed in 275us (555us total) trans 17179872072 rc 0/0 00000100:00100000:2.0:1763343278.455487:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1791 00002000:00010000:2.0:1763343278.455491:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/741 (0->18446744073709551615) 00002000:00100000:2.0:1763343278.455493:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5955880 with x1848998400018688 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343278.455498:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5955880. 00000100:00100000:2.0:1763343278.455513:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1792 00000100:00100000:2.0:1763343278.455520:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998400018560:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:2.0:1763343278.455622:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2e4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343278.455625:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2e4:0x0] updating lvb mtime from disk: 1763343277 -> 1763343277 00002000:00010000:2.0:1763343278.455627:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2e4:0x0] updating lvb atime from disk: 1763343277 -> 0 00002000:00010000:2.0:1763343278.455629:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2e4:0x0] updating lvb ctime from disk: 1763343277 -> 1763343277 00002000:00010000:2.0:1763343278.455631:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2e4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343278.455665:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998400018560:12345-192.168.201.40@tcp:10:bash.0 Request processed in 145us (689us total) trans 21474839341 rc 0/0 00000100:00100000:2.0:1763343278.455672:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1792 00002000:00010000:2.0:1763343278.455675:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/740 (0->18446744073709551615) 00002000:00100000:2.0:1763343278.455678:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5956680 with x1848998400018560 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343278.455682:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5956680. 00000100:00100000:2.0:1763343278.455708:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400018944 00000100:00100000:2.0:1763343278.455712:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400018944 00000100:00100000:2.0:1763343278.455744:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3910 00000100:00100000:2.0:1763343278.455752:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57205:x1848998400018944:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343278.455907:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57205:x1848998400018944:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 155us (573us total) trans 4294973972 rc 0/0 00000100:00100000:2.0:1763343278.455914:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3910 00000100:00100000:3.0:1763343278.459893:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.459955:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400019200 00000100:00100000:1.0:1763343278.459968:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400019200 00000100:00100000:1.0:1763343278.460099:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11060 00000100:00100000:1.0:1763343278.460110:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57205:x1848998400019200:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343278.460135:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.460155:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5778 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x227:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a166 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.460274:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a577f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x227:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343278.460289:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a577f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x227:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.460300:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a577f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x227:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:1.0:1763343278.460313:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x227:0x0]: returning size 2 00010000:00010000:1.0:1763343278.460423:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5778 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x227:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a166 expref: 312 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.460450:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a577f lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x227:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a166 expref: 311 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.460459:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x227:0x0].0x0 (ffff9400c4758a00) 00010000:00010000:1.0:1763343278.460462:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763343278.460465:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176a00, rc 0) 00000100:00100000:1.0:1763343278.461326:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57205:x1848998400019200:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1212us (1437us total) trans 4294973973 rc 0/0 00000100:00100000:1.0:1763343278.461336:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11060 00000100:00100000:1.0:1763343278.464431:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.464509:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400019328 00000100:00100000:2.0:1763343278.464520:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400019328 00000100:00100000:1.0:1763343278.464558:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.464666:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400019584 00000100:00100000:3.0:1763343278.464672:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400019584 00000100:00100000:3.0:1763343278.464727:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11061 00000100:00100000:3.0:1763343278.464737:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57206:x1848998400019584:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:3.0:1763343278.464794:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1763343278.464823:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a577f lrc: 0/0,0 mode: --/PW res: [0x240000404:0x227:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a166 expref: 311 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.464846:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a571d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x227:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a143 expref: 310 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.464857:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a5755 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a14a expref: 309 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.464869:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a56e5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x227:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a135 expref: 308 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.464879:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x227:0x0].0x0 (ffff9400c4758a00) 00010000:00010000:3.0:1763343278.464889:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343278.464918:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a578d lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343278.464931:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a578d lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.464939:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a578d lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.464949:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5794 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343278.464954:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5794 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.464960:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5794 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.465088:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a579b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x227:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343278.465096:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a579b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x227:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.465103:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a579b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x227:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00080000:3.0:1763343278.465355:0:6525:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x227:0x0] is inserted into orphan list, open count = 2 00010000:00010000:3.0:1763343278.465439:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a579b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x227:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.465447:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a579b lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x227:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.465453:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a579b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x227:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.465459:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508b200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343278.465463:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a579b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x227:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.465470:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a579b lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x227:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.465478:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x227:0x0].0x0 (ffff9401fd0d4e00) 00010000:00010000:3.0:1763343278.465481:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763343278.465484:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a579b lrc: 2/0,0 mode: --/EX res: [0x240000404:0x227:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.465494:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508b200/0x9104b1ba770a579b lrc: 0/0,0 mode: --/EX res: [0x240000404:0x227:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.465510:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a578d lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.465515:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a578d lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.465521:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a578d lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.465526:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a578d lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.465531:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508be00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343278.465533:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a578d lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.465539:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a578d lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.465546:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4c00) 00010000:00010000:3.0:1763343278.465548:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343278.465551:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a578d lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.465556:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a578d lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00000004:00010000:3.0:1763343278.465566:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d85a67dc reply state 00000000ad7b1ca7 transno 4294973974 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5794 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.465576:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5794 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.465582:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4900) 00010000:00010000:3.0:1763343278.465584:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343278.465586:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343278.465604:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7577 00000100:00100000:2.0:1763343278.465616:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998400019328:12345-192.168.201.40@tcp:1:lfs.0 00010000:00010000:2.0:1763343278.465642:0:8626:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a57a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.465655:0:8626:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a5763 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a151 expref: 17 pid: 8412 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343278.465662:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57206:x1848998400019584:12345-192.168.201.40@tcp:36:rm.0 Request processed in 928us (1105us total) trans 4294973974 rc 0/0 00010000:00010000:2.0:1763343278.465663:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343278.465665:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343278.465668:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a57a2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343278.465670:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11061 00010000:00010000:2.0:1763343278.465699:0:8626:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a5763 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a151 expref: 17 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.465713:0:8626:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a5763 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a151 expref: 17 pid: 8412 timeout: 1171 lvb_type: 0 00000100:00100000:2.0:1763343278.465727:0:8626:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6275880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8626:1848998413021696:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343278.465776:0:8626:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c53049c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343278.468460:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6275880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8626:1848998413021696:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343278.468490:0:8626:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a57a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343278.469004:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.469166:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400019712 00000100:00100000:0.0:1763343278.469175:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400019712 00002000:00100000:0.0:1763343278.469235:0:28386:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2e4:0x0] (0->4) req@ffff9401edc2d500 x1848998400019712/t0(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:19/0 lens 496/0 e 0 to 0 dl 1763343289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763343278.469245:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401edc2d500 with x1848998400019712 ext(0->4) 00010000:00010000:0.0:1763343278.469253:0:28386:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a5763 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a151 expref: 18 pid: 8412 timeout: 1171 lvb_type: 0 00010000:00010000:0.0:1763343278.469269:0:28386:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a5763 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a151 expref: 18 pid: 8412 timeout: 1171 lvb_type: 0 00002000:00010000:0.0:1763343278.469275:0:28386:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9401edc2d500 00000100:00100000:0.0:1763343278.469299:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 126 00000100:00100000:0.0:1763343278.469309:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998400019712:12345-192.168.201.40@tcp:4:bash.0 00000100:00100000:0.0:1763343278.471089:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2408:x1848998400019712:12345-192.168.201.40@tcp:4:bash.0 Request processed in 1773us (2078us total) trans 21474839342 rc 0/0 00000100:00100000:0.0:1763343278.471102:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 126 00002000:00100000:0.0:1763343278.471112:0:28386:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2e4:0x0] (0->4) req@ffff9401edc2d500 x1848998400019712/t21474839342(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:19/0 lens 496/448 e 0 to 0 dl 1763343289 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763343278.471127:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401edc2d500 with x1848998400019712 ext(0->4) 00010000:00010000:0.0:1763343278.471135:0:28386:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a5763 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a151 expref: 20 pid: 8412 timeout: 1171 lvb_type: 0 00010000:00010000:0.0:1763343278.471151:0:28386:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a5763 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a151 expref: 20 pid: 8412 timeout: 1171 lvb_type: 0 00002000:00010000:0.0:1763343278.471158:0:28386:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9401edc2d500 00000100:00100000:0.0:1763343278.477231:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.477353:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400019840 00000100:00100000:2.0:1763343278.477364:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400019840 00010000:00010000:2.0:1763343278.477407:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a5763 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a151 expref: 20 pid: 8412 timeout: 1171 lvb_type: 0 00000100:00100000:2.0:1763343278.478218:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3609 00000100:00100000:2.0:1763343278.478232:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2410:x1848998400019840:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343278.478249:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1763343278.478267:0:35278:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2e4:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:2.0:1763343278.478282:0:35278:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2e4:0x0] updating lvb atime from disk: 0 -> 1763343277 00002000:00010000:2.0:1763343278.478285:0:35278:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2e4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1763343278.478291:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a5763 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a151 expref: 20 pid: 8412 timeout: 1171 lvb_type: 0 00010000:00010000:2.0:1763343278.478306:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a5763 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a151 expref: 20 pid: 8412 timeout: 1171 lvb_type: 0 00010000:00010000:2.0:1763343278.478332:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a5763 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a151 expref: 20 pid: 8412 timeout: 1171 lvb_type: 0 00010000:00010000:2.0:1763343278.478348:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.478350:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.478355:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a57a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.478370:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a57a2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.478409:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343278.478448:0:8626:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a57a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.478460:0:8626:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a57a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343278.478475:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2410:x1848998400019840:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 246us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.478484:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3609 00010000:00010000:1.0:1763343278.479166:0:8626:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a57a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.479178:0:8626:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a57a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.479186:0:8626:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a57a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.480237:0:8626:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343278.480242:0:8626:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a57a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.480252:0:8626:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a57a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.480478:0:8626:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a57a2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.480486:0:8626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a57a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343278.480567:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.480634:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400019968 00000100:00100000:2.0:1763343278.480644:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400019968 00000100:00100000:1.0:1763343278.480750:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2407:x1848998400019328:12345-192.168.201.40@tcp:1:lfs.0 Request processed in 15136us (16327us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343278.480761:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7577 00000100:00100000:2.0:1763343278.481052:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11062 00000100:00100000:2.0:1763343278.481063:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57207:x1848998400019968:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343278.481085:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.481105:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88400/0x9104b1ba770a57a9 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a16d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.481472:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a57b0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343278.481485:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a57b0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.481495:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a57b0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.481505:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a57b7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343278.481512:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a57b7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.481521:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a57b7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.481562:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a57b0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.481570:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a57b0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.481575:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a57b0 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.481580:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a57b0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.481586:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.481589:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a57b0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.481595:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a57b0 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.481606:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c6733200) 00010000:00010000:2.0:1763343278.481610:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.481613:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a57b0 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.481619:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a57b0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.481630:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a57b7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.481635:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a57b7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.481640:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a57b7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.481644:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.481647:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a57b7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.481652:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a57b7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.481657:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4900) 00010000:00010000:2.0:1763343278.481659:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.481662:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a57b7 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.481666:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a57b7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.481693:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88400/0x9104b1ba770a57a9 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a16d expref: 310 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.481702:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c6733200) 00010000:00010000:2.0:1763343278.481704:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.481707:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88400/0x9104b1ba770a57a9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a16d expref: 310 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.481718:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88400, rc 0) 00000100:00100000:2.0:1763343278.481765:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57207:x1848998400019968:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 705us (1203us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343278.481772:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11062 00000100:00100000:3.0:1763343278.483946:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.484001:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.484154:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400020224 00000100:00100000:2.0:1763343278.484165:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400020224 00000100:00100000:0.0:1763343278.484181:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400020352 00000100:00100000:0.0:1763343278.484188:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400020352 00000100:00100000:2.0:1763343278.484225:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11063 00000100:00100000:2.0:1763343278.484237:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57205:x1848998400020224:12345-192.168.201.40@tcp:36:lfs.0 00000100:00100000:0.0:1763343278.484244:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11064 00000100:00100000:0.0:1763343278.484255:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57207:x1848998400020352:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343278.484267:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.484289:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a57be lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a174 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.484345:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a57c5 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00000100:00100000:2.0:1763343278.484354:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57205:x1848998400020224:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 120us (414us total) trans 0 rc -116/-116 00010000:00010000:0.0:1763343278.484358:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a57c5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00000100:00100000:2.0:1763343278.484365:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11063 00010000:00010000:0.0:1763343278.484388:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a57c5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.484400:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a57cc lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343278.484407:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a57cc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.484413:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a57cc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.484457:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a57c5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.484463:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a57c5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.484469:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a57c5 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.484474:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a57c5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.484481:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ac00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.484484:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a57c5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.484490:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a57c5 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.484501:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48aab00) 00010000:00010000:0.0:1763343278.484504:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.484507:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a57c5 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.484513:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a57c5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.484524:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a57cc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.484529:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a57cc lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.484535:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a57cc lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.484540:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ae00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.484543:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a57cc lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.484548:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a57cc lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.484555:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4900) 00010000:00010000:0.0:1763343278.484557:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.484560:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a57cc lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.484566:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a57cc lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.484595:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a57be lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a174 expref: 310 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.484604:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48aab00) 00010000:00010000:0.0:1763343278.484607:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.484610:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a57be lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a174 expref: 310 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.484621:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b800, rc 0) 00000100:00100000:0.0:1763343278.484664:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57207:x1848998400020352:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 411us (662us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343278.484670:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11064 00000100:00100000:3.0:1763343278.486637:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.486685:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400020608 00000100:00100000:2.0:1763343278.486695:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400020608 00000100:00100000:2.0:1763343278.486745:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3911 00000100:00100000:2.0:1763343278.486754:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57205:x1848998400020608:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343278.487542:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57205:x1848998400020608:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 784us (909us total) trans 4294973975 rc 0/0 00000100:00100000:2.0:1763343278.487552:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3911 00000100:00100000:1.0:1763343278.488382:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.488552:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400020736 00000100:00100000:2.0:1763343278.488559:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400020736 00000100:00100000:2.0:1763343278.488605:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11065 00000100:00100000:2.0:1763343278.488614:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57207:x1848998400020736:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343278.488629:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.488652:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a57d3 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a17b expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.489153:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a57da lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.489166:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a57da lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.489181:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a57da lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:2.0:1763343278.489231:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763343278.489236:0:33856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763343278.489267:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a57d3 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a17b expref: 312 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.489285:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a57da lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a17b expref: 311 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.489663:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c6733800) 00010000:00010000:2.0:1763343278.489667:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763343278.489672:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88800, rc 0) 00000100:00100000:3.0:1763343278.490927:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.491104:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400020992 00000100:00100000:0.0:1763343278.491114:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400020992 00000100:00100000:0.0:1763343278.491166:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3912 00000100:00100000:0.0:1763343278.491175:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57205:x1848998400020992:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:0.0:1763343278.491425:0:6527:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x227:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763343278.491496:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1826, 64 off151504 00000040:00080000:0.0:1763343278.491522:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1835, 64 off152264 00000040:00080000:0.0:1763343278.491533:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1836, 64 off152328 00000040:00080000:0.0:1763343278.491545:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1827, 64 off151568 00010000:00010000:0.0:1763343278.491602:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a57e1 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x227:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343278.491617:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a57e1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x227:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343278.491626:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a57e1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x227:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343278.491633:0:6527:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a57e1 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x227:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343278.491639:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a57e1 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x227:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343278.491644:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a57e1 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x227:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343278.491671:0:6527:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343278.491812:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57207:x1848998400020736:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3196us (3431us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.491821:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11065 00000100:00100000:0.0:1763343278.491850:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57205:x1848998400020992:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 675us (927us total) trans 4294973976 rc 0/0 00000100:00100000:0.0:1763343278.491858:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3912 00010000:00010000:1.0:1763343278.492244:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343278.492251:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a57e1 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x227:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343278.492258:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343278.492262:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a57e1 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x227:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343278.492270:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a57e1 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x227:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343278.492287:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x227:0x0].0x0 (ffff9400c48aa600) 00010000:00010000:1.0:1763343278.492290:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763343278.492294:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a57e1 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x227:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343278.492299:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a57e1 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x227:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT1 00010000:00010000:1.0:1763343278.492315:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343278.492317:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343278.492318:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343278.495726:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.495916:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400021120 00000100:00100000:2.0:1763343278.495926:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400021120 00000100:00100000:2.0:1763343278.495983:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11066 00000100:00100000:2.0:1763343278.495993:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57207:x1848998400021120:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343278.496018:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.496067:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88400/0x9104b1ba770a57e8 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a182 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.496133:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a57ef lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.496150:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a57ef lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.496162:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a57ef lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.496171:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a57f6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.496178:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a57f6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.496184:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a57f6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.496229:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a57ef lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.496565:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a57ef lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.496572:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a57ef lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.496577:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.496581:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a57ef lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.496588:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a57ef lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.496600:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c6733800) 00010000:00010000:2.0:1763343278.496603:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.496607:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a57ef lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.496612:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a57ef lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.496624:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a57f6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.496629:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a57f6 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.496635:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a57f6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.496639:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.496641:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a57f6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.496646:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a57f6 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.496653:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4900) 00010000:00010000:2.0:1763343278.496655:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.496658:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a57f6 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.496663:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a57f6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.496690:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88400/0x9104b1ba770a57e8 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a182 expref: 313 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.496698:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c6733800) 00010000:00010000:2.0:1763343278.496701:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.496704:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88400/0x9104b1ba770a57e8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a182 expref: 313 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.496713:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88400, rc 0) 00000100:00100000:2.0:1763343278.496782:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57207:x1848998400021120:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 791us (1063us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343278.496790:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11066 00000100:00100000:1.0:1763343278.501664:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.501827:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400021376 00000100:00100000:2.0:1763343278.501838:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400021376 00000100:00100000:0.0:1763343278.504714:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11067 00000100:00100000:0.0:1763343278.504741:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57207:x1848998400021376:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343278.504765:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.504769:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343278.504796:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a57da lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a17b expref: 312 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.504817:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c6733800) 00010000:00010000:0.0:1763343278.504826:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343278.504844:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a57fd lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a189 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.504954:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5804 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343278.504967:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5804 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.504975:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5804 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.504985:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a580b lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343278.504992:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a580b lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.504998:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a580b lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.505403:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5812 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x228:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343278.505413:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5812 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.505420:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5812 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:0.0:1763343278.505429:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x228:0x0]: returning size 0 00010000:00010000:0.0:1763343278.505453:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5804 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.505459:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5804 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.505464:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5804 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.505470:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ae00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.505473:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5804 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.505480:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5804 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.505487:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48aab00) 00010000:00010000:0.0:1763343278.505491:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.505494:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5804 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.505500:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5804 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:0.0:1763343278.505511:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000221a220d reply state 0000000039a86c6b transno 4294973977 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a580b lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.505521:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a580b lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.505531:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4900) 00010000:00010000:0.0:1763343278.505534:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343278.505536:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343278.505563:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a57fd lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a189 expref: 314 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.505579:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5812 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a189 expref: 313 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.505586:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x228:0x0].0x0 (ffff9400c48aad00) 00010000:00010000:0.0:1763343278.505589:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343278.505591:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a600, rc 0) 00000100:00100000:0.0:1763343278.505660:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57207:x1848998400021376:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 933us (4006us total) trans 4294973977 rc 0/0 00000100:00100000:0.0:1763343278.505668:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11067 00000100:00100000:3.0:1763343278.510506:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.511749:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400021888 00000100:00100000:0.0:1763343278.511761:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400021888 00000100:00100000:0.0:1763343278.511831:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11068 00000100:00100000:0.0:1763343278.511843:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57207:x1848998400021888:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343278.511872:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.511895:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5820 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x228:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a197 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.512003:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a5827 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x228:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343278.512018:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5812 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a189 expref: 315 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.512048:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a5827 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x228:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.512084:0:33856:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5812 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a189 expref: 315 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.512097:0:33856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5812 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a189 expref: 315 pid: 33856 timeout: 1171 lvb_type: 0 00000100:00100000:0.0:1763343278.512110:0:33856:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c511ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998413021824:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343278.512211:0:33856:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1763343278.512300:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.515462:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400021760 00000100:00100000:0.0:1763343278.515478:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400021760 00000100:00100000:0.0:1763343278.515552:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11069 00000100:00100000:0.0:1763343278.515565:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57208:x1848998400021760:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343278.515587:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.515613:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a582e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x228:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a190 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.515720:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5835 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x228:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343278.515735:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5835 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.515748:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5835 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:0.0:1763343278.515759:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x228:0x0]: returning size 0 00010000:00010000:0.0:1763343278.515845:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5835 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.515852:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5835 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.515858:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5835 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.515864:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.515868:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5835 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.515875:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5835 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.515886:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x228:0x0].0x0 (ffff9400c48aad00) 00010000:00010000:0.0:1763343278.515889:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763343278.515893:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5835 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x228:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.515899:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5835 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x228:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.515944:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a582e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x228:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a190 expref: 318 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.515955:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x228:0x0].0x0 (ffff9400c48aad00) 00010000:00010000:0.0:1763343278.515958:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343278.515961:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a582e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x228:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a190 expref: 318 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.515971:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b400, rc 0) 00000100:00100000:0.0:1763343278.516063:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57208:x1848998400021760:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 501us (3764us total) trans 4294973978 rc 301/301 00000100:00100000:0.0:1763343278.516071:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11069 00000100:00100000:3.0:1763343278.516603:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.516625:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400022016 00000100:00100000:3.0:1763343278.516631:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400022016 00010000:00010000:3.0:1763343278.516654:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5812 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a189 expref: 317 pid: 33856 timeout: 1171 lvb_type: 0 00000100:00100000:3.0:1763343278.516685:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3610 00000100:00100000:3.0:1763343278.516693:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6401500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:2408:x1848998400022016:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343278.516703:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343278.516709:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5812 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a189 expref: 317 pid: 33856 timeout: 1171 lvb_type: 0 00010000:00010000:3.0:1763343278.516719:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5812 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a189 expref: 317 pid: 33856 timeout: 1171 lvb_type: 0 00010000:00010000:3.0:1763343278.516739:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x228:0x0].0x0 (ffff9400c48aad00) 00010000:00010000:3.0:1763343278.516743:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a5827 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x228:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.516750:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a5827 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x228:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.516756:0:6511:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a5827 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x228:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.516771:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343278.516798:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6401500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:2408:x1848998400022016:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 107us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343278.516805:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3610 00010000:00010000:0.0:1763343278.517525:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5812 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a189 expref: 316 pid: 33856 timeout: 1171 lvb_type: 0 00000100:00100000:0.0:1763343278.517543:0:33856:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c511ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998413021824:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343278.517565:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a5827 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x228:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.517581:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a5827 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x228:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.517587:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a5827 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x228:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:0.0:1763343278.517610:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x228:0x0]: returning size 0 00000004:00080000:0.0:1763343278.517781:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2e7:0x0], index 1: 0 00000004:00080000:0.0:1763343278.517788:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2e6:0x0], index 0: 0 00000004:00080000:0.0:1763343278.517793:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2e7:0x0], index 0: 0 00000004:00080000:0.0:1763343278.517796:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2e8:0x0], index 1: 0 00010000:00010000:0.0:1763343278.517886:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a5827 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x228:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.517893:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a5827 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x228:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.517899:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a5827 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x228:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.517904:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501be00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.517908:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a5827 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x228:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.517914:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a5827 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x228:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.517926:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x228:0x0].0x0 (ffff9400c48aad00) 00010000:00010000:0.0:1763343278.517928:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343278.517932:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a5827 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x228:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.517938:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a5827 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x228:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.517981:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5820 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x228:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a197 expref: 316 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.517992:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x228:0x0].0x0 (ffff9400c48aad00) 00010000:00010000:0.0:1763343278.517994:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343278.517997:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5820 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x228:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a197 expref: 316 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.518010:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a800, rc 0) 00000100:00100000:0.0:1763343278.518097:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57207:x1848998400021888:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 6254us (7598us total) trans 4294973979 rc 301/301 00000100:00100000:0.0:1763343278.518105:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11068 00000100:00100000:2.0:1763343278.523504:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.523596:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.523656:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400022400 00000100:00100000:0.0:1763343278.523665:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400022400 00000100:00100000:0.0:1763343278.523723:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11070 00000100:00100000:0.0:1763343278.523734:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57208:x1848998400022400:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343278.523760:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.523786:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a584a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x228:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a19e expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.523883:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5851 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x228:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343278.523897:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5851 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.523908:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5851 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:0.0:1763343278.523935:0:33856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343278.523953:0:33856:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5851 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.523977:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a584a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x228:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a19e expref: 317 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.523995:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5851 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a19e expref: 316 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.524003:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x228:0x0].0x0 (ffff9400c48aab00) 00010000:00010000:0.0:1763343278.524007:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343278.524011:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501ae00, rc 0) 00000100:00100000:0.0:1763343278.524109:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57208:x1848998400022400:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 376us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343278.524117:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11070 00000100:00100000:3.0:1763343278.524379:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400022272 00000100:00100000:3.0:1763343278.524385:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400022272 00000100:00100000:3.0:1763343278.524424:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3913 00000100:00100000:3.0:1763343278.524432:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82d4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57207:x1848998400022272:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343278.524631:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82d4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57207:x1848998400022272:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 199us (1138us total) trans 4294973980 rc 0/0 00000100:00100000:3.0:1763343278.524638:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3913 00000100:00100000:2.0:1763343278.526068:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.526098:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.526172:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400022528 00000100:00100000:1.0:1763343278.526181:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400022528 00000100:00100000:1.0:1763343278.526251:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7578 00000100:00100000:1.0:1763343278.526261:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998400022528:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343278.526276:0:8626:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.526295:0:8626:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a5858 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a1a5 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343278.526316:0:8626:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343278.526335:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.526338:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.526348:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a5858 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1a5 expref: 19 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343278.526363:0:8626:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a5858 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1a5 expref: 19 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343278.526380:0:8626:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177000, rc 0) 00000100:00100000:1.0:1763343278.526427:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2408:x1848998400022528:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 167us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343278.526433:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7578 00000100:00100000:0.0:1763343278.526511:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400022784 00000100:00100000:0.0:1763343278.526516:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400022784 00000100:00100000:0.0:1763343278.526543:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3914 00000100:00100000:0.0:1763343278.526549:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57207:x1848998400022784:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343278.526691:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+318:57207:x1848998400022784:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 141us (591us total) trans 4294973981 rc 0/0 00000100:00100000:0.0:1763343278.526698:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3914 00000100:00100000:3.0:1763343278.526922:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.527046:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400022912 00000100:00100000:1.0:1763343278.527051:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400022912 00000100:00100000:1.0:1763343278.527081:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7579 00000100:00100000:1.0:1763343278.527087:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:2407:x1848998400022912:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343278.527096:0:8626:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.527108:0:8626:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a585f lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a1ac expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343278.527124:0:8626:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343278.527134:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.527136:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.527141:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a585f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1ac expref: 30 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343278.527155:0:8626:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a585f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1ac expref: 30 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343278.527164:0:8626:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177800, rc 0) 00000100:00100000:1.0:1763343278.527189:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+30:2407:x1848998400022912:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 102us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343278.527195:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7579 00000100:00100000:3.0:1763343278.530951:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.532289:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400023168 00000100:00100000:2.0:1763343278.532482:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.532536:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400023168 00000100:00100000:0.0:1763343278.532638:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400023424 00000100:00100000:0.0:1763343278.532643:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400023424 00000100:00100000:0.0:1763343278.532691:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11071 00000100:00100000:0.0:1763343278.532702:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:55884:x1848998400023424:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343278.532727:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.532752:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5866 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a1b3 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.532883:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a586d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343278.532897:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a586d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.532909:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a586d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.532919:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5874 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343278.532926:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5874 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.532931:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5874 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.532986:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a587b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x228:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343278.532994:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a587b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.533001:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a587b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:0.0:1763343278.533011:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x228:0x0]: returning size 0 00000100:00100000:1.0:1763343278.533331:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3915 00000100:00100000:1.0:1763343278.533341:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:57208:x1848998400023168:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343278.533465:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+322:57208:x1848998400023168:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 126us (2525us total) trans 4294973983 rc 0/0 00000100:00100000:1.0:1763343278.533473:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3915 00010000:00010000:0.0:1763343278.533693:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a586d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.533701:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a586d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.533707:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a586d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.533713:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a586d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.533719:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501be00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.533723:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a586d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.533730:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a586d lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.533742:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48aad00) 00010000:00010000:0.0:1763343278.533745:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.533749:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a586d lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.533759:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a586d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.533772:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5874 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.533777:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5874 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.533783:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5874 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.533788:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.533790:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5874 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.533795:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5874 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.533801:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4900) 00010000:00010000:0.0:1763343278.533804:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.533806:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5874 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.533811:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5874 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.533844:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5866 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1b3 expref: 322 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.533859:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a587b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1b3 expref: 321 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.533871:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x228:0x0].0x0 (ffff9400c48aab00) 00010000:00010000:0.0:1763343278.533874:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343278.533876:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b400, rc 0) 00000100:00100000:0.0:1763343278.534625:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:55884:x1848998400023424:12345-192.168.201.40@tcp:101:bash.0 Request processed in 1922us (2142us total) trans 4294973982 rc 0/0 00000100:00100000:0.0:1763343278.534634:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11071 00000100:00100000:3.0:1763343278.541009:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.541089:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.541135:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.541171:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400023680 00000100:00100000:3.0:1763343278.541182:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400023680 00000100:00100000:0.0:1763343278.541216:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400023936 00000100:00100000:0.0:1763343278.541223:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400023936 00000100:00100000:3.0:1763343278.541262:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 458 00000100:00100000:3.0:1763343278.541273:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+322:2409:x1848998400023680:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343278.541289:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343278.541320:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a587b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1b3 expref: 322 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.541339:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x228:0x0].0x0 (ffff9400c48aab00) 00010000:00010000:3.0:1763343278.541345:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343278.541393:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:2409:x1848998400023680:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 122us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343278.541401:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 458 00000100:00100000:0.0:1763343278.541509:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400023552 00000100:00100000:0.0:1763343278.541513:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400023552 00000100:00100000:0.0:1763343278.541558:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11072 00000100:00100000:0.0:1763343278.541567:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:57208:x1848998400023936:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343278.541588:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.541605:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a5889 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x228:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a1c1 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343278.541609:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11073 00000100:00100000:2.0:1763343278.541624:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+322:55884:x1848998400023552:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343278.541634:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.541645:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5890 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x228:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a1ba expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.541672:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a5897 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x228:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343278.541686:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a5897 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.541698:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a5897 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.541712:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a589e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x228:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343278.541723:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a589e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x228:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.541731:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a589e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x228:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:0.0:1763343278.541741:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x228:0x0]: returning size 0 00010000:00010000:0.0:1763343278.541856:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a5889 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x228:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1c1 expref: 325 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.541875:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a589e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x228:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1c1 expref: 324 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.541881:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x228:0x0].0x0 (ffff9400c48aab00) 00010000:00010000:0.0:1763343278.541884:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1763343278.541887:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a400, rc 0) 00000100:00100000:0.0:1763343278.541927:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+324:57208:x1848998400023936:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 362us (929us total) trans 4294973984 rc 0/0 00000100:00100000:0.0:1763343278.541934:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11072 00010000:00010000:0.0:1763343278.541981:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5890 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x228:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1ba expref: 324 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.541994:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a5897 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1ba expref: 323 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.542001:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x228:0x0].0x0 (ffff9400c48aab00) 00010000:00010000:0.0:1763343278.542004:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343278.542006:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89400, rc 0) 00000100:00100000:0.0:1763343278.542062:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:55884:x1848998400023552:12345-192.168.201.40@tcp:101:bash.0 Request processed in 442us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343278.542069:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11073 00000100:00100000:2.0:1763343278.549959:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.550006:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.550133:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400024064 00000100:00100000:1.0:1763343278.550144:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400024064 00000100:00100000:1.0:1763343278.550233:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3916 00000100:00100000:1.0:1763343278.550244:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:57208:x1848998400024064:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:1.0:1763343278.550409:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:57208:x1848998400024064:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 165us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343278.550417:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3916 00000100:00100000:3.0:1763343278.550965:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400024320 00000100:00100000:3.0:1763343278.550972:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400024320 00000100:00100000:3.0:1763343278.551512:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11074 00000100:00100000:3.0:1763343278.551524:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:55884:x1848998400024320:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:3.0:1763343278.551569:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343278.551593:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5851 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a19e expref: 323 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.551611:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x228:0x0].0x0 (ffff9400c48aab00) 00010000:00010000:3.0:1763343278.551722:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343278.551885:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a58ac lrc: 3/0,1 mode: --/PW res: [0x240000404:0x228:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343278.551900:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a58ac lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x228:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.551910:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a58ac lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x228:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000001:00080000:3.0:1763343278.551955:0:7641:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294973985 00000004:00010000:3.0:1763343278.551978:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f2aca2e8 reply state 00000000b2c37df7 transno 4294973986 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a58ac lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x228:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.551989:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a58ac lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x228:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.551994:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x228:0x0].0x0 (ffff9400c48aab00) 00010000:00010000:3.0:1763343278.551998:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343278.552000:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343278.552100:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+325:55884:x1848998400024320:12345-192.168.201.40@tcp:36:bash.0 Request processed in 579us (2093us total) trans 4294973986 rc 0/0 00000100:00100000:3.0:1763343278.552107:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11074 00000020:00080000:3.0:1763343278.552321:0:7641:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763343278.556061:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.556165:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400024576 00000100:00100000:0.0:1763343278.556176:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400024576 00000100:00100000:0.0:1763343278.556400:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3917 00000100:00100000:0.0:1763343278.556411:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+325:55884:x1848998400024576:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:0.0:1763343278.556640:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+326:55884:x1848998400024576:12345-192.168.201.40@tcp:35:bash.0 Request processed in 230us (626us total) trans 4294973987 rc 0/0 00000100:00100000:0.0:1763343278.556649:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3917 00000100:00100000:0.0:1763343278.566771:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.566816:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.567395:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400024832 00000100:00100000:3.0:1763343278.567400:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400025088 00000100:00100000:1.0:1763343278.567405:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400024832 00000100:00100000:3.0:1763343278.567406:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400025088 00000100:00100000:0.0:1763343278.568263:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11075 00000100:00100000:2.0:1763343278.568273:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11076 00000100:00100000:0.0:1763343278.568277:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c511ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+327:55884:x1848998400024832:12345-192.168.201.40@tcp:101:bash.0 00000100:00100000:2.0:1763343278.568281:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c511d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+327:57209:x1848998400025088:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343278.568300:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.568300:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.568304:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343278.568324:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a58b3 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a1cf expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.568328:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a589e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x228:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1c1 expref: 327 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.568344:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x228:0x0].0x0 (ffff9400c48aab00) 00010000:00010000:0.0:1763343278.568349:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343278.568355:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a58ba lrc: 2/0,0 mode: --/EX res: [0x240000404:0x228:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a1c8 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.568391:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a58c1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x228:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343278.568392:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a58c8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343278.568404:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a58c8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.568404:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a58c1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x228:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.568414:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a58c8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.568414:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a58c1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x228:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.568423:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a58cf lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343278.568430:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a58cf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.568435:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a58cf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.568520:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a58d6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x228:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343278.568529:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a58d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.568536:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a58d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343278.568545:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x228:0x0]: returning size 0 00000040:00080000:0.0:1763343278.570527:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1837, 88 off152416 00000004:00080000:0.0:1763343278.570547:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1071694522092ns, next at 1072111826735ns, rc = 0 00000040:00080000:0.0:1763343278.570607:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1828, 88 off151656 00000004:00080000:0.0:1763343278.570612:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1071694587562ns, next at 1072111852630ns, rc = 0 00000040:00080000:0.0:1763343278.570660:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1829, 88 off151744 00000004:00080000:0.0:1763343278.570664:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1071694639806ns, next at 1072111852630ns, rc = 0 00000040:00080000:0.0:1763343278.570675:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1838, 88 off152504 00000004:00080000:0.0:1763343278.570679:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1071694654016ns, next at 1072111826735ns, rc = 0 00010000:00010000:3.0:1763343278.571858:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a58d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.571872:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a58d6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.571879:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a58d6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.571885:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343278.571890:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a58d6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.571897:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a58d6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.571917:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x228:0x0].0x0 (ffff9400c48aab00) 00010000:00010000:3.0:1763343278.571920:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1763343278.571925:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a58d6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x228:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.571931:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a58d6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x228:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.571950:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a58c8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.571957:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a58c8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.571963:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a58c8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.571969:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a58c8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.571979:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343278.571982:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a58c8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.571987:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a58c8 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.571994:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c6733200) 00010000:00010000:3.0:1763343278.571997:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343278.572000:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a58c8 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.572005:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a58c8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.572016:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a58cf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.572021:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a58cf lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.572054:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a58cf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.572059:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343278.572062:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a58cf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.572067:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a58cf lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.572074:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4900) 00010000:00010000:3.0:1763343278.572077:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343278.572080:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a58cf lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.572085:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a58cf lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343278.572133:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a58b3 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1cf expref: 330 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.572144:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c6733200) 00010000:00010000:3.0:1763343278.572147:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343278.572151:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a58b3 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1cf expref: 330 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.572171:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88000, rc 0) 00000100:00100000:3.0:1763343278.572255:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c511d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+329:57209:x1848998400025088:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3972us (5437us total) trans 4294973989 rc 301/301 00000100:00100000:3.0:1763343278.572264:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11076 00010000:00010000:1.0:1763343278.573940:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5794 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.573954:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5794 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.573961:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5794 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.573967:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508aa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.573972:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5794 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.573982:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5794 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.573997:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4900) 00010000:00010000:1.0:1763343278.574000:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.574004:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5794 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.574010:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5794 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.574470:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a580b lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.574478:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a580b lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.574483:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a580b lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.574488:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ac00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.574491:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a580b lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.574497:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a580b lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.574505:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4900) 00010000:00010000:1.0:1763343278.574507:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.574510:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a580b lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.574514:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a580b lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.574534:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a58ac lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x228:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.574540:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a58ac lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x228:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.574544:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a58ac lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x228:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.574549:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fd2dfa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.574552:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a58ac lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x228:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.574558:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a58ac lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x228:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.574564:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x228:0x0].0x0 (ffff9400c48aab00) 00010000:00010000:1.0:1763343278.574566:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.574569:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a58ac lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x228:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.574574:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a58ac lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x228:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000001:00080000:0.0:1763343278.574644:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294973988 is committed 00000004:00080000:0.0:1763343278.574652:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1178 committed 00000004:00080000:0.0:1763343278.574670:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1170 committed 00000004:00080000:0.0:1763343278.574683:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1169 committed 00000004:00080000:0.0:1763343278.574686:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1177 committed 00010000:00010000:0.0:1763343278.574771:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a58c1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x228:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1c8 expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.574780:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x228:0x0].0x0 (ffff9400c48aab00) 00010000:00010000:0.0:1763343278.574782:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343278.574794:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a58ba lrc: 0/0,0 mode: --/EX res: [0x240000404:0x228:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1c8 expref: 308 pid: 6525 timeout: 0 lvb_type: 3 00000100:00100000:3.0:1763343278.574807:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6401500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413021952:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1763343278.574808:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a58c1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x228:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1c8 expref: 307 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.574836:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x228:0x0].0x0 (ffff9400c48aab00) 00010000:00010000:0.0:1763343278.574838:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343278.574840:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501be00, rc 0) 00000100:00100000:2.0:1763343278.575003:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413022208:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343278.575126:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343278.575325:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343278.575353:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413022720:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343278.575376:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343278.575395:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1763343278.575401:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413022336:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343278.575418:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343278.575431:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413022848:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343278.575448:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343278.575478:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413021952 00000100:00100000:2.0:1763343278.575485:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413021952 00000100:00100000:2.0:1763343278.575524:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413022208 00000100:00100000:2.0:1763343278.575527:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413022208 00000100:00100000:2.0:1763343278.575543:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413022720 00000100:00100000:2.0:1763343278.575546:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413022720 00000100:00100000:2.0:1763343278.575559:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413022336 00000100:00100000:2.0:1763343278.575562:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413022336 00000100:00100000:2.0:1763343278.575572:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413022848 00000100:00100000:2.0:1763343278.575574:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413022848 00000100:00100000:2.0:1763343278.575590:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7580 00000100:00100000:2.0:1763343278.575597:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+51:3659:x1848998413021952:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763343278.575622:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:741 count 1 00010000:00010000:2.0:1763343278.575645:0:8413:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a58e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.575668:0:8413:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5771 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a15f expref: 29 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.575676:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343278.575678:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343278.575681:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a58e4 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.575708:0:8413:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5771 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a15f expref: 29 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.575722:0:8413:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5771 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a15f expref: 29 pid: 8412 timeout: 1171 lvb_type: 0 00000100:00100000:2.0:1763343278.575734:0:8413:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c517ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8413:1848998413022976:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343278.575790:0:8413:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c53049c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343278.575807:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7581 00000100:00100000:2.0:1763343278.575815:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edde5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+51:3661:x1848998413022208:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343278.575969:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edde5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+52:3661:x1848998413022208:12345-0@lo:2:osp-syn-1-1.0 Request processed in 154us (642us total) trans 17179872073 rc 0/0 00000100:00100000:2.0:1763343278.575976:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7581 00000100:00100000:2.0:1763343278.575995:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7582 00000100:00100000:2.0:1763343278.576002:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5178000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+26:3661:x1848998413022720:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343278.576129:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413022464:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763343278.576133:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5178000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+27:3661:x1848998413022720:12345-0@lo:2:osp-syn-0-1.0 Request processed in 133us (756us total) trans 21474839343 rc 0/0 00000100:00100000:2.0:1763343278.576142:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7582 00000100:00100000:3.0:1763343278.576153:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343278.576155:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7583 00000100:00100000:2.0:1763343278.576160:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+51:3661:x1848998413022336:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343278.576165:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1763343278.576170:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413022080:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343278.576190:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343278.576213:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413022592:0@lo:6:osp-syn-0-1.0 00002000:00010000:2.0:1763343278.576225:0:8414:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2e8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343278.576228:0:8414:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2e8:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763343278.576231:0:8414:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2e8:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:3.0:1763343278.576233:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1763343278.576233:0:8414:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2e8:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763343278.576236:0:8414:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2e8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343278.576256:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+52:3661:x1848998413022336:12345-0@lo:2:osp-syn-1-1.0 Request processed in 96us (837us total) trans 17179872074 rc 0/0 00000100:00100000:2.0:1763343278.576261:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7583 00000100:00100000:2.0:1763343278.576271:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413022464 00000100:00100000:2.0:1763343278.576274:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413022464 00000100:00100000:3.0:1763343278.576281:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413022080 00000100:00100000:3.0:1763343278.576284:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413022080 00000100:00100000:2.0:1763343278.576286:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413022592 00000100:00100000:2.0:1763343278.576288:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413022592 00000100:00100000:2.0:1763343278.576297:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7584 00000100:00100000:3.0:1763343278.576300:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7585 00000100:00100000:2.0:1763343278.576301:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+28:3661:x1848998413022848:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343278.576305:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+28:3659:x1848998413022464:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343278.576315:0:35281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:740 count 1 00002000:00010000:3.0:1763343278.576334:0:35281:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2e4:0x0] initial LVB size: 5, mtime: 0x691a7bad, atime: 0x691a7bad, ctime: 0x691a7bad, blocks: 0x8 00010000:00010000:3.0:1763343278.576340:0:35281:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401fd2dea00/0x9104b1ba770a58eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343278.576347:0:8414:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2e7:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:3.0:1763343278.576348:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00002000:00010000:2.0:1763343278.576349:0:8414:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2e7:0x0] updating lvb mtime from disk: 0 -> 0 00010000:00010000:3.0:1763343278.576350:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00002000:00010000:2.0:1763343278.576351:0:8414:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2e7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343278.576353:0:8414:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2e7:0x0] updating lvb ctime from disk: 0 -> 0 00010000:00010000:3.0:1763343278.576354:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401fd2dea00/0x9104b1ba770a58eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343278.576355:0:8414:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2e7:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:3.0:1763343278.576367:0:35281:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401fd2dea00/0x9104b1ba770a58eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.576377:0:35281:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401fd2dea00/0x9104b1ba770a58eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343278.576377:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+29:3661:x1848998413022848:12345-0@lo:2:osp-syn-0-1.0 Request processed in 75us (927us total) trans 21474839344 rc 0/0 00000100:00100000:2.0:1763343278.576383:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7584 00010000:00010000:3.0:1763343278.576385:0:35281:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401fd2dea00/0x9104b1ba770a58eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343278.576394:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7586 00000100:00100000:2.0:1763343278.576399:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+28:3659:x1848998413022592:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1763343278.576400:0:35281:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1763343278.576411:0:8414:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:741 count 1 00010000:00010000:2.0:1763343278.576420:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88400/0x9104b1ba770a58f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.576430:0:8414:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a56b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a120 expref: 18 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343278.576436:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.576438:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.576440:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88400/0x9104b1ba770a58f2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.576458:0:8414:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a56b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a120 expref: 18 pid: 8412 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343278.576467:0:8414:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a56b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a120 expref: 18 pid: 8412 timeout: 1171 lvb_type: 1 00000100:00100000:2.0:1763343278.576476:0:8414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c517bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1848998413023104:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343278.576500:0:8414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c5304e40 going to sleep for 11 seconds 00000100:00100000:2.0:1763343278.576517:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7587 00000100:00100000:2.0:1763343278.576523:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+52:3659:x1848998413022080:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763343278.576533:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:742 count 1 00010000:00010000:2.0:1763343278.576544:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a58f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.576555:0:35266:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a56bb lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a119 expref: 29 pid: 11289 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343278.576561:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.576563:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.576566:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a58f9 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.576583:0:35266:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a56bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a119 expref: 29 pid: 11289 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343278.576590:0:35266:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a56bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a119 expref: 29 pid: 11289 timeout: 1171 lvb_type: 1 00000100:00100000:2.0:1763343278.576599:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5178380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998413023232:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343278.576621:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c5304d80 going to sleep for 11 seconds 00000100:00100000:3.0:1763343278.576622:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+29:3659:x1848998413022464:12345-0@lo:6:osp-syn-0-1.0 Request processed in 316us (467us total) trans 21474839345 rc 0/0 00000100:00100000:3.0:1763343278.576628:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7585 00000004:00080000:3.0:1763343278.576652:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401edc2ce00/2, rc 0, transno 21474839345 00000004:00080000:2.0:1763343278.576652:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5955f80/2, rc 0, transno 17179872074 00000100:00100000:3.0:1763343278.576658:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413022464:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763343278.576658:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413022336:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1763343278.576666:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401edc2e680/2, rc 0, transno 21474839344 00000100:00100000:2.0:1763343278.576670:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413022848:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763343278.576677:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401edc2ed80/2, rc 0, transno 21474839343 00000100:00100000:2.0:1763343278.576680:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413022720:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763343278.576687:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5954000/2, rc 0, transno 17179872073 00000100:00100000:2.0:1763343278.576690:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413022208:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1763343278.576792:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343278.576798:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9401fd2dea00/0x9104b1ba770a58eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.576805:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fd2dea00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343278.576809:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9401fd2dea00/0x9104b1ba770a58eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.576822:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9401fd2dea00/0x9104b1ba770a58eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.576838:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9401fd2dea00/0x9104b1ba770a58eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.576845:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401fd2dea00/0x9104b1ba770a58eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.576861:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343278.576863:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343278.576865:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343278.577006:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c511ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:55884:x1848998400024832:12345-192.168.201.40@tcp:101:bash.0 Request processed in 8731us (10242us total) trans 4294973988 rc 0/0 00000100:00100000:0.0:1763343278.577013:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11075 00000100:00100000:2.0:1763343278.580349:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5178380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998413023232:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343278.580380:0:35266:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a58f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343278.580404:0:8414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c517bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1848998413023104:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343278.580425:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:1.0:1763343278.580426:0:8414:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88400/0x9104b1ba770a58f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343278.580808:0:8413:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c517ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8413:1848998413022976:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343278.580823:0:8413:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a58e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343278.580860:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400025216 00000100:00100000:3.0:1763343278.580867:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400025216 00000100:00100000:3.0:1763343278.580931:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11077 00000100:00100000:3.0:1763343278.580941:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57209:x1848998400025216:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343278.580962:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343278.580993:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a5900 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x228:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a1d6 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.581110:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5907 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x228:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343278.581125:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5907 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.581136:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5907 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:3.0:1763343278.581165:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x228:0x0]: returning size 2 00000004:00200000:3.0:1763343278.581169:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343278.581187:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5907 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.581225:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2df600/0x9104b1ba770a5900 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x228:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1d6 expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.581247:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5907 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1d6 expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.581256:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x228:0x0].0x0 (ffff9400c48aab00) 00010000:00010000:3.0:1763343278.581259:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343278.581263:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c508aa00, rc 0) 00000100:00100000:3.0:1763343278.583409:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57209:x1848998400025216:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2460us (2977us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343278.583423:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11077 00000100:00100000:0.0:1763343278.584948:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.584988:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.585012:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400025344 00000100:00100000:0.0:1763343278.585064:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.585100:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400025472 00000100:00100000:2.0:1763343278.585106:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400025472 00010000:00010000:2.0:1763343278.585149:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a56bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a119 expref: 30 pid: 11289 timeout: 1171 lvb_type: 1 00000100:00100000:2.0:1763343278.585182:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400025600 00000100:00100000:2.0:1763343278.585185:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400025600 00010000:00010000:2.0:1763343278.585197:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5771 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a15f expref: 31 pid: 8412 timeout: 1171 lvb_type: 0 00000100:00100000:2.0:1763343278.585230:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3611 00000100:00100000:2.0:1763343278.585250:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7919c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+31:2407:x1848998400025472:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343278.585265:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343278.585271:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a56bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a119 expref: 31 pid: 11289 timeout: 1171 lvb_type: 1 00010000:00010000:2.0:1763343278.585282:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a56bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a119 expref: 31 pid: 11289 timeout: 1171 lvb_type: 1 00010000:00010000:2.0:1763343278.585307:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a56bb lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a119 expref: 31 pid: 11289 timeout: 1171 lvb_type: 1 00010000:00010000:2.0:1763343278.585322:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.585324:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.585329:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a58f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.585339:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a58f9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.585363:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343278.585412:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7919c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+30:2407:x1848998400025472:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 174us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.585419:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3611 00000100:00100000:2.0:1763343278.585435:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3612 00000100:00100000:2.0:1763343278.585441:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:2409:x1848998400025600:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343278.585449:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343278.585454:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5771 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a15f expref: 29 pid: 8412 timeout: 1171 lvb_type: 0 00010000:00010000:2.0:1763343278.585463:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5771 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a15f expref: 29 pid: 8412 timeout: 1171 lvb_type: 0 00010000:00010000:2.0:1763343278.585474:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5771 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a15f expref: 29 pid: 8412 timeout: 1171 lvb_type: 0 00010000:00010000:2.0:1763343278.585482:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.585483:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.585486:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a58e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.585493:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a58e4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.585513:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343278.585529:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2409:x1848998400025600:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 88us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.585536:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3612 00010000:00010000:2.0:1763343278.585559:0:35266:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a58f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.585566:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a58f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.585574:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a58f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.585581:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a58f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.585595:0:35266:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343278.586048:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400025344 00010000:00010000:3.0:1763343278.586074:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a56b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a120 expref: 19 pid: 8412 timeout: 1171 lvb_type: 1 00000100:00100000:3.0:1763343278.586103:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3613 00000100:00100000:3.0:1763343278.586110:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c511c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2408:x1848998400025344:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343278.586122:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343278.586126:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a56b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a120 expref: 19 pid: 8412 timeout: 1171 lvb_type: 1 00010000:00010000:3.0:1763343278.586136:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a56b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a120 expref: 19 pid: 8412 timeout: 1171 lvb_type: 1 00010000:00010000:3.0:1763343278.586150:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5ba3000/0x9104b1ba770a56b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a120 expref: 19 pid: 8412 timeout: 1171 lvb_type: 1 00010000:00010000:3.0:1763343278.586161:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343278.586163:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343278.586166:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88400/0x9104b1ba770a58f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.586173:0:6511:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88400/0x9104b1ba770a58f2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343278.586196:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:3.0:1763343278.586212:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343278.586237:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c511c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998400025344:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 127us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343278.586244:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3613 00010000:00010000:1.0:1763343278.586267:0:8414:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88400/0x9104b1ba770a58f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.586277:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88400/0x9104b1ba770a58f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.586286:0:8413:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a58e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.586287:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88400/0x9104b1ba770a58f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.586311:0:8413:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a58e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.586317:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88400/0x9104b1ba770a58f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.586323:0:8413:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a58e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.586333:0:8413:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a58e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.586337:0:8414:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1763343278.586347:0:8413:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1763343278.586515:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+29:3659:x1848998413022592:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10114us (10279us total) trans 21474839346 rc 0/0 00000100:00100000:1.0:1763343278.586523:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7586 00000100:00100000:1.0:1763343278.586536:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400025728 00000100:00100000:1.0:1763343278.586541:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400025728 00000100:00100000:1.0:1763343278.586569:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7588 00000100:00100000:1.0:1763343278.586577:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:55884:x1848998400025728:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343278.586591:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.586610:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a590e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a1dd expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343278.586628:0:8414:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343278.586640:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.586642:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.586648:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a590e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1dd expref: 29 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.586661:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a590e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1dd expref: 29 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.586670:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176e00, rc 0) 00000100:00100000:1.0:1763343278.586690:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:55884:x1848998400025728:12345-192.168.201.40@tcp:101:bash.0 Request processed in 115us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343278.586696:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7588 00010000:00010000:1.0:1763343278.586717:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1763343278.586722:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a58f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.586729:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343278.586733:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a58f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.586741:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a58f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.586753:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a58f9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.586761:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a58f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.586775:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763343278.586778:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88400/0x9104b1ba770a58f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.586783:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88400 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343278.586786:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88400/0x9104b1ba770a58f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.586793:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88400/0x9104b1ba770a58f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.586803:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88400/0x9104b1ba770a58f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.586810:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88400/0x9104b1ba770a58f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.586822:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343278.586825:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a58e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.586831:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343278.586834:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a58e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.586841:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a58e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.586849:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a58e4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.586855:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a58e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.586877:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343278.586880:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343278.586881:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343278.586892:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343278.586930:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401edc2c000/2, rc 0, transno 21474839346 00000100:00100000:1.0:1763343278.586937:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413022592:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343278.587266:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.587308:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+54:3659:x1848998413022080:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10783us (11114us total) trans 17179872075 rc 0/0 00000100:00100000:2.0:1763343278.587316:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7587 00000100:00100000:2.0:1763343278.587345:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400025856 00000100:00100000:2.0:1763343278.587350:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400025856 00000004:00080000:0.0:1763343278.587371:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5957b80/2, rc 0, transno 17179872075 00000100:00100000:0.0:1763343278.587379:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413022080:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343278.587383:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7589 00000100:00100000:2.0:1763343278.587396:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:2407:x1848998400025856:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343278.587405:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.587414:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5915 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a1e4 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343278.587458:0:35266:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c517ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998413023360:192.168.201.40@tcp:106: 00000100:00100000:2.0:1763343278.587518:0:35266:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c53043c0 going to sleep for 11 seconds 00010000:00010000:2.0:1763343278.587530:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343278.587745:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+53:3659:x1848998413021952:12345-0@lo:6:osp-syn-1-1.0 Request processed in 12147us (12618us total) trans 17179872076 rc 0/0 00000100:00100000:3.0:1763343278.587752:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7580 00000004:00080000:1.0:1763343278.587963:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6401500/2, rc 0, transno 17179872076 00000100:00100000:1.0:1763343278.587968:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6401500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413021952:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343278.589697:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.589801:0:8413:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400025984 00000100:00100000:3.0:1763343278.589810:0:8413:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400025984 00000100:00100000:3.0:1763343278.589862:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7590 00000100:00100000:3.0:1763343278.589872:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:55884:x1848998400025984:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343278.589889:0:8413:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343278.589909:0:8413:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c508b200/0x9104b1ba770a591c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a1eb expref: -99 pid: 8413 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343278.589930:0:8413:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343278.589950:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343278.589953:0:8413:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343278.589961:0:8413:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c508b200/0x9104b1ba770a591c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1eb expref: 19 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.589980:0:8413:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c508b200/0x9104b1ba770a591c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1eb expref: 19 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.589991:0:8413:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c508b200, rc 0) 00000100:00100000:3.0:1763343278.590079:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:55884:x1848998400025984:12345-192.168.201.40@tcp:101:bash.0 Request processed in 207us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343278.590087:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7590 00002000:00010000:2.0:1763343278.592937:0:35266:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000400:0x2e7:0x0] updating lvb mtime: 0 -> 1763343277 00002000:00010000:2.0:1763343278.592947:0:35266:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000400:0x2e7:0x0] updating lvb atime: 0 -> 1763343277 00002000:00010000:2.0:1763343278.592950:0:35266:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000400:0x2e7:0x0] updating lvb ctime: 0 -> 1763343277 00000100:00100000:2.0:1763343278.592971:0:35266:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c517ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35266:1848998413023360:192.168.201.40@tcp:106: 00010000:00010000:2.0:1763343278.593007:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5915 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1e4 expref: 30 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343278.593172:0:35266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5915 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1e4 expref: 30 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343278.593186:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89c00, rc 0) 00000100:00100000:2.0:1763343278.593288:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:2407:x1848998400025856:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 5894us (6022us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343278.593297:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7589 00000100:00100000:0.0:1763343278.595303:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.595339:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.595415:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.595521:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400026240 00000100:00100000:1.0:1763343278.595532:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400026240 00002000:00010000:1.0:1763343278.595570:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/742 (0->18446744073709551615) 00002000:00100000:1.0:1763343278.595576:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c7918700 with x1848998400026240 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343278.595593:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c7918700. 00000100:00100000:1.0:1763343278.595617:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400026112 00000100:00100000:1.0:1763343278.595620:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400026112 00002000:00010000:1.0:1763343278.595635:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/743 (0->18446744073709551615) 00002000:00100000:1.0:1763343278.595639:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c791bb80 with x1848998400026112 ext(0->18446744073709551615) 00000100:00100000:2.0:1763343278.595643:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1793 00002000:00010000:1.0:1763343278.595647:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c791bb80. 00000100:00100000:2.0:1763343278.595661:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2410:x1848998400026240:12345-192.168.201.40@tcp:10:bash.0 00000100:00100000:1.0:1763343278.595670:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1794 00000100:00100000:1.0:1763343278.595679:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:2410:x1848998400026112:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:2.0:1763343278.595850:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2e6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343278.595850:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2e7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343278.595857:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2e6:0x0] updating lvb mtime from disk: 0 -> 1763343277 00002000:00010000:1.0:1763343278.595858:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2e7:0x0] updating lvb mtime from disk: 1763343277 -> 1763343277 00002000:00010000:2.0:1763343278.595863:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2e6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343278.595865:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2e7:0x0] updating lvb atime from disk: 1763343277 -> 0 00002000:00010000:2.0:1763343278.595867:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2e6:0x0] updating lvb ctime from disk: 0 -> 1763343277 00002000:00010000:1.0:1763343278.595870:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2e7:0x0] updating lvb ctime from disk: 1763343277 -> 1763343277 00002000:00010000:2.0:1763343278.595871:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2e6:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1763343278.595874:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2e7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343278.595920:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2410:x1848998400026240:12345-192.168.201.40@tcp:10:bash.0 Request processed in 266us (626us total) trans 21474839347 rc 0/0 00000100:00100000:2.0:1763343278.595928:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1793 00002000:00010000:2.0:1763343278.595931:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/742 (0->18446744073709551615) 00002000:00100000:2.0:1763343278.595934:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c7918700 with x1848998400026240 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343278.595938:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c7918700. 00000100:00100000:3.0:1763343278.596470:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400026496 00000100:00100000:3.0:1763343278.596476:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400026496 00000100:00100000:3.0:1763343278.596505:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3918 00000100:00100000:3.0:1763343278.596512:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57209:x1848998400026496:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343278.596763:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+30:2410:x1848998400026112:12345-192.168.201.40@tcp:10:bash.0 Request processed in 1084us (1421us total) trans 17179872077 rc 0/0 00000100:00100000:3.0:1763343278.596773:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57209:x1848998400026496:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 257us (1354us total) trans 4294973990 rc 0/0 00000100:00100000:1.0:1763343278.596774:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1794 00002000:00010000:1.0:1763343278.596781:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/743 (0->18446744073709551615) 00002000:00100000:1.0:1763343278.596785:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c791bb80 with x1848998400026112 ext(0->18446744073709551615) 00000100:00100000:3.0:1763343278.596787:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3918 00002000:00010000:1.0:1763343278.596794:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c791bb80. 00000100:00100000:1.0:1763343278.603756:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.603804:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.603877:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400026752 00000100:00100000:3.0:1763343278.603890:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400026752 00000100:00100000:2.0:1763343278.604060:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400027008 00000100:00100000:2.0:1763343278.604066:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400027008 00000100:00100000:1.0:1763343278.604098:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11078 00000100:00100000:2.0:1763343278.604108:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3919 00000100:00100000:1.0:1763343278.604114:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57209:x1848998400026752:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:2.0:1763343278.604122:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82d6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:55884:x1848998400027008:12345-192.168.201.40@tcp:35:bash.0 00010000:00010000:1.0:1763343278.604141:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.604167:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5923 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a1f2 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.604244:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a592a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343278.604257:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a592a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.604267:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a592a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.604280:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5931 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343278.604287:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5931 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.604293:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5931 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.604379:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5938 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x228:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:1.0:1763343278.604392:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5938 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.604400:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5938 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:1.0:1763343278.604411:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x228:0x0]: returning size 5 00000100:00100000:2.0:1763343278.604421:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82d6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:55884:x1848998400027008:12345-192.168.201.40@tcp:35:bash.0 Request processed in 303us (614us total) trans 4294973991 rc 0/0 00000100:00100000:2.0:1763343278.604430:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3919 00010000:00010000:1.0:1763343278.604463:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a592a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.604471:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a592a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.604477:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a592a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.604482:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a592a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.604488:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.604492:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a592a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.604498:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a592a lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.604509:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5000) 00010000:00010000:1.0:1763343278.604512:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.604516:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a592a lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.604521:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a592a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.604535:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5931 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.604541:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5931 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.604546:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5931 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.604550:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.604554:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5931 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.604560:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5931 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.604570:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5e00) 00010000:00010000:1.0:1763343278.604572:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.604575:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5931 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.604581:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5931 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:1.0:1763343278.604624:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5923 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1f2 expref: 313 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.604639:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5938 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1f2 expref: 312 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.604649:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x228:0x0].0x0 (ffff9400c48aab00) 00010000:00010000:1.0:1763343278.604652:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343278.604654:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176c00, rc 0) 00000100:00100000:1.0:1763343278.604692:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57209:x1848998400026752:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 585us (946us total) trans 4294973992 rc 0/0 00000100:00100000:1.0:1763343278.604699:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11078 00000100:00100000:1.0:1763343278.613154:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.613214:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.613342:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400027264 00000100:00100000:2.0:1763343278.613353:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400027264 00000100:00100000:3.0:1763343278.613364:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400027520 00000100:00100000:3.0:1763343278.613371:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400027520 00000100:00100000:2.0:1763343278.613421:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3920 00000100:00100000:3.0:1763343278.613427:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11079 00000100:00100000:2.0:1763343278.613437:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57209:x1848998400027264:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343278.613440:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57210:x1848998400027520:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:3.0:1763343278.613501:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1763343278.613528:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a58c1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x228:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1c8 expref: 313 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.613551:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5938 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1f2 expref: 312 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.613564:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5907 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1d6 expref: 311 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.613575:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a5897 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x228:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1ba expref: 310 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.613584:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x228:0x0].0x0 (ffff9400c48aab00) 00010000:00010000:3.0:1763343278.613594:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343278.613619:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5946 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343278.613631:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5946 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.613639:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5946 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.613652:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a594d lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343278.613659:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a594d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.613665:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a594d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.613736:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5954 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x228:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343278.613744:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5954 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x228:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.613755:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5954 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x228:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000100:00100000:2.0:1763343278.613789:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57209:x1848998400027264:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 355us (643us total) trans 4294973993 rc 0/0 00000100:00100000:2.0:1763343278.613799:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3920 00000040:00080000:3.0:1763343278.613911:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1839, 64 off152568 00000040:00080000:3.0:1763343278.613929:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1830, 64 off151808 00000040:00080000:3.0:1763343278.613940:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1831, 64 off151872 00000040:00080000:3.0:1763343278.613950:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1840, 64 off152632 00010000:00010000:3.0:1763343278.613985:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a595b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x228:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343278.613994:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a595b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.614001:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a595b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.614008:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a595b lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.614013:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a595b lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.614019:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a595b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.614261:0:6525:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343278.614264:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343278.614273:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a595b lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.614279:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5954 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x228:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.614288:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5954 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x228:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.614294:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5954 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x228:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.614295:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8693e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343278.614303:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a595b lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x228:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.614311:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8692c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343278.614320:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5954 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x228:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.614320:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a595b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.614336:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5954 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x228:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.614341:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x228:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:1.0:1763343278.614346:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763343278.614351:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a595b lrc: 1/0,0 mode: --/PW res: [0x240000404:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.614354:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x228:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:1.0:1763343278.614357:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a595b lrc: 0/0,0 mode: --/PW res: [0x240000404:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.614359:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763343278.614365:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5954 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x228:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.614372:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5954 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x228:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.614374:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343278.614378:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343278.614382:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343278.614496:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5946 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.614502:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5946 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.614507:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5946 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.614512:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5946 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.614516:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508be00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343278.614519:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5946 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.614524:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5946 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.614534:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4700) 00010000:00010000:3.0:1763343278.614536:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343278.614539:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5946 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.614544:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5946 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00000004:00010000:3.0:1763343278.614554:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001e47bafa reply state 00000000b6172248 transno 4294973994 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a594d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.614563:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a594d lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.614568:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4c00) 00010000:00010000:3.0:1763343278.614570:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343278.614573:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343278.614627:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57210:x1848998400027520:12345-192.168.201.40@tcp:36:rm.0 Request processed in 1191us (1411us total) trans 4294973994 rc 0/0 00000100:00100000:3.0:1763343278.614633:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11079 00000100:00100000:1.0:1763343278.625068:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.625164:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400027776 00000100:00100000:3.0:1763343278.625176:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400027776 00000100:00100000:3.0:1763343278.625358:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11080 00000100:00100000:3.0:1763343278.625370:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57209:x1848998400027776:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343278.625396:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343278.625420:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5962 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a1f9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.625500:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a5969 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343278.625514:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a5969 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.625527:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a5969 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.625538:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5970 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343278.625544:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5970 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.625551:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5970 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.625592:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a5969 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.625600:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a5969 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.625606:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a5969 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.625612:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a5969 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.625619:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8693e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343278.625623:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a5969 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.625630:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a5969 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.625645:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4700) 00010000:00010000:3.0:1763343278.625649:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343278.625653:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a5969 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.625659:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693e00/0x9104b1ba770a5969 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.625669:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5970 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.625674:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5970 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.625680:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5970 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.625685:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508be00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343278.625687:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5970 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.625693:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5970 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.625700:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4c00) 00010000:00010000:3.0:1763343278.625703:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343278.625705:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5970 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.625711:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5970 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.625738:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5962 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1f9 expref: 312 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.625748:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4700) 00010000:00010000:3.0:1763343278.625750:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343278.625753:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5962 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1f9 expref: 312 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.625764:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8692c00, rc 0) 00000100:00100000:3.0:1763343278.625830:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57209:x1848998400027776:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 463us (776us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343278.625837:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11080 00000100:00100000:2.0:1763343278.634624:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.634713:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400027904 00000100:00100000:3.0:1763343278.634724:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400027904 00000100:00100000:3.0:1763343278.634787:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11081 00000100:00100000:3.0:1763343278.634797:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57211:x1848998400027904:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343278.634816:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343278.634840:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5977 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a200 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.634909:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a597e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343278.634924:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a597e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.634935:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a597e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.634945:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5985 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343278.634955:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5985 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.634960:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5985 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.634996:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a597e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.635003:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a597e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.635009:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a597e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.635015:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a597e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.635021:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343278.635098:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a597e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.635105:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a597e lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.635116:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:3.0:1763343278.635119:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343278.635122:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a597e lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.635128:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a597e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.635138:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5985 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.635144:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5985 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.635149:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5985 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.635154:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343278.635156:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5985 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.635161:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5985 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.635167:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4c00) 00010000:00010000:3.0:1763343278.635169:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343278.635171:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5985 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.635176:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5985 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.635212:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5977 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a200 expref: 312 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.635222:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:3.0:1763343278.635224:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343278.635230:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5977 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a200 expref: 312 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.635242:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c508aa00, rc 0) 00000100:00100000:3.0:1763343278.635968:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57211:x1848998400027904:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1168us (1349us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343278.635977:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11081 00000100:00100000:2.0:1763343278.642130:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.642214:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400028032 00000100:00100000:1.0:1763343278.642230:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400028032 00000100:00100000:1.0:1763343278.642429:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11082 00000100:00100000:1.0:1763343278.642440:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57211:x1848998400028032:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343278.642462:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.642487:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a598c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a207 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.642560:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5993 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343278.642573:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5993 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.642585:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5993 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.642594:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a599a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343278.642601:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a599a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.642606:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a599a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.642644:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5993 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.642650:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5993 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.642656:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5993 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.642661:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5993 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.642667:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.642671:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5993 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.642677:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5993 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.642689:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5000) 00010000:00010000:1.0:1763343278.642692:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.642697:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5993 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.642703:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5993 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.642714:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a599a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.642720:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a599a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.642725:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a599a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.642730:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.642732:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a599a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.642738:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a599a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.642744:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4c00) 00010000:00010000:1.0:1763343278.642747:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.642750:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a599a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.642755:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a599a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.642781:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a598c lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a207 expref: 312 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.642791:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5000) 00010000:00010000:1.0:1763343278.642794:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.642797:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a598c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a207 expref: 312 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.642811:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177c00, rc 0) 00000100:00100000:1.0:1763343278.643635:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57211:x1848998400028032:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1192us (1510us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343278.643646:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11082 00000100:00100000:1.0:1763343278.649859:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.650059:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400028416 00000100:00100000:3.0:1763343278.650070:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400028416 00000100:00100000:2.0:1763343278.650430:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.650845:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400028160 00000100:00100000:3.0:1763343278.650850:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400028160 00000100:00100000:0.0:1763343278.650896:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11083 00000100:00100000:0.0:1763343278.650908:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57212:x1848998400028416:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343278.650929:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.650953:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a59a1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a215 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.651053:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a59a8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343278.651067:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a59a8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.651078:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a59a8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.651088:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a59af lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343278.651095:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a59af lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.651101:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a59af lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.651137:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a59a8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.651145:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a59a8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.651151:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a59a8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.651157:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a59a8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.651163:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501aa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.651167:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a59a8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.651173:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a59a8 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.651184:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5b00) 00010000:00010000:0.0:1763343278.651187:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.651191:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a59a8 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.651197:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a59a8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.651223:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a59af lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.651229:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a59af lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.651234:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a59af lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.651238:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.651240:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a59af lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.651245:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a59af lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.651251:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4c00) 00010000:00010000:0.0:1763343278.651253:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.651256:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a59af lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.651260:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a59af lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.651284:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a59a1 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a215 expref: 313 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.651292:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5b00) 00010000:00010000:0.0:1763343278.651294:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343278.651297:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a59a1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a215 expref: 313 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.651308:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a400, rc 0) 00000100:00100000:0.0:1763343278.651366:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57212:x1848998400028416:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 461us (1519us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343278.651372:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11083 00000100:00100000:0.0:1763343278.651392:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11084 00000100:00100000:0.0:1763343278.651399:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57211:x1848998400028160:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343278.651405:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.651414:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a59b6 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a20e expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.651441:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a59bd lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343278.651449:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a59bd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.651456:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a59bd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343278.651493:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343278.651497:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343278.651521:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a59b6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a20e expref: 313 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.651533:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a59bd lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a20e expref: 312 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.651539:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5000) 00010000:00010000:0.0:1763343278.651541:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343278.651544:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b000, rc 0) 00000100:00100000:0.0:1763343278.651563:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57211:x1848998400028160:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 166us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343278.651569:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11084 00000100:00100000:1.0:1763343278.659257:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.660597:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400028672 00000100:00100000:0.0:1763343278.660610:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400028672 00000100:00100000:0.0:1763343278.660681:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11085 00000100:00100000:0.0:1763343278.660693:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57211:x1848998400028672:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343278.660713:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.660717:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343278.660745:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a59bd lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a20e expref: 312 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.660765:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5000) 00010000:00010000:0.0:1763343278.660775:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343278.660791:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a59c4 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a21c expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.660888:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a59cb lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343278.660901:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a59cb lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.660911:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a59cb lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.660922:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a59d2 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343278.660930:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a59d2 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.660936:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a59d2 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.662597:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a59d9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343278.662616:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a59d9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.662627:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a59d9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343278.662640:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22a:0x0]: returning size 0 00010000:00010000:0.0:1763343278.662667:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a59cb lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.662674:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a59cb lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.662681:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a59cb lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.662688:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a59cb lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.662694:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ba00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.662699:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a59cb lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.662706:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a59cb lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.662716:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5800) 00010000:00010000:0.0:1763343278.662719:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.662723:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a59cb lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.662729:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a59cb lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000004:00010000:0.0:1763343278.662741:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000421f81a2 reply state 00000000d1dd0ced transno 4294973995 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a59d2 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.662753:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a59d2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.662763:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4c00) 00010000:00010000:0.0:1763343278.662765:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343278.662768:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343278.662802:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a59c4 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a21c expref: 314 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.662818:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a59d9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a21c expref: 313 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.662826:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22a:0x0].0x0 (ffff9401cc2f5b00) 00010000:00010000:0.0:1763343278.663423:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343278.663428:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501bc00, rc 0) 00000100:00100000:0.0:1763343278.664109:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57211:x1848998400028672:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3414us (4869us total) trans 4294973995 rc 0/0 00000100:00100000:0.0:1763343278.664120:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11085 00000100:00100000:2.0:1763343278.670454:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.670637:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400028928 00000100:00100000:0.0:1763343278.670648:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400028928 00000100:00100000:0.0:1763343278.670973:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11086 00000100:00100000:0.0:1763343278.670984:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6275500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57211:x1848998400028928:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343278.671008:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.671061:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a59e7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a223 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.671164:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a59ee lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343278.671179:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a59d9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a21c expref: 315 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.671195:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a59ee lrc: 4/0,1 mode: --/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.671247:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a59d9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a21c expref: 315 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.671262:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a59d9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a21c expref: 315 pid: 7641 timeout: 1171 lvb_type: 0 00000100:00100000:0.0:1763343278.671293:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7918000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998413023488:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343278.671384:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343278.672793:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.673451:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400029184 00000100:00100000:1.0:1763343278.673462:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400029184 00000100:00100000:1.0:1763343278.673526:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11087 00000100:00100000:1.0:1763343278.673535:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57213:x1848998400029184:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343278.673553:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.673573:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a59f5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a22a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.673669:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a59fc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343278.673684:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a59fc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.673695:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a59fc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:1.0:1763343278.673705:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22a:0x0]: returning size 0 00010000:00010000:1.0:1763343278.673783:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a59fc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.673791:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a59fc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.673797:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a59fc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.673803:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.673807:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a59fc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.673814:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a59fc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.673825:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22a:0x0].0x0 (ffff9401cc2f5b00) 00010000:00010000:1.0:1763343278.673828:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1763343278.673832:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a59fc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.673838:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a59fc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343278.673872:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a59f5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x22a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a22a expref: 318 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.673886:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22a:0x0].0x0 (ffff9401cc2f5b00) 00010000:00010000:1.0:1763343278.673888:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343278.673891:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a59f5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x22a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a22a expref: 318 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.673899:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177c00, rc 0) 00000100:00100000:1.0:1763343278.673952:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57213:x1848998400029184:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 418us (1164us total) trans 4294973996 rc 301/301 00000100:00100000:1.0:1763343278.673959:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11087 00000100:00100000:0.0:1763343278.675227:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7918000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7641:1848998413023488:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343278.675254:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a59ee lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000100:00100000:2.0:1763343278.676241:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.676566:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400029312 00000100:00100000:0.0:1763343278.676578:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400029312 00010000:00010000:0.0:1763343278.676621:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a59d9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a21c expref: 317 pid: 7641 timeout: 1171 lvb_type: 0 00000100:00100000:0.0:1763343278.676738:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3614 00000100:00100000:0.0:1763343278.676748:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6274700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:2408:x1848998400029312:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343278.676764:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343278.676771:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a59d9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a21c expref: 317 pid: 7641 timeout: 1171 lvb_type: 0 00010000:00010000:0.0:1763343278.676783:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a59d9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a21c expref: 317 pid: 7641 timeout: 1171 lvb_type: 0 00010000:00010000:0.0:1763343278.676807:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a59d9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a21c expref: 317 pid: 7641 timeout: 1171 lvb_type: 0 00010000:00010000:0.0:1763343278.676824:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22a:0x0].0x0 (ffff9401cc2f5b00) 00010000:00010000:0.0:1763343278.676829:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a59ee lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.676839:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a59ee lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.676845:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a59ee lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.676881:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343278.676948:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6274700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:2408:x1848998400029312:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 200us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343278.676955:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3614 00010000:00010000:2.0:1763343278.677177:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a59ee lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.677185:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a59ee lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343278.677220:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22a:0x0]: returning size 0 00000004:00080000:2.0:1763343278.677409:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2e8:0x0], index 0: 0 00000004:00080000:2.0:1763343278.677417:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2e9:0x0], index 1: 0 00000004:00080000:2.0:1763343278.677422:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2ea:0x0], index 1: 0 00000004:00080000:2.0:1763343278.677425:0:7641:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2e9:0x0], index 0: 0 00010000:00010000:2.0:1763343278.677527:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a59ee lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.677535:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a59ee lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.677541:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a59ee lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.677547:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.677550:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a59ee lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.677557:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a59ee lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.677567:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22a:0x0].0x0 (ffff9401cc2f5b00) 00010000:00010000:2.0:1763343278.677570:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343278.677574:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a59ee lrc: 2/0,0 mode: --/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.677579:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a59ee lrc: 0/0,0 mode: --/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.677625:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a59e7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x22a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a223 expref: 316 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.677635:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22a:0x0].0x0 (ffff9401cc2f5b00) 00010000:00010000:2.0:1763343278.677637:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343278.677640:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a59e7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x22a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a223 expref: 316 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.677654:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b000, rc 0) 00000100:00100000:2.0:1763343278.677704:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6275500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57211:x1848998400028928:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 6721us (7261us total) trans 4294973997 rc 301/301 00000100:00100000:2.0:1763343278.677711:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11086 00000100:00100000:1.0:1763343278.679118:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.679207:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400029568 00000100:00100000:2.0:1763343278.679216:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400029568 00000100:00100000:2.0:1763343278.679878:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3921 00000100:00100000:2.0:1763343278.679890:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57213:x1848998400029568:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343278.680721:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57213:x1848998400029568:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 830us (1604us total) trans 4294973998 rc 0/0 00000100:00100000:2.0:1763343278.680730:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3921 00000100:00100000:1.0:1763343278.687871:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.687953:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400029824 00000100:00100000:2.0:1763343278.687963:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400029824 00000100:00100000:2.0:1763343278.688057:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3922 00000100:00100000:2.0:1763343278.688068:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57211:x1848998400029824:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343278.688297:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57211:x1848998400029824:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 231us (435us total) trans 4294973999 rc 0/0 00000100:00100000:2.0:1763343278.688308:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3922 00000100:00100000:1.0:1763343278.690942:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.691060:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400030080 00000100:00100000:0.0:1763343278.691071:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400030080 00000100:00100000:0.0:1763343278.691130:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11088 00000100:00100000:0.0:1763343278.691141:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57213:x1848998400030080:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343278.691164:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.691186:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5a11 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a231 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.691279:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5a18 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343278.691293:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5a18 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.691305:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5a18 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.691314:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5a1f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343278.691322:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5a1f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.691328:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5a1f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.691436:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5a26 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343278.691445:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5a26 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.691451:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5a26 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343278.691461:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22a:0x0]: returning size 0 00010000:00010000:0.0:1763343278.691537:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5a18 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.691545:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5a18 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.691550:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5a18 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.691556:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5a18 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.691561:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ba00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.691566:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5a18 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.691573:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5a18 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.691585:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5800) 00010000:00010000:0.0:1763343278.691588:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.691593:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5a18 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.691599:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5a18 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.691613:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5a1f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.691619:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5a1f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.691624:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5a1f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.691629:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.691632:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5a1f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.691637:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5a1f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.691643:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4c00) 00010000:00010000:0.0:1763343278.691645:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.691647:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5a1f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.691655:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5a1f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343278.691688:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5a11 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a231 expref: 320 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.691704:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5a26 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a231 expref: 319 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.691712:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22a:0x0].0x0 (ffff9401cc2f5000) 00010000:00010000:0.0:1763343278.691714:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343278.691717:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b200, rc 0) 00000100:00100000:0.0:1763343278.691766:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:57213:x1848998400030080:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 627us (832us total) trans 4294974000 rc 0/0 00000100:00100000:0.0:1763343278.691774:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11088 00000100:00100000:1.0:1763343278.692734:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.693330:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400030336 00000100:00100000:0.0:1763343278.693339:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400030336 00000100:00100000:0.0:1763343278.694234:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3923 00000100:00100000:0.0:1763343278.694247:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:57211:x1848998400030336:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343278.694465:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+320:57211:x1848998400030336:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 220us (1734us total) trans 4294974001 rc 0/0 00000100:00100000:0.0:1763343278.694472:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3923 00000100:00100000:1.0:1763343278.701471:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.701801:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400030464 00000100:00100000:2.0:1763343278.701812:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400030464 00000100:00100000:2.0:1763343278.701899:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7591 00000100:00100000:2.0:1763343278.701908:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f648a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998400030464:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343278.701924:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.701944:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a5a34 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a238 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343278.701965:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343278.701981:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.701983:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.701991:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a5a34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a238 expref: 21 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343278.702006:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a5a34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a238 expref: 21 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343278.702018:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89400, rc 0) 00000100:00100000:2.0:1763343278.702607:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f648a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998400030464:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 698us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.702615:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7591 00000100:00100000:1.0:1763343278.708372:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.708435:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400030720 00000100:00100000:3.0:1763343278.708445:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400030720 00000100:00100000:3.0:1763343278.708511:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11089 00000100:00100000:3.0:1763343278.708522:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+320:55884:x1848998400030720:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343278.708545:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343278.708548:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343278.708575:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5a26 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a231 expref: 320 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.708597:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22a:0x0].0x0 (ffff9401cc2f5000) 00010000:00010000:3.0:1763343278.708607:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343278.708623:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5a3b lrc: 2/0,0 mode: --/CW res: [0x240000404:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a23f expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.708779:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5a42 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343278.708791:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5a42 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x22a:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.708800:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5a42 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x22a:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:3.0:1763343278.708813:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22a:0x0]: returning size 0 00010000:00010000:3.0:1763343278.708920:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5a3b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a23f expref: 322 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.708934:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5a42 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x22a:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a23f expref: 321 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.708941:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22a:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:3.0:1763343278.708944:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:3.0:1763343278.708946:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3000, rc 0) 00000100:00100000:3.0:1763343278.709014:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:55884:x1848998400030720:12345-192.168.201.40@tcp:101:bash.0 Request processed in 493us (661us total) trans 4294974002 rc 0/0 00000100:00100000:3.0:1763343278.709021:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11089 00000100:00100000:1.0:1763343278.718785:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.719390:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400030848 00000100:00100000:3.0:1763343278.719400:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400030848 00000100:00100000:1.0:1763343278.719816:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.722894:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11090 00000100:00100000:3.0:1763343278.722917:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:57213:x1848998400030848:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343278.722938:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343278.722961:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5a50 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a246 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343278.723036:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400030976 00010000:00010000:3.0:1763343278.723038:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5a50 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x22a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a246 expref: 322 pid: 6525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343278.723044:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400030976 00010000:00010000:3.0:1763343278.723053:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5a50 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x22a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a246 expref: 323 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.723071:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22a:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:3.0:1763343278.723074:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343278.723078:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5ba3a00, rc 0) 00000100:00100000:2.0:1763343278.723098:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11091 00000100:00100000:2.0:1763343278.723107:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:55884:x1848998400030976:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343278.723121:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.723131:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5a57 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a24d expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.723152:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5a5e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.723161:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5a5e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.723170:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5a5e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.723282:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5a57 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a24d expref: 325 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.723299:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5a5e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a24d expref: 324 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.723307:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22a:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:2.0:1763343278.723310:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343278.723312:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89000, rc 0) 00000100:00100000:2.0:1763343278.723381:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+324:55884:x1848998400030976:12345-192.168.201.40@tcp:101:bash.0 Request processed in 275us (3566us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.723388:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11091 00000100:00100000:3.0:1763343278.723615:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:57213:x1848998400030848:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 708us (4839us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343278.723621:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11090 00000100:00100000:1.0:1763343278.729799:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.729852:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.730143:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400031232 00000100:00100000:0.0:1763343278.730160:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400031232 00000100:00100000:3.0:1763343278.730326:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400031488 00000100:00100000:3.0:1763343278.730332:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400031488 00000100:00100000:3.0:1763343278.730391:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11092 00000100:00100000:3.0:1763343278.730401:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+324:55884:x1848998400031488:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:3.0:1763343278.730456:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343278.730481:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5a42 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x22a:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a23f expref: 324 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.730500:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22a:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:3.0:1763343278.730505:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343278.730687:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a5a65 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343278.730701:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a5a65 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.730711:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a5a65 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000001:00080000:3.0:1763343278.730756:0:6525:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294974003 00000004:00010000:3.0:1763343278.730779:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000be495c49 reply state 000000006bbcb127 transno 4294974004 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a5a65 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.730792:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a5a65 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.730798:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22a:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:3.0:1763343278.730801:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343278.730804:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343278.730883:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3924 00000100:00100000:0.0:1763343278.730894:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+326:57213:x1848998400031232:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343278.730904:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+326:55884:x1848998400031488:12345-192.168.201.40@tcp:36:bash.0 Request processed in 501us (1047us total) trans 4294974004 rc 0/0 00000100:00100000:3.0:1763343278.730914:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11092 00000020:00080000:3.0:1763343278.730920:0:6525:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343278.731014:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+326:57213:x1848998400031232:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 122us (1226us total) trans 4294974005 rc 0/0 00000100:00100000:0.0:1763343278.731022:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3924 00000100:00100000:1.0:1763343278.738887:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.738945:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.739255:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400032000 00000100:00100000:0.0:1763343278.739267:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400032000 00000100:00100000:2.0:1763343278.739387:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400031744 00000100:00100000:2.0:1763343278.739392:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400031744 00000100:00100000:0.0:1763343278.739446:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11093 00000100:00100000:0.0:1763343278.739459:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+327:57213:x1848998400032000:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:2.0:1763343278.739472:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11094 00000100:00100000:2.0:1763343278.739482:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+327:55884:x1848998400031744:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343278.739484:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.739496:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.739498:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343278.739511:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5a6c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a25b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.739524:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3a00/0x9104b1ba770a5a50 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x22a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a246 expref: 327 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.739542:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22a:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:2.0:1763343278.739548:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343278.739557:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5a73 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a254 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.739594:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5a7a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343278.739599:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5a81 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343278.739609:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5a7a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.739613:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5a81 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.739627:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5a7a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.739629:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5a81 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.739650:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5a88 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343278.739661:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5a88 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.739668:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5a88 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.739756:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5a8f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343278.739769:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5a8f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.739777:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5a8f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:0.0:1763343278.739787:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22a:0x0]: returning size 0 00010000:00010000:0.0:1763343278.739851:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5a8f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.739858:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5a8f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.739865:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5a8f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.739871:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501aa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.739876:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5a8f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.739882:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5a8f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00000040:00080000:2.0:1763343278.739884:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1832, 88 off151960 00000004:00080000:2.0:1763343278.739895:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1071863870303ns, next at 1072111852630ns, rc = 0 00010000:00010000:0.0:1763343278.739898:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22a:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:0.0:1763343278.739904:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1763343278.739908:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5a8f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.739921:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5a8f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.739934:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5a7a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.739944:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5a7a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.739949:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5a7a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.739954:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5a7a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00000040:00080000:2.0:1763343278.739956:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1841, 88 off152720 00010000:00010000:0.0:1763343278.739958:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.739964:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5a7a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00000004:00080000:2.0:1763343278.739966:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1071863940635ns, next at 1072111826735ns, rc = 0 00010000:00010000:0.0:1763343278.739972:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5a7a lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.739984:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5800) 00010000:00010000:0.0:1763343278.739986:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000040:00080000:2.0:1763343278.739988:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1842, 88 off152808 00010000:00010000:0.0:1763343278.739990:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5a7a lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00000004:00080000:2.0:1763343278.739996:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1071863970929ns, next at 1072111826735ns, rc = 0 00010000:00010000:0.0:1763343278.739998:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5a7a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.740009:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5a88 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00000040:00080000:2.0:1763343278.740011:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1833, 88 off152048 00010000:00010000:0.0:1763343278.740016:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5a88 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00000004:00080000:2.0:1763343278.740019:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1071863994118ns, next at 1072111852630ns, rc = 0 00010000:00010000:0.0:1763343278.740064:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5a88 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.740070:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ba00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.740073:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5a88 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.740079:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5a88 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.740087:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4c00) 00010000:00010000:0.0:1763343278.740090:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.740093:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5a88 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.740099:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5a88 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.740302:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5a6c lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a25b expref: 330 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.740312:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5800) 00010000:00010000:0.0:1763343278.740315:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343278.740319:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5a6c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a25b expref: 330 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.740332:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501bc00, rc 0) 00000100:00100000:0.0:1763343278.741622:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+329:57213:x1848998400032000:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2158us (2738us total) trans 4294974006 rc 301/301 00000100:00100000:0.0:1763343278.741633:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11093 00000100:00100000:3.0:1763343278.743828:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.743899:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400032256 00000100:00100000:0.0:1763343278.743911:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400032256 00000100:00100000:0.0:1763343278.743956:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3925 00000100:00100000:0.0:1763343278.743964:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82d4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+329:57213:x1848998400032256:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343278.744217:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82d4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+330:57213:x1848998400032256:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 252us (398us total) trans 4294974008 rc 0/0 00000100:00100000:0.0:1763343278.744224:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3925 00000001:00080000:0.0:1763343278.745617:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974007 is committed 00000004:00080000:0.0:1763343278.745629:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1172 committed 00000004:00080000:0.0:1763343278.745642:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1180 committed 00000004:00080000:0.0:1763343278.745656:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1179 committed 00000004:00080000:0.0:1763343278.745658:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1171 committed 00010000:00010000:2.0:1763343278.745737:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a594d lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.745754:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a594d lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.745762:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a594d lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.745768:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8693c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.745773:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a594d lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.745780:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a594d lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.745805:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4c00) 00010000:00010000:2.0:1763343278.745809:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.745815:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a594d lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.745821:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a594d lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.745839:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a59d2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.745845:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a59d2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.745852:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a59d2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.745857:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501be00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.745860:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a59d2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.745866:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a59d2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.745873:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4c00) 00010000:00010000:2.0:1763343278.745876:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.745879:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a59d2 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.745884:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a59d2 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.745904:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a5a65 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.745910:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a5a65 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.745916:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a5a65 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.745921:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.745924:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a5a65 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.745929:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a5a65 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.745936:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22a:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:2.0:1763343278.745938:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.745941:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a5a65 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.745947:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5ba3200/0x9104b1ba770a5a65 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x22a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.746001:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5a81 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x22a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a254 expref: 308 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.746010:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22a:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:2.0:1763343278.746013:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343278.746062:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5a73 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a254 expref: 308 pid: 33856 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763343278.746082:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5a81 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x22a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a254 expref: 307 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343278.746090:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413023744:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1763343278.746136:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22a:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:2.0:1763343278.746140:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343278.746143:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88a00, rc 0) 00000100:00100000:3.0:1763343278.746160:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343278.746194:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:55884:x1848998400031744:12345-192.168.201.40@tcp:101:bash.0 Request processed in 6713us (7247us total) trans 4294974007 rc 0/0 00000100:00100000:3.0:1763343278.746206:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343278.746215:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413023616:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343278.746220:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11094 00000100:00100000:3.0:1763343278.746240:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343278.746265:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413023872:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343278.746295:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343278.746314:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343278.746320:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413024000:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343278.746342:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343278.746362:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c39b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413024384:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343278.746382:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343278.746400:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343278.746406:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c39b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413024512:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343278.746428:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343278.746461:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413023744 00000100:00100000:3.0:1763343278.746469:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413023744 00000100:00100000:3.0:1763343278.746511:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413023616 00000100:00100000:3.0:1763343278.746515:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413023616 00000100:00100000:3.0:1763343278.746547:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413023872 00000100:00100000:3.0:1763343278.746551:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413023872 00000100:00100000:3.0:1763343278.746566:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413024000 00000100:00100000:3.0:1763343278.746569:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413024000 00000100:00100000:3.0:1763343278.746585:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413024384 00000100:00100000:3.0:1763343278.746587:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413024384 00000100:00100000:3.0:1763343278.746597:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413024512 00000100:00100000:3.0:1763343278.746598:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413024512 00000100:00100000:3.0:1763343278.746609:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7592 00000100:00100000:3.0:1763343278.746616:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+56:3660:x1848998413023744:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763343278.746640:0:28562:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:744 count 1 00010000:00010000:3.0:1763343278.746663:0:28562:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5a9d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.746679:0:28562:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a585f lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1ac expref: 29 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343278.746687:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343278.746689:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343278.746692:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5a9d lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.746717:0:28562:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a585f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1ac expref: 29 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343278.746730:0:28562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a585f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1ac expref: 29 pid: 8626 timeout: 1171 lvb_type: 1 00000100:00100000:3.0:1763343278.746740:0:28562:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9dc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28562:1848998413024640:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343278.746786:0:28562:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc6d780 going to sleep for 11 seconds 00000100:00100000:3.0:1763343278.746801:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7593 00000100:00100000:3.0:1763343278.746808:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+56:3660:x1848998413023616:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763343278.746820:0:28561:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:743 count 1 00010000:00010000:3.0:1763343278.746831:0:28561:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5aa4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.746843:0:28561:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a590e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1dd expref: 29 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.746850:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343278.746851:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343278.746854:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5aa4 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.746871:0:28561:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a590e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1dd expref: 29 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.746880:0:28561:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a590e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1dd expref: 29 pid: 8414 timeout: 1171 lvb_type: 0 00000100:00100000:3.0:1763343278.746889:0:28561:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9dc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998413024768:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343278.746914:0:28561:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc6dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1763343278.746931:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7594 00000100:00100000:3.0:1763343278.746938:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+56:3661:x1848998413023872:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343278.747108:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+57:3661:x1848998413023872:12345-0@lo:2:osp-syn-1-1.0 Request processed in 170us (812us total) trans 17179872078 rc 0/0 00000100:00100000:3.0:1763343278.747114:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7594 00000100:00100000:3.0:1763343278.747129:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7595 00000100:00100000:3.0:1763343278.747135:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+56:3661:x1848998413024000:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343278.747216:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+57:3661:x1848998413024000:12345-0@lo:2:osp-syn-1-1.0 Request processed in 81us (872us total) trans 17179872079 rc 0/0 00000100:00100000:3.0:1763343278.747221:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7595 00000100:00100000:3.0:1763343278.747234:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7596 00000100:00100000:3.0:1763343278.747241:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c4b20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+30:3661:x1848998413024384:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763343278.747311:0:8414:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2e8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343278.747315:0:8414:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2e8:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343278.747317:0:8414:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2e8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343278.747319:0:8414:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2e8:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343278.747322:0:8414:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2e8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343278.747348:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+31:3661:x1848998413024384:12345-0@lo:2:osp-syn-0-1.0 Request processed in 107us (964us total) trans 21474839348 rc 0/0 00000100:00100000:3.0:1763343278.747355:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7596 00000100:00100000:3.0:1763343278.747367:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7597 00000100:00100000:3.0:1763343278.747373:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+30:3661:x1848998413024512:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343278.747440:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+31:3661:x1848998413024512:12345-0@lo:2:osp-syn-0-1.0 Request processed in 67us (1010us total) trans 21474839349 rc 0/0 00000100:00100000:3.0:1763343278.747446:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7597 00000100:00100000:3.0:1763343278.747482:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413024256:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343278.747507:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343278.747528:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343278.747534:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413024128:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343278.747554:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343278.747575:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413024256 00000100:00100000:3.0:1763343278.747579:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413024256 00000100:00100000:3.0:1763343278.747599:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413024128 00000100:00100000:3.0:1763343278.747602:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413024128 00000100:00100000:3.0:1763343278.747619:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7598 00000100:00100000:3.0:1763343278.747625:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+32:3660:x1848998413024256:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343278.747636:0:8412:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:743 count 1 00010000:00010000:3.0:1763343278.747648:0:8412:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c508be00/0x9104b1ba770a5aab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.747661:0:8412:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a5858 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1a5 expref: 20 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343278.747667:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343278.747669:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343278.747673:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c508be00/0x9104b1ba770a5aab lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.747694:0:8412:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a5858 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1a5 expref: 20 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343278.747703:0:8412:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a5858 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1a5 expref: 20 pid: 8626 timeout: 1171 lvb_type: 1 00000100:00100000:3.0:1763343278.747714:0:8412:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b25c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998413024896:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343278.747740:0:8412:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c4df1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1763343278.747757:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7599 00000100:00100000:3.0:1763343278.747764:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+32:3660:x1848998413024128:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343278.747777:0:35281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:742 count 1 00010000:00010000:3.0:1763343278.747787:0:35281:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a5ab2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.747798:0:35281:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c508b200/0x9104b1ba770a591c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1eb expref: 20 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.747804:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343278.747806:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343278.747808:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a5ab2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.747828:0:35281:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c508b200/0x9104b1ba770a591c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1eb expref: 20 pid: 8413 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.747837:0:35281:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c508b200/0x9104b1ba770a591c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1eb expref: 20 pid: 8413 timeout: 1171 lvb_type: 0 00000100:00100000:3.0:1763343278.747846:0:35281:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5951c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35281:1848998413025024:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343278.747870:0:35281:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c3a8a3c0 going to sleep for 11 seconds 00000004:00080000:3.0:1763343278.747909:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c39b7480/2, rc 0, transno 21474839349 00000100:00100000:3.0:1763343278.747915:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c39b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413024512:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763343278.747926:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c39b4380/2, rc 0, transno 21474839348 00000100:00100000:3.0:1763343278.747929:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c39b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413024384:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763343278.747940:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6282300/2, rc 0, transno 17179872079 00000100:00100000:3.0:1763343278.747943:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413024000:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763343278.747951:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6280a80/2, rc 0, transno 17179872078 00000100:00100000:3.0:1763343278.747955:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413023872:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343278.749725:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.750060:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400032384 00000100:00100000:0.0:1763343278.750069:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400032384 00000100:00100000:0.0:1763343278.750116:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3926 00000100:00100000:0.0:1763343278.750124:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57213:x1848998400032384:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:0.0:1763343278.750268:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57213:x1848998400032384:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 143us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343278.750276:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3926 00000100:00100000:3.0:1763343278.752065:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.752105:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.752141:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400032640 00000100:00100000:2.0:1763343278.752143:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400032512 00000100:00100000:3.0:1763343278.752149:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400032640 00000100:00100000:2.0:1763343278.752151:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400032512 00010000:00010000:2.0:1763343278.752188:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a590e lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1dd expref: 31 pid: 8414 timeout: 1171 lvb_type: 0 00010000:00010000:3.0:1763343278.752189:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a585f lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1ac expref: 31 pid: 8626 timeout: 1171 lvb_type: 1 00000100:00100000:3.0:1763343278.752236:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3615 00000100:00100000:2.0:1763343278.752244:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3616 00000100:00100000:3.0:1763343278.752252:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+31:2408:x1848998400032640:12345-192.168.201.40@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1763343278.752259:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+31:2408:x1848998400032512:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343278.752270:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343278.752275:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343278.752277:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a590e lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1dd expref: 31 pid: 8414 timeout: 1171 lvb_type: 0 00010000:00010000:3.0:1763343278.752284:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a585f lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x2e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1ac expref: 31 pid: 8626 timeout: 1171 lvb_type: 1 00010000:00010000:2.0:1763343278.752295:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a590e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1dd expref: 31 pid: 8414 timeout: 1171 lvb_type: 0 00010000:00010000:3.0:1763343278.752301:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a585f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1ac expref: 31 pid: 8626 timeout: 1171 lvb_type: 1 00010000:00010000:3.0:1763343278.752324:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.752324:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.752329:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343278.752330:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343278.752336:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5a9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.752337:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5aa4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.752359:0:6511:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5a9d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.752359:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5aa4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.752398:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343278.752398:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343278.752459:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+31:2408:x1848998400032512:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 205us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.752466:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3616 00010000:00010000:1.0:1763343278.752709:0:28561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a590e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1dd expref: 30 pid: 8414 timeout: 1171 lvb_type: 0 00000100:00100000:1.0:1763343278.752723:0:28561:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9dc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998413024768:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343278.752743:0:28561:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5aa4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.752753:0:28561:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5aa4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.752760:0:28561:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5aa4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.752769:0:28561:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5aa4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.752776:0:28561:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5aa4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.752802:0:28561:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343278.752975:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343278.752993:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5aa4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.753002:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508aa00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343278.753006:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5aa4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.753016:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5aa4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.753048:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5aa4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.753056:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5aa4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.753076:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343278.753077:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+57:3660:x1848998413023616:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6266us (6833us total) trans 17179872080 rc 0/0 00010000:00010000:2.0:1763343278.753078:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343278.753082:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343278.753090:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7593 00000004:00080000:1.0:1763343278.753147:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6282a00/2, rc 0, transno 17179872080 00000100:00100000:1.0:1763343278.753153:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413023616:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343278.753319:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.753342:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.753359:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400032768 00000100:00100000:1.0:1763343278.753364:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400032768 00010000:00010000:1.0:1763343278.753386:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a5858 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1a5 expref: 21 pid: 8626 timeout: 1171 lvb_type: 1 00000100:00100000:1.0:1763343278.753412:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400032896 00000100:00100000:1.0:1763343278.753415:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400032896 00000100:00100000:2.0:1763343278.753427:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3617 00010000:00010000:1.0:1763343278.753430:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c508b200/0x9104b1ba770a591c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1eb expref: 22 pid: 8413 timeout: 1171 lvb_type: 0 00000100:00100000:2.0:1763343278.753442:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2409:x1848998400032768:12345-192.168.201.40@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1763343278.753454:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3618 00010000:00010000:2.0:1763343278.753457:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343278.753465:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a5858 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1a5 expref: 22 pid: 8626 timeout: 1171 lvb_type: 1 00000100:00100000:1.0:1763343278.753465:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998400032896:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343278.753478:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343278.753485:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a5858 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1a5 expref: 22 pid: 8626 timeout: 1171 lvb_type: 1 00010000:00010000:1.0:1763343278.753486:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c508b200/0x9104b1ba770a591c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1eb expref: 22 pid: 8413 timeout: 1171 lvb_type: 0 00010000:00010000:1.0:1763343278.753511:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c508b200/0x9104b1ba770a591c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1eb expref: 22 pid: 8413 timeout: 1171 lvb_type: 0 00010000:00010000:2.0:1763343278.753517:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.753521:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.753525:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c508be00/0x9104b1ba770a5aab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.753526:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.753529:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.753535:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a5ab2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.753544:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a5ab2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.753551:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c508be00/0x9104b1ba770a5aab lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.753562:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343278.753570:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343278.753596:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998400032896:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 133us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.753603:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2409:x1848998400032768:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 163us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343278.753609:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3618 00000100:00100000:2.0:1763343278.753621:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3617 00010000:00010000:2.0:1763343278.753668:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177000/0x9104b1ba770a5858 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1a5 expref: 20 pid: 8626 timeout: 1171 lvb_type: 1 00000100:00100000:2.0:1763343278.753681:0:8412:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b25c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8412:1848998413024896:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343278.753700:0:8412:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c508be00/0x9104b1ba770a5aab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.753708:0:8412:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c508be00/0x9104b1ba770a5aab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.753715:0:8412:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c508be00/0x9104b1ba770a5aab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.753723:0:8412:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c508be00/0x9104b1ba770a5aab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.753730:0:8412:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c508be00/0x9104b1ba770a5aab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.753756:0:8412:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343278.753795:0:28562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a585f lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1ac expref: 29 pid: 8626 timeout: 1171 lvb_type: 1 00000100:00100000:0.0:1763343278.753808:0:28562:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9dc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28562:1848998413024640:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343278.753822:0:28562:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5a9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.753831:0:28562:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5a9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.753838:0:28562:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5a9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.753846:0:28562:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5a9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.753854:0:28562:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5a9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.753869:0:28562:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1763343278.753931:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+33:3660:x1848998413024256:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6304us (6420us total) trans 21474839350 rc 0/0 00000100:00100000:2.0:1763343278.753940:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7598 00000100:00100000:0.0:1763343278.753999:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c4b22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+57:3660:x1848998413023744:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7382us (7838us total) trans 17179872081 rc 0/0 00000100:00100000:0.0:1763343278.754006:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7592 00010000:00010000:0.0:1763343278.754046:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763343278.754052:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c508be00/0x9104b1ba770a5aab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.754059:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508be00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343278.754064:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c508be00/0x9104b1ba770a5aab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.754072:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c508be00/0x9104b1ba770a5aab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.754085:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c508be00/0x9104b1ba770a5aab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.754092:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c508be00/0x9104b1ba770a5aab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.754112:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343278.754115:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5a9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.754121:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5ba3000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343278.754123:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5a9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.754130:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5a9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.754139:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5a9d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.754146:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5ba3000/0x9104b1ba770a5a9d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.754157:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343278.754160:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343278.754161:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343278.754780:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2408:x1848998400032640:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 2529us (2718us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343278.754792:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3615 00010000:00010000:3.0:1763343278.754873:0:35281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c508b200/0x9104b1ba770a591c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a1eb expref: 19 pid: 8413 timeout: 1171 lvb_type: 0 00000100:00100000:3.0:1763343278.754885:0:35281:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5951c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35281:1848998413025024:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343278.754902:0:35281:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a5ab2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.754912:0:35281:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a5ab2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.754918:0:35281:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a5ab2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.754926:0:35281:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a5ab2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.754933:0:35281:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a5ab2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.754950:0:35281:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343278.754966:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.755144:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+33:3660:x1848998413024128:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7378us (7586us total) trans 21474839351 rc 0/0 00000100:00100000:3.0:1763343278.755152:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7599 00000100:00100000:3.0:1763343278.755167:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400033024 00000100:00100000:3.0:1763343278.755172:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400033024 00000100:00100000:3.0:1763343278.755217:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7600 00000100:00100000:3.0:1763343278.755225:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6276d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:55884:x1848998400033024:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343278.755239:0:35281:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343278.755253:0:35281:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a5ab9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a262 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.755275:0:35281:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a5a34 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a238 expref: 20 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343278.755283:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343278.755285:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343278.755288:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a5ab9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a262 expref: 20 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.755317:0:35281:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a5a34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a238 expref: 20 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343278.755329:0:35281:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a5a34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a238 expref: 20 pid: 35266 timeout: 1171 lvb_type: 1 00000100:00100000:3.0:1763343278.755341:0:35281:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c3729f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35281:1848998413025152:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343278.755404:0:35281:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c4532780 going to sleep for 11 seconds 00010000:00010000:3.0:1763343278.755416:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343278.755421:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a5ab2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.755428:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8692c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343278.755432:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a5ab2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.755440:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a5ab2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.755454:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a5ab2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.755461:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c8692c00/0x9104b1ba770a5ab2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.755474:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343278.755476:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343278.755478:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343278.755948:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343278.755985:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401efc71c00/2, rc 0, transno 21474839351 00000100:00100000:1.0:1763343278.755993:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413024128:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1763343278.756004:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401efc73100/2, rc 0, transno 21474839350 00000100:00100000:1.0:1763343278.756007:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413024256:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1763343278.756019:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6283b80/2, rc 0, transno 17179872081 00000100:00100000:1.0:1763343278.756348:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413023744:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343278.761414:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.761523:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400033152 00000100:00100000:0.0:1763343278.761533:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400033152 00010000:00010000:0.0:1763343278.761576:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a5a34 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a238 expref: 21 pid: 35266 timeout: 1171 lvb_type: 1 00000100:00100000:0.0:1763343278.761622:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3619 00000100:00100000:0.0:1763343278.761633:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6274700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998400033152:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343278.761651:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343278.761656:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a5a34 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a238 expref: 21 pid: 35266 timeout: 1171 lvb_type: 1 00010000:00010000:0.0:1763343278.761671:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a5a34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a238 expref: 21 pid: 35266 timeout: 1171 lvb_type: 1 00010000:00010000:0.0:1763343278.761697:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343278.761700:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343278.761707:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a5ab9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a262 expref: 21 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.761718:0:6511:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a5ab9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a262 expref: 21 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.761758:0:6511:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a5ab9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a262 expref: 21 pid: 35281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343278.761772:0:6511:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7918000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6511:1848998413025280:192.168.201.40@tcp:105: 00000100:00100000:0.0:1763343278.761857:0:6511:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f96c0 going to sleep for 11 seconds 00010000:00010000:3.0:1763343278.762339:0:35281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a5a34 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a238 expref: 21 pid: 35266 timeout: 1171 lvb_type: 1 00000100:00100000:3.0:1763343278.762354:0:35281:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c3729f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35281:1848998413025152:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343278.762378:0:35281:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a5ab9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a262 expref: 20 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.762387:0:35281:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8693e00, rc 0) 00000100:00100000:3.0:1763343278.762430:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6276d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:55884:x1848998400033024:12345-192.168.201.40@tcp:101:bash.0 Request processed in 7205us (7465us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343278.762437:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7600 00000100:00100000:2.0:1763343278.765473:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.765592:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400033408 00000100:00100000:3.0:1763343278.765601:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400033408 00000100:00100000:3.0:1763343278.765829:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11095 00000100:00100000:3.0:1763343278.765842:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57214:x1848998400033408:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343278.765865:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343278.765889:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5ac0 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a269 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.765966:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5ac7 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343278.765978:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5ac7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.765989:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5ac7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.766000:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5ace lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343278.766007:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5ace lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.766013:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5ace lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.766884:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5ad5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343278.766897:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5ad5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.766905:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5ad5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:3.0:1763343278.766915:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22a:0x0]: returning size 2 00010000:00010000:3.0:1763343278.766995:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5ac7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.767002:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5ac7 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.767009:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5ac7 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.767014:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8693c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343278.767018:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5ac7 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.767045:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5ac7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.767057:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4600) 00010000:00010000:3.0:1763343278.767060:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343278.767066:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5ac7 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.767071:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5ac7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.767084:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5ace lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.767089:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5ace lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.767093:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5ace lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.767098:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508be00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343278.767100:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5ace lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.767109:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5ace lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.767115:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4a00) 00010000:00010000:3.0:1763343278.767118:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343278.767120:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5ace lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.767126:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5ace lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.767168:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5ac0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a269 expref: 310 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.767183:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5ad5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a269 expref: 309 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.767190:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22a:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:3.0:1763343278.767192:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343278.767194:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c508aa00, rc 0) 00000100:00100000:3.0:1763343278.769287:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57214:x1848998400033408:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3436us (3813us total) trans 4294974009 rc 0/0 00000100:00100000:3.0:1763343278.769301:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11095 00000100:00100000:2.0:1763343278.769579:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.769682:0:6511:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7918000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6511:1848998413025280:192.168.201.40@tcp:105: 00010000:00010000:0.0:1763343278.769704:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343278.769758:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6274700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2408:x1848998400033152:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 8126us (8353us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343278.769767:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3619 00000100:00100000:3.0:1763343278.770175:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400033536 00000100:00100000:3.0:1763343278.770183:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400033536 00000100:00100000:3.0:1763343278.770230:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7601 00000100:00100000:3.0:1763343278.770239:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:55884:x1848998400033536:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343278.770255:0:35281:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343278.770277:0:35281:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5ae3 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a270 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343278.770301:0:35281:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343278.770321:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343278.770324:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343278.770334:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5ae3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a270 expref: 29 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.770350:0:35281:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5ae3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a270 expref: 29 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.770361:0:35281:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c508b200, rc 0) 00000100:00100000:3.0:1763343278.770387:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:55884:x1848998400033536:12345-192.168.201.40@tcp:101:bash.0 Request processed in 150us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343278.770393:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7601 00000100:00100000:2.0:1763343278.779403:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.779666:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400033792 00000100:00100000:0.0:1763343278.779677:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400033792 00000100:00100000:0.0:1763343278.779734:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3927 00000100:00100000:0.0:1763343278.779744:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57214:x1848998400033792:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343278.780462:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57214:x1848998400033792:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 716us (1065us total) trans 4294974010 rc 0/0 00000100:00100000:0.0:1763343278.780471:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3927 00000100:00100000:3.0:1763343278.780472:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.780519:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400034048 00000100:00100000:2.0:1763343278.780525:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400034048 00002000:00010000:2.0:1763343278.780550:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/745 (0->18446744073709551615) 00002000:00100000:2.0:1763343278.780555:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c3729f80 with x1848998400034048 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343278.780567:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c3729f80. 00000100:00100000:2.0:1763343278.780592:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1795 00000100:00100000:2.0:1763343278.780599:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:2408:x1848998400034048:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:2.0:1763343278.780745:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343278.780748:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2e9:0x0] updating lvb mtime from disk: 0 -> 1763343278 00002000:00010000:2.0:1763343278.780751:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343278.780753:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2e9:0x0] updating lvb ctime from disk: 0 -> 1763343278 00002000:00010000:2.0:1763343278.780755:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2e9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343278.780764:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.780804:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400033920 00000100:00100000:0.0:1763343278.780808:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400033920 00002000:00010000:0.0:1763343278.780822:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/744 (0->18446744073709551615) 00002000:00100000:0.0:1763343278.780825:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5951c00 with x1848998400033920 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343278.780831:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5951c00. 00000100:00100000:0.0:1763343278.780848:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1796 00000100:00100000:0.0:1763343278.780855:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2408:x1848998400033920:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:0.0:1763343278.780943:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2e8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343278.780946:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2e8:0x0] updating lvb mtime from disk: 0 -> 1763343278 00002000:00010000:0.0:1763343278.780948:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2e8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343278.780951:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2e8:0x0] updating lvb ctime from disk: 0 -> 1763343278 00002000:00010000:0.0:1763343278.780953:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2e8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343278.781391:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+30:2408:x1848998400034048:12345-192.168.201.40@tcp:10:bash.0 Request processed in 789us (916us total) trans 17179872082 rc 0/0 00000100:00100000:2.0:1763343278.781399:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1795 00002000:00010000:2.0:1763343278.781403:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/745 (0->18446744073709551615) 00002000:00100000:2.0:1763343278.781406:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c3729f80 with x1848998400034048 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343278.781411:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c3729f80. 00000100:00100000:0.0:1763343278.781468:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2408:x1848998400033920:12345-192.168.201.40@tcp:10:bash.0 Request processed in 612us (702us total) trans 21474839352 rc 0/0 00000100:00100000:0.0:1763343278.781475:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1796 00002000:00010000:0.0:1763343278.781478:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/744 (0->18446744073709551615) 00002000:00100000:0.0:1763343278.781481:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5951c00 with x1848998400033920 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343278.781485:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5951c00. 00000100:00100000:2.0:1763343278.788534:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.788687:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400034304 00000100:00100000:0.0:1763343278.788698:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400034304 00000100:00100000:0.0:1763343278.788757:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3928 00000100:00100000:0.0:1763343278.788767:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:55884:x1848998400034304:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:0.0:1763343278.789102:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:55884:x1848998400034304:12345-192.168.201.40@tcp:35:bash.0 Request processed in 336us (578us total) trans 4294974011 rc 0/0 00000100:00100000:0.0:1763343278.789110:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3928 00000100:00100000:1.0:1763343278.795677:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.795767:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400034560 00000100:00100000:3.0:1763343278.795778:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400034560 00000100:00100000:3.0:1763343278.795840:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11096 00000100:00100000:3.0:1763343278.795852:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57216:x1848998400034560:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:3.0:1763343278.795908:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763343278.795936:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5a81 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x22a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a254 expref: 311 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.795958:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5ad5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a269 expref: 310 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.795978:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5a5e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a24d expref: 309 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.795988:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22a:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:3.0:1763343278.795999:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343278.797155:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5aea lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.797173:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5aea lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.797189:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5aea lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.797218:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a5af1 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.797225:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a5af1 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.797232:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a5af1 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.797355:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5af8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.797363:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5af8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.797370:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5af8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000040:00080000:2.0:1763343278.797593:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1834, 64 off152112 00000040:00080000:2.0:1763343278.797617:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1843, 64 off152872 00000040:00080000:2.0:1763343278.797627:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1844, 64 off152936 00000040:00080000:2.0:1763343278.797636:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1835, 64 off152176 00010000:00010000:2.0:1763343278.797689:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5aff lrc: 3/0,1 mode: --/PW res: [0x240000404:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.797698:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5aff lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.797705:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5aff lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.797715:0:33856:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5aff lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x22a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.797720:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5aff lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x22a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.797725:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5aff lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x22a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.797750:0:33856:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343278.797770:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5af8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.797777:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5af8 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.797782:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5af8 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.797787:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.797792:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5af8 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.797798:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5af8 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.797809:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22a:0x0].0x0 (ffff9400c4758000) 00010000:00010000:2.0:1763343278.797811:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763343278.797815:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5af8 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.797820:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5af8 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.797934:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5aea lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.797941:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5aea lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.797946:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5aea lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.797952:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8692c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.797955:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5aea lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.797960:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5aea lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.797967:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4600) 00010000:00010000:2.0:1763343278.797970:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.797972:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5aea lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.797978:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5aea lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:2.0:1763343278.797991:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009693d5ad reply state 00000000a2d860c5 transno 4294974012 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a5af1 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.798000:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a5af1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.798006:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758600) 00010000:00010000:2.0:1763343278.798008:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343278.798011:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343278.798122:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343278.798129:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5aff lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x22a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.798134:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343278.798137:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5aff lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x22a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.798142:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5aff lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x22a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.798151:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22a:0x0].0x0 (ffff9400c4758000) 00010000:00010000:0.0:1763343278.798154:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343278.798157:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5aff lrc: 1/0,0 mode: --/PW res: [0x240000404:0x22a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.798162:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5aff lrc: 0/0,0 mode: --/PW res: [0x240000404:0x22a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.798173:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343278.798175:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343278.798177:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343278.798396:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57216:x1848998400034560:12345-192.168.201.40@tcp:36:rm.0 Request processed in 2543us (2727us total) trans 4294974012 rc 0/0 00000100:00100000:2.0:1763343278.798406:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11096 00000100:00100000:3.0:1763343278.805506:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.806609:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400034816 00000100:00100000:2.0:1763343278.806620:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400034816 00000100:00100000:2.0:1763343278.806674:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11097 00000100:00100000:2.0:1763343278.806684:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c511c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57215:x1848998400034816:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343278.806705:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.806725:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5b06 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a277 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.806795:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b0d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.806808:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b0d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.806818:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b0d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.806826:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b14 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.806832:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b14 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.806838:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b14 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.806875:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b0d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.806885:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b0d lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.806891:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b0d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.806895:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.806899:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b0d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.806905:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b0d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.806915:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758100) 00010000:00010000:2.0:1763343278.806918:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.806921:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b0d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.806926:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b0d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.806935:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b14 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.806940:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b14 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.806946:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b14 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.806950:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.806952:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b14 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.806961:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b14 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.806966:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758600) 00010000:00010000:2.0:1763343278.806968:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.806970:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b14 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.806975:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b14 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.806996:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5b06 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a277 expref: 311 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.807004:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758100) 00010000:00010000:2.0:1763343278.807006:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343278.807009:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5b06 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a277 expref: 311 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.807018:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88c00, rc 0) 00000100:00100000:2.0:1763343278.807108:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c511c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57215:x1848998400034816:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 425us (1613us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343278.807115:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11097 00000100:00100000:0.0:1763343278.812635:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.812860:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400034944 00000100:00100000:3.0:1763343278.812871:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400034944 00000100:00100000:3.0:1763343278.812932:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11098 00000100:00100000:3.0:1763343278.812942:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57215:x1848998400034944:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343278.812962:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343278.812985:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5b1b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a27e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.813069:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5b22 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343278.813082:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5b22 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.813092:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5b22 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.813102:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5b29 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343278.813109:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5b29 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.813115:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5b29 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.813153:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5b22 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.813160:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5b22 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.813166:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5b22 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.813171:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5b22 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.813177:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8692c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343278.813181:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5b22 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.813187:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5b22 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.813206:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:3.0:1763343278.813209:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343278.813213:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5b22 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.813218:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5b22 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.813230:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5b29 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.813236:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5b29 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.813241:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5b29 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.813246:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508aa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343278.813248:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5b29 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.813253:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5b29 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.813260:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758600) 00010000:00010000:3.0:1763343278.813261:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343278.813264:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5b29 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.813269:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5b29 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.813293:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5b1b lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a27e expref: 311 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.813303:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:3.0:1763343278.813306:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343278.813310:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5b1b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a27e expref: 311 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.813322:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8693c00, rc 0) 00000100:00100000:3.0:1763343278.813644:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57215:x1848998400034944:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 702us (1017us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343278.813651:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11098 00000100:00100000:3.0:1763343278.816777:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.816992:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400035072 00000100:00100000:2.0:1763343278.817004:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400035072 00000100:00100000:2.0:1763343278.817098:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11099 00000100:00100000:2.0:1763343278.817108:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57217:x1848998400035072:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343278.817129:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.817153:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5b30 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a285 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.817235:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b37 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.817249:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b37 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.817259:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b37 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.817268:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b3e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.817447:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b3e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.817454:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b3e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.817495:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b37 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.817502:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b37 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.817507:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b37 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.817513:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.817517:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b37 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.817524:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b37 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.817535:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758100) 00010000:00010000:2.0:1763343278.817538:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.817542:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b37 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.817548:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b37 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.817561:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b3e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.817567:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b3e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.817572:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b3e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.817577:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.817579:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b3e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.817585:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b3e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.817590:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758600) 00010000:00010000:2.0:1763343278.817592:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.817595:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b3e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.817599:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b3e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.817624:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5b30 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a285 expref: 311 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.817634:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758100) 00010000:00010000:2.0:1763343278.817636:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.817639:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5b30 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a285 expref: 311 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.817650:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88c00, rc 0) 00000100:00100000:2.0:1763343278.817709:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57217:x1848998400035072:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 603us (942us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343278.817716:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11099 00000100:00100000:0.0:1763343278.823211:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.823818:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400035200 00000100:00100000:2.0:1763343278.823829:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400035200 00000100:00100000:3.0:1763343278.823938:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11100 00000100:00100000:3.0:1763343278.823951:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57217:x1848998400035200:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343278.823970:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343278.823992:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5b45 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a28c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.824080:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5b4c lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343278.824094:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5b4c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.824103:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5b4c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.824114:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5b53 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343278.824120:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5b53 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.824126:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5b53 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.824162:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5b4c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.824168:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5b4c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.824173:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5b4c lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.824179:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5b4c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.824189:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508be00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343278.824193:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5b4c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.824211:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5b4c lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.824222:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:3.0:1763343278.824225:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343278.824231:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5b4c lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.824237:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5b4c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.824249:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5b53 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.824254:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5b53 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.824259:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5b53 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.824263:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c8693c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343278.824266:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5b53 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.824271:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5b53 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.824278:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758600) 00010000:00010000:3.0:1763343278.824280:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343278.824283:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5b53 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.824288:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5b53 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.824313:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5b45 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a28c expref: 311 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.824322:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:3.0:1763343278.824324:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343278.824327:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5b45 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a28c expref: 311 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.824339:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c508aa00, rc 0) 00000100:00100000:3.0:1763343278.824740:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57217:x1848998400035200:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 790us (1548us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343278.824748:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11100 00000100:00100000:0.0:1763343278.827677:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.827978:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400035584 00000100:00100000:3.0:1763343278.827990:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400035584 00000100:00100000:3.0:1763343278.828122:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11101 00000100:00100000:3.0:1763343278.828133:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57217:x1848998400035584:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343278.828152:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343278.828175:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5b5a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a29a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343278.828188:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:3.0:1763343278.828255:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5b61 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343278.828268:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5b61 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.828279:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5b61 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:3.0:1763343278.828326:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763343278.828331:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1763343278.828366:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5b5a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a29a expref: 312 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.828384:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5b61 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a29a expref: 311 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.828393:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4a00) 00010000:00010000:3.0:1763343278.828396:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763343278.828399:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121e200, rc 0) 00000100:00100000:1.0:1763343278.828441:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400035456 00000100:00100000:3.0:1763343278.828468:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57217:x1848998400035584:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 337us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343278.828475:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11101 00000100:00100000:1.0:1763343278.828525:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400035456 00000100:00100000:2.0:1763343278.828556:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11102 00000100:00100000:2.0:1763343278.828565:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57218:x1848998400035456:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343278.828574:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.828583:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5b68 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a293 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.828627:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b6f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.828636:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b6f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.828643:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b6f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.828651:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b76 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.828662:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b76 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.828667:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b76 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.828694:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b6f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.828699:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b6f lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.828705:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b6f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.828711:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.828714:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b6f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.828721:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b6f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.828728:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4a00) 00010000:00010000:2.0:1763343278.828730:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.828733:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b6f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.828738:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5b6f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.828745:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b76 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.828751:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b76 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.828756:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b76 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.828761:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.828763:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b76 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.828768:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b76 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.828773:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758600) 00010000:00010000:2.0:1763343278.828775:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.828777:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b76 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.828781:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5b76 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.828798:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5b68 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a293 expref: 312 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.828807:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4a00) 00010000:00010000:2.0:1763343278.828809:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343278.828812:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5b68 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a293 expref: 312 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.828819:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88c00, rc 0) 00000100:00100000:2.0:1763343278.828840:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57218:x1848998400035456:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 277us (652us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343278.828846:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11102 00000100:00100000:0.0:1763343278.836530:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.837581:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400035840 00000100:00100000:3.0:1763343278.837595:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400035840 00000100:00100000:3.0:1763343278.837666:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11103 00000100:00100000:3.0:1763343278.837677:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57217:x1848998400035840:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343278.837700:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343278.837703:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343278.837736:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5b61 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a29a expref: 311 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.837756:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4a00) 00010000:00010000:3.0:1763343278.837767:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343278.837782:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5b7d lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a2a1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.837881:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5b84 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343278.837894:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5b84 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.837903:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5b84 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.837912:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5b8b lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343278.837919:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5b8b lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.837924:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5b8b lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.838367:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5b92 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343278.838377:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5b92 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.838385:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5b92 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:3.0:1763343278.838394:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22b:0x0]: returning size 0 00010000:00010000:3.0:1763343278.838422:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5b84 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.838428:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5b84 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.838433:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5b84 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.838439:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5b84 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.838444:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121fc00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343278.838448:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5b84 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.838454:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5b84 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.838463:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:3.0:1763343278.838465:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343278.838469:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5b84 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.838475:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5b84 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00000004:00010000:3.0:1763343278.838484:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a76ee2f7 reply state 000000003316b0c8 transno 4294974013 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5b8b lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.838495:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5b8b lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.838501:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758600) 00010000:00010000:3.0:1763343278.838503:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343278.838505:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343278.838533:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5b7d lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2a1 expref: 313 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.838551:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5b92 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2a1 expref: 312 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.838557:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9401fd0d4e00) 00010000:00010000:3.0:1763343278.838559:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343278.838562:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8693c00, rc 0) 00000100:00100000:3.0:1763343278.838620:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57217:x1848998400035840:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 945us (2102us total) trans 4294974013 rc 0/0 00000100:00100000:3.0:1763343278.838627:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11103 00000100:00100000:0.0:1763343278.842606:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.842661:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.842760:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400036096 00000100:00100000:2.0:1763343278.842772:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400036096 00000100:00100000:2.0:1763343278.842838:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400036352 00000100:00100000:2.0:1763343278.842842:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400036352 00000100:00100000:2.0:1763343278.842879:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11104 00000100:00100000:2.0:1763343278.842888:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57217:x1848998400036096:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343278.842917:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.842944:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5ba0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a2a8 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343278.843067:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11105 00010000:00010000:3.0:1763343278.843120:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343278.843120:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5ba7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00000100:00100000:3.0:1763343278.843129:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57219:x1848998400036352:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343278.843135:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5b92 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2a1 expref: 315 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.843137:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343278.843145:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5bae lrc: 2/0,0 mode: --/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a2af expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.843145:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5ba7 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.843184:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5bb5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343278.843190:0:33856:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5b92 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2a1 expref: 316 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.843214:0:33856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5b92 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2a1 expref: 316 pid: 6525 timeout: 1171 lvb_type: 0 00000100:00100000:2.0:1763343278.843226:0:33856:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a38e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998413025408:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343278.843315:0:33856:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c53049c0 going to sleep for 11 seconds 00010000:00010000:3.0:1763343278.844902:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5bb5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343278.844921:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5bb5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:3.0:1763343278.844937:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22b:0x0]: returning size 0 00010000:00010000:2.0:1763343278.845178:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5bb5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.845186:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5bb5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.845193:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5bb5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.845207:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508aa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.845212:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5bb5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.845219:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5bb5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.845233:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9401fd0d4e00) 00010000:00010000:2.0:1763343278.845236:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1763343278.845240:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5bb5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.845245:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5bb5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.845343:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5bae lrc: 1/0,0 mode: --/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2af expref: 317 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.845353:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9401fd0d4e00) 00010000:00010000:2.0:1763343278.845356:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343278.845359:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8692c00/0x9104b1ba770a5bae lrc: 0/0,0 mode: --/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2af expref: 317 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.845367:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c8692c00, rc 0) 00000100:00100000:2.0:1763343278.846165:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57219:x1848998400036352:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3087us (3499us total) trans 4294974014 rc 301/301 00000100:00100000:2.0:1763343278.846175:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11105 00000100:00100000:0.0:1763343278.846424:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.846619:0:33856:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a38e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998413025408:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343278.846687:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5ba7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:2.0:1763343278.846721:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400036480 00000100:00100000:2.0:1763343278.846728:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400036480 00010000:00010000:2.0:1763343278.846756:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5b92 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2a1 expref: 316 pid: 6525 timeout: 1171 lvb_type: 0 00000100:00100000:2.0:1763343278.846786:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3620 00000100:00100000:2.0:1763343278.846794:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:2408:x1848998400036480:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343278.846806:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343278.846811:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5b92 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2a1 expref: 316 pid: 6525 timeout: 1171 lvb_type: 0 00010000:00010000:2.0:1763343278.846821:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5b92 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2a1 expref: 316 pid: 6525 timeout: 1171 lvb_type: 0 00010000:00010000:2.0:1763343278.846839:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c8693c00/0x9104b1ba770a5b92 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2a1 expref: 316 pid: 6525 timeout: 1171 lvb_type: 0 00010000:00010000:2.0:1763343278.846851:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9401fd0d4e00) 00010000:00010000:2.0:1763343278.846855:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5ba7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.846863:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5ba7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.846869:0:6511:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5ba7 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.846888:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343278.846923:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:2408:x1848998400036480:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 131us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.846932:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3620 00010000:00010000:3.0:1763343278.847079:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5ba7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.847087:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5ba7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:3.0:1763343278.847112:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22b:0x0]: returning size 0 00000004:00080000:2.0:1763343278.848867:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2eb:0x0], index 1: 0 00000004:00080000:2.0:1763343278.848885:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2ea:0x0], index 0: 0 00000004:00080000:2.0:1763343278.848891:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2eb:0x0], index 0: 0 00000004:00080000:2.0:1763343278.848894:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2ec:0x0], index 1: 0 00010000:00010000:2.0:1763343278.849055:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5ba7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.849066:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5ba7 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.849073:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5ba7 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.849079:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.849083:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5ba7 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.849091:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5ba7 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.849106:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9401fd0d4e00) 00010000:00010000:2.0:1763343278.849109:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343278.849113:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5ba7 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.849119:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5ba7 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.849171:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5ba0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2a8 expref: 315 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.849186:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9401fd0d4e00) 00010000:00010000:2.0:1763343278.849188:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343278.849191:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5ba0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2a8 expref: 315 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.849214:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88c00, rc 0) 00000100:00100000:2.0:1763343278.849265:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57217:x1848998400036096:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 6377us (6669us total) trans 4294974015 rc 301/301 00000100:00100000:2.0:1763343278.849282:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11104 00000100:00100000:1.0:1763343278.853854:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.854377:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.854505:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400036736 00000100:00100000:2.0:1763343278.854516:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400036736 00000100:00100000:2.0:1763343278.854570:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400036992 00000100:00100000:2.0:1763343278.854573:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400036992 00000100:00100000:2.0:1763343278.854590:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3929 00000100:00100000:2.0:1763343278.854599:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57219:x1848998400036736:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343278.855015:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3930 00000100:00100000:0.0:1763343278.855039:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57217:x1848998400036992:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343278.856465:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57217:x1848998400036992:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1435us (2083us total) trans 4294974017 rc 0/0 00000100:00100000:0.0:1763343278.856476:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3930 00000100:00100000:2.0:1763343278.857340:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57219:x1848998400036736:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1756us (2510us total) trans 4294974016 rc 0/0 00000100:00100000:2.0:1763343278.857350:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3929 00000100:00100000:0.0:1763343278.860443:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.860764:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.860835:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400037248 00000100:00100000:0.0:1763343278.860844:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400037248 00000100:00100000:0.0:1763343278.860900:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3931 00000100:00100000:0.0:1763343278.860911:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82d7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57217:x1848998400037248:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343278.861135:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82d7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57217:x1848998400037248:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 225us (873us total) trans 4294974018 rc 0/0 00000100:00100000:0.0:1763343278.861143:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3931 00000100:00100000:2.0:1763343278.862556:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400037504 00000100:00100000:2.0:1763343278.862567:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400037504 00000100:00100000:2.0:1763343278.862619:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11106 00000100:00100000:2.0:1763343278.862629:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57219:x1848998400037504:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343278.862647:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.862672:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5bca lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a2b6 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.862750:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5bd1 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.862763:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5bd1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.862774:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5bd1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.862784:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5bd8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.862792:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5bd8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.862799:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5bd8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.862902:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5bdf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.862909:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5bdf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.862916:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5bdf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:2.0:1763343278.862925:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22b:0x0]: returning size 0 00010000:00010000:2.0:1763343278.862985:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5bd1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.862992:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5bd1 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.863001:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5bd1 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.863007:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.863011:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5bd1 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.863017:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5bd1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.863046:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758100) 00010000:00010000:2.0:1763343278.863050:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.863054:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5bd1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.863060:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5bd1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.863070:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5bd8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.863075:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5bd8 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.863081:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5bd8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.863085:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.863088:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5bd8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.863094:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5bd8 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.863105:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758600) 00010000:00010000:2.0:1763343278.863107:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.863110:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5bd8 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.863115:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5bd8 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.863147:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5bca lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2b6 expref: 320 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.863162:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5bdf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2b6 expref: 319 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.863168:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c4758800) 00010000:00010000:2.0:1763343278.863170:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343278.863173:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89000, rc 0) 00000100:00100000:2.0:1763343278.863240:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:57219:x1848998400037504:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 612us (2799us total) trans 4294974019 rc 0/0 00000100:00100000:2.0:1763343278.863247:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11106 00000100:00100000:1.0:1763343278.867316:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.867494:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400037632 00000100:00100000:0.0:1763343278.867506:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400037632 00000100:00100000:0.0:1763343278.867565:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7602 00000100:00100000:0.0:1763343278.867575:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+30:2408:x1848998400037632:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343278.867592:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.867615:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5bed lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a2bd expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343278.867638:0:28562:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343278.867657:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343278.867660:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343278.867669:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5bed lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2bd expref: 31 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343278.867687:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5bed lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2bd expref: 31 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343278.867700:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b400, rc 0) 00000100:00100000:0.0:1763343278.867762:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+31:2408:x1848998400037632:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 188us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343278.867770:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7602 00000100:00100000:0.0:1763343278.870128:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.870176:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400037888 00000100:00100000:2.0:1763343278.870186:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400037888 00000100:00100000:2.0:1763343278.870256:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11107 00000100:00100000:2.0:1763343278.870265:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:55884:x1848998400037888:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343278.870302:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.870305:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343278.870331:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5bdf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2b6 expref: 319 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.870354:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c4758800) 00010000:00010000:2.0:1763343278.870364:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343278.870388:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5bf4 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a2c4 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.870503:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5bfb lrc: 3/0,1 mode: --/CW res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.870515:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5bfb lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x22b:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.870525:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5bfb lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x22b:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:2.0:1763343278.870540:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22b:0x0]: returning size 0 00000100:00100000:1.0:1763343278.870643:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:2.0:1763343278.870653:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5bf4 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2c4 expref: 321 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.870665:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5bfb lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x22b:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2c4 expref: 320 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.870672:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c4758100) 00010000:00010000:2.0:1763343278.870675:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:2.0:1763343278.870678:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89200, rc 0) 00000100:00100000:2.0:1763343278.870730:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+320:55884:x1848998400037888:12345-192.168.201.40@tcp:101:bash.0 Request processed in 466us (612us total) trans 4294974020 rc 0/0 00000100:00100000:2.0:1763343278.870738:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11107 00000100:00100000:2.0:1763343278.871240:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400038016 00000100:00100000:2.0:1763343278.871247:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400038016 00000100:00100000:3.0:1763343278.871292:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11108 00000100:00100000:3.0:1763343278.871302:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+320:57219:x1848998400038016:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343278.871312:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343278.871323:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5c09 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a2cb expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.871354:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5c09 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2cb expref: 321 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.871368:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5c09 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2cb expref: 321 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.871535:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c4758100) 00010000:00010000:2.0:1763343278.871539:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343278.871542:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c508be00, rc 0) 00000100:00100000:2.0:1763343278.871584:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:57219:x1848998400038016:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 284us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.871590:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11108 00000100:00100000:1.0:1763343278.873627:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.874089:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.874128:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400038400 00000100:00100000:0.0:1763343278.874141:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400038400 00000100:00100000:2.0:1763343278.874146:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400038272 00000100:00100000:2.0:1763343278.874151:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400038272 00000100:00100000:0.0:1763343278.874189:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11109 00000100:00100000:2.0:1763343278.874190:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3932 00000100:00100000:2.0:1763343278.874207:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c39b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+322:57219:x1848998400038272:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343278.874207:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+322:55884:x1848998400038400:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343278.874231:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.874250:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a5c10 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a2d2 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.874285:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5c17 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343278.874300:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5c17 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.874313:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5c17 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343278.874419:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a5c10 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2d2 expref: 324 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.874434:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5c17 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2d2 expref: 323 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.874442:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c4758100) 00010000:00010000:0.0:1763343278.874445:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343278.874448:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a800, rc 0) 00000100:00100000:0.0:1763343278.874516:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+324:55884:x1848998400038400:12345-192.168.201.40@tcp:101:bash.0 Request processed in 319us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343278.874524:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11109 00000100:00100000:2.0:1763343278.874612:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c39b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+323:57219:x1848998400038272:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 415us (1167us total) trans 4294974021 rc 0/0 00000100:00100000:2.0:1763343278.874620:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3932 00000100:00100000:3.0:1763343278.876118:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.876181:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.876306:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400038784 00000100:00100000:2.0:1763343278.876314:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400038784 00000100:00100000:2.0:1763343278.876351:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400038912 00000100:00100000:2.0:1763343278.876354:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400038912 00000100:00100000:2.0:1763343278.876377:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11110 00000100:00100000:2.0:1763343278.876385:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+324:55884:x1848998400038784:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:2.0:1763343278.876433:0:7641:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343278.876455:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5bfb lrc: 0/0,0 mode: --/CW res: [0x240000404:0x22b:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2c4 expref: 324 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.876470:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c4758100) 00010000:00010000:2.0:1763343278.876474:0:7641:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343278.876622:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5c1e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343278.876635:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5c1e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.876644:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5c1e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000001:00080000:2.0:1763343278.876687:0:7641:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294974022 00000004:00010000:2.0:1763343278.876707:0:7641:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000597c17d2 reply state 000000003b4ddb2d transno 4294974023 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5c1e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.876718:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5c1e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.876724:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c4758100) 00010000:00010000:2.0:1763343278.876727:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343278.876729:0:7641:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343278.876801:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+326:55884:x1848998400038784:12345-192.168.201.40@tcp:36:bash.0 Request processed in 416us (690us total) trans 4294974023 rc 0/0 00000100:00100000:2.0:1763343278.876808:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11110 00000020:00080000:2.0:1763343278.876814:0:7641:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763343278.876831:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11111 00000100:00100000:2.0:1763343278.876838:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+325:57219:x1848998400038912:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343278.876846:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.876857:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5c25 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a2d9 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.876898:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5c2c lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343278.876906:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5c2c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.876914:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5c2c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.876923:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5c33 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343278.876930:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5c33 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.876936:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5c33 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.877005:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5c3a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343278.877013:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5c3a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.877019:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5c3a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:2.0:1763343278.877055:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22b:0x0]: returning size 0 00010000:00010000:2.0:1763343278.877106:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5c2c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.877113:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5c2c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.877119:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5c2c lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.877124:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5c2c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.877130:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.877134:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5c2c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.877140:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5c2c lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.877149:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758800) 00010000:00010000:2.0:1763343278.877152:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.877155:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5c2c lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.877161:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5c2c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.877169:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5c33 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.877175:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5c33 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.877180:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5c33 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.877185:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.877187:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5c33 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.877192:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5c33 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.877210:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758600) 00010000:00010000:2.0:1763343278.877212:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.877215:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5c33 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.877225:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5c33 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.877252:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5c25 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2d9 expref: 328 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.877267:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5c3a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2d9 expref: 327 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.877274:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c4758100) 00010000:00010000:2.0:1763343278.877277:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343278.877279:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89600, rc 0) 00000100:00100000:2.0:1763343278.877313:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+327:57219:x1848998400038912:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 476us (1132us total) trans 4294974024 rc 0/0 00000100:00100000:2.0:1763343278.877319:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11111 00000100:00100000:1.0:1763343278.880123:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.880794:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400039168 00000100:00100000:3.0:1763343278.880805:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400039168 00000100:00100000:3.0:1763343278.880865:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11112 00000100:00100000:3.0:1763343278.880875:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+327:55884:x1848998400039168:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343278.880898:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343278.880901:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343278.880927:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5c09 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2cb expref: 327 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.880944:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c4758100) 00010000:00010000:3.0:1763343278.880949:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343278.880961:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5c48 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a2e0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.881011:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5c4f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343278.881050:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5c3a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2d9 expref: 327 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.881060:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5c4f lrc: 4/0,1 mode: --/EX res: [0x240000404:0x22b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343278.881094:0:9827:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5c3a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2d9 expref: 327 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.881107:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5c3a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2d9 expref: 327 pid: 7641 timeout: 1172 lvb_type: 0 00000100:00100000:3.0:1763343278.881119:0:9827:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c8bc2680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998413025536:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343278.881213:0:9827:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c4532f00 going to sleep for 11 seconds 00000100:00100000:0.0:1763343278.881256:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.881681:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400039424 00000100:00100000:3.0:1763343278.881687:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400039424 00000100:00100000:3.0:1763343278.882088:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3933 00000100:00100000:3.0:1763343278.882098:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+328:57219:x1848998400039424:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343278.882926:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+329:57219:x1848998400039424:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 825us (1665us total) trans 4294974025 rc 0/0 00000100:00100000:2.0:1763343278.882935:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3933 00000100:00100000:3.0:1763343278.883395:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c8bc2680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998413025536:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343278.883422:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5c4f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:1.0:1763343278.885162:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.885230:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.885320:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400039680 00000100:00100000:2.0:1763343278.885329:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400039680 00000100:00100000:2.0:1763343278.885376:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3934 00000100:00100000:2.0:1763343278.885386:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+329:57219:x1848998400039680:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:2.0:1763343278.885541:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+329:57219:x1848998400039680:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 156us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.885553:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3934 00000100:00100000:0.0:1763343278.885588:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400039552 00000100:00100000:0.0:1763343278.885594:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400039552 00010000:00010000:0.0:1763343278.885619:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5c3a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2d9 expref: 329 pid: 7641 timeout: 1172 lvb_type: 0 00000100:00100000:0.0:1763343278.885652:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3621 00000100:00100000:0.0:1763343278.885661:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5865880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+329:2409:x1848998400039552:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343278.885671:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343278.885677:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5c3a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2d9 expref: 329 pid: 7641 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343278.885695:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5c3a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2d9 expref: 329 pid: 7641 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343278.885725:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5c3a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2d9 expref: 329 pid: 7641 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343278.885741:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c4758100) 00010000:00010000:0.0:1763343278.885746:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5c4f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.885755:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5c4f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.885765:0:7904:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5c4f lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.885794:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343278.885980:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5865880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+328:2409:x1848998400039552:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 318us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343278.885988:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3621 00010000:00010000:0.0:1763343278.886015:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5c4f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.886044:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5c4f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000040:00080000:0.0:1763343278.886603:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1845, 88 off153024 00000004:00080000:0.0:1763343278.886613:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1072010588514ns, next at 1072111826735ns, rc = 0 00000040:00080000:0.0:1763343278.886653:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1836, 88 off152264 00000004:00080000:0.0:1763343278.886659:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1072010634430ns, next at 1072111852630ns, rc = 0 00000040:00080000:0.0:1763343278.886687:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1837, 88 off152352 00000004:00080000:0.0:1763343278.886694:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1072010669037ns, next at 1072111852630ns, rc = 0 00000040:00080000:0.0:1763343278.886710:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1846, 88 off153112 00000004:00080000:0.0:1763343278.886715:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1072010690284ns, next at 1072111826735ns, rc = 0 00000001:00080000:0.0:1763343278.896537:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974026 is committed 00000004:00080000:0.0:1763343278.896553:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1182 committed 00000004:00080000:0.0:1763343278.896568:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1174 committed 00000004:00080000:0.0:1763343278.896579:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1173 committed 00000004:00080000:0.0:1763343278.896581:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1181 committed 00000100:00100000:0.0:1763343278.896768:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c8bc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413025664:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1763343278.896840:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a5af1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.896853:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a5af1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00000100:00100000:0.0:1763343278.896860:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763343278.896865:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a5af1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00000100:00100000:3.0:1763343278.896905:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413025664 00000100:00100000:0.0:1763343278.896905:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6403100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413026176:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343278.896915:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413025664 00000100:00100000:0.0:1763343278.896941:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763343278.896959:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.896966:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a5af1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00000100:00100000:0.0:1763343278.896969:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00010000:00010000:2.0:1763343278.896976:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a5af1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00000100:00100000:0.0:1763343278.896979:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c7ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413025792:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1763343278.896995:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758600) 00010000:00010000:2.0:1763343278.896999:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.897004:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a5af1 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.897010:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a5af1 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000100:00100000:0.0:1763343278.897015:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763343278.897047:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5b8b lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.897054:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5b8b lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.897059:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5b8b lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.897063:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.897066:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5b8b lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.897071:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5b8b lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.897078:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758600) 00010000:00010000:2.0:1763343278.897080:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.897082:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5b8b lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.897087:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5b8b lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343278.897101:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5c1e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.897106:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5c1e lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.897111:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5c1e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.897115:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.897117:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5c1e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.897122:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5c1e lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.897127:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c4758100) 00010000:00010000:2.0:1763343278.897129:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.897131:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5c1e lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:2.0:1763343278.897136:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5c1e lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00000100:00100000:1.0:1763343278.897379:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.897405:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400039936 00000100:00100000:1.0:1763343278.897409:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400039936 00000100:00100000:3.0:1763343278.897433:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413026176 00000100:00100000:3.0:1763343278.897437:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413026176 00000100:00100000:1.0:1763343278.897442:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11113 00000100:00100000:1.0:1763343278.897451:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57220:x1848998400039936:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:3.0:1763343278.897459:0:35281:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413025792 00000100:00100000:3.0:1763343278.897463:0:35281:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413025792 00000100:00100000:0.0:1763343278.897463:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413026304:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1763343278.897472:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1763343278.897490:0:35281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7603 00010000:00010000:1.0:1763343278.897497:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a5c56 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a2e7 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343278.897499:0:35281:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+57:3659:x1848998413025664:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343278.897501:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1763343278.897525:0:35281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:745 count 1 00000100:00100000:0.0:1763343278.897535:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413025920:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1763343278.897547:0:35281:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5c5d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2e9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343278.897563:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343278.897567:0:35281:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5ae3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a270 expref: 30 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.897576:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343278.897578:0:35281:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343278.897582:0:35281:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5c5d lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343278.897583:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413026432:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1763343278.897621:0:35281:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5ae3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a270 expref: 30 pid: 35281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343278.897626:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343278.897637:0:35281:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5ae3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a270 expref: 30 pid: 35281 timeout: 1172 lvb_type: 0 00000100:00100000:0.0:1763343278.897650:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1763343278.897655:0:35281:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35281:1848998413026688:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343278.897660:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413026048:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343278.897728:0:35281:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c4532f00 going to sleep for 11 seconds 00000100:00100000:3.0:1763343278.897742:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413026304 00000100:00100000:3.0:1763343278.897746:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413026304 00000100:00100000:3.0:1763343278.897767:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413025920 00000100:00100000:3.0:1763343278.897769:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413025920 00000100:00100000:3.0:1763343278.897780:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413026432 00000100:00100000:3.0:1763343278.897782:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413026432 00000100:00100000:3.0:1763343278.897791:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7604 00000100:00100000:3.0:1763343278.897797:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+36:3659:x1848998413026176:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343278.897863:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343278.897875:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413026560:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343278.897893:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343278.897916:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413026048 00000100:00100000:0.0:1763343278.897919:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413026048 00000100:00100000:0.0:1763343278.897938:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413026560 00000100:00100000:0.0:1763343278.897941:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413026560 00000100:00100000:0.0:1763343278.897953:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7605 00000100:00100000:0.0:1763343278.897960:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+37:3659:x1848998413025792:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343278.897970:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+37:3659:x1848998413026176:12345-0@lo:2:osp-syn-0-1.0 Request processed in 171us (1029us total) trans 21474839353 rc 0/0 00002000:00080000:0.0:1763343278.897974:0:28561:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:744 count 1 00000100:00100000:3.0:1763343278.897980:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7604 00010000:00010000:0.0:1763343278.897989:0:28561:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c501a600/0x9104b1ba770a5c64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343278.898000:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7606 00010000:00010000:0.0:1763343278.898005:0:28561:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a5ab9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a262 expref: 19 pid: 35281 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343278.898009:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+60:3659:x1848998413026304:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1763343278.898019:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343278.898021:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343278.898043:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501a600/0x9104b1ba770a5c64 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.898065:0:28561:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a5ab9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a262 expref: 19 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.898074:0:28561:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a5ab9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a262 expref: 19 pid: 35281 timeout: 1172 lvb_type: 0 00000100:00100000:0.0:1763343278.898085:0:28561:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28561:1848998413026816:192.168.201.40@tcp:104: 00002000:00010000:3.0:1763343278.898103:0:8626:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2eb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343278.898108:0:8626:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2eb:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343278.898110:0:8626:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2eb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343278.898113:0:8626:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2eb:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343278.898115:0:8626:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2eb:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343278.898116:0:28561:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343278.898133:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7607 00000100:00100000:3.0:1763343278.898141:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+61:3659:x1848998413026304:12345-0@lo:2:osp-syn-1-1.0 Request processed in 134us (643us total) trans 17179872083 rc 0/0 00000100:00100000:0.0:1763343278.898144:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+36:3661:x1848998413025920:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343278.898152:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7606 00002000:00080000:0.0:1763343278.898164:0:28562:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:745 count 1 00000100:00100000:3.0:1763343278.898171:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7608 00000100:00100000:3.0:1763343278.898179:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+36:3661:x1848998413026432:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763343278.898182:0:28562:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343278.898190:0:28562:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c501aa00/0x9104b1ba770a5c6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.898209:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343278.898210:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343278.898214:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501aa00/0x9104b1ba770a5c6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.898229:0:28562:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c501aa00/0x9104b1ba770a5c6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.898237:0:28562:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c501aa00/0x9104b1ba770a5c6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.898245:0:28562:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501aa00/0x9104b1ba770a5c6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343278.898258:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7609 00010000:00010000:0.0:1763343278.898263:0:28562:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343278.898325:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+60:3661:x1848998413026048:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763343278.898339:0:8412:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:746 count 1 00002000:00010000:2.0:1763343278.898355:0:8412:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343278.898361:0:8412:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5c72 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.898369:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.898371:0:8412:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.898374:0:8412:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5c72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.898385:0:8412:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5c72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.898393:0:8412:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5c72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.898400:0:8412:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5c72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.898416:0:8412:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1763343278.898421:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+37:3661:x1848998413025920:12345-0@lo:6:osp-syn-0-1.0 Request processed in 278us (856us total) trans 21474839354 rc 0/0 00000100:00100000:0.0:1763343278.898436:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7607 00000100:00100000:0.0:1763343278.898457:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7610 00000100:00100000:0.0:1763343278.898466:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+61:3661:x1848998413026560:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343278.898539:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+62:3661:x1848998413026048:12345-0@lo:6:osp-syn-1-1.0 Request processed in 272us (674us total) trans 17179872084 rc 0/0 00010000:00010000:1.0:1763343278.898539:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a5c79 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00000100:00100000:2.0:1763343278.898546:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7609 00010000:00010000:1.0:1763343278.898550:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a5c79 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.898559:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a5c79 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.898572:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5c80 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00000100:00100000:0.0:1763343278.898573:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+61:3661:x1848998413026560:12345-0@lo:2:osp-syn-1-1.0 Request processed in 108us (676us total) trans 17179872085 rc 0/0 00010000:00010000:1.0:1763343278.898587:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5c80 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00000100:00100000:0.0:1763343278.898593:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7610 00010000:00010000:1.0:1763343278.898600:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5c80 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.898629:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763343278.898636:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c501aa00/0x9104b1ba770a5c6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.898644:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501aa00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343278.898648:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c501aa00/0x9104b1ba770a5c6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.898656:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c501aa00/0x9104b1ba770a5c6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.898672:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c501aa00/0x9104b1ba770a5c6b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.898679:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c501aa00/0x9104b1ba770a5c6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.898688:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5c87 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343278.898693:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343278.898697:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5c72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.898699:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5c87 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.898710:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343278.898714:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5c72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.898715:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5c87 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.898733:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5c72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.898743:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5c72 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.898750:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5c72 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.898760:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343278.898762:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343278.898763:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343278.898770:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343278.898797:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bfc700/2, rc 0, transno 17179872084 00000100:00100000:0.0:1763343278.898803:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413026048:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1763343278.898812:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c586d500/2, rc 0, transno 17179872085 00000100:00100000:0.0:1763343278.898815:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413026560:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763343278.898823:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6488000/2, rc 0, transno 21474839354 00000100:00100000:0.0:1763343278.898827:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413025920:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763343278.898868:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5c4f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x22b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2e0 expref: 309 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.898877:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c4758100) 00010000:00010000:0.0:1763343278.898880:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343278.898892:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5c48 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2e0 expref: 309 pid: 9827 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763343278.898905:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5c4f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x22b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2e0 expref: 308 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.898928:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c4758100) 00010000:00010000:0.0:1763343278.898930:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343278.898932:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121e800, rc 0) 00000100:00100000:0.0:1763343278.898959:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:55884:x1848998400039168:12345-192.168.201.40@tcp:101:bash.0 Request processed in 18085us (18846us total) trans 4294974026 rc 0/0 00000100:00100000:0.0:1763343278.898966:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11112 00000100:00100000:3.0:1763343278.899020:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+37:3661:x1848998413026432:12345-0@lo:2:osp-syn-0-1.0 Request processed in 841us (1405us total) trans 21474839355 rc 0/0 00000100:00100000:3.0:1763343278.899051:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7608 00000004:00080000:3.0:1763343278.899104:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5bfce00/2, rc 0, transno 17179872083 00000100:00100000:3.0:1763343278.899109:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413026304:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763343278.899118:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6403100/2, rc 0, transno 21474839353 00000100:00100000:3.0:1763343278.899122:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6403100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413026176:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763343278.899177:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c586a680/2, rc 0, transno 21474839355 00000100:00100000:0.0:1763343278.899184:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413026432:0@lo:2:osp-syn-0-1.0 00000004:00200000:1.0:1763343278.900564:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22b:0x0]: returning size 2 00010000:00010000:1.0:1763343278.900675:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5c87 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.900685:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5c87 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.900697:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5c87 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.900702:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.900706:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5c87 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.900713:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5c87 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.900725:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c4758100) 00010000:00010000:1.0:1763343278.900728:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1763343278.900732:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5c87 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.900737:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5c87 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.900752:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a5c79 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.900757:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a5c79 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.900763:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a5c79 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.900768:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.900771:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a5c79 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.900776:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a5c79 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.900786:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5000) 00010000:00010000:1.0:1763343278.900789:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.900791:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a5c79 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.900797:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a5c79 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.900804:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5c80 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.900809:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5c80 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.900814:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5c80 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.900819:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.900822:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5c80 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.900827:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5c80 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.900833:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5e00) 00010000:00010000:1.0:1763343278.900836:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.900838:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5c80 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.900843:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5c80 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.900887:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a5c56 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2e7 expref: 308 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.900897:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5000) 00010000:00010000:1.0:1763343278.900899:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343278.900903:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a5c56 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2e7 expref: 308 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.900913:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176a00, rc 0) 00000100:00100000:1.0:1763343278.900967:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57220:x1848998400039936:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3516us (3589us total) trans 4294974027 rc 301/301 00000100:00100000:1.0:1763343278.900975:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11113 00000100:00100000:0.0:1763343278.901775:0:28561:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28561:1848998413026816:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343278.901803:0:28561:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c501a600/0x9104b1ba770a5c64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343278.901830:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.901863:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.901875:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400040064 00000100:00100000:0.0:1763343278.901883:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400040064 00010000:00010000:0.0:1763343278.901914:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a5ab9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a262 expref: 20 pid: 35281 timeout: 1172 lvb_type: 0 00000100:00100000:0.0:1763343278.901953:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3622 00000100:00100000:0.0:1763343278.901963:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2407:x1848998400040064:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343278.901978:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343278.901983:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a5ab9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a262 expref: 20 pid: 35281 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343278.901993:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a5ab9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a262 expref: 20 pid: 35281 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343278.902014:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c8693e00/0x9104b1ba770a5ab9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a262 expref: 20 pid: 35281 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343278.902052:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343278.902054:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343278.902060:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c501a600/0x9104b1ba770a5c64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.902068:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501a600/0x9104b1ba770a5c64 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.902101:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343278.902120:0:28561:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c501a600/0x9104b1ba770a5c64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343278.902138:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2407:x1848998400040064:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 174us (307us total) trans 0 rc 0/0 00010000:00010000:2.0:1763343278.902139:0:28561:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c501a600/0x9104b1ba770a5c64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343278.902153:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3622 00010000:00010000:2.0:1763343278.902156:0:28561:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c501a600/0x9104b1ba770a5c64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.902165:0:28561:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501a600/0x9104b1ba770a5c64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.902183:0:28561:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343278.902370:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400040192 00000100:00100000:1.0:1763343278.902376:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400040192 00000100:00100000:1.0:1763343278.902410:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7611 00000100:00100000:1.0:1763343278.902417:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+31:55884:x1848998400040192:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343278.902430:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.902445:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5c95 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a2ee expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.902464:0:8414:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5bed lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2bd expref: 32 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343278.902471:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.902472:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.902475:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5c95 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2ee expref: 32 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.902504:0:8414:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5bed lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2bd expref: 32 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343278.902517:0:8414:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5bed lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2bd expref: 32 pid: 28562 timeout: 1172 lvb_type: 1 00000100:00100000:1.0:1763343278.902530:0:8414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5864380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8414:1848998413026944:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343278.902582:0:8414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc52e40 going to sleep for 11 seconds 00010000:00010000:3.0:1763343278.902661:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343278.902669:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c501a600/0x9104b1ba770a5c64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.902677:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343278.902682:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c501a600/0x9104b1ba770a5c64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.902691:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c501a600/0x9104b1ba770a5c64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.902702:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c501a600/0x9104b1ba770a5c64 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.902709:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c501a600/0x9104b1ba770a5c64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.902729:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343278.902731:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343278.902733:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343278.902904:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+37:3659:x1848998413025792:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4942us (5893us total) trans 21474839356 rc 0/0 00000100:00100000:2.0:1763343278.902911:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7605 00000004:00080000:3.0:1763343278.903990:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401c7ef4e00/2, rc 0, transno 21474839356 00000100:00100000:3.0:1763343278.904001:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c7ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413025792:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343278.905522:0:35281:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35281:1848998413026688:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343278.905551:0:35281:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5c5d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343278.907091:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.907119:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.907147:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.907401:0:8414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5864380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8414:1848998413026944:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343278.907416:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400040320 00000100:00100000:2.0:1763343278.907426:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400040320 00010000:00010000:1.0:1763343278.907439:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5c95 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2ee expref: 33 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.907458:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176000, rc 0) 00010000:00010000:2.0:1763343278.907481:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5ae3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a270 expref: 33 pid: 35281 timeout: 1172 lvb_type: 0 00000100:00100000:2.0:1763343278.907518:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400040448 00000100:00100000:1.0:1763343278.907519:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+33:55884:x1848998400040192:12345-192.168.201.40@tcp:101:bash.0 Request processed in 5100us (5654us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.907523:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400040448 00000100:00100000:1.0:1763343278.907533:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7611 00010000:00010000:2.0:1763343278.907556:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5bed lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2bd expref: 33 pid: 28562 timeout: 1172 lvb_type: 1 00000100:00100000:1.0:1763343278.907566:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400040576 00000100:00100000:1.0:1763343278.907572:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400040576 00000100:00100000:2.0:1763343278.907591:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3623 00000100:00100000:2.0:1763343278.907602:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+33:2409:x1848998400040320:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343278.907616:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343278.907626:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5ae3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a270 expref: 33 pid: 35281 timeout: 1172 lvb_type: 0 00010000:00010000:2.0:1763343278.907639:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5ae3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a270 expref: 33 pid: 35281 timeout: 1172 lvb_type: 0 00010000:00010000:2.0:1763343278.907662:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5ae3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a270 expref: 33 pid: 35281 timeout: 1172 lvb_type: 0 00010000:00010000:2.0:1763343278.907675:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.907677:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.907683:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5c5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.907693:0:6511:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5c5d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.907714:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343278.907737:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+32:2409:x1848998400040320:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 138us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343278.907949:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3624 00000100:00100000:1.0:1763343278.907958:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+32:2408:x1848998400040448:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343278.907967:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343278.907971:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5bed lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2bd expref: 32 pid: 28562 timeout: 1172 lvb_type: 1 00000100:00100000:2.0:1763343278.907977:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3623 00010000:00010000:1.0:1763343278.907990:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5bed lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2bd expref: 32 pid: 28562 timeout: 1172 lvb_type: 1 00010000:00010000:1.0:1763343278.908011:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5bed lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2bd expref: 31 pid: 28562 timeout: 1172 lvb_type: 1 00010000:00010000:1.0:1763343278.908021:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.908051:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.908058:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5c95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2ee expref: 30 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.908068:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5c95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2ee expref: 30 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.908096:0:6509:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5c95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2ee expref: 30 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343278.908109:0:6509:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5864380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6509:1848998413027072:192.168.201.40@tcp:105: 00010000:00010000:3.0:1763343278.908481:0:35281:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5c5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.908491:0:35281:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5c5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.908501:0:35281:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5c5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.908510:0:35281:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5c5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.908534:0:35281:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343278.908675:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343278.908683:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5c5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.908692:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121fc00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343278.908697:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5c5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.908718:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5c5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.908732:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5c5d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.908739:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5c5d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35281 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.908758:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343278.908760:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343278.908763:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343278.909620:0:6509:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc52e40 going to sleep for 11 seconds 00000100:00100000:1.0:1763343278.909677:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11114 00000100:00100000:1.0:1763343278.909687:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57220:x1848998400040576:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343278.909706:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.909725:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a5c9c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a2f5 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.909828:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5ca3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343278.909840:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5ca3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.909850:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5ca3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:1.0:1763343278.909874:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22b:0x0]: returning size 2 00000004:00200000:1.0:1763343278.909877:0:33856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343278.909893:0:33856:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5ca3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.909914:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a5c9c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2f5 expref: 309 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.909926:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5ca3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2f5 expref: 308 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.909933:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c4758100) 00010000:00010000:1.0:1763343278.909937:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343278.909940:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177c00, rc 0) 00000100:00100000:1.0:1763343278.909984:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57220:x1848998400040576:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 299us (2835us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343278.909991:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11114 00000100:00100000:1.0:1763343278.913063:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.913091:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400040704 00000100:00100000:1.0:1763343278.913100:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400040704 00000100:00100000:1.0:1763343278.913146:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7612 00000100:00100000:1.0:1763343278.913154:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5867800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:55884:x1848998400040704:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343278.913171:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.913204:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a5caa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a2fc expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343278.913233:0:8414:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343278.913255:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.913258:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.913268:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a5caa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2fc expref: 20 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.913284:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a5caa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2fc expref: 20 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343278.913290:0:6509:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5864380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6509:1848998413027072:192.168.201.40@tcp:105: 00010000:00010000:1.0:1763343278.913298:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177e00, rc 0) 00010000:00010000:2.0:1763343278.913313:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343278.913356:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+30:2408:x1848998400040448:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 5398us (6234us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.913365:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3624 00000004:00080000:0.0:1763343278.913531:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c8bc2680/2, rc 0, transno 17179872086 00000100:00100000:0.0:1763343278.913538:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c8bc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413025664:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343278.913687:0:35281:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+61:3659:x1848998413025664:12345-0@lo:6:osp-syn-1-1.0 Request processed in 16189us (16830us total) trans 17179872086 rc 0/0 00000100:00100000:3.0:1763343278.913695:0:35281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7603 00000100:00100000:2.0:1763343278.913773:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.913827:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400040960 00000100:00100000:0.0:1763343278.913831:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400040960 00000100:00100000:0.0:1763343278.913866:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3935 00000100:00100000:0.0:1763343278.913874:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57220:x1848998400040960:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343278.914212:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5867800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:55884:x1848998400040704:12345-192.168.201.40@tcp:101:bash.0 Request processed in 192us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343278.914220:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7612 00000100:00100000:3.0:1763343278.914408:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.914693:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57220:x1848998400040960:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 819us (919us total) trans 4294974028 rc 0/0 00000100:00100000:0.0:1763343278.914700:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3935 00000100:00100000:1.0:1763343278.914748:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400041216 00000100:00100000:1.0:1763343278.914753:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400041216 00002000:00010000:1.0:1763343278.914773:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/746 (0->18446744073709551615) 00002000:00100000:1.0:1763343278.914777:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c586d880 with x1848998400041216 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343278.914785:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c586d880. 00000100:00100000:1.0:1763343278.914807:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1797 00000100:00100000:1.0:1763343278.914814:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2408:x1848998400041216:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:1.0:1763343278.914949:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2ea:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343278.914952:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2ea:0x0] updating lvb mtime from disk: 0 -> 1763343278 00002000:00010000:1.0:1763343278.914955:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2ea:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343278.914957:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2ea:0x0] updating lvb ctime from disk: 0 -> 1763343278 00002000:00010000:1.0:1763343278.914959:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2ea:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343278.914982:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998400041216:12345-192.168.201.40@tcp:10:bash.0 Request processed in 168us (573us total) trans 21474839357 rc 0/0 00000100:00100000:1.0:1763343278.914993:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1797 00002000:00010000:1.0:1763343278.914996:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/746 (0->18446744073709551615) 00002000:00100000:1.0:1763343278.914999:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c586d880 with x1848998400041216 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343278.915004:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c586d880. 00000100:00100000:3.0:1763343278.915126:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.915786:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400041088 00000100:00100000:0.0:1763343278.915793:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400041088 00002000:00010000:0.0:1763343278.915814:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/747 (0->18446744073709551615) 00002000:00100000:0.0:1763343278.915818:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c586df80 with x1848998400041088 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343278.915825:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c586df80. 00000100:00100000:0.0:1763343278.915855:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1798 00000100:00100000:0.0:1763343278.915862:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+30:2407:x1848998400041088:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:0.0:1763343278.915966:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2eb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343278.915969:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2eb:0x0] updating lvb mtime from disk: 0 -> 1763343278 00002000:00010000:0.0:1763343278.915972:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2eb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343278.915974:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2eb:0x0] updating lvb ctime from disk: 0 -> 1763343278 00002000:00010000:0.0:1763343278.915976:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2eb:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343278.916013:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+31:2407:x1848998400041088:12345-192.168.201.40@tcp:10:bash.0 Request processed in 151us (1556us total) trans 17179872087 rc 0/0 00000100:00100000:0.0:1763343278.916020:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1798 00002000:00010000:0.0:1763343278.916048:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/747 (0->18446744073709551615) 00002000:00100000:0.0:1763343278.916052:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c586df80 with x1848998400041088 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343278.916056:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c586df80. 00000100:00100000:3.0:1763343278.917105:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.917187:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400041344 00000100:00100000:1.0:1763343278.917202:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400041344 00000100:00100000:1.0:1763343278.917403:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11115 00000100:00100000:1.0:1763343278.917412:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57220:x1848998400041344:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343278.917431:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.917453:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a5cb1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a303 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.917515:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5cb8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343278.917529:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5cb8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.917541:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5cb8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.917554:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5cbf lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343278.917560:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5cbf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.917565:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5cbf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.917633:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5cc6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343278.917641:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5cc6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.917647:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5cc6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343278.917680:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22b:0x0]: returning size 2 00000004:00200000:1.0:1763343278.917685:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343278.917702:0:9827:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5cc6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.917714:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5cc6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.917724:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5cb8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.917730:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5cb8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.917735:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5cb8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.917740:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5cb8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.917745:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.917749:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5cb8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.917755:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5cb8 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.917765:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:1.0:1763343278.917767:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.917772:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5cb8 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.917777:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5cb8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.917787:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5cbf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.917792:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5cbf lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.917797:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5cbf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.917802:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.917805:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5cbf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.917810:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5cbf lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.917817:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c38f5300) 00010000:00010000:1.0:1763343278.917820:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.917822:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5cbf lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.917827:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5cbf lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.917854:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a5cb1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a303 expref: 311 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.917867:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5cc6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a303 expref: 310 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.917874:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c4758100) 00010000:00010000:1.0:1763343278.917876:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343278.917879:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177000, rc 0) 00000100:00100000:1.0:1763343278.919211:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57220:x1848998400041344:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1782us (2091us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343278.919221:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11115 00000100:00100000:0.0:1763343278.920123:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.920392:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400041600 00000100:00100000:1.0:1763343278.920403:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400041600 00000100:00100000:1.0:1763343278.920925:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3936 00000100:00100000:1.0:1763343278.920937:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:55884:x1848998400041600:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:1.0:1763343278.921271:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:55884:x1848998400041600:12345-192.168.201.40@tcp:35:bash.0 Request processed in 336us (1149us total) trans 4294974029 rc 0/0 00000100:00100000:1.0:1763343278.921666:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3936 00000100:00100000:3.0:1763343278.924656:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.924747:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.924896:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400041728 00000100:00100000:2.0:1763343278.924905:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400041728 00000100:00100000:2.0:1763343278.924973:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 459 00000100:00100000:2.0:1763343278.924983:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:2409:x1848998400041728:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343278.924998:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343278.925054:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5cc6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a303 expref: 311 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.925080:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c4758100) 00010000:00010000:2.0:1763343278.925085:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343278.925132:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:2409:x1848998400041728:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 151us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.925139:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 459 00000100:00100000:1.0:1763343278.926820:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400041984 00000100:00100000:1.0:1763343278.926834:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400041984 00000100:00100000:1.0:1763343278.926893:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11116 00000100:00100000:1.0:1763343278.926902:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57220:x1848998400041984:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343278.926927:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.926946:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a5ccd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a30a expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.927094:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5cd4 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343278.927111:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5ca3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2f5 expref: 311 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.927120:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5cd4 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x22b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.927151:0:9827:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5ca3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2f5 expref: 311 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.927164:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5ca3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2f5 expref: 311 pid: 33856 timeout: 1172 lvb_type: 0 00000100:00100000:1.0:1763343278.927176:0:9827:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5864000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998413027200:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343278.927273:0:9827:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc526c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343278.928998:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.929469:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400042240 00000100:00100000:2.0:1763343278.929479:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400042240 00000100:00100000:2.0:1763343278.929530:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11117 00000100:00100000:2.0:1763343278.929541:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57221:x1848998400042240:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:2.0:1763343278.929588:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763343278.929613:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5c4f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x22b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2e0 expref: 312 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.929634:0:33856:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5ca3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2f5 expref: 311 pid: 33856 timeout: 1172 lvb_type: 0 00010000:00010000:2.0:1763343278.929648:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5c17 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2d2 expref: 311 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.929659:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c4758100) 00010000:00010000:2.0:1763343278.929663:0:33856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5cd4 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x22b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.929671:0:33856:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5cd4 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x22b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.929678:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5cd4 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x22b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.929694:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343278.929721:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5cdb lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.929730:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5cdb lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.929736:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5cdb lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.929746:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5ce2 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.929751:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5ce2 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.929756:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5ce2 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.931109:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5ce9 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.931128:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5cd4 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x22b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.931135:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5ce9 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.931151:0:33856:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5cd4 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x22b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.931160:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5ce9 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.931643:0:9827:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.40@tcp) returned -22 from blocking AST (req@0000000045f098b7 x1848998413027200) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5ca3 lrc: 1/0,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2f5 expref: 310 pid: 33856 timeout: 1172 lvb_type: 0 00010000:00010000:1.0:1763343278.931659:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5ca3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2f5 expref: 310 pid: 33856 timeout: 1172 lvb_type: 0 00000100:00100000:1.0:1763343278.931672:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5864000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998413027200:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343278.931692:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c4758100) 00010000:00010000:1.0:1763343278.931696:0:9827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5ce9 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.931702:0:9827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5ce9 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.931712:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5cd4 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x22b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.931718:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5cd4 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x22b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.931724:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5cd4 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x22b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343278.931742:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22b:0x0]: returning size 5 00010000:00010000:1.0:1763343278.931869:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a5ccd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a30a expref: 311 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.931888:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5cd4 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x22b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a30a expref: 310 pid: 9827 timeout: 1172 lvb_type: 0 00010000:00010000:1.0:1763343278.931897:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5cd4 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x22b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a30a expref: 310 pid: 9827 timeout: 1172 lvb_type: 0 00010000:00010000:1.0:1763343278.931904:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176e00, rc 0) 00000100:00100000:1.0:1763343278.931959:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57220:x1848998400041984:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 5057us (7211us total) trans 4294974030 rc 0/0 00000100:00100000:1.0:1763343278.931967:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11116 00000100:00100000:0.0:1763343278.934179:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.934287:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400042368 00000100:00100000:3.0:1763343278.934297:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400042368 00010000:00010000:3.0:1763343278.934336:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5cd4 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x22b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a30a expref: 310 pid: 9827 timeout: 1172 lvb_type: 0 00000100:00100000:3.0:1763343278.934370:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3625 00000100:00100000:3.0:1763343278.934379:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5868e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:2407:x1848998400042368:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343278.934394:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343278.934400:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5cd4 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x22b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a30a expref: 310 pid: 9827 timeout: 1172 lvb_type: 0 00010000:00010000:3.0:1763343278.934412:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5cd4 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x22b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a30a expref: 310 pid: 9827 timeout: 1172 lvb_type: 0 00010000:00010000:3.0:1763343278.934433:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a5cd4 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x22b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a30a expref: 310 pid: 9827 timeout: 1172 lvb_type: 0 00010000:00010000:3.0:1763343278.934447:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c4758100) 00010000:00010000:3.0:1763343278.934452:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5ce9 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.934464:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5ce9 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.934471:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5ce9 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343278.934550:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343278.934668:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5ce9 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.934676:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5ce9 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00080000:0.0:1763343278.934905:0:33856:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x22b:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1763343278.934988:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5ce9 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.934996:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5ce9 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.935002:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5ce9 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.935008:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.935011:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5ce9 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.935018:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5ce9 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.935049:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c4758100) 00010000:00010000:0.0:1763343278.935053:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763343278.935057:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5ce9 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.935064:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5ce9 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.935081:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5cdb lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.935087:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5cdb lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.935092:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5cdb lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.935097:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.935100:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5cdb lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.935109:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5cdb lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.935114:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c6733000) 00010000:00010000:0.0:1763343278.935116:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.935123:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5cdb lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.935129:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5cdb lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:0.0:1763343278.935141:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006461e8e9 reply state 0000000032174824 transno 4294974031 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5ce2 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.935151:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5ce2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.935157:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c6733500) 00010000:00010000:0.0:1763343278.935160:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343278.935162:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343278.935218:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57221:x1848998400042240:12345-192.168.201.40@tcp:36:rm.0 Request processed in 5677us (6225us total) trans 4294974031 rc 0/0 00000100:00100000:0.0:1763343278.935227:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11117 00000100:00100000:3.0:1763343278.935621:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5868e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:2407:x1848998400042368:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1239us (1446us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343278.935630:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3625 00000100:00100000:2.0:1763343278.935893:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.935961:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400042496 00000100:00100000:1.0:1763343278.935969:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400042496 00000100:00100000:1.0:1763343278.936145:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11118 00000100:00100000:1.0:1763343278.936153:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57220:x1848998400042496:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343278.936172:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.936189:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5cf7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a311 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.936263:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5cfe lrc: 3/1,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343278.936273:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5cfe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.936282:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5cfe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343278.936312:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22b:0x0]: returning size 5 00000004:00200000:1.0:1763343278.936317:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343278.936333:0:9827:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5cfe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.936356:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5cf7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a311 expref: 312 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.936370:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5cfe lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a311 expref: 311 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.936378:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:1.0:1763343278.936381:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1763343278.936383:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177a00, rc 0) 00000100:00100000:1.0:1763343278.936429:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57220:x1848998400042496:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 277us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343278.936436:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11118 00000100:00100000:1.0:1763343278.939466:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.939726:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400042752 00000100:00100000:0.0:1763343278.939736:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400042752 00000100:00100000:0.0:1763343278.939996:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11119 00000100:00100000:0.0:1763343278.940006:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57220:x1848998400042752:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343278.940060:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.940079:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5d05 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a318 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.940216:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5d0c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343278.940230:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5d0c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.940240:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5d0c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:0.0:1763343278.940252:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22b:0x0]: returning size 5 00010000:00010000:0.0:1763343278.940358:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5d05 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a318 expref: 314 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.940376:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5d0c lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a318 expref: 313 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.940385:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:0.0:1763343278.940388:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343278.940391:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b000, rc 0) 00000100:00100000:0.0:1763343278.940444:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57220:x1848998400042752:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 439us (988us total) trans 4294974032 rc 0/0 00000100:00100000:0.0:1763343278.940452:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11119 00000100:00100000:3.0:1763343278.943108:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.943174:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400042880 00000100:00100000:1.0:1763343278.943184:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400042880 00000100:00100000:1.0:1763343278.943250:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7613 00000100:00100000:1.0:1763343278.943263:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+31:2407:x1848998400042880:12345-192.168.201.40@tcp:1:lfs.0 00010000:00010000:1.0:1763343278.943305:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5d1a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.943322:0:8414:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5c95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2ee expref: 31 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.943329:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343278.943331:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343278.943334:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5d1a lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.943368:0:8414:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5c95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2ee expref: 31 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.943393:0:8414:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5c95 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2ee expref: 31 pid: 8414 timeout: 1172 lvb_type: 0 00000100:00100000:1.0:1763343278.943407:0:8414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5867480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8414:1848998413027328:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343278.943484:0:8414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc526c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343278.948206:0:8414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5867480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8414:1848998413027328:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343278.948241:0:8414:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5d1a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343278.948761:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.950358:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400043008 00000100:00100000:1.0:1763343278.950373:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400043008 00002000:00100000:1.0:1763343278.950428:0:28386:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000400:0x2eb:0x0] (0->4) req@ffff9400c586ed80 x1848998400043008/t0(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:19/0 lens 496/0 e 0 to 0 dl 1763343289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763343278.950440:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c586ed80 with x1848998400043008 ext(0->4) 00010000:00010000:1.0:1763343278.950450:0:28386:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5c95 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2ee expref: 32 pid: 8414 timeout: 1172 lvb_type: 0 00010000:00010000:1.0:1763343278.950467:0:28386:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5c95 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2ee expref: 32 pid: 8414 timeout: 1172 lvb_type: 0 00002000:00010000:1.0:1763343278.950476:0:28386:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9400c586ed80 00000100:00100000:1.0:1763343278.950517:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 127 00000100:00100000:1.0:1763343278.950529:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+32:2407:x1848998400043008:12345-192.168.201.40@tcp:4:bash.0 00000100:00100000:3.0:1763343278.950819:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.950990:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400043136 00000100:00100000:0.0:1763343278.950995:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400043136 00000100:00100000:0.0:1763343278.951055:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11120 00000100:00100000:0.0:1763343278.951062:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57222:x1848998400043136:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343278.951079:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.951101:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5d21 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a31f expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.951162:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5d28 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343278.951176:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5d28 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.951187:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5d28 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.951209:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5d2f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343278.951216:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5d2f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.951222:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5d2f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.951252:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5d28 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.951259:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5d28 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.951265:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5d28 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.951271:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.951275:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5d28 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.951282:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5d28 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.951296:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5300) 00010000:00010000:0.0:1763343278.951299:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.951303:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5d28 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.951309:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5d28 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.951321:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5d2f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.951327:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5d2f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.951332:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5d2f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.951337:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501bc00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343278.951340:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5d2f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.951345:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5d2f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.951352:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c6733500) 00010000:00010000:0.0:1763343278.951354:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.951357:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5d2f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.951363:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5d2f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.951387:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5d21 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a31f expref: 314 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.951396:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5300) 00010000:00010000:0.0:1763343278.951399:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343278.951402:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5d21 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a31f expref: 314 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.951414:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b600, rc 0) 00000100:00100000:0.0:1763343278.951460:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57222:x1848998400043136:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 399us (643us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343278.951467:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11120 00000100:00100000:1.0:1763343278.952207:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+34:2407:x1848998400043008:12345-192.168.201.40@tcp:4:bash.0 Request processed in 1664us (3431us total) trans 17179872088 rc 0/0 00000100:00100000:1.0:1763343278.952219:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 127 00002000:00100000:1.0:1763343278.952230:0:28386:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000400:0x2eb:0x0] (0->4) req@ffff9400c586ed80 x1848998400043008/t17179872088(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:19/0 lens 496/448 e 0 to 0 dl 1763343289 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763343278.952241:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c586ed80 with x1848998400043008 ext(0->4) 00010000:00010000:1.0:1763343278.952249:0:28386:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5c95 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2ee expref: 34 pid: 8414 timeout: 1172 lvb_type: 0 00010000:00010000:1.0:1763343278.952264:0:28386:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5c95 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2ee expref: 34 pid: 8414 timeout: 1172 lvb_type: 0 00002000:00010000:1.0:1763343278.952273:0:28386:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9400c586ed80 00000100:00100000:3.0:1763343278.955634:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343278.955682:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.955695:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400043392 00000100:00100000:2.0:1763343278.955706:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400043392 00010000:00010000:2.0:1763343278.955744:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5c95 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2ee expref: 34 pid: 8414 timeout: 1172 lvb_type: 0 00000100:00100000:1.0:1763343278.955752:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400043264 00000100:00100000:1.0:1763343278.955760:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400043264 00000100:00100000:2.0:1763343278.955786:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3626 00000100:00100000:2.0:1763343278.955803:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+34:2410:x1848998400043392:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343278.955818:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1763343278.955834:0:6510:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2eb:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:2.0:1763343278.955837:0:6510:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2eb:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1763343278.955842:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5c95 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2ee expref: 34 pid: 8414 timeout: 1172 lvb_type: 0 00010000:00010000:2.0:1763343278.955855:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5c95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2ee expref: 34 pid: 8414 timeout: 1172 lvb_type: 0 00010000:00010000:2.0:1763343278.955876:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176000/0x9104b1ba770a5c95 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2ee expref: 34 pid: 8414 timeout: 1172 lvb_type: 0 00010000:00010000:2.0:1763343278.955891:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.955893:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343278.955897:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5d1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.955907:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5d1a lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.955944:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343278.955990:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+33:2410:x1848998400043392:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 188us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.955998:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3626 00000100:00100000:1.0:1763343278.956242:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11121 00000100:00100000:1.0:1763343278.956250:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57222:x1848998400043264:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343278.956265:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.956287:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a5d36 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a326 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.956379:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5d3d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343278.956391:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5d3d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.956400:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5d3d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.956409:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5d44 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343278.956415:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5d44 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.956421:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5d44 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.956456:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5d3d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.956462:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5d3d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.956467:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5d3d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.956477:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5d3d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.956483:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.956487:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5d3d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.956494:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5d3d lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.956502:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5300) 00010000:00010000:1.0:1763343278.956505:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.956508:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5d3d lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.956513:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5d3d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.956523:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5d44 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.956528:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5d44 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.956532:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5d44 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.956536:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343278.956538:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5d44 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.956543:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5d44 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.956552:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c6733500) 00010000:00010000:1.0:1763343278.956554:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.956557:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5d44 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.956561:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a5d44 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343278.956581:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a5d36 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a326 expref: 314 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.956588:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5300) 00010000:00010000:1.0:1763343278.956590:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343278.956593:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176a00/0x9104b1ba770a5d36 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a326 expref: 314 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.956603:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176a00, rc 0) 00000100:00100000:1.0:1763343278.956630:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57222:x1848998400043264:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 382us (948us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343278.956636:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11121 00010000:00010000:3.0:1763343278.957250:0:8414:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5d1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.957262:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5d1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.957349:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5d1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.957358:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5d1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.957365:0:8414:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5d1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.957372:0:8414:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343278.957375:0:8414:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5d1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.957383:0:8414:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5d1a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.957397:0:8414:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5d1a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343278.957403:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177800/0x9104b1ba770a5d1a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343278.957458:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+32:2407:x1848998400042880:12345-192.168.201.40@tcp:1:lfs.0 Request processed in 14198us (14356us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343278.957466:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7613 00000100:00100000:2.0:1763343278.963656:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.963698:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.963740:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400043648 00000100:00100000:0.0:1763343278.963752:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400043648 00000100:00100000:0.0:1763343278.963804:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400043776 00000100:00100000:0.0:1763343278.963807:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400043776 00000100:00100000:0.0:1763343278.963833:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11122 00000100:00100000:0.0:1763343278.963842:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57220:x1848998400043648:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:0.0:1763343278.963893:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1763343278.963904:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11123 00000100:00100000:1.0:1763343278.963913:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57222:x1848998400043776:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343278.963920:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a5cfe lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a311 expref: 314 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.963923:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.963939:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:1.0:1763343278.963941:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5d4b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a32d expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.963944:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343278.963968:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5d52 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:1.0:1763343278.963975:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5d59 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343278.963980:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5d52 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.963987:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5d59 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.963990:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5d52 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343278.963994:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5d59 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343278.964149:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763343278.964154:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763343278.964189:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5d4b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a32d expref: 315 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.964215:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5d59 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a32d expref: 314 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343278.964222:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5400) 00010000:00010000:1.0:1763343278.964224:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343278.964227:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177200, rc 0) 00000040:00080000:0.0:1763343278.964242:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1847, 88 off153200 00000004:00080000:0.0:1763343278.964249:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1072088224140ns, next at 1072111826735ns, rc = 0 00000040:00080000:0.0:1763343278.964291:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1838, 88 off152440 00000004:00080000:0.0:1763343278.964296:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1072088271159ns, next at 1072111852630ns, rc = 0 00000040:00080000:0.0:1763343278.964322:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1839, 88 off152528 00000004:00080000:0.0:1763343278.964326:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1072088301440ns, next at 1072111852630ns, rc = 0 00000040:00080000:0.0:1763343278.964338:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1848, 88 off153288 00000004:00080000:0.0:1763343278.964342:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1072088316927ns, next at 1072111826735ns, rc = 0 00000100:00100000:1.0:1763343278.965422:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57222:x1848998400043776:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1504us (1715us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343278.965432:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11123 00000001:00080000:0.0:1763343278.966688:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974033 is committed 00000004:00080000:0.0:1763343278.966698:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1184 committed 00000004:00080000:0.0:1763343278.966709:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1176 committed 00000004:00080000:0.0:1763343278.966722:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1175 committed 00000004:00080000:0.0:1763343278.966724:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1183 committed 00000004:00010000:0.0:1763343278.966778:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b6cab89d reply state 000000008f1f7382 transno 4294974033 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5d52 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.966798:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5d52 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343278.966806:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:0.0:1763343278.966810:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763343278.966814:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1763343278.966900:0:33856:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763343278.966911:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57220:x1848998400043648:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 3069us (3266us total) trans 4294974033 rc 0/0 00000100:00100000:0.0:1763343278.966919:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11122 00010000:00010000:2.0:1763343278.966983:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5ce2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.966991:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5ce2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.966998:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5ce2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.967003:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.967007:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5ce2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.967014:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5ce2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.967057:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c6733500) 00010000:00010000:2.0:1763343278.967060:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.967065:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5ce2 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.967071:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5ce2 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.967096:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5d52 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.967102:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5d52 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.967108:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5d52 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.967113:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.967116:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5d52 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.967121:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5d52 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.967128:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:2.0:1763343278.967131:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343278.967133:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5d52 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.967138:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5d52 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000100:00100000:3.0:1763343278.967405:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413027840:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343278.967458:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343278.967497:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343278.967504:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413027712:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343278.967527:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343278.967555:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413027840 00000100:00100000:3.0:1763343278.967563:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413027840 00000100:00100000:3.0:1763343278.967600:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413027712 00000100:00100000:3.0:1763343278.967603:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413027712 00000100:00100000:3.0:1763343278.967623:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7614 00000100:00100000:3.0:1763343278.967632:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+62:3662:x1848998413027840:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343278.967813:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+63:3662:x1848998413027840:12345-0@lo:2:osp-syn-1-1.0 Request processed in 183us (355us total) trans 17179872089 rc 0/0 00000100:00100000:3.0:1763343278.967821:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7614 00000100:00100000:0.0:1763343278.967825:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5867480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413027456:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343278.967836:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7615 00000100:00100000:3.0:1763343278.967841:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+62:3662:x1848998413027712:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343278.967855:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343278.967877:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763343278.967882:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5866d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413027584:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343278.967902:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343278.967904:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+63:3662:x1848998413027712:12345-0@lo:2:osp-syn-1-1.0 Request processed in 64us (377us total) trans 17179872090 rc 0/0 00000100:00100000:3.0:1763343278.967911:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7615 00000100:00100000:3.0:1763343278.967920:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413027456 00000100:00100000:3.0:1763343278.967923:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413027456 00000100:00100000:0.0:1763343278.967925:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413027584 00000100:00100000:0.0:1763343278.967927:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413027584 00000100:00100000:3.0:1763343278.969372:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7616 00000100:00100000:0.0:1763343278.969404:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7617 00000100:00100000:0.0:1763343278.969418:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+38:3659:x1848998413027584:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343278.969513:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.969573:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+39:3659:x1848998413027584:12345-0@lo:2:osp-syn-0-1.0 Request processed in 161us (1669us total) trans 21474839358 rc 0/0 00000100:00100000:0.0:1763343278.969580:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7617 00000100:00100000:2.0:1763343278.969678:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400043904 00000100:00100000:2.0:1763343278.969685:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400043904 00000100:00100000:2.0:1763343278.969724:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11124 00000100:00100000:2.0:1763343278.969731:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57222:x1848998400043904:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343278.969742:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.969762:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88400/0x9104b1ba770a5d60 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a334 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343278.969797:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edde6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+38:3659:x1848998413027456:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1763343278.969836:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a5d67 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00002000:00010000:3.0:1763343278.969854:0:28561:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2ea:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:2.0:1763343278.969854:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a5d67 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00002000:00010000:3.0:1763343278.969857:0:28561:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2ea:0x0] updating lvb mtime from disk: 1763343278 -> 1763343278 00002000:00010000:3.0:1763343278.969860:0:28561:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2ea:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343278.969862:0:28561:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2ea:0x0] updating lvb ctime from disk: 1763343278 -> 1763343278 00002000:00010000:3.0:1763343278.969864:0:28561:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2ea:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:2.0:1763343278.969865:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a5d67 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.969877:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5d6e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.969884:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5d6e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00000100:00100000:3.0:1763343278.969889:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edde6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+39:3659:x1848998413027456:12345-0@lo:2:osp-syn-0-1.0 Request processed in 96us (2033us total) trans 21474839359 rc 0/0 00010000:00010000:2.0:1763343278.969890:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5d6e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:3.0:1763343278.969895:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7616 00010000:00010000:2.0:1763343278.969919:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a5d67 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.969926:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a5d67 lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.969931:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a5d67 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.969937:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.969940:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a5d67 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.969947:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a5d67 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.969958:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5400) 00010000:00010000:2.0:1763343278.969960:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.969964:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a5d67 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.969969:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a5d67 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.969978:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5d6e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.969984:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5d6e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.969989:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5d6e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.969993:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.969996:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5d6e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.970001:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5d6e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.970007:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758600) 00010000:00010000:2.0:1763343278.970010:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.970012:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5d6e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.970017:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5d6e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00080000:3.0:1763343278.970062:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c586fb80/2, rc 0, transno 17179872090 00010000:00010000:2.0:1763343278.970066:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88400/0x9104b1ba770a5d60 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a334 expref: 307 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343278.970068:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413027712:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1763343278.970075:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5400) 00000004:00080000:3.0:1763343278.970079:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c586dc00/2, rc 0, transno 17179872089 00010000:00010000:2.0:1763343278.970079:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.970082:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88400/0x9104b1ba770a5d60 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a334 expref: 307 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343278.970083:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413027840:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1763343278.970091:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88400, rc 0) 00000100:00100000:2.0:1763343278.970128:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57222:x1848998400043904:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 398us (616us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343278.970135:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11124 00000004:00080000:0.0:1763343278.970248:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5866d80/2, rc 0, transno 21474839358 00000100:00100000:0.0:1763343278.970265:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5866d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413027584:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763343278.970275:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5867480/2, rc 0, transno 21474839359 00000100:00100000:0.0:1763343278.970278:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5867480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413027456:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343278.971997:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.972095:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400044032 00000100:00100000:0.0:1763343278.972106:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400044032 00000100:00100000:0.0:1763343278.972157:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11125 00000100:00100000:0.0:1763343278.972167:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+306:57220:x1848998400044032:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343278.972214:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.972235:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5d75 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a33b expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.972297:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5d75 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a33b expref: 307 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.972314:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5d75 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a33b expref: 307 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.972339:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:0.0:1763343278.972342:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343278.972346:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b600, rc 0) 00000100:00100000:0.0:1763343278.972402:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57220:x1848998400044032:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 236us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343278.972409:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11125 00000100:00100000:3.0:1763343278.972716:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.972748:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400044288 00000100:00100000:2.0:1763343278.972753:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400044288 00000100:00100000:2.0:1763343278.972792:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11126 00000100:00100000:2.0:1763343278.972799:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57222:x1848998400044288:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343278.972808:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.972811:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343278.972829:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5d59 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a32d expref: 307 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.972842:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c38f5400) 00010000:00010000:2.0:1763343278.972849:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343278.972859:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5d7c lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a342 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.972940:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a5d83 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.972949:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a5d83 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.972958:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a5d83 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.972974:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5d8a lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.972981:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5d8a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.972987:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5d8a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.973433:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a5d91 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.973443:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a5d91 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.973450:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a5d91 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:2.0:1763343278.973458:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22c:0x0]: returning size 0 00010000:00010000:2.0:1763343278.973479:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a5d83 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.973485:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a5d83 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.973491:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a5d83 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.973496:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.973500:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a5d83 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.973506:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a5d83 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.973514:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758100) 00010000:00010000:2.0:1763343278.973517:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343278.973520:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a5d83 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.973525:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a5d83 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:2.0:1763343278.973533:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000049517400 reply state 0000000098a348cc transno 4294974034 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5d8a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.973541:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5d8a lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.973546:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758000) 00010000:00010000:2.0:1763343278.973548:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343278.973550:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343278.973571:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5d7c lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a342 expref: 309 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.973585:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a5d91 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a342 expref: 308 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.973591:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22c:0x0].0x0 (ffff9400c4758b00) 00010000:00010000:2.0:1763343278.973593:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343278.973595:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89400, rc 0) 00000100:00100000:2.0:1763343278.973638:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57222:x1848998400044288:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 839us (922us total) trans 4294974034 rc 0/0 00000100:00100000:2.0:1763343278.973644:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11126 00000100:00100000:1.0:1763343278.976837:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.976905:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400044672 00000100:00100000:0.0:1763343278.976917:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400044672 00000100:00100000:0.0:1763343278.976976:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11127 00000100:00100000:0.0:1763343278.976987:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c7f55450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57222:x1848998400044672:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343278.977011:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343278.977068:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5d9f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x22c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a350 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.977171:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5da6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343278.977185:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a5d91 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a342 expref: 310 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.977204:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5da6 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343278.977240:0:9827:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a5d91 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a342 expref: 310 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343278.977253:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a5d91 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a342 expref: 310 pid: 33856 timeout: 1172 lvb_type: 0 00000100:00100000:0.0:1763343278.977271:0:9827:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998413027968:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343278.977343:0:9827:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1763343278.977472:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.977504:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400044416 00000100:00100000:2.0:1763343278.977509:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400044416 00000100:00100000:2.0:1763343278.977542:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11128 00000100:00100000:2.0:1763343278.977549:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57220:x1848998400044416:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343278.977557:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343278.977567:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5dad lrc: 2/0,0 mode: --/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a349 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.977611:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5db4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343278.977622:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5db4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.977632:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5db4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:2.0:1763343278.977657:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22b:0x0]: returning size 5 00000004:00200000:2.0:1763343278.977662:0:33856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343278.977679:0:33856:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5db4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343278.977702:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5dad lrc: 0/0,0 mode: --/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a349 expref: 313 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.977717:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5db4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a349 expref: 312 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.977726:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:2.0:1763343278.977729:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1763343278.977732:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88e00, rc 0) 00000100:00100000:2.0:1763343278.977777:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57220:x1848998400044416:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 228us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343278.977784:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11128 00000100:00100000:2.0:1763343278.982268:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.982387:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998413027968:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343278.982415:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5da6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:3.0:1763343278.982628:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400044800 00000100:00100000:3.0:1763343278.982636:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400044800 00010000:00010000:3.0:1763343278.982671:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a5d91 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a342 expref: 312 pid: 33856 timeout: 1172 lvb_type: 0 00000100:00100000:3.0:1763343278.982756:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3627 00000100:00100000:3.0:1763343278.982767:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:2408:x1848998400044800:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343278.982782:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343278.982788:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a5d91 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a342 expref: 312 pid: 33856 timeout: 1172 lvb_type: 0 00010000:00010000:3.0:1763343278.982799:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a5d91 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a342 expref: 312 pid: 33856 timeout: 1172 lvb_type: 0 00010000:00010000:3.0:1763343278.982820:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a5d91 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a342 expref: 312 pid: 33856 timeout: 1172 lvb_type: 0 00010000:00010000:3.0:1763343278.982835:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22c:0x0].0x0 (ffff9400c4758b00) 00010000:00010000:3.0:1763343278.982840:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5da6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343278.982849:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5da6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343278.982856:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5da6 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:3.0:1763343278.982887:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343278.982940:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:2408:x1848998400044800:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 175us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343278.982946:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3627 00000100:00100000:1.0:1763343278.983088:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343278.983115:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400044928 00000100:00100000:1.0:1763343278.983119:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400044928 00000100:00100000:1.0:1763343278.983146:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7618 00000100:00100000:1.0:1763343278.983153:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5866a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+32:2408:x1848998400044928:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343278.983170:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343278.983188:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5dbb lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a357 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343278.983221:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2eb:0x0] initial LVB size: 5, mtime: 0x691a7bae, atime: 0x0, ctime: 0x691a7bae, blocks: 0x8 00010000:00010000:1.0:1763343278.983236:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.983239:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343278.983247:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5dbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a357 expref: 33 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343278.983261:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5dbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a357 expref: 33 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343278.983327:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5da6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.983334:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5da6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:2.0:1763343278.983357:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22c:0x0]: returning size 0 00000004:00080000:2.0:1763343278.983535:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2ec:0x0], index 0: 0 00000004:00080000:2.0:1763343278.983543:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2ed:0x0], index 1: 0 00000004:00080000:2.0:1763343278.983547:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2ee:0x0], index 1: 0 00000004:00080000:2.0:1763343278.983550:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2ed:0x0], index 0: 0 00010000:00010000:1.0:1763343278.983604:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177c00, rc 0) 00010000:00010000:2.0:1763343278.983654:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5da6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.983661:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5da6 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.983667:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5da6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.983673:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343278.983677:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5da6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.983684:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5da6 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.983694:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22c:0x0].0x0 (ffff9400c4758b00) 00010000:00010000:2.0:1763343278.983697:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343278.983701:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5da6 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.983706:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5da6 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343278.983749:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5d9f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x22c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a350 expref: 311 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.983758:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22c:0x0].0x0 (ffff9400c4758b00) 00010000:00010000:2.0:1763343278.983761:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343278.983764:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5d9f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x22c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a350 expref: 311 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343278.983777:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501bc00, rc 0) 00000100:00100000:2.0:1763343278.983818:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c7f55450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57222:x1848998400044672:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 6833us (6989us total) trans 4294974035 rc 301/301 00000100:00100000:2.0:1763343278.983825:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11127 00000100:00100000:1.0:1763343278.983891:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5866a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+33:2408:x1848998400044928:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 738us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343278.983897:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7618 00000100:00100000:1.0:1763343278.986907:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343278.986989:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400045184 00000100:00100000:0.0:1763343278.987002:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400045184 00000100:00100000:0.0:1763343278.987094:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3937 00000100:00100000:0.0:1763343278.987111:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82c8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57222:x1848998400045184:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343278.987425:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82c8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57222:x1848998400045184:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 320us (526us total) trans 4294974036 rc 0/0 00000100:00100000:0.0:1763343278.987434:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3937 00000100:00100000:3.0:1763343278.991978:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343278.992047:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400045440 00000100:00100000:2.0:1763343278.992057:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400045440 00000100:00100000:2.0:1763343278.992112:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3938 00000100:00100000:2.0:1763343278.992122:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57222:x1848998400045440:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343278.992338:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57222:x1848998400045440:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 217us (369us total) trans 4294974037 rc 0/0 00000100:00100000:2.0:1763343278.992345:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3938 00000100:00100000:3.0:1763343278.998308:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343279.004252:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400045696 00000100:00100000:2.0:1763343279.004371:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400045696 00000100:00100000:0.0:1763343279.004612:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11129 00000100:00100000:0.0:1763343279.004626:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:55884:x1848998400045696:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343279.004656:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343279.004685:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5dc9 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a35e expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.004856:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5dd0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343279.004874:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5dd0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343279.004887:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5dd0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343279.004901:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5dd7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343279.004909:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5dd7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343279.004916:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5dd7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343279.004982:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5dde lrc: 3/1,0 mode: --/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343279.004990:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5dde lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343279.004998:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5dde lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:0.0:1763343279.005009:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22c:0x0]: returning size 0 00010000:00010000:0.0:1763343279.005170:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5dd0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343279.005178:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5dd0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343279.005183:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5dd0 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343279.005190:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5dd0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343279.005207:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343279.005212:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5dd0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343279.005225:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5dd0 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343279.005239:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401cc2f5300) 00010000:00010000:0.0:1763343279.005242:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343279.005247:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5dd0 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343279.005253:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5dd0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343279.005269:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5dd7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343279.005275:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5dd7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343279.005281:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5dd7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343279.005285:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501aa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343279.005288:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5dd7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343279.005293:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5dd7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343279.005300:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758000) 00010000:00010000:0.0:1763343279.005302:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343279.005305:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5dd7 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343279.005310:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5dd7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343279.005353:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5dc9 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a35e expref: 315 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.005372:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5dde lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a35e expref: 314 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.005379:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22c:0x0].0x0 (ffff9401cc2f5900) 00010000:00010000:0.0:1763343279.005382:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343279.005384:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a600, rc 0) 00000100:00100000:0.0:1763343279.005452:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:55884:x1848998400045696:12345-192.168.201.40@tcp:101:bash.0 Request processed in 829us (7162us total) trans 4294974038 rc 0/0 00000100:00100000:0.0:1763343279.005461:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11129 00000100:00080000:1.0:1763343279.005569:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1763343279.007995:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343279.008756:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400045824 00000100:00100000:2.0:1763343279.008769:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400045824 00000100:00100000:2.0:1763343279.008838:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11130 00000100:00100000:2.0:1763343279.008849:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:55884:x1848998400045824:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343279.008874:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343279.008897:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5dec lrc: 2/0,0 mode: --/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a365 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.008931:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5df3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343279.008944:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5df3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.008956:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5df3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.009096:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5dec lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a365 expref: 316 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.009114:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5df3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a365 expref: 315 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.009122:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22c:0x0].0x0 (ffff9401cc2f5900) 00010000:00010000:2.0:1763343279.009126:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343279.009130:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89e00, rc 0) 00000100:00100000:2.0:1763343279.009205:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:55884:x1848998400045824:12345-192.168.201.40@tcp:101:bash.0 Request processed in 358us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343279.009213:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11130 00000100:00100000:3.0:1763343279.012624:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.013085:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400046080 00000100:00100000:0.0:1763343279.013096:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400046080 00000100:00100000:0.0:1763343279.013154:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11131 00000100:00100000:0.0:1763343279.013165:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:55884:x1848998400046080:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:0.0:1763343279.013229:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343279.013260:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5dde lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a35e expref: 315 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.013617:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22c:0x0].0x0 (ffff9401cc2f5900) 00010000:00010000:0.0:1763343279.013624:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343279.013827:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5dfa lrc: 3/0,1 mode: --/PW res: [0x240000404:0x22c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343279.013841:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5dfa lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343279.013854:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5dfa lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000001:00080000:0.0:1763343279.013903:0:9827:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294974039 00000004:00010000:0.0:1763343279.013926:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000da113f35 reply state 000000006414a99a transno 4294974040 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5dfa lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343279.013936:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5dfa lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x22c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343279.013942:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22c:0x0].0x0 (ffff9401cc2f5900) 00010000:00010000:0.0:1763343279.013944:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343279.013947:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343279.014079:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:55884:x1848998400046080:12345-192.168.201.40@tcp:36:bash.0 Request processed in 914us (1473us total) trans 4294974040 rc 0/0 00000100:00100000:0.0:1763343279.014088:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11131 00000020:00080000:0.0:1763343279.014093:0:9827:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343279.016718:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343279.016928:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400046208 00000100:00100000:2.0:1763343279.016940:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400046208 00000100:00100000:2.0:1763343279.017009:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11132 00000100:00100000:2.0:1763343279.017057:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:55884:x1848998400046208:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343279.017084:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343279.017104:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5e01 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x22c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a36c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.017165:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5e01 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x22c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a36c expref: 318 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.017182:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5e01 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x22c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a36c expref: 318 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.017216:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22c:0x0].0x0 (ffff9401cc2f5900) 00010000:00010000:2.0:1763343279.017221:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343279.017225:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89200, rc 0) 00000100:00100000:2.0:1763343279.017297:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+318:55884:x1848998400046208:12345-192.168.201.40@tcp:101:bash.0 Request processed in 277us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343279.017305:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11132 00000100:00100000:1.0:1763343279.020185:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.020420:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400046464 00000100:00100000:0.0:1763343279.020430:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400046464 00000100:00100000:0.0:1763343279.021012:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11133 00000100:00100000:0.0:1763343279.021097:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+318:55884:x1848998400046464:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343279.021119:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343279.021122:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343279.021149:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89200/0x9104b1ba770a5e01 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x22c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a36c expref: 318 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.021168:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22c:0x0].0x0 (ffff9401cc2f5900) 00010000:00010000:0.0:1763343279.021172:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343279.021185:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5e08 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a373 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.021243:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5e0f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343279.021255:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5e0f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343279.021264:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5e0f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000040:00080000:0.0:1763343279.021492:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1840, 88 off152616 00000004:00080000:0.0:1763343279.021502:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1072145476918ns, next at 1072111852630ns, rc = 0 00000040:00080000:0.0:1763343279.021537:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1849, 88 off153376 00000004:00080000:0.0:1763343279.021543:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1072145518748ns, next at 1072111826735ns, rc = 0 00000040:00080000:0.0:1763343279.021567:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1850, 88 off153464 00000004:00080000:0.0:1763343279.021572:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1072145546893ns, next at 1072111826735ns, rc = 0 00000040:00080000:0.0:1763343279.021580:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1841, 88 off152704 00000004:00080000:0.0:1763343279.021583:0:9827:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1072145558796ns, next at 1072111852630ns, rc = 0 00000001:00080000:1.0:1763343279.026835:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974041 is committed 00000004:00080000:1.0:1763343279.026847:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1178 committed 00000004:00080000:1.0:1763343279.026863:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1186 committed 00000004:00080000:1.0:1763343279.026875:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1185 committed 00000004:00080000:1.0:1763343279.026878:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1177 committed 00010000:00010000:1.0:1763343279.026970:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5e0f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x22c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a373 expref: 312 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.026988:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22c:0x0].0x0 (ffff9401cc2f5900) 00010000:00010000:1.0:1763343279.026991:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343279.027008:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a5e08 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a373 expref: 312 pid: 9827 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343279.027054:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5e0f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x22c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a373 expref: 311 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.027085:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22c:0x0].0x0 (ffff9401cc2f5900) 00010000:00010000:1.0:1763343279.027088:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343279.027091:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a400, rc 0) 00000100:00100000:1.0:1763343279.027155:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:55884:x1848998400046464:12345-192.168.201.40@tcp:101:bash.0 Request processed in 6133us (6979us total) trans 4294974041 rc 0/0 00000100:00100000:1.0:1763343279.027165:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11133 00000100:00100000:3.0:1763343279.027175:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413028224:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343279.027240:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763343279.027263:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5d8a lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.027272:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5d8a lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.027279:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5d8a lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.027284:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343279.027288:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5d8a lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00000100:00100000:3.0:1763343279.027290:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343279.027296:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413028096:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1763343279.027300:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5d8a lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.027310:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758000) 00010000:00010000:2.0:1763343279.027313:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343279.027316:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763343279.027317:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5d8a lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.027323:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5d8a lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.027346:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5dfa lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x22c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343279.027352:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5dfa lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x22c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343279.027356:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5dfa lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x22c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343279.027361:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343279.027364:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5dfa lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x22c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343279.027369:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5dfa lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x22c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343279.027375:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22c:0x0].0x0 (ffff9401cc2f5900) 00010000:00010000:2.0:1763343279.027378:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343279.027380:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5dfa lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x22c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343279.027385:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5dfa lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x22c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00000100:00100000:2.0:1763343279.027625:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413028352:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343279.027656:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343279.027684:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763343279.027690:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413028480:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343279.027710:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343279.027763:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413028224 00000100:00100000:0.0:1763343279.027771:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413028224 00000100:00100000:0.0:1763343279.027821:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413028096 00000100:00100000:0.0:1763343279.027824:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413028096 00000100:00100000:0.0:1763343279.027837:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413028352 00000100:00100000:0.0:1763343279.027839:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413028352 00000100:00100000:0.0:1763343279.027855:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413028480 00000100:00100000:0.0:1763343279.027857:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413028480 00000100:00100000:0.0:1763343279.027876:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7619 00000100:00100000:0.0:1763343279.027884:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+40:3660:x1848998413028224:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343279.028059:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7620 00000100:00100000:3.0:1763343279.028067:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+41:3660:x1848998413028096:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343279.028076:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+41:3660:x1848998413028224:12345-0@lo:2:osp-syn-0-1.0 Request processed in 193us (835us total) trans 21474839360 rc 0/0 00000100:00100000:0.0:1763343279.028085:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7619 00000100:00100000:0.0:1763343279.028099:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7621 00000100:00100000:0.0:1763343279.028105:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+64:3661:x1848998413028352:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343279.028137:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+41:3660:x1848998413028096:12345-0@lo:2:osp-syn-0-1.0 Request processed in 71us (820us total) trans 21474839361 rc 0/0 00000100:00100000:3.0:1763343279.028143:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7620 00000100:00100000:3.0:1763343279.028155:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7622 00000100:00100000:3.0:1763343279.028161:0:8413:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+65:3661:x1848998413028480:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343279.028211:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+65:3661:x1848998413028352:12345-0@lo:2:osp-syn-1-1.0 Request processed in 105us (553us total) trans 17179872091 rc 0/0 00000100:00100000:0.0:1763343279.028217:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7621 00000100:00100000:3.0:1763343279.028245:0:8413:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+65:3661:x1848998413028480:12345-0@lo:2:osp-syn-1-1.0 Request processed in 84us (533us total) trans 17179872092 rc 0/0 00000100:00100000:3.0:1763343279.028250:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7622 00000004:00080000:0.0:1763343279.028257:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c586b480/2, rc 0, transno 17179872091 00000100:00100000:0.0:1763343279.028262:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413028352:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763343279.028272:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c586aa00/2, rc 0, transno 17179872092 00000100:00100000:0.0:1763343279.028276:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413028480:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763343279.028376:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c586c380/2, rc 0, transno 21474839361 00000100:00100000:3.0:1763343279.028381:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413028096:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763343279.028389:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c586c000/2, rc 0, transno 21474839360 00000100:00100000:3.0:1763343279.028393:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413028224:0@lo:2:osp-syn-0-1.0 00000100:00080000:2.0:1763343279.029443:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1763343279.029450:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1763343279.030380:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343279.030490:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400046592 00000100:00100000:1.0:1763343279.030500:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400046592 00000100:00100000:1.0:1763343279.030562:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7623 00000100:00100000:1.0:1763343279.030570:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:55884:x1848998400046592:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343279.030586:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343279.030608:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a5e16 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a37a expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343279.030631:0:8414:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343279.030653:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343279.030655:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343279.030666:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a5e16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a37a expref: 22 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.030680:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a5e16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a37a expref: 22 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.030690:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176e00, rc 0) 00000100:00100000:1.0:1763343279.030745:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:55884:x1848998400046592:12345-192.168.201.40@tcp:101:bash.0 Request processed in 176us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343279.030752:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7623 00000100:00080000:2.0:1763343279.031053:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1763343279.036424:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343279.036466:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400046720 00000100:00100000:1.0:1763343279.036477:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400046720 00000100:00100000:1.0:1763343279.036680:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7624 00000100:00100000:1.0:1763343279.036691:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+33:55884:x1848998400046720:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343279.036709:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343279.036730:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5e1d lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a381 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343279.036754:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343279.036776:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343279.036779:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343279.036787:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5e1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a381 expref: 34 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.036803:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5e1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a381 expref: 34 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.036815:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177200, rc 0) 00000100:00100000:1.0:1763343279.036868:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+34:55884:x1848998400046720:12345-192.168.201.40@tcp:101:bash.0 Request processed in 179us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343279.036877:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7624 00000100:00100000:3.0:1763343279.036940:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00080000:2.0:1763343279.037062:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1763343279.037111:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400046848 00000100:00100000:1.0:1763343279.037115:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400046848 00000100:00100000:1.0:1763343279.037139:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7625 00000100:00100000:1.0:1763343279.037146:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+34:2408:x1848998400046848:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:1.0:1763343279.037227:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+34:2408:x1848998400046848:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 81us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343279.037234:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7625 00000100:00100000:3.0:1763343279.039464:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343279.040845:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400046976 00000100:00100000:1.0:1763343279.040860:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400046976 00002000:00010000:1.0:1763343279.040903:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/748 (0->18446744073709551615) 00002000:00100000:1.0:1763343279.040909:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c517b800 with x1848998400046976 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343279.040921:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c517b800. 00000100:00100000:1.0:1763343279.040956:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1799 00000100:00100000:1.0:1763343279.040965:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2410:x1848998400046976:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:1.0:1763343279.041161:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343279.041165:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2ec:0x0] updating lvb mtime from disk: 0 -> 1763343278 00002000:00010000:1.0:1763343279.041167:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343279.041169:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2ec:0x0] updating lvb ctime from disk: 0 -> 1763343278 00002000:00010000:1.0:1763343279.041171:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2ec:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343279.041234:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2410:x1848998400046976:12345-192.168.201.40@tcp:10:bash.0 Request processed in 269us (1777us total) trans 21474839362 rc 0/0 00000100:00100000:1.0:1763343279.041242:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1799 00002000:00010000:1.0:1763343279.041246:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/748 (0->18446744073709551615) 00002000:00100000:1.0:1763343279.041248:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c517b800 with x1848998400046976 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343279.041253:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c517b800. 00000100:00100000:3.0:1763343279.041776:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.042279:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400047104 00000100:00100000:0.0:1763343279.042286:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400047104 00002000:00010000:0.0:1763343279.042314:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/749 (0->18446744073709551615) 00002000:00100000:0.0:1763343279.042318:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c517ad80 with x1848998400047104 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343279.042326:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c517ad80. 00000100:00100000:0.0:1763343279.042352:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1800 00000100:00100000:0.0:1763343279.042359:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+34:2410:x1848998400047104:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:0.0:1763343279.042486:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2ed:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343279.042489:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2ed:0x0] updating lvb mtime from disk: 0 -> 1763343278 00002000:00010000:0.0:1763343279.042491:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2ed:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343279.042493:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2ed:0x0] updating lvb ctime from disk: 0 -> 1763343278 00002000:00010000:0.0:1763343279.042494:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2ed:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343279.042525:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+35:2410:x1848998400047104:12345-192.168.201.40@tcp:10:bash.0 Request processed in 167us (751us total) trans 17179872093 rc 0/0 00000100:00100000:0.0:1763343279.042535:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1800 00002000:00010000:0.0:1763343279.042538:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/749 (0->18446744073709551615) 00002000:00100000:0.0:1763343279.042540:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c517ad80 with x1848998400047104 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343279.042544:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c517ad80. 00000100:00100000:0.0:1763343279.043059:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343279.043854:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400047232 00000100:00100000:3.0:1763343279.043863:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400047232 00000100:00100000:1.0:1763343279.044393:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7626 00000100:00100000:1.0:1763343279.044405:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+35:2407:x1848998400047232:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:1.0:1763343279.044497:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+35:2407:x1848998400047232:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 95us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343279.044504:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7626 00000100:00100000:2.0:1763343279.045717:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.045800:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400047488 00000100:00100000:0.0:1763343279.045807:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400047488 00000100:00100000:0.0:1763343279.045855:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3939 00000100:00100000:0.0:1763343279.045864:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:55884:x1848998400047488:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:0.0:1763343279.046170:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:55884:x1848998400047488:12345-192.168.201.40@tcp:35:bash.0 Request processed in 306us (458us total) trans 4294974042 rc 0/0 00000100:00100000:0.0:1763343279.046178:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3939 00000100:00100000:3.0:1763343279.050019:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343279.050092:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400047616 00000100:00100000:1.0:1763343279.050101:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400047616 00000100:00100000:1.0:1763343279.050175:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1801 00000100:00100000:1.0:1763343279.050185:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+35:2407:x1848998400047616:12345-192.168.201.40@tcp:3:lfs.0 00010000:00010000:1.0:1763343279.050232:0:28386:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5e24 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.050247:0:28386:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343279.050249:0:28386:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343279.050254:0:28386:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5e24 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.050269:0:28386:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5e24 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.050378:0:28386:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5e24 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.050387:0:28386:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5e24 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.050394:0:28386:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5e24 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.050401:0:28386:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343279.050406:0:28386:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5e24 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.050414:0:28386:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5e24 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.050431:0:28386:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5e24 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.050438:0:28386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177000/0x9104b1ba770a5e24 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28386 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343279.050511:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+35:2407:x1848998400047616:12345-192.168.201.40@tcp:3:lfs.0 Request processed in 327us (501us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1763343279.050519:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1801 00000100:00100000:3.0:1763343279.054460:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343279.054750:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400047872 00000100:00100000:1.0:1763343279.054760:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400047872 00000100:00100000:0.0:1763343279.055653:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11134 00000100:00100000:0.0:1763343279.055671:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57223:x1848998400047872:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:0.0:1763343279.055700:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343279.055729:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a5e2b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a38f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.055803:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a5e32 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343279.055818:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a5e32 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.055831:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a5e32 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.055847:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5e39 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343279.055854:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5e39 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.055861:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5e39 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.055933:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5e40 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343279.055942:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5e40 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.055950:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5e40 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:0.0:1763343279.055988:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22c:0x0]: returning size 5 00000004:00200000:0.0:1763343279.055993:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343279.056013:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5e40 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.056039:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5e40 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.056050:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a5e32 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.056056:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a5e32 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.056062:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a5e32 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.056072:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a5e32 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.056078:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343279.056081:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a5e32 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.056088:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a5e32 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.056100:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48aab00) 00010000:00010000:0.0:1763343279.056103:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343279.056107:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a5e32 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.056113:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a5e32 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.056126:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5e39 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.056131:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5e39 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.056136:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5e39 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.056140:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ae00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343279.056142:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5e39 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.056147:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5e39 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.056157:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c48aa000) 00010000:00010000:0.0:1763343279.056159:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343279.056161:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5e39 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.056166:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a5e39 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.056206:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a5e2b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a38f expref: 312 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.056222:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5e40 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a38f expref: 311 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.056229:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22c:0x0].0x0 (ffff9401cc2f5900) 00010000:00010000:0.0:1763343279.056232:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343279.056234:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b400, rc 0) 00000100:00100000:0.0:1763343279.056304:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57223:x1848998400047872:12345-192.168.201.40@tcp:101:rm.0 Request processed in 639us (1853us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343279.056311:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11134 00000100:00100000:3.0:1763343279.056525:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343279.056586:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400047744 00000100:00100000:2.0:1763343279.056593:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400047744 00000100:00100000:2.0:1763343279.056628:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11135 00000100:00100000:2.0:1763343279.056636:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57220:x1848998400047744:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343279.056647:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343279.056658:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5e47 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a388 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.056677:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88400/0x9104b1ba770a5e4e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343279.056685:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88400/0x9104b1ba770a5e4e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.056693:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88400/0x9104b1ba770a5e4e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.056770:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5e47 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a388 expref: 313 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.056783:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88400/0x9104b1ba770a5e4e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a388 expref: 312 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.056790:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:2.0:1763343279.056792:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343279.057127:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88400, rc 0) 00000100:00100000:2.0:1763343279.057159:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57220:x1848998400047744:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 523us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343279.057165:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11135 00000100:00100000:3.0:1763343279.059133:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343279.059710:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400048128 00000100:00100000:2.0:1763343279.059720:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400048128 00000100:00100000:2.0:1763343279.059775:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11136 00000100:00100000:2.0:1763343279.059785:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c517a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57223:x1848998400048128:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:2.0:1763343279.059839:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763343279.059869:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a5e0f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x22c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a373 expref: 312 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.059894:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a5e40 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a38f expref: 311 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.059909:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5df3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a365 expref: 310 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.059920:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22c:0x0].0x0 (ffff9401cc2f5900) 00010000:00010000:2.0:1763343279.059931:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343279.059958:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5e55 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343279.059971:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5e55 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.059980:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5e55 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.059991:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a5e5c lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343279.059998:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a5e5c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.060004:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a5e5c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.060091:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5e63 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343279.060099:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5e63 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.060106:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5e63 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000040:00080000:2.0:1763343279.060371:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1842, 64 off152768 00000004:00080000:2.0:1763343279.060379:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1072184354497ns, next at 1073184352022ns, rc = 0 00000040:00080000:2.0:1763343279.060405:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1851, 64 off153528 00000004:00080000:2.0:1763343279.060410:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1072184385162ns, next at 1073184383515ns, rc = 0 00000040:00080000:2.0:1763343279.060420:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1852, 64 off153592 00000040:00080000:2.0:1763343279.060431:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1843, 64 off152832 00010000:00010000:2.0:1763343279.060482:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5e6a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x22c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343279.060495:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5e6a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.060503:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5e6a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.060510:0:33856:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5e6a lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x22c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.060516:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5e6a lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x22c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.060523:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5e6a lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x22c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.060550:0:33856:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343279.060568:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5e63 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.060574:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5e63 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.060580:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5e63 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.060586:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343279.060589:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5e63 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.060597:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5e63 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.060611:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22c:0x0].0x0 (ffff9400c4758100) 00010000:00010000:2.0:1763343279.060614:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763343279.060618:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5e63 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.060624:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5e63 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x22c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.060735:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5e55 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.060742:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5e55 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.060748:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5e55 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.060753:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343279.060756:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5e55 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.060761:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5e55 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.060769:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c4758000) 00010000:00010000:2.0:1763343279.060772:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343279.060775:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5e55 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.060781:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5e55 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:2.0:1763343279.060791:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e15f40a4 reply state 0000000032174824 transno 4294974043 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a5e5c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.060801:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a5e5c lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.060808:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758b00) 00010000:00010000:2.0:1763343279.060810:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343279.060812:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343279.060901:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c517a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57223:x1848998400048128:12345-192.168.201.40@tcp:36:rm.0 Request processed in 1116us (1779us total) trans 4294974043 rc 0/0 00000100:00100000:2.0:1763343279.060908:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11136 00010000:00010000:0.0:1763343279.061352:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343279.061360:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5e6a lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x22c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.061366:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343279.061369:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5e6a lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x22c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.061375:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5e6a lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x22c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.061386:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22c:0x0].0x0 (ffff9400c4758100) 00010000:00010000:0.0:1763343279.061389:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343279.061392:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5e6a lrc: 1/0,0 mode: --/PW res: [0x240000404:0x22c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.061397:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a5e6a lrc: 0/0,0 mode: --/PW res: [0x240000404:0x22c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.061410:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343279.061412:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343279.061414:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343279.061839:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343279.062150:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400048256 00000100:00100000:2.0:1763343279.062158:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400048256 00000100:00100000:2.0:1763343279.066554:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1802 00000100:00100000:2.0:1763343279.066584:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5869c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2409:x1848998400048256:12345-192.168.201.40@tcp:4:lfs.0 00002000:00010000:2.0:1763343279.066649:0:28399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343279.066659:0:28399:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88000/0x9104b1ba770a5e71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.066674:0:28399:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343279.066677:0:28399:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343279.066682:0:28399:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88000/0x9104b1ba770a5e71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.066696:0:28399:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88000/0x9104b1ba770a5e71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1763343279.069297:0:24675:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839363 is committed 00000001:00080000:2.0:1763343279.069317:0:24675:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839361 is committed 00002000:00010000:1.0:1763343279.070015:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2eb:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:1.0:1763343279.070020:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2eb:0x0] updating lvb mtime from disk: 0 -> 1763343278 00002000:00010000:1.0:1763343279.070050:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2eb:0x0] updating lvb ctime from disk: 0 -> 1763343278 00002000:00010000:1.0:1763343279.070054:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2eb:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1763343279.070067:0:28399:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88000/0x9104b1ba770a5e71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.070079:0:28399:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88000/0x9104b1ba770a5e71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.070091:0:28399:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88000/0x9104b1ba770a5e71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.070097:0:28399:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343279.070102:0:28399:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88000/0x9104b1ba770a5e71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.070111:0:28399:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88000/0x9104b1ba770a5e71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.070130:0:28399:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88000/0x9104b1ba770a5e71 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.070137:0:28399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88000/0x9104b1ba770a5e71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28399 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343279.070247:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5869c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:2409:x1848998400048256:12345-192.168.201.40@tcp:4:lfs.0 Request processed in 3673us (8403us total) trans 21474839363 rc 0/0 00000100:00100000:1.0:1763343279.070258:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1802 00000100:00100000:1.0:1763343279.075621:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343279.075740:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400048384 00000100:00100000:3.0:1763343279.075753:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400048384 00000100:00100000:2.0:1763343279.076582:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11137 00000100:00100000:2.0:1763343279.076598:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57224:x1848998400048384:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343279.076624:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343279.076655:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5e78 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a396 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.076742:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5e7f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343279.076758:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5e7f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.076771:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5e7f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.076780:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5e86 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343279.076786:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5e86 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.076791:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5e86 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.076838:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5e7f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.076845:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5e7f lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.076852:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5e7f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.076858:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343279.076862:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5e7f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.076870:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5e7f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.076881:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48ac900) 00010000:00010000:2.0:1763343279.076884:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343279.076888:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5e7f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.076893:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5e7f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.076906:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5e86 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.076911:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5e86 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.076916:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5e86 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.076920:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343279.076922:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5e86 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.076927:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5e86 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.076933:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758b00) 00010000:00010000:2.0:1763343279.076934:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343279.076937:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5e86 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.076941:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5e86 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.076965:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5e78 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a396 expref: 312 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.076975:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48ac900) 00010000:00010000:2.0:1763343279.076977:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343279.076981:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5e78 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a396 expref: 312 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.076992:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89c00, rc 0) 00000100:00100000:2.0:1763343279.078129:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57224:x1848998400048384:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1524us (2510us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343279.078143:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11137 00000100:00100000:3.0:1763343279.080804:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343279.080934:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400048512 00000100:00100000:2.0:1763343279.080943:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400048512 00000100:00100000:3.0:1763343279.081118:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11138 00000100:00100000:3.0:1763343279.081130:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57224:x1848998400048512:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343279.081151:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343279.081175:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5e8d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a39d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.081255:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5e94 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343279.081347:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5e94 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.081361:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5e94 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.081373:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5e9b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343279.081380:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5e9b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.081387:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5e9b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.081428:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5e94 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.081436:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5e94 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.081442:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5e94 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.081447:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5e94 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.081452:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121e200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343279.081456:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5e94 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.081463:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5e94 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.081474:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:3.0:1763343279.081478:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343279.081482:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5e94 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.081487:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5e94 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.081498:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5e9b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.081504:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5e9b lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.081510:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5e9b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.081516:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343279.081518:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5e9b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.081523:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5e9b lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.081529:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758b00) 00010000:00010000:3.0:1763343279.081532:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343279.081534:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5e9b lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.081539:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5e9b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.081565:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5e8d lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a39d expref: 312 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.081574:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:3.0:1763343279.081576:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343279.081579:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5e8d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a39d expref: 312 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.081590:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121fc00, rc 0) 00000100:00100000:3.0:1763343279.082216:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57224:x1848998400048512:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1084us (1418us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343279.082225:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11138 00000100:00100000:0.0:1763343279.082504:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343279.082580:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400048768 00000100:00100000:2.0:1763343279.082588:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400048768 00000100:00100000:2.0:1763343279.082662:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11139 00000100:00100000:2.0:1763343279.082672:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57220:x1848998400048768:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:2.0:1763343279.082713:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343279.082733:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5db4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a349 expref: 311 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.082747:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:2.0:1763343279.082751:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343279.082811:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5ea2 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343279.082823:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5ea2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.082833:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5ea2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00010000:2.0:1763343279.082946:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000051c50c41 reply state 0000000002bbc28f transno 4294974044 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5ea2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.082957:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5ea2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.082963:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:2.0:1763343279.082965:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343279.082968:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343279.083149:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57220:x1848998400048768:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 477us (644us total) trans 4294974044 rc 0/0 00000100:00100000:2.0:1763343279.083157:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11139 00000100:00100000:1.0:1763343279.084203:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343279.084270:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400048896 00000100:00100000:2.0:1763343279.084278:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400048896 00000100:00100000:2.0:1763343279.084650:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11140 00000100:00100000:2.0:1763343279.084660:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57224:x1848998400048896:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343279.084678:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343279.084696:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5ea9 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a3a4 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.084751:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5eb0 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343279.084765:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5eb0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.084777:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5eb0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:2.0:1763343279.084819:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763343279.084830:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763343279.084865:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5ea9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3a4 expref: 314 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.084882:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5eb0 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3a4 expref: 313 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.084896:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48ac900) 00010000:00010000:2.0:1763343279.084898:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763343279.084902:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89e00, rc 0) 00000100:00100000:2.0:1763343279.084961:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57224:x1848998400048896:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 302us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343279.084969:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11140 00000100:00100000:3.0:1763343279.085280:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.085338:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400049024 00000100:00100000:0.0:1763343279.085344:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400049024 00000100:00100000:0.0:1763343279.085381:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7627 00000100:00100000:0.0:1763343279.085389:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:57220:x1848998400049024:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343279.085398:0:35266:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343279.085411:0:35266:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c501b800/0x9104b1ba770a5eb7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a3ab expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343279.085431:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2eb:0x0] initial LVB size: 4096, mtime: 0x691a7bae, atime: 0x0, ctime: 0x691a7bae, blocks: 0x8 00010000:00010000:0.0:1763343279.085446:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343279.085448:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343279.085455:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501b800/0x9104b1ba770a5eb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ab expref: 13 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.085469:0:35266:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c501b800/0x9104b1ba770a5eb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ab expref: 13 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.085486:0:35266:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b800, rc 0) 00000100:00100000:0.0:1763343279.085526:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:57220:x1848998400049024:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 137us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343279.085532:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7627 00000100:00100000:0.0:1763343279.087343:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343279.087890:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400049152 00000100:00100000:1.0:1763343279.087902:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400049152 00000100:00100000:1.0:1763343279.087962:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7628 00000100:00100000:1.0:1763343279.087972:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+35:57220:x1848998400049152:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343279.087990:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343279.088013:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5ebe lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a3b2 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343279.088070:0:8414:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343279.088092:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343279.088095:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343279.088103:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5ebe lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3b2 expref: 36 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.088119:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5ebe lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3b2 expref: 36 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.088130:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176200, rc 0) 00000100:00100000:3.0:1763343279.088163:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343279.088179:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+36:57220:x1848998400049152:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 209us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343279.088186:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7628 00000100:00100000:2.0:1763343279.088473:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400049280 00000100:00100000:2.0:1763343279.088479:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400049280 00000100:00100000:2.0:1763343279.088519:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11141 00000100:00100000:2.0:1763343279.088526:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57224:x1848998400049280:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343279.088539:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343279.088553:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5ec5 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a3b9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.088615:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5ecc lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343279.088626:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5ecc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.088635:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5ecc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.088644:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5ed3 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343279.088650:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5ed3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.088657:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5ed3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.088693:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5ecc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.088700:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5ecc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.088706:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5ecc lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.088712:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5ecc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.088717:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343279.088721:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5ecc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.088728:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5ecc lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.088738:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48ac900) 00010000:00010000:2.0:1763343279.088741:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343279.088745:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5ecc lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.088751:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5ecc lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.088763:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5ed3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.088769:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5ed3 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.088774:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5ed3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.088779:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343279.088781:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5ed3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.088787:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5ed3 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.088794:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758b00) 00010000:00010000:2.0:1763343279.088796:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343279.088798:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5ed3 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.088803:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5ed3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.088827:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5ec5 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3b9 expref: 314 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.088836:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48ac900) 00010000:00010000:2.0:1763343279.088839:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343279.088841:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5ec5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3b9 expref: 314 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.088849:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88e00, rc 0) 00000100:00100000:2.0:1763343279.088884:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57224:x1848998400049280:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 358us (936us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343279.088891:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11141 00000100:00100000:0.0:1763343279.090708:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343279.090775:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400049408 00000100:00100000:1.0:1763343279.090784:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400049408 00002000:00010000:1.0:1763343279.090819:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/747 (5->18446744073709551615) 00000100:00100000:0.0:1763343279.090821:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00002000:00100000:1.0:1763343279.090823:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c586ad80 with x1848998400049408 ext(5->18446744073709551615) 00002000:00010000:1.0:1763343279.090834:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c586ad80. 00000100:00100000:0.0:1763343279.090856:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.090883:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400049792 00000100:00100000:0.0:1763343279.090887:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400049792 00000100:00100000:0.0:1763343279.090921:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11142 00000100:00100000:1.0:1763343279.090929:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400049536 00000100:00100000:0.0:1763343279.090929:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57224:x1848998400049792:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:1.0:1763343279.090932:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400049536 00002000:00010000:1.0:1763343279.090944:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/748 (0->18446744073709551615) 00010000:00010000:0.0:1763343279.090944:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:1.0:1763343279.090947:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5868700 with x1848998400049536 ext(0->18446744073709551615) 00010000:00010000:0.0:1763343279.090947:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00002000:00010000:1.0:1763343279.090954:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5868700. 00010000:00010000:0.0:1763343279.090969:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5eb0 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3a4 expref: 313 pid: 6525 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343279.090986:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1803 00010000:00010000:0.0:1763343279.090986:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48ac900) 00000100:00100000:3.0:1763343279.090994:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2409:x1848998400049408:12345-192.168.201.40@tcp:10:lfs.0 00010000:00010000:0.0:1763343279.090995:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343279.091007:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5eda lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a3c0 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.091108:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5ee1 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343279.091120:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5ee1 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.091130:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5ee1 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.091141:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5ee8 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343279.091147:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5ee8 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.091152:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5ee8 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00002000:00010000:3.0:1763343279.091308:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2eb:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:3.0:1763343279.091312:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2eb:0x0] updating lvb mtime from disk: 1763343278 -> 1763343278 00002000:00010000:3.0:1763343279.091314:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2eb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343279.091316:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2eb:0x0] updating lvb ctime from disk: 1763343278 -> 1763343278 00002000:00010000:3.0:1763343279.091318:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2eb:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343279.091366:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2409:x1848998400049408:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 372us (666us total) trans 21474839364 rc 0/0 00000100:00100000:3.0:1763343279.091373:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1803 00002000:00010000:3.0:1763343279.091376:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/747 (5->18446744073709551615) 00002000:00100000:3.0:1763343279.091378:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c586ad80 with x1848998400049408 ext(5->18446744073709551615) 00002000:00010000:3.0:1763343279.091382:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c586ad80. 00000100:00100000:3.0:1763343279.091400:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1804 00000100:00100000:3.0:1763343279.091407:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+36:2409:x1848998400049536:12345-192.168.201.40@tcp:10:lfs.0 00002000:00010000:3.0:1763343279.091486:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343279.091489:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2ec:0x0] updating lvb mtime from disk: 0 -> 1763343278 00002000:00010000:3.0:1763343279.091491:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343279.091492:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2ec:0x0] updating lvb ctime from disk: 0 -> 1763343278 00002000:00010000:3.0:1763343279.091495:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2ec:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:0.0:1763343279.091501:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5eef lrc: 3/1,0 mode: --/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343279.091509:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5eef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00000100:00100000:3.0:1763343279.091515:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+37:2409:x1848998400049536:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 108us (693us total) trans 17179872094 rc 0/0 00010000:00010000:0.0:1763343279.091517:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5eef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:3.0:1763343279.091521:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1804 00002000:00010000:3.0:1763343279.091524:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/748 (0->18446744073709551615) 00000004:00200000:0.0:1763343279.091525:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22e:0x0]: returning size 0 00002000:00100000:3.0:1763343279.091526:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5868700 with x1848998400049536 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343279.091531:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5868700. 00010000:00010000:0.0:1763343279.091547:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5ee1 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.091553:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5ee1 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.091559:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5ee1 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.091565:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343279.091569:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5ee1 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.091576:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5ee1 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.091584:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48aa600) 00010000:00010000:0.0:1763343279.091587:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343279.091590:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5ee1 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.091596:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5ee1 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:0.0:1763343279.091607:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000064dd9b23 reply state 0000000089931c72 transno 4294974045 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5ee8 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.091618:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5ee8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.091624:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758b00) 00010000:00010000:0.0:1763343279.091626:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343279.091629:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343279.091652:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a5eda lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3c0 expref: 315 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.091668:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5eef lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3c0 expref: 314 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.091675:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22e:0x0].0x0 (ffff9400c48aa300) 00010000:00010000:0.0:1763343279.091678:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343279.091680:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a800, rc 0) 00000100:00100000:0.0:1763343279.091702:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57224:x1848998400049792:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 775us (845us total) trans 4294974045 rc 0/0 00000100:00100000:0.0:1763343279.091712:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11142 00000100:00100000:3.0:1763343279.093641:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.093680:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400050304 00000100:00100000:0.0:1763343279.093689:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400050304 00000100:00100000:2.0:1763343279.094005:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11143 00000100:00100000:2.0:1763343279.094015:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57224:x1848998400050304:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343279.094057:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343279.094116:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5efd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a3c7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343279.094202:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:2.0:1763343279.094221:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f04 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343279.094235:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5eef lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3c0 expref: 316 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.094244:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f04 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.094277:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5eef lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3c0 expref: 316 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.094290:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5eef lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3c0 expref: 316 pid: 33856 timeout: 1172 lvb_type: 0 00000100:00100000:2.0:1763343279.094303:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998413028608:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343279.094379:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c53049c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343279.094419:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400050048 00000100:00100000:0.0:1763343279.094424:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400050048 00000100:00100000:0.0:1763343279.094455:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11144 00000100:00100000:0.0:1763343279.094462:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57220:x1848998400050048:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:0.0:1763343279.094502:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5f0b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343279.094513:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5f0b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.094523:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5f0b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00010000:0.0:1763343279.094625:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007b6f3332 reply state 00000000b1a6a8f6 transno 4294974046 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5f0b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.094638:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5f0b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.094645:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:0.0:1763343279.094648:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343279.094651:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343279.094702:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:57220:x1848998400050048:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 240us (511us total) trans 4294974046 rc 0/0 00000100:00100000:0.0:1763343279.094709:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11144 00000100:00100000:2.0:1763343279.096242:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998413028608:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343279.096266:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f04 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000100:00100000:1.0:1763343279.096679:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343279.096713:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343279.096723:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400050432 00000100:00100000:3.0:1763343279.096730:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400050432 00010000:00010000:3.0:1763343279.096758:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5eef lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3c0 expref: 319 pid: 33856 timeout: 1172 lvb_type: 0 00000100:00100000:2.0:1763343279.096776:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400050560 00000100:00100000:2.0:1763343279.096780:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400050560 00000100:00100000:3.0:1763343279.096791:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3628 00000100:00100000:3.0:1763343279.096799:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5867100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:2410:x1848998400050432:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343279.096812:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1763343279.096813:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7629 00010000:00010000:3.0:1763343279.096818:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5eef lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3c0 expref: 319 pid: 33856 timeout: 1172 lvb_type: 0 00000100:00100000:2.0:1763343279.096819:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5864700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+37:2408:x1848998400050560:12345-192.168.201.40@tcp:2:lfs.0 00010000:00010000:3.0:1763343279.096830:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5eef lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3c0 expref: 319 pid: 33856 timeout: 1172 lvb_type: 0 00010000:00010000:3.0:1763343279.096849:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a5eef lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3c0 expref: 319 pid: 33856 timeout: 1172 lvb_type: 0 00010000:00010000:3.0:1763343279.096864:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22e:0x0].0x0 (ffff9400c48aa300) 00010000:00010000:3.0:1763343279.096869:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f04 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.096876:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f04 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.096882:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f04 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.096902:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343279.096946:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5867100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+318:2410:x1848998400050432:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 148us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343279.096953:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3628 00002000:00010000:2.0:1763343279.096958:0:8414:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2eb:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763343279.096961:0:8414:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2eb:0x0] updating lvb mtime from disk: 1763343278 -> 1763343278 00002000:00010000:2.0:1763343279.096963:0:8414:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2eb:0x0] updating lvb atime from disk: 0 -> 1763343278 00002000:00010000:2.0:1763343279.096966:0:8414:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2eb:0x0] updating lvb ctime from disk: 1763343278 -> 1763343278 00002000:00010000:2.0:1763343279.096968:0:8414:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2eb:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763343279.096991:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5864700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+38:2408:x1848998400050560:12345-192.168.201.40@tcp:2:lfs.0 Request processed in 171us (277us total) trans 17179872095 rc 0/0 00000100:00100000:2.0:1763343279.096997:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7629 00010000:00010000:2.0:1763343279.097016:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f04 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.097048:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f04 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:2.0:1763343279.097068:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22e:0x0]: returning size 0 00000004:00080000:2.0:1763343279.097232:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2ef:0x0], index 1: 0 00000004:00080000:2.0:1763343279.097239:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2ee:0x0], index 0: 0 00000004:00080000:2.0:1763343279.097244:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2ef:0x0], index 0: 0 00000004:00080000:2.0:1763343279.097247:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2f0:0x0], index 1: 0 00010000:00010000:2.0:1763343279.097344:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f04 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.097351:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f04 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.097359:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f04 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.097364:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343279.097368:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f04 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.097376:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f04 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.097390:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22e:0x0].0x0 (ffff9400c48aa300) 00010000:00010000:2.0:1763343279.097393:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343279.097401:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f04 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.097407:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f04 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.097449:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5efd lrc: 1/0,0 mode: --/CR res: [0x240000404:0x22e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3c7 expref: 318 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.097459:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22e:0x0].0x0 (ffff9400c48aa300) 00010000:00010000:2.0:1763343279.097461:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343279.097464:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5efd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x22e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3c7 expref: 318 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.097477:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89c00, rc 0) 00000100:00100000:2.0:1763343279.097514:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57224:x1848998400050304:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3501us (3880us total) trans 4294974047 rc 301/301 00000100:00100000:2.0:1763343279.097521:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11143 00000100:00100000:1.0:1763343279.099398:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343279.099728:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400050816 00000100:00100000:2.0:1763343279.099738:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400050816 00000100:00100000:2.0:1763343279.099795:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3940 00000100:00100000:2.0:1763343279.099806:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57224:x1848998400050816:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343279.100153:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+318:57224:x1848998400050816:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 347us (762us total) trans 4294974048 rc 0/0 00000100:00100000:2.0:1763343279.100161:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3940 00000100:00100000:3.0:1763343279.100220:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343279.100324:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400051072 00000100:00100000:2.0:1763343279.100329:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400051072 00000100:00100000:2.0:1763343279.100452:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3941 00000100:00100000:2.0:1763343279.100461:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+318:57220:x1848998400051072:12345-192.168.201.40@tcp:35:lfs.0 00000004:00010000:2.0:1763343279.100495:0:6527:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x22b:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5d0c lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a318 expref: 318 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.100535:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5f19 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343279.100547:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5d75 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a33b expref: 318 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.100555:0:6527:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5f19 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343279.100585:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5d75 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a33b expref: 318 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.100597:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5d75 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a33b expref: 318 pid: 9827 timeout: 1172 lvb_type: 0 00000100:00100000:2.0:1763343279.100614:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6527:1848998413028736:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343279.101124:0:6527:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c53043c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343279.102654:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.102967:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400051328 00000100:00100000:0.0:1763343279.102977:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400051328 00000100:00100000:0.0:1763343279.103213:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3942 00000100:00100000:0.0:1763343279.103223:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82c9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:57224:x1848998400051328:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343279.103479:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82c9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+320:57224:x1848998400051328:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 255us (830us total) trans 4294974049 rc 0/0 00000100:00100000:0.0:1763343279.103488:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3942 00000100:00100000:2.0:1763343279.103998:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6527:1848998413028736:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343279.104021:0:6527:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5f19 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00000100:00100000:1.0:1763343279.104913:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.104998:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400051456 00000100:00100000:0.0:1763343279.105004:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400051456 00010000:00010000:0.0:1763343279.105094:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5d75 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a33b expref: 320 pid: 9827 timeout: 1172 lvb_type: 0 00000100:00100000:0.0:1763343279.105126:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3629 00000100:00100000:0.0:1763343279.105135:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5865f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+320:2407:x1848998400051456:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343279.105147:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343279.105153:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5d75 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a33b expref: 320 pid: 9827 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343279.105164:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5d75 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a33b expref: 320 pid: 9827 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343279.105184:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5d75 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a33b expref: 320 pid: 9827 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343279.105209:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:0.0:1763343279.105214:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5f19 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343279.105224:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5f19 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343279.105235:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5f19 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT1 00010000:00010000:0.0:1763343279.105257:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343279.105301:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5865f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:2407:x1848998400051456:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 167us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343279.105308:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3629 00010000:00010000:2.0:1763343279.105625:0:6527:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5f19 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343279.105633:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5f19 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00000040:00080000:2.0:1763343279.105854:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1853, 88 off153680 00000004:00080000:2.0:1763343279.105862:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1072229837166ns, next at 1073184383515ns, rc = 0 00000040:00080000:2.0:1763343279.105902:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1844, 88 off152920 00000004:00080000:2.0:1763343279.105907:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1072229882171ns, next at 1073184352022ns, rc = 0 00000040:00080000:2.0:1763343279.105931:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1845, 88 off153008 00000004:00080000:2.0:1763343279.105935:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1072229910826ns, next at 1073184352022ns, rc = 0 00000040:00080000:2.0:1763343279.105946:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1854, 88 off153768 00000004:00080000:2.0:1763343279.105950:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1072229925384ns, next at 1073184383515ns, rc = 0 00000100:00100000:2.0:1763343279.107356:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343279.107408:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400051712 00000100:00100000:3.0:1763343279.107416:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400051712 00000100:00100000:3.0:1763343279.107509:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11145 00000100:00100000:3.0:1763343279.107523:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+320:55884:x1848998400051712:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:3.0:1763343279.107542:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343279.107564:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5f20 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a3ce expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.107688:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5f27 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343279.107700:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5f27 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.107717:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5f27 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.107728:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5f2e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343279.107734:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5f2e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.107744:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5f2e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.107797:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5f35 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343279.107805:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5f35 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.107812:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5f35 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:3.0:1763343279.107821:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22e:0x0]: returning size 0 00010000:00010000:3.0:1763343279.107904:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5f27 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.107912:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5f27 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.107918:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5f27 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.107925:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5f27 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.107931:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343279.107935:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5f27 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.107942:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5f27 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.107954:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:3.0:1763343279.107957:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343279.107962:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5f27 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.107968:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5f27 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.107980:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5f2e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.107986:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5f2e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.107992:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5f2e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.107996:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121e200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343279.107999:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5f2e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.108004:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5f2e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.108010:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758b00) 00010000:00010000:3.0:1763343279.108012:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343279.108015:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5f2e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.108020:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5f2e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.108072:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5f20 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ce expref: 323 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.108088:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5f35 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ce expref: 322 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.108095:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22e:0x0].0x0 (ffff9401fd0d4a00) 00010000:00010000:3.0:1763343279.108098:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343279.108100:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401d121e800, rc 0) 00000100:00100000:3.0:1763343279.108159:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+322:55884:x1848998400051712:12345-192.168.201.40@tcp:101:bash.0 Request processed in 638us (810us total) trans 4294974051 rc 0/0 00000100:00100000:3.0:1763343279.108166:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11145 00000001:00080000:0.0:1763343279.109261:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974050 is committed 00000004:00080000:0.0:1763343279.109280:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1189 committed 00000004:00080000:0.0:1763343279.109292:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1181 committed 00000004:00080000:0.0:1763343279.109304:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1180 committed 00000004:00080000:0.0:1763343279.109306:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1188 committed 00000004:00080000:0.0:1763343279.109319:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1187 committed 00000004:00080000:0.0:1763343279.109321:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1179 committed 00010000:00010000:1.0:1763343279.109411:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a5e5c lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343279.109421:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a5e5c lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343279.109427:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a5e5c lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343279.109432:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343279.109436:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a5e5c lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343279.109441:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a5e5c lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343279.109455:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758b00) 00010000:00010000:1.0:1763343279.109458:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343279.109462:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a5e5c lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343279.109467:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a5e5c lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343279.109481:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5ea2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.109487:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5ea2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.109492:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5ea2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.109498:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343279.109500:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5ea2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.109506:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5ea2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.109513:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:1.0:1763343279.109516:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343279.109519:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5ea2 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.109524:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5ea2 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00000100:00100000:2.0:1763343279.109527:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413028992:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1763343279.109532:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5ee8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343279.109537:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5ee8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343279.109543:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5ee8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343279.109546:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501bc00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343279.109549:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5ee8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343279.109554:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5ee8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343279.109560:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400c4758b00) 00010000:00010000:1.0:1763343279.109563:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343279.109565:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5ee8 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343279.109569:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501bc00/0x9104b1ba770a5ee8 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000100:00100000:2.0:1763343279.109577:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343279.109584:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5f0b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343279.109589:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5f0b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343279.109594:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5f0b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343279.109599:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343279.109601:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5f0b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343279.109606:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5f0b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00000100:00100000:2.0:1763343279.109608:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1763343279.109612:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c38f5200) 00000100:00100000:2.0:1763343279.109613:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413028864:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1763343279.109615:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343279.109617:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5f0b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343279.109623:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5f0b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000100:00100000:2.0:1763343279.109631:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343279.109652:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413029120:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343279.109672:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343279.109696:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763343279.109701:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413029632:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343279.109723:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343279.109741:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413029376:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343279.109744:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413029248:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343279.109759:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343279.109782:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763343279.109782:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343279.109786:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413029760:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343279.109800:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763343279.109805:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343279.109805:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413029504:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343279.109821:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343279.109834:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413028992 00000100:00100000:0.0:1763343279.109839:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413028864 00000100:00100000:2.0:1763343279.109841:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413028992 00000100:00100000:0.0:1763343279.109841:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413028864 00000100:00100000:3.0:1763343279.109888:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413029120 00000100:00100000:3.0:1763343279.109892:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413029120 00000100:00100000:1.0:1763343279.110113:0:11289:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413029632 00000100:00100000:1.0:1763343279.110118:0:11289:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413029632 00000100:00100000:2.0:1763343279.110173:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413029376 00000100:00100000:0.0:1763343279.110173:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413029248 00000100:00100000:2.0:1763343279.110177:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413029376 00000100:00100000:0.0:1763343279.110177:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413029248 00000100:00100000:2.0:1763343279.110202:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413029760 00000100:00100000:0.0:1763343279.110202:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413029504 00000100:00100000:2.0:1763343279.110205:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413029760 00000100:00100000:0.0:1763343279.110205:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413029504 00000100:00100000:0.0:1763343279.110219:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7630 00000100:00100000:2.0:1763343279.110225:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7631 00000100:00100000:0.0:1763343279.110225:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:3660:x1848998413028864:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763343279.110230:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+8:3660:x1848998413028992:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763343279.110248:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:749 count 1 00002000:00080000:0.0:1763343279.110248:0:27798:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:748 count 1 00010000:00010000:0.0:1763343279.110267:0:27798:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c501ba00/0x9104b1ba770a5f43 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343279.110273:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343279.110278:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5f4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.110290:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343279.110292:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343279.110298:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5f4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.110310:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5f4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.110318:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5f4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.110325:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5f4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.110343:0:35266:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343279.110355:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7632 00000100:00100000:3.0:1763343279.110363:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+68:3659:x1848998413029376:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763343279.110375:0:28561:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:749 count 1 00010000:00010000:3.0:1763343279.110389:0:28561:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5f51 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.110401:0:28561:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5e1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a381 expref: 37 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.110408:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343279.110410:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343279.110412:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5f51 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.110435:0:28561:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5e1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a381 expref: 37 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.110449:0:28561:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5e1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a381 expref: 37 pid: 35266 timeout: 1172 lvb_type: 0 00000100:00100000:3.0:1763343279.110465:0:28561:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9831500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998413029888:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343279.110520:0:28561:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c45320c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343279.110546:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3660:x1848998413028992:12345-0@lo:6:osp-syn-0-1.0 Request processed in 314us (967us total) trans 21474839365 rc 0/0 00000100:00100000:2.0:1763343279.110554:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7631 00000100:00100000:1.0:1763343279.110560:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7633 00000100:00100000:2.0:1763343279.110567:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7634 00000100:00100000:1.0:1763343279.110567:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+8:3661:x1848998413029248:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763343279.110572:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+68:3659:x1848998413029504:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763343279.110581:0:35266:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:750 count 1 00002000:00010000:2.0:1763343279.110594:0:35266:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343279.110598:0:35266:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f58 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.110605:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343279.110606:0:35266:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343279.110609:0:35266:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.110618:0:35266:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.110625:0:35266:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.110632:0:35266:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343279.110641:0:11289:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2eb:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763343279.110644:0:11289:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2eb:0x0] updating lvb mtime from disk: 1763343278 -> 1763343278 00002000:00010000:1.0:1763343279.110647:0:11289:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2eb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343279.110649:0:11289:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2eb:0x0] updating lvb ctime from disk: 1763343278 -> 1763343278 00002000:00010000:1.0:1763343279.110651:0:11289:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2eb:0x0] updating lvb blocks from disk: 8 -> 8 00010000:00010000:2.0:1763343279.110652:0:35266:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1763343279.110682:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+9:3661:x1848998413029248:12345-0@lo:2:osp-syn-0-1.0 Request processed in 116us (921us total) trans 21474839366 rc 0/0 00000100:00100000:1.0:1763343279.110688:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7633 00000100:00100000:1.0:1763343279.110702:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7635 00000100:00100000:1.0:1763343279.110708:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+69:3661:x1848998413029760:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763343279.110755:0:11289:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343279.110758:0:11289:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2ec:0x0] updating lvb mtime from disk: 1763343278 -> 1763343278 00002000:00010000:1.0:1763343279.110760:0:11289:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343279.110762:0:11289:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2ec:0x0] updating lvb ctime from disk: 1763343278 -> 1763343278 00000100:00100000:2.0:1763343279.110764:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+70:3659:x1848998413029504:12345-0@lo:6:osp-syn-1-1.0 Request processed in 192us (942us total) trans 17179872096 rc 0/0 00002000:00010000:1.0:1763343279.110765:0:11289:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2ec:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343279.110771:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7634 00000100:00100000:2.0:1763343279.110783:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7636 00000100:00100000:1.0:1763343279.110786:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+69:3661:x1848998413029760:12345-0@lo:2:osp-syn-1-1.0 Request processed in 79us (979us total) trans 17179872097 rc 0/0 00000100:00100000:2.0:1763343279.110788:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+8:3661:x1848998413029120:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343279.110792:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7635 00000100:00100000:1.0:1763343279.110803:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7637 00000100:00100000:1.0:1763343279.110808:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+68:3661:x1848998413029632:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1763343279.110835:0:35266:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2ea:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343279.110838:0:35266:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2ea:0x0] updating lvb mtime from disk: 1763343278 -> 1763343278 00002000:00010000:2.0:1763343279.110840:0:35266:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2ea:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343279.110842:0:35266:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2ea:0x0] updating lvb ctime from disk: 1763343278 -> 1763343278 00002000:00010000:2.0:1763343279.110844:0:35266:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2ea:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1763343279.110846:0:11289:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2eb:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763343279.110849:0:11289:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2eb:0x0] updating lvb mtime from disk: 1763343278 -> 1763343278 00002000:00010000:1.0:1763343279.110851:0:11289:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2eb:0x0] updating lvb atime from disk: 1763343278 -> 1763343278 00002000:00010000:1.0:1763343279.110853:0:11289:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2eb:0x0] updating lvb ctime from disk: 1763343278 -> 1763343278 00002000:00010000:1.0:1763343279.110855:0:11289:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2eb:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763343279.110868:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3661:x1848998413029120:12345-0@lo:2:osp-syn-0-1.0 Request processed in 79us (1194us total) trans 21474839367 rc 0/0 00000100:00100000:2.0:1763343279.110873:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7636 00000100:00100000:1.0:1763343279.110874:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+69:3661:x1848998413029632:12345-0@lo:2:osp-syn-1-1.0 Request processed in 67us (1151us total) trans 17179872098 rc 0/0 00000100:00100000:1.0:1763343279.110878:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7637 00010000:00010000:2.0:1763343279.110901:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763343279.110908:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5f4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763343279.110913:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6505500/2, rc 0, transno 17179872097 00010000:00010000:2.0:1763343279.110914:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343279.110918:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5f4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343279.110918:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413029760:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763343279.110927:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6505880/2, rc 0, transno 17179872098 00000100:00100000:1.0:1763343279.110930:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413029632:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1763343279.110932:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5f4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343279.110938:0:3661:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474839361 gen 2 00000004:00080000:1.0:1763343279.110942:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b9d500, transno 21474839318 00010000:00010000:2.0:1763343279.110946:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5f4a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763343279.110951:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400cc5de300, transno 21474839319 00010000:00010000:2.0:1763343279.110953:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5f4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763343279.110954:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400cc5dc380, transno 21474839320 00000004:00080000:1.0:1763343279.110956:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b9c700, transno 21474839321 00000004:00080000:1.0:1763343279.110959:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bff800, transno 21474839322 00000004:00080000:1.0:1763343279.110962:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bfc380, transno 21474839323 00000004:00080000:1.0:1763343279.110964:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c7ef7480, transno 21474839325 00010000:00010000:2.0:1763343279.110967:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:1.0:1763343279.110967:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c7ef6300, transno 21474839326 00000004:00080000:1.0:1763343279.110969:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c7ef7b80, transno 21474839327 00010000:00010000:2.0:1763343279.110970:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763343279.110972:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bfdf80, transno 21474839328 00000004:00080000:1.0:1763343279.110975:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b18000, transno 21474839329 00010000:00010000:2.0:1763343279.110977:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89600 already unused, calling callback (ffffffffc0ca3b40) 00000004:00080000:1.0:1763343279.110977:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bfca80, transno 21474839330 00010000:00010000:2.0:1763343279.110980:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763343279.110980:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6b56680, transno 21474839332 00000004:00080000:1.0:1763343279.110983:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6b56300, transno 21474839333 00000004:00080000:1.0:1763343279.110986:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6b55500, transno 21474839334 00010000:00010000:2.0:1763343279.110987:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763343279.110988:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6b57100, transno 21474839335 00000004:00080000:1.0:1763343279.110991:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9832a00, transno 21474839337 00000004:00080000:1.0:1763343279.110994:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6488700, transno 21474839338 00010000:00010000:2.0:1763343279.110996:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f58 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763343279.110996:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9831c00, transno 21474839339 00000004:00080000:1.0:1763343279.110999:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c9831880, transno 21474839340 00010000:00010000:2.0:1763343279.111002:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f58 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35266 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763343279.111002:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc2ed80, transno 21474839343 00000004:00080000:1.0:1763343279.111005:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc2e680, transno 21474839344 00000004:00080000:1.0:1763343279.111007:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc2ce00, transno 21474839345 00000004:00080000:1.0:1763343279.111010:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc2c000, transno 21474839346 00000004:00080000:1.0:1763343279.111013:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c39b4380, transno 21474839348 00000004:00080000:1.0:1763343279.111015:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c39b7480, transno 21474839349 00010000:00010000:2.0:1763343279.111017:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343279.111018:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401efc73100, transno 21474839350 00010000:00010000:2.0:1763343279.111019:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343279.111020:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401efc71c00, transno 21474839351 00010000:00010000:2.0:1763343279.111021:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343279.111051:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6403100, transno 21474839353 00000004:00080000:1.0:1763343279.111054:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6488000, transno 21474839354 00000004:00080000:1.0:1763343279.111057:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c586a680, transno 21474839355 00000004:00080000:1.0:1763343279.111059:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401c7ef4e00, transno 21474839356 00000004:00080000:1.0:1763343279.111062:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5866d80, transno 21474839358 00000004:00080000:1.0:1763343279.111064:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5867480, transno 21474839359 00000004:00080000:1.0:1763343279.111066:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c586c000, transno 21474839360 00000004:00080000:1.0:1763343279.111069:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c586c380, transno 21474839361 00010000:00010000:0.0:1763343279.111110:0:27798:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a5e16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a37a expref: 13 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.111118:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343279.111120:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343279.111123:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501ba00/0x9104b1ba770a5f43 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.111144:0:27798:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a5e16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a37a expref: 13 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.111153:0:27798:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a5e16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a37a expref: 13 pid: 8414 timeout: 1172 lvb_type: 0 00000100:00100000:0.0:1763343279.111164:0:27798:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5868000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27798:1848998413030016:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343279.111208:0:27798:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9600 going to sleep for 11 seconds 00000004:00080000:0.0:1763343279.111238:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6506d80/2, rc 0, transno 17179872096 00000100:00100000:0.0:1763343279.111243:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413029504:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763343279.111307:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343279.111384:0:3661:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9400c5a39880 x1848998413029248/t21474839366(21474839366) o2->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763343295 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1763343279.111393:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5a39880/2, rc 0, transno 21474839366 00000100:00100000:1.0:1763343279.111397:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413029248:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763343279.111670:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5a38700/2, rc 0, transno 21474839365 00000100:00100000:2.0:1763343279.111676:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413028992:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1763343279.111680:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5a39180/2, rc 0, transno 21474839367 00000100:00100000:1.0:1763343279.111684:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413029120:0@lo:2:osp-syn-0-1.0 00000004:00010000:2.0:1763343279.111719:0:6527:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b33cf2ae reply state 000000006f0f47ac transno 4294974050 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5f19 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343279.111733:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5f19 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343279.111741:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:2.0:1763343279.111744:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1763343279.111747:0:6527:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343279.111751:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:2.0:1763343279.111753:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343279.111757:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a5d0c lrc: 0/0,0 mode: --/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a318 expref: 308 pid: 33856 timeout: 0 lvb_type: 0 00010000:00080000:2.0:1763343279.111819:0:6527:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1763343279.111844:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57220:x1848998400051072:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 11383us (11623us total) trans 4294974050 rc 0/0 00000100:00100000:2.0:1763343279.111852:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3941 00010000:00010000:3.0:1763343279.111866:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5f19 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343279.111873:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5f19 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343279.111879:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5f19 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343279.111884:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343279.111888:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5f19 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343279.111894:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5f19 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343279.111904:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:3.0:1763343279.111906:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343279.111910:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5f19 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343279.111916:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a5f19 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT1 00000004:00080000:1.0:1763343279.111971:0:8616:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 4 in progress, 1 in flight, 36 done 00000100:00100000:2.0:1763343279.112582:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343279.112706:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400051840 00000100:00100000:3.0:1763343279.112714:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400051840 00000100:00100000:3.0:1763343279.112863:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11146 00000100:00100000:3.0:1763343279.112872:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:55884:x1848998400051840:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343279.113183:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343279.113211:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5f5f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a3d5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.113524:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5f66 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343279.113539:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5f66 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.113550:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5f66 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.113660:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5f5f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3d5 expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.113678:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5f66 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3d5 expref: 308 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.113687:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22e:0x0].0x0 (ffff9401fd0d4a00) 00010000:00010000:2.0:1763343279.113689:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343279.113692:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89800, rc 0) 00000100:00100000:2.0:1763343279.113748:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:55884:x1848998400051840:12345-192.168.201.40@tcp:101:bash.0 Request processed in 877us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343279.113755:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11146 00000100:00100000:1.0:1763343279.114712:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343279.114841:0:28561:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9831500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998413029888:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343279.114865:0:28561:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5f51 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343279.114975:0:27798:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5868000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27798:1848998413030016:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343279.114988:0:27798:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c501ba00/0x9104b1ba770a5f43 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343279.115078:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400051968 00000100:00100000:2.0:1763343279.115084:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400051968 00000100:00100000:2.0:1763343279.115123:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11147 00000100:00100000:2.0:1763343279.115130:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57220:x1848998400051968:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343279.115150:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343279.115165:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5f6d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a3dc expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.115230:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5f6d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3dc expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.115244:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88600/0x9104b1ba770a5f6d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x22b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3dc expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.115261:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:2.0:1763343279.115264:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343279.115267:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88600, rc 0) 00000100:00100000:2.0:1763343279.115320:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57220:x1848998400051968:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 189us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343279.115327:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11147 00000100:00100000:1.0:1763343279.116005:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343279.116054:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343279.116079:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.116227:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400052224 00000100:00100000:0.0:1763343279.116234:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400052224 00010000:00010000:0.0:1763343279.116261:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a5e16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a37a expref: 14 pid: 8414 timeout: 1172 lvb_type: 0 00000100:00100000:0.0:1763343279.116288:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400052096 00000100:00100000:0.0:1763343279.116292:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400052096 00010000:00010000:0.0:1763343279.116305:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5e1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a381 expref: 38 pid: 35266 timeout: 1172 lvb_type: 0 00000100:00100000:0.0:1763343279.116327:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3630 00000100:00100000:0.0:1763343279.116335:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998400052224:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343279.116348:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343279.116353:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a5e16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a37a expref: 14 pid: 8414 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343279.116363:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a5e16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a37a expref: 14 pid: 8414 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343279.116385:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a5e16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a37a expref: 14 pid: 8414 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343279.116402:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343279.116405:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343279.116409:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c501ba00/0x9104b1ba770a5f43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.116418:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501ba00/0x9104b1ba770a5f43 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.116447:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343279.116480:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2408:x1848998400052224:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 145us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343279.116487:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3630 00000100:00100000:0.0:1763343279.116533:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3631 00000100:00100000:0.0:1763343279.116540:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5867480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+38:2408:x1848998400052096:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343279.116549:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343279.116554:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5e1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a381 expref: 38 pid: 35266 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343279.116564:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5e1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a381 expref: 38 pid: 35266 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343279.116578:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177200/0x9104b1ba770a5e1d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a381 expref: 38 pid: 35266 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343279.116589:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343279.116591:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343279.116594:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5f51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.116601:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5f51 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.116616:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343279.116634:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5867480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+37:2408:x1848998400052096:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 94us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343279.116641:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3631 00010000:00010000:0.0:1763343279.116665:0:27798:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c501ba00/0x9104b1ba770a5f43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.116674:0:27798:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c501ba00/0x9104b1ba770a5f43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.116684:0:27798:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c501ba00/0x9104b1ba770a5f43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.116691:0:27798:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501ba00/0x9104b1ba770a5f43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.116706:0:27798:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343279.116958:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+9:3660:x1848998413028864:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6731us (7324us total) trans 21474839368 rc 0/0 00000100:00100000:0.0:1763343279.116966:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7630 00010000:00010000:0.0:1763343279.116984:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343279.116991:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c501ba00/0x9104b1ba770a5f43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.116999:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ba00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343279.117003:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c501ba00/0x9104b1ba770a5f43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.117012:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c501ba00/0x9104b1ba770a5f43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.117063:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c501ba00/0x9104b1ba770a5f43 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.117071:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c501ba00/0x9104b1ba770a5f43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.117089:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343279.117091:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343279.117092:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343279.117127:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5a3b100/2, rc 0, transno 21474839368 00000100:00100000:0.0:1763343279.117134:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413028864:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1763343279.117305:0:28561:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5f51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.117314:0:28561:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5f51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.117322:0:28561:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5f51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.117329:0:28561:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5f51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.117349:0:28561:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343279.117484:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+69:3659:x1848998413029376:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7122us (7701us total) trans 17179872099 rc 0/0 00000100:00100000:3.0:1763343279.117491:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7632 00000004:00080000:3.0:1763343279.117521:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401f6504a80/2, rc 0, transno 17179872099 00000100:00100000:3.0:1763343279.117525:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413029376:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343279.117625:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400052480 00000100:00100000:2.0:1763343279.117630:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400052480 00000100:00100000:2.0:1763343279.117665:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11148 00000100:00100000:2.0:1763343279.117672:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:55884:x1848998400052480:12345-192.168.201.40@tcp:36:bash.0 00010000:00010000:2.0:1763343279.117712:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343279.117727:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e800/0x9104b1ba770a5f35 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ce expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.117739:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22e:0x0].0x0 (ffff9401fd0d4a00) 00010000:00010000:2.0:1763343279.117742:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343279.117870:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f74 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343279.117881:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f74 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.117892:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f74 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000001:00080000:2.0:1763343279.117927:0:33856:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294974052 00000004:00010000:2.0:1763343279.117943:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000045f098b7 reply state 0000000024666b20 transno 4294974053 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f74 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.117954:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f74 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.117960:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22e:0x0].0x0 (ffff9401fd0d4a00) 00010000:00010000:2.0:1763343279.117963:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343279.117965:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343279.118020:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:55884:x1848998400052480:12345-192.168.201.40@tcp:36:bash.0 Request processed in 347us (1939us total) trans 4294974053 rc 0/0 00000100:00100000:2.0:1763343279.118050:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11148 00000020:00080000:2.0:1763343279.118053:0:33856:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1763343279.119395:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343279.119409:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5f51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.119421:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c508b200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343279.119425:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5f51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.119433:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5f51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.119453:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5f51 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.119461:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c508b200/0x9104b1ba770a5f51 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.119485:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343279.119487:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343279.119489:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343279.119806:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343279.119885:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343279.119949:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400052736 00000100:00100000:2.0:1763343279.119958:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400052736 00000100:00100000:2.0:1763343279.120011:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3943 00000100:00100000:2.0:1763343279.120051:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57220:x1848998400052736:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:2.0:1763343279.120376:0:6527:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x22b:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1763343279.120460:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1855, 64 off153832 00000040:00080000:2.0:1763343279.120488:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1846, 64 off153072 00000040:00080000:2.0:1763343279.120498:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1847, 64 off153136 00000040:00080000:2.0:1763343279.120508:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1856, 64 off153896 00000100:00100000:3.0:1763343279.120530:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400052864 00000100:00100000:3.0:1763343279.120536:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400052864 00010000:00010000:2.0:1763343279.120577:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5f7b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00000100:00100000:3.0:1763343279.120581:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11149 00000100:00100000:3.0:1763343279.120588:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:55884:x1848998400052864:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343279.120592:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5f7b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343279.120601:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343279.120603:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5f7b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343279.120610:0:6527:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5f7b lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343279.120612:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5f82 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a3e3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.120617:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5f7b lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343279.120623:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5f7b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT1 00010000:00010000:2.0:1763343279.120643:0:6527:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343279.120646:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343279.120651:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5f7b lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343279.120656:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343279.120660:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5f7b lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343279.120666:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5f7b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343279.120676:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22b:0x0].0x0 (ffff9400c38f5200) 00010000:00010000:3.0:1763343279.120679:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343279.120683:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5f7b lrc: 1/0,0 mode: --/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343279.120688:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89c00/0x9104b1ba770a5f7b lrc: 0/0,0 mode: --/PW res: [0x240000404:0x22b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT1 00010000:00010000:3.0:1763343279.120697:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343279.120699:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343279.120701:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343279.120715:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5f82 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x22e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3e3 expref: 314 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.120725:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5f82 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x22e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3e3 expref: 314 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.120744:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22e:0x0].0x0 (ffff9401fd0d4a00) 00010000:00010000:3.0:1763343279.120747:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343279.120749:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c508aa00, rc 0) 00000100:00100000:3.0:1763343279.120803:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:55884:x1848998400052864:12345-192.168.201.40@tcp:101:bash.0 Request processed in 214us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343279.120810:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11149 00000100:00100000:2.0:1763343279.120874:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57220:x1848998400052736:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 854us (1069us total) trans 4294974054 rc 0/0 00000100:00100000:2.0:1763343279.120881:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3943 00000100:00100000:1.0:1763343279.122739:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343279.122839:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400053120 00000100:00100000:2.0:1763343279.122848:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400053120 00000100:00100000:2.0:1763343279.122904:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11150 00000100:00100000:2.0:1763343279.122916:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:55884:x1848998400053120:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343279.122938:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343279.122941:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343279.122968:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508aa00/0x9104b1ba770a5f82 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x22e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3e3 expref: 313 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.122984:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22e:0x0].0x0 (ffff9401fd0d4a00) 00010000:00010000:2.0:1763343279.122989:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343279.123000:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a5f89 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a3ea expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.123266:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5f90 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343279.123396:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5f90 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.123411:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5f90 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:1.0:1763343279.123604:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000040:00080000:2.0:1763343279.123628:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1857, 88 off153984 00000004:00080000:2.0:1763343279.123636:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1072247610881ns, next at 1073184383515ns, rc = 0 00000040:00080000:2.0:1763343279.123669:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1848, 88 off153224 00000004:00080000:2.0:1763343279.123674:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1072247649664ns, next at 1073184352022ns, rc = 0 00000040:00080000:2.0:1763343279.123697:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1849, 88 off153312 00000004:00080000:2.0:1763343279.123701:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1072247676235ns, next at 1073184352022ns, rc = 0 00000040:00080000:2.0:1763343279.123711:0:33856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1858, 88 off154072 00000004:00080000:2.0:1763343279.123714:0:33856:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1072247689849ns, next at 1073184383515ns, rc = 0 00000100:00100000:3.0:1763343279.123763:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400053376 00000100:00100000:3.0:1763343279.123768:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400053376 00000100:00100000:3.0:1763343279.123929:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11151 00000100:00100000:3.0:1763343279.123937:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5865880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57220:x1848998400053376:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343279.123950:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343279.123964:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5f97 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a3f1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.124044:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5f9e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343279.124053:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5f9e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.124061:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5f9e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.124072:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5fa5 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343279.124078:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5fa5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.124084:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5fa5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.124162:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5fac lrc: 3/1,0 mode: --/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343279.124170:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5fac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.124176:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5fac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:3.0:1763343279.124184:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22e:0x0]: returning size 2 00010000:00010000:3.0:1763343279.124579:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5fac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.124587:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5fac lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.124595:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5fac lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.124602:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121ea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343279.124607:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5fac lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.124615:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5fac lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.124627:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22e:0x0].0x0 (ffff9401fd0d4a00) 00010000:00010000:3.0:1763343279.124630:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1763343279.124635:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5fac lrc: 2/0,0 mode: --/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.124642:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121ea00/0x9104b1ba770a5fac lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.124660:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5f9e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.124667:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5f9e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.124672:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5f9e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.124678:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5f9e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.124683:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121fc00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343279.124686:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5f9e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.124692:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5f9e lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.124699:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:3.0:1763343279.124701:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343279.124704:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5f9e lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.124709:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121fc00/0x9104b1ba770a5f9e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.124717:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5fa5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.124723:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5fa5 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.124728:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5fa5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.124733:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401d121e200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343279.124736:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5fa5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.124742:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5fa5 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.124924:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4700) 00010000:00010000:3.0:1763343279.124926:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343279.124929:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5fa5 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.124935:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401d121e200/0x9104b1ba770a5fa5 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.124986:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5f97 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3f1 expref: 317 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.124998:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:3.0:1763343279.125001:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343279.125005:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c508be00/0x9104b1ba770a5f97 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3f1 expref: 317 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.125017:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c508be00, rc 0) 00000001:00080000:1.0:1763343279.125200:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974055 is committed 00000004:00080000:1.0:1763343279.125207:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1191 committed 00000004:00080000:1.0:1763343279.125213:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1183 committed 00000100:00100000:2.0:1763343279.125218:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5865880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57220:x1848998400053376:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1281us (1614us total) trans 4294974056 rc 301/301 00000004:00080000:1.0:1763343279.125219:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1182 committed 00000004:00080000:1.0:1763343279.125222:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1190 committed 00000100:00100000:2.0:1763343279.125227:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11151 00000100:00100000:1.0:1763343279.125346:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413030528:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343279.125400:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343279.125437:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763343279.125443:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413030400:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1763343279.125452:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f74 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.125459:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f74 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00000100:00100000:1.0:1763343279.125463:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343279.125466:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f74 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.125472:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343279.125475:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f74 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.125482:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f74 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.125491:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22e:0x0].0x0 (ffff9401fd0d4a00) 00010000:00010000:3.0:1763343279.125493:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343279.125496:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f74 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.125501:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89600/0x9104b1ba770a5f74 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343279.125516:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5f90 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x22e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ea expref: 310 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343279.125521:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413030528 00010000:00010000:1.0:1763343279.125524:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22e:0x0].0x0 (ffff9401fd0d4a00) 00010000:00010000:1.0:1763343279.125526:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:3.0:1763343279.125527:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413030528 00010000:00010000:1.0:1763343279.125534:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88800/0x9104b1ba770a5f89 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ea expref: 310 pid: 33856 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343279.125545:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5f90 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x22e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ea expref: 309 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343279.125558:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413030400 00000100:00100000:3.0:1763343279.125561:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413030400 00010000:00010000:1.0:1763343279.125567:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22e:0x0].0x0 (ffff9401fd0d4a00) 00010000:00010000:1.0:1763343279.125570:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343279.125572:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89e00, rc 0) 00000100:00100000:3.0:1763343279.125578:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7638 00000100:00100000:3.0:1763343279.125584:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+10:3662:x1848998413030528:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343279.125597:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:55884:x1848998400053120:12345-192.168.201.40@tcp:101:bash.0 Request processed in 2685us (2867us total) trans 4294974055 rc 0/0 00000100:00100000:1.0:1763343279.125607:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11150 00000100:00100000:3.0:1763343279.125732:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+11:3662:x1848998413030528:12345-0@lo:2:osp-syn-0-1.0 Request processed in 147us (331us total) trans 21474839369 rc 0/0 00000100:00100000:3.0:1763343279.125739:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7638 00000100:00100000:3.0:1763343279.125764:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7639 00000100:00100000:3.0:1763343279.125771:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+10:3662:x1848998413030400:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763343279.125836:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+11:3662:x1848998413030400:12345-0@lo:2:osp-syn-0-1.0 Request processed in 66us (372us total) trans 21474839370 rc 0/0 00000100:00100000:3.0:1763343279.125842:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7639 00000100:00100000:0.0:1763343279.125854:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413030272:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343279.125867:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5869180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413031040:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343279.125882:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343279.125904:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413030272 00000100:00100000:3.0:1763343279.125907:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413030272 00000100:00100000:0.0:1763343279.125908:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413030784:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343279.125926:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343279.125927:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7640 00000100:00100000:3.0:1763343279.125932:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+11:3660:x1848998413030272:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763343279.125941:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1763343279.125946:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413030144:0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763343279.125947:0:28562:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:747 count 1 00010000:00010000:3.0:1763343279.125965:0:28562:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0600/0x9104b1ba770a5fba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343279.125965:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343279.125979:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413030656:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763343279.125981:0:28562:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c501b800/0x9104b1ba770a5eb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ab expref: 12 pid: 35266 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.125990:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343279.125993:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1763343279.125996:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343279.125998:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0600/0x9104b1ba770a5fba lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343279.126015:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413030784 00000100:00100000:0.0:1763343279.126018:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413030784 00010000:00010000:3.0:1763343279.126051:0:28562:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c501b800/0x9104b1ba770a5eb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ab expref: 12 pid: 35266 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343279.126063:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413030144 00010000:00010000:3.0:1763343279.126065:0:28562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c501b800/0x9104b1ba770a5eb7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ab expref: 12 pid: 35266 timeout: 1172 lvb_type: 0 00000100:00100000:0.0:1763343279.126067:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413030144 00000100:00100000:3.0:1763343279.126078:0:28562:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9831500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28562:1848998413031168:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343279.126078:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413030656 00000100:00100000:0.0:1763343279.126079:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413030656 00000100:00100000:0.0:1763343279.126092:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7641 00000100:00100000:0.0:1763343279.126098:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+70:3660:x1848998413030784:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763343279.126112:0:8626:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:748 count 1 00000100:00100000:3.0:1763343279.126125:0:28562:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c4532780 going to sleep for 11 seconds 00010000:00010000:0.0:1763343279.126126:0:8626:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5fc1 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343279.126138:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7642 00010000:00010000:0.0:1763343279.126138:0:8626:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5ebe lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3b2 expref: 36 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343279.126145:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+12:3660:x1848998413030144:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763343279.126151:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343279.126152:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343279.126155:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5fc1 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1763343279.126157:0:8414:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:746 count 1 00010000:00010000:3.0:1763343279.126167:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a5fc8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.126174:0:8626:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5ebe lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3b2 expref: 36 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.126177:0:8414:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a5caa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2fc expref: 12 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.126183:0:8626:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5ebe lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3b2 expref: 36 pid: 8414 timeout: 1172 lvb_type: 0 00010000:00010000:3.0:1763343279.126184:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343279.126185:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343279.126188:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a5fc8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343279.126207:0:8626:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998413031296:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343279.126216:0:8414:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a5caa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2fc expref: 12 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.126224:0:8414:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a5caa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2fc expref: 12 pid: 8414 timeout: 1172 lvb_type: 0 00000100:00100000:0.0:1763343279.126228:0:8626:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343279.126233:0:8414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9832300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1848998413031424:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343279.126244:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7643 00000100:00100000:0.0:1763343279.126251:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+70:3660:x1848998413030656:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343279.126253:0:8414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c45320c0 going to sleep for 11 seconds 00002000:00080000:0.0:1763343279.126262:0:27798:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:747 count 1 00000100:00100000:3.0:1763343279.126265:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763343279.126273:0:27798:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5fcf lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.126284:0:27798:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5dbb lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a357 expref: 36 pid: 35266 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343279.126290:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343279.126292:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343279.126294:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5fcf lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763343279.126313:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5865f80/2, rc 0, transno 21474839370 00010000:00010000:0.0:1763343279.126314:0:27798:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5dbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a357 expref: 36 pid: 35266 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1763343279.126318:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413030400:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1763343279.126322:0:27798:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5dbb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a357 expref: 36 pid: 35266 timeout: 1172 lvb_type: 1 00000004:00080000:3.0:1763343279.126327:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5865180/2, rc 0, transno 21474839369 00000100:00100000:3.0:1763343279.126330:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413030528:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343279.126331:0:27798:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401edc2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:27798:1848998413031552:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343279.126337:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343279.126342:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5868380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413030912:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343279.126351:0:27798:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f67f9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1763343279.126360:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343279.126376:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413031040 00000100:00100000:3.0:1763343279.126380:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413031040 00000100:00100000:3.0:1763343279.126393:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413030912 00000100:00100000:3.0:1763343279.126396:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413030912 00000100:00100000:3.0:1763343279.126407:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7644 00000100:00100000:3.0:1763343279.126412:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+72:3662:x1848998413031040:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343279.126510:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+73:3662:x1848998413031040:12345-0@lo:2:osp-syn-1-1.0 Request processed in 97us (243us total) trans 17179872100 rc 0/0 00000100:00100000:3.0:1763343279.126517:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7644 00000100:00100000:3.0:1763343279.126530:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7645 00000100:00100000:3.0:1763343279.126536:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+72:3662:x1848998413030912:12345-0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763343279.127179:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5869180/2, rc 0, transno 17179872100 00000100:00100000:0.0:1763343279.127186:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5869180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413031040:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763343279.128291:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+73:3662:x1848998413030912:12345-0@lo:2:osp-syn-1-1.0 Request processed in 1749us (1923us total) trans 17179872101 rc 0/0 00000100:00100000:3.0:1763343279.128303:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7645 00000004:00080000:0.0:1763343279.128389:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5868380/2, rc 0, transno 17179872101 00000100:00100000:0.0:1763343279.128396:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5868380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413030912:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343279.129468:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343279.130059:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400053504 00000100:00100000:2.0:1763343279.130071:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400053504 00000100:00100000:2.0:1763343279.130128:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11152 00000100:00100000:2.0:1763343279.130137:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+309:57220:x1848998400053504:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343279.130156:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343279.130177:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5fd6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a3f8 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.130296:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5fdd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343279.130311:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5fdd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.130322:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5fdd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:2.0:1763343279.130349:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22e:0x0]: returning size 2 00000004:00200000:2.0:1763343279.130353:0:33856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343279.130372:0:33856:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5fdd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.130399:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89000/0x9104b1ba770a5fd6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x22e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3f8 expref: 311 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.130415:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5fdd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3f8 expref: 310 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.130424:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22e:0x0].0x0 (ffff9401fd0d4a00) 00010000:00010000:2.0:1763343279.130427:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343279.130431:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88a00, rc 0) 00000100:00100000:2.0:1763343279.130895:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57220:x1848998400053504:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 755us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343279.130904:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11152 00000100:00100000:2.0:1763343279.131306:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998413031296:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343279.131311:0:27798:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401edc2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:27798:1848998413031552:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343279.131330:0:8626:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5fc1 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.131331:0:27798:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5fcf lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343279.131365:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.131395:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.131414:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.131434:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400053632 00000100:00100000:0.0:1763343279.131440:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400053632 00010000:00010000:0.0:1763343279.131464:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501b800/0x9104b1ba770a5eb7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ab expref: 13 pid: 35266 timeout: 1172 lvb_type: 0 00000100:00100000:0.0:1763343279.131490:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400053760 00000100:00100000:0.0:1763343279.131493:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400053760 00010000:00010000:0.0:1763343279.131503:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5ebe lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3b2 expref: 37 pid: 8414 timeout: 1172 lvb_type: 0 00000100:00100000:0.0:1763343279.131517:0:6511:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400054016 00000100:00100000:0.0:1763343279.131520:0:6511:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400054016 00010000:00010000:0.0:1763343279.131529:0:6511:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5dbb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a357 expref: 38 pid: 35266 timeout: 1172 lvb_type: 1 00000100:00100000:0.0:1763343279.131544:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3632 00000100:00100000:0.0:1763343279.131551:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2410:x1848998400053632:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343279.131563:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343279.131567:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c501b800/0x9104b1ba770a5eb7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ab expref: 13 pid: 35266 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343279.131578:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c501b800/0x9104b1ba770a5eb7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ab expref: 13 pid: 35266 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343279.131601:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343279.131603:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343279.131607:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0600/0x9104b1ba770a5fba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.131616:0:6511:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0600/0x9104b1ba770a5fba lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.131638:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343279.131672:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2410:x1848998400053632:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 120us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343279.131678:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3632 00000100:00100000:0.0:1763343279.131693:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3633 00000100:00100000:0.0:1763343279.131699:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+38:2409:x1848998400053760:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343279.131707:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343279.131712:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5ebe lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3b2 expref: 38 pid: 8414 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343279.131722:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5ebe lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3b2 expref: 38 pid: 8414 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343279.131735:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a5ebe lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3b2 expref: 38 pid: 8414 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343279.131745:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343279.131746:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343279.131749:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5fc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.131756:0:6511:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5fc1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.131768:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343279.131786:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+37:2409:x1848998400053760:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 87us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343279.131792:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3633 00000100:00100000:0.0:1763343279.131805:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3634 00000100:00100000:0.0:1763343279.131811:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+36:2409:x1848998400054016:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343279.131818:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343279.131823:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5dbb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a357 expref: 36 pid: 35266 timeout: 1172 lvb_type: 1 00010000:00010000:0.0:1763343279.131831:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5dbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a357 expref: 36 pid: 35266 timeout: 1172 lvb_type: 1 00010000:00010000:0.0:1763343279.131843:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a5dbb lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a357 expref: 36 pid: 35266 timeout: 1172 lvb_type: 1 00010000:00010000:0.0:1763343279.131852:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343279.131853:0:6511:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343279.131856:0:6511:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5fcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.131863:0:6511:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5fcf lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.131879:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343279.131897:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+35:2409:x1848998400054016:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 87us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343279.131904:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3634 00010000:00010000:2.0:1763343279.131910:0:8626:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5fc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.131918:0:8626:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5fc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.131921:0:27798:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5fcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.131928:0:8626:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5fc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.131928:0:27798:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5fcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.131936:0:8626:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5fc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.131936:0:27798:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5fcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.131943:0:27798:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5fcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.131954:0:8626:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1763343279.132216:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+73:3660:x1848998413030784:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6116us (6286us total) trans 17179872102 rc 0/0 00000100:00100000:2.0:1763343279.132223:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7641 00000004:00080000:1.0:1763343279.132338:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5868000/2, rc 0, transno 17179872102 00000100:00100000:1.0:1763343279.132345:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413030784:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763343279.132550:0:8414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9832300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1848998413031424:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343279.132567:0:8414:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a5fc8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.132588:0:28562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c501b800/0x9104b1ba770a5eb7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ab expref: 12 pid: 35266 timeout: 1172 lvb_type: 0 00000100:00100000:3.0:1763343279.132598:0:28562:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9831500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28562:1848998413031168:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343279.132607:0:28562:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0600/0x9104b1ba770a5fba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.132618:0:28562:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0600/0x9104b1ba770a5fba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.132625:0:28562:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0600/0x9104b1ba770a5fba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.132631:0:28562:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0600/0x9104b1ba770a5fba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.132637:0:28562:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0600/0x9104b1ba770a5fba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343279.132697:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343279.132714:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400053888 00000100:00100000:1.0:1763343279.132720:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400053888 00010000:00010000:1.0:1763343279.132739:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a5caa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2fc expref: 12 pid: 8414 timeout: 1172 lvb_type: 0 00000100:00100000:1.0:1763343279.132759:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3635 00000100:00100000:1.0:1763343279.132765:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:2409:x1848998400053888:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343279.132773:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343279.132777:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a5caa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2fc expref: 12 pid: 8414 timeout: 1172 lvb_type: 0 00010000:00010000:1.0:1763343279.132787:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a5caa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2fc expref: 12 pid: 8414 timeout: 1172 lvb_type: 0 00010000:00010000:1.0:1763343279.132804:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a5caa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a2fc expref: 12 pid: 8414 timeout: 1172 lvb_type: 0 00010000:00010000:1.0:1763343279.132813:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343279.132815:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343279.132818:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a5fc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.132831:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a5fc8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.132847:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343279.132870:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+11:2409:x1848998400053888:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 105us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343279.132875:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3635 00010000:00010000:1.0:1763343279.132892:0:8414:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a5fc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.132899:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a5fc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.132906:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a5fc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.132912:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a5fc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.133082:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1763343279.133090:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5fc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.133098:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343279.133102:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5fc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.133110:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5fc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.133126:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5fc1 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.133133:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c501b600/0x9104b1ba770a5fc1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.133426:0:27798:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1763343279.133619:0:28562:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1763343279.133699:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+73:3660:x1848998413030656:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7447us (7699us total) trans 17179872103 rc 0/0 00000100:00100000:0.0:1763343279.133707:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7643 00010000:00010000:0.0:1763343279.133728:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1763343279.133733:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5fcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.133741:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343279.133744:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5fcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.133751:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5fcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.133763:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5fcf lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343279.133774:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+13:3660:x1848998413030272:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7841us (7890us total) trans 21474839371 rc 0/0 00010000:00010000:0.0:1763343279.133776:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a5fcf lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343279.133780:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7640 00010000:00010000:0.0:1763343279.133791:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763343279.133795:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0600/0x9104b1ba770a5fba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.133798:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343279.133801:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c7ec0600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343279.133804:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0600/0x9104b1ba770a5fba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.133811:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0600/0x9104b1ba770a5fba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.133820:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0600/0x9104b1ba770a5fba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.133827:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec0600/0x9104b1ba770a5fba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.133839:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343279.133841:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343279.133842:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343279.133910:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.133933:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400054144 00000100:00100000:0.0:1763343279.133939:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400054144 00000100:00100000:0.0:1763343279.133964:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7646 00000100:00100000:0.0:1763343279.133972:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+35:55884:x1848998400054144:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:0.0:1763343279.133984:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343279.133998:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5fe4 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a3ff expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343279.134016:0:28562:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343279.134054:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343279.134056:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343279.134063:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5fe4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ff expref: 36 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.134076:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5fe4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ff expref: 36 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.134087:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b200, rc 0) 00000100:00100000:0.0:1763343279.134112:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+36:55884:x1848998400054144:12345-192.168.201.40@tcp:101:bash.0 Request processed in 141us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343279.134118:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7646 00010000:00010000:2.0:1763343279.134419:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343279.134421:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343279.134423:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343279.134639:0:8414:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000100:00100000:1.0:1763343279.134790:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+13:3660:x1848998413030144:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8644us (8822us total) trans 21474839372 rc 0/0 00000100:00100000:1.0:1763343279.134798:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7642 00000004:00080000:1.0:1763343279.134846:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5864380/2, rc 0, transno 21474839372 00000100:00100000:1.0:1763343279.134852:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413030144:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1763343279.134866:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5868e00/2, rc 0, transno 17179872103 00000100:00100000:1.0:1763343279.134870:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413030656:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1763343279.134907:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5867100/2, rc 0, transno 21474839371 00000100:00100000:1.0:1763343279.134910:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413030272:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1763343279.135096:0:35284:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343279.135099:0:35284:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343279.135101:0:35284:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343279.135222:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343279.135459:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a5fc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.135472:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c7ec1c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343279.135476:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a5fc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.135486:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a5fc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.135502:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a5fc8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.135508:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401c7ec1c00/0x9104b1ba770a5fc8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.135523:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343279.135525:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343279.135527:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343279.136163:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.136213:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343279.136286:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400054272 00000100:00100000:1.0:1763343279.136295:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400054272 00000100:00100000:1.0:1763343279.136340:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7647 00000100:00100000:1.0:1763343279.136349:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+11:55884:x1848998400054272:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343279.136363:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343279.136381:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a5feb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a406 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343279.136384:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400054528 00000100:00100000:2.0:1763343279.136389:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400054528 00002000:00010000:1.0:1763343279.136403:0:8414:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343279.136421:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343279.136423:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1763343279.136425:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3944 00000100:00100000:2.0:1763343279.136431:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57220:x1848998400054528:12345-192.168.201.40@tcp:35:lfs.0 00010000:00010000:1.0:1763343279.136431:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a5feb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a406 expref: 12 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.136445:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a5feb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a406 expref: 12 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.136454:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176a00, rc 0) 00000100:00100000:1.0:1763343279.136496:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:55884:x1848998400054272:12345-192.168.201.40@tcp:101:bash.0 Request processed in 149us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343279.136503:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7647 00000100:00100000:2.0:1763343279.136593:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57220:x1848998400054528:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 161us (378us total) trans 4294974057 rc 0/0 00000100:00100000:2.0:1763343279.136599:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3944 00000100:00100000:1.0:1763343279.139356:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.139371:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343279.139434:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343279.139518:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400054656 00000100:00100000:2.0:1763343279.139532:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400054656 00000100:00100000:3.0:1763343279.139549:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400055040 00000100:00100000:3.0:1763343279.139553:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400055040 00002000:00010000:2.0:1763343279.139569:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/751 (0->18446744073709551615) 00002000:00100000:2.0:1763343279.139573:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c586c380 with x1848998400054656 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343279.139585:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c586c380. 00000100:00100000:3.0:1763343279.139589:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11153 00000100:00100000:3.0:1763343279.139598:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57220:x1848998400055040:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:2.0:1763343279.139600:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400054912 00000100:00100000:2.0:1763343279.139603:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400054912 00002000:00010000:2.0:1763343279.139612:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/750 (0->18446744073709551615) 00010000:00010000:3.0:1763343279.139615:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:2.0:1763343279.139620:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401f6403100 with x1848998400054912 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343279.139625:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9401f6403100. 00010000:00010000:3.0:1763343279.139633:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a5ff2 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a40d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343279.139640:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1805 00000100:00100000:2.0:1763343279.139646:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+36:2408:x1848998400054656:12345-192.168.201.40@tcp:10:bash.0 00010000:00010000:3.0:1763343279.139701:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a5ff9 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343279.139713:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a5ff9 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.139723:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a5ff9 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.139734:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a6000 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343279.139740:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a6000 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.139746:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a6000 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00002000:00010000:2.0:1763343279.139805:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2ef:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343279.139808:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2ef:0x0] updating lvb mtime from disk: 0 -> 1763343278 00002000:00010000:2.0:1763343279.139810:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2ef:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343279.139812:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2ef:0x0] updating lvb ctime from disk: 0 -> 1763343278 00002000:00010000:2.0:1763343279.139815:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2ef:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:3.0:1763343279.139840:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a6007 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343279.139848:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a6007 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.139855:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a6007 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000100:00100000:2.0:1763343279.139862:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+37:2408:x1848998400054656:12345-192.168.201.40@tcp:10:bash.0 Request processed in 216us (517us total) trans 17179872104 rc 0/0 00000004:00200000:3.0:1763343279.139865:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22e:0x0]: returning size 2 00000100:00100000:2.0:1763343279.139872:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1805 00002000:00010000:2.0:1763343279.139877:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/751 (0->18446744073709551615) 00002000:00100000:2.0:1763343279.139879:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c586c380 with x1848998400054656 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343279.139883:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c586c380. 00000100:00100000:2.0:1763343279.139899:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1806 00000100:00100000:2.0:1763343279.139904:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:2408:x1848998400054912:12345-192.168.201.40@tcp:10:bash.0 00010000:00010000:3.0:1763343279.139921:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a5ff9 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.139929:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a5ff9 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.139938:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a5ff9 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.139943:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a5ff9 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.139948:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401c7ec0600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343279.139952:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a5ff9 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.139959:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a5ff9 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.139971:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:3.0:1763343279.139974:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343279.139979:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a5ff9 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.139984:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0600/0x9104b1ba770a5ff9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00002000:00010000:2.0:1763343279.139985:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2ee:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343279.139987:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2ee:0x0] updating lvb mtime from disk: 0 -> 1763343278 00002000:00010000:2.0:1763343279.139990:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2ee:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343279.139992:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2ee:0x0] updating lvb ctime from disk: 0 -> 1763343278 00002000:00010000:2.0:1763343279.139993:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2ee:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:3.0:1763343279.139997:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a6000 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.140002:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a6000 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.140008:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a6000 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00000100:00100000:2.0:1763343279.140012:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2408:x1848998400054912:12345-192.168.201.40@tcp:10:bash.0 Request processed in 107us (578us total) trans 21474839373 rc 0/0 00010000:00010000:3.0:1763343279.140013:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401f1bf0200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343279.140016:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a6000 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00000100:00100000:2.0:1763343279.140018:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1806 00002000:00010000:2.0:1763343279.140021:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/750 (0->18446744073709551615) 00010000:00010000:3.0:1763343279.140048:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a6000 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00002000:00100000:2.0:1763343279.140051:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401f6403100 with x1848998400054912 ext(0->18446744073709551615) 00010000:00010000:3.0:1763343279.140056:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401fd0d4700) 00002000:00010000:2.0:1763343279.140056:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9401f6403100. 00010000:00010000:3.0:1763343279.140059:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343279.140062:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a6000 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.140067:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a6000 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.140101:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401c7ec0c00/0x9104b1ba770a5ff2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a40d expref: 314 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.140130:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a6007 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a40d expref: 313 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.140137:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22e:0x0].0x0 (ffff9401fd0d4a00) 00010000:00010000:3.0:1763343279.140139:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343279.140142:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401f1bf1c00, rc 0) 00000100:00100000:3.0:1763343279.140170:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57220:x1848998400055040:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 574us (799us total) trans 4294974058 rc 0/0 00000100:00100000:3.0:1763343279.140176:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11153 00000100:00100000:1.0:1763343279.146206:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343279.146310:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343279.146891:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400055296 00000100:00100000:2.0:1763343279.146901:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400055296 00000100:00100000:2.0:1763343279.146950:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400055424 00000100:00100000:2.0:1763343279.146952:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400055424 00000100:00100000:2.0:1763343279.146965:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3945 00000100:00100000:2.0:1763343279.146972:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:55884:x1848998400055296:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:2.0:1763343279.147298:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:55884:x1848998400055296:12345-192.168.201.40@tcp:35:bash.0 Request processed in 324us (1108us total) trans 4294974059 rc 0/0 00000100:00100000:2.0:1763343279.147310:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3945 00000100:00100000:2.0:1763343279.147330:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3946 00000100:00100000:2.0:1763343279.147337:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57220:x1848998400055424:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:2.0:1763343279.147406:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57220:x1848998400055424:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 69us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343279.147412:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3946 00000100:00100000:0.0:1763343279.148691:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343279.148936:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400055552 00000100:00100000:1.0:1763343279.148947:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400055552 00000100:00100000:1.0:1763343279.149005:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 460 00000100:00100000:1.0:1763343279.149014:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:2409:x1848998400055552:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343279.149062:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343279.149088:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a6007 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a40d expref: 314 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.149105:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22e:0x0].0x0 (ffff9401fd0d4a00) 00010000:00010000:1.0:1763343279.149109:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343279.149771:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:2409:x1848998400055552:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 755us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343279.149780:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 460 00000100:00100000:0.0:1763343279.153169:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343279.153315:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400055808 00000100:00100000:3.0:1763343279.153326:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400055808 00000100:00100000:3.0:1763343279.153389:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11154 00000100:00100000:3.0:1763343279.153399:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57220:x1848998400055808:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343279.153424:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343279.153445:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a6015 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a414 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.153548:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a601c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343279.153563:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a601c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.153573:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a601c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:3.0:1763343279.153585:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x22e:0x0]: returning size 5 00010000:00010000:3.0:1763343279.153697:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a6015 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x22e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a414 expref: 316 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.153714:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a601c lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x22e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a414 expref: 315 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.153723:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22e:0x0].0x0 (ffff9401fd0d4a00) 00010000:00010000:3.0:1763343279.153726:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763343279.153729:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c6b99600, rc 0) 00000100:00100000:3.0:1763343279.153793:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57220:x1848998400055808:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 396us (635us total) trans 4294974060 rc 0/0 00000100:00100000:3.0:1763343279.153801:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11154 00000100:00100000:2.0:1763343279.156794:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343279.156838:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343279.157329:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400056064 00000100:00100000:3.0:1763343279.157340:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400056064 00000100:00100000:3.0:1763343279.157406:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3947 00000100:00100000:3.0:1763343279.157416:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82cac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57220:x1848998400056064:12345-192.168.201.40@tcp:35:lfs.0 00000004:00010000:3.0:1763343279.157487:0:19639:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x22e:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a601c lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x22e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a414 expref: 315 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.157540:0:19639:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a602a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19639 initiator: MDT0 00010000:00010000:3.0:1763343279.157552:0:19639:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5f66 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3d5 expref: 315 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.157560:0:19639:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5fdd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3f8 expref: 315 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.157568:0:19639:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5f90 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x22e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ea expref: 315 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.157576:0:19639:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a602a lrc: 6/0,1 mode: --/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343279.157608:0:19639:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5f90 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x22e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ea expref: 315 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.157622:0:19639:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5f90 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x22e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ea expref: 315 pid: 33856 timeout: 1172 lvb_type: 0 00000100:00100000:3.0:1763343279.157636:0:19639:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9831500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998413031680:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343279.157728:0:19639:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5fdd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3f8 expref: 315 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.157738:0:19639:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5fdd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3f8 expref: 315 pid: 33856 timeout: 1172 lvb_type: 0 00000100:00100000:3.0:1763343279.157753:0:19639:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9832300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998413031808:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343279.157786:0:19639:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5f66 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3d5 expref: 315 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.157796:0:19639:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5f66 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3d5 expref: 315 pid: 6525 timeout: 1172 lvb_type: 0 00000100:00100000:3.0:1763343279.157806:0:19639:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9832a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998413031936:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343279.157847:0:19639:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c4532f00 going to sleep for 11 seconds 00000100:00100000:0.0:1763343279.160119:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400056320 00000100:00100000:0.0:1763343279.160133:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400056320 00000100:00100000:0.0:1763343279.160204:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11155 00000100:00100000:0.0:1763343279.160212:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57225:x1848998400056320:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:0.0:1763343279.160267:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1763343279.160329:0:6525:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5f90 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x22e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ea expref: 316 pid: 33856 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343279.160354:0:6525:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5fdd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3f8 expref: 316 pid: 33856 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343279.160365:0:6525:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5f66 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3d5 expref: 316 pid: 6525 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343279.160376:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22e:0x0].0x0 (ffff9401fd0d4a00) 00010000:00010000:0.0:1763343279.160381:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a602a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343279.160390:0:6525:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a602a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343279.160396:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a602a lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343279.160413:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343279.160441:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a6031 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343279.160450:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a6031 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.160458:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a6031 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.160470:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a6038 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343279.160481:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a6038 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.160487:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a6038 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.160524:0:19639:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.40@tcp) returned -22 from blocking AST (req@000000001a9c6d98 x1848998413031680) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5f90 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x22e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ea expref: 316 pid: 33856 timeout: 1172 lvb_type: 0 00010000:00010000:3.0:1763343279.160535:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a5f90 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x22e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ea expref: 316 pid: 33856 timeout: 1172 lvb_type: 0 00000100:00100000:3.0:1763343279.160547:0:19639:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9831500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998413031680:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343279.160557:0:19639:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.40@tcp) returned -22 from blocking AST (req@00000000a7dcf92d x1848998413031808) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5fdd lrc: 1/0,0 mode: --/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3f8 expref: 315 pid: 33856 timeout: 1172 lvb_type: 0 00010000:00010000:3.0:1763343279.160566:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a5fdd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3f8 expref: 315 pid: 33856 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343279.160566:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a603f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343279.160574:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a603f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00000100:00100000:3.0:1763343279.160576:0:19639:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9832300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998413031808:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343279.160581:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a603f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.160585:0:19639:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.40@tcp) returned -22 from blocking AST (req@00000000da9f2c5f x1848998413031936) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5f66 lrc: 1/0,0 mode: --/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3d5 expref: 314 pid: 6525 timeout: 1172 lvb_type: 0 00010000:00010000:3.0:1763343279.160593:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a5f66 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x22e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3d5 expref: 314 pid: 6525 timeout: 1172 lvb_type: 0 00000100:00100000:3.0:1763343279.160600:0:19639:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9832a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998413031936:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343279.160621:0:19639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22e:0x0].0x0 (ffff9401fd0d4a00) 00010000:00010000:3.0:1763343279.160625:0:19639:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a602a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343279.160632:0:19639:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a602a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343279.160636:0:19639:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a602a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00000004:00020000:3.0:1763343279.160746:0:19639:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0001-mdtlov: can not set all stale mirrors for [0x240000404:0x22e:0x0]: rc = -1 00010000:00010000:3.0:1763343279.160772:0:19639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a602a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343279.160779:0:19639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a602a lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19639 initiator: MDT1 00000004:00080000:0.0:1763343279.160782:0:6525:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x22e:0x0] is inserted into orphan list, open count = 2 00010000:00010000:3.0:1763343279.160785:0:19639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a602a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343279.160791:0:19639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b98200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343279.160795:0:19639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a602a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343279.160803:0:19639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a602a lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343279.160810:0:19639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22e:0x0].0x0 (ffff9401fd0d4a00) 00010000:00010000:3.0:1763343279.160813:0:19639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1763343279.160816:0:19639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a602a lrc: 2/0,0 mode: --/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343279.160821:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a602a lrc: 0/0,0 mode: --/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343279.160829:0:19639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22e:0x0].0x0 (ffff9401fd0d4a00) 00010000:00010000:3.0:1763343279.160831:0:19639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763343279.160836:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a601c lrc: 0/0,0 mode: --/PW res: [0x240000404:0x22e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a414 expref: 314 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.160852:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a603f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.160858:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a603f lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.160863:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a603f lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.160868:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501aa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343279.160871:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a603f lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.160877:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a603f lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.160884:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22e:0x0].0x0 (ffff9401fd0d4a00) 00010000:00010000:0.0:1763343279.160887:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763343279.160889:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a603f lrc: 2/0,0 mode: --/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.160894:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a603f lrc: 0/0,0 mode: --/EX res: [0x240000404:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.160909:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a6031 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.160913:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a6031 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.160918:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a6031 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.160923:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a6031 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.160927:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343279.160930:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a6031 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.160935:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a6031 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.160942:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9402021da200) 00010000:00010000:0.0:1763343279.160945:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343279.160947:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a6031 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.160953:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a6031 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00000004:00010000:0.0:1763343279.160963:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009b4a64fd reply state 000000001dc04b45 transno 4294974061 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a6038 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.160973:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a6038 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.160979:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695200) 00010000:00010000:0.0:1763343279.160981:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343279.160984:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343279.161810:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57225:x1848998400056320:12345-192.168.201.40@tcp:36:rm.0 Request processed in 1595us (4967us total) trans 4294974061 rc 0/0 00000100:00100000:0.0:1763343279.161820:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11155 00000100:00100000:3.0:1763343279.161874:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82cac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57220:x1848998400056064:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 4459us (5088us total) trans 4294974062 rc -1/-1 00000100:00100000:3.0:1763343279.161882:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3947 00000100:00100000:2.0:1763343279.163986:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.164157:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400056448 00000100:00100000:0.0:1763343279.164167:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400056448 00000100:00100000:0.0:1763343279.164230:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11156 00000100:00100000:0.0:1763343279.164240:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57220:x1848998400056448:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343279.164264:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343279.164287:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a6046 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a41b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.164344:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a6046 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x22e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a41b expref: 315 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.164358:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ae00/0x9104b1ba770a6046 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x22e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a41b expref: 315 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.164540:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22e:0x0].0x0 (ffff9401f6695300) 00010000:00010000:0.0:1763343279.164545:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343279.164548:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501ae00, rc 0) 00000100:00100000:0.0:1763343279.164647:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57220:x1848998400056448:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 408us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343279.164659:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11156 00000100:00100000:2.0:1763343279.167341:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343279.167789:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400056704 00000100:00100000:3.0:1763343279.167800:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400056704 00000100:00100000:3.0:1763343279.167857:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3948 00000100:00100000:3.0:1763343279.167867:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57220:x1848998400056704:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:3.0:1763343279.168169:0:19639:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x22e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1763343279.168253:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1859, 64 off154136 00000040:00080000:3.0:1763343279.168281:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1850, 64 off153376 00000040:00080000:3.0:1763343279.168292:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1851, 64 off153440 00000040:00080000:3.0:1763343279.168302:0:19639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1860, 64 off154200 00010000:00010000:3.0:1763343279.168361:0:19639:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a604d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19639 initiator: MDT0 00010000:00010000:3.0:1763343279.168391:0:19639:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a604d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343279.168404:0:19639:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a604d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343279.168412:0:19639:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a604d lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343279.168419:0:19639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a604d lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343279.168425:0:19639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a604d lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343279.168444:0:19639:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343279.168702:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343279.168709:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a604d lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343279.168716:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a2000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343279.168719:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a604d lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343279.168727:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a604d lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343279.168739:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x22e:0x0].0x0 (ffff9401f6695300) 00010000:00010000:2.0:1763343279.168742:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763343279.168746:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a604d lrc: 1/0,0 mode: --/PW res: [0x240000404:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343279.168751:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a604d lrc: 0/0,0 mode: --/PW res: [0x240000404:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343279.168763:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343279.168765:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343279.168766:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343279.170608:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57220:x1848998400056704:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 2730us (3264us total) trans 4294974063 rc 0/0 00000100:00100000:3.0:1763343279.170622:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3948 00000100:00100000:0.0:1763343279.187278:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343279.187355:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400056960 00000100:00100000:3.0:1763343279.187367:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400056960 00000100:00100000:3.0:1763343279.187465:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11157 00000100:00100000:3.0:1763343279.187475:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57227:x1848998400056960:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343279.187498:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343279.187522:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a6054 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a422 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.187594:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a605b lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343279.187606:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a605b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.187617:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a605b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.187627:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a6062 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343279.187633:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a6062 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.187639:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a6062 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.187833:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a605b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.187843:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a605b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.187849:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a605b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.187854:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a605b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.187860:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a3000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343279.187863:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a605b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.187872:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a605b lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.187883:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:3.0:1763343279.187886:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343279.187891:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a605b lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.187897:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a605b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.187909:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a6062 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.187914:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a6062 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.187918:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a6062 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.187922:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a2000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343279.187925:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a6062 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.187930:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a6062 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.187934:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695200) 00010000:00010000:3.0:1763343279.187936:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343279.187939:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a6062 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.187943:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a6062 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.187969:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a6054 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a422 expref: 317 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.187978:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:3.0:1763343279.187980:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343279.187983:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a6054 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a422 expref: 317 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.187998:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c89a2e00, rc 0) 00000100:00100000:3.0:1763343279.188397:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57227:x1848998400056960:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 920us (1126us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343279.188406:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11157 00000100:00100000:2.0:1763343279.194966:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.195066:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400057088 00000100:00100000:0.0:1763343279.195076:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400057088 00000100:00100000:0.0:1763343279.195130:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11158 00000100:00100000:0.0:1763343279.195139:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57226:x1848998400057088:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343279.195158:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343279.195178:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6069 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a429 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.195291:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a6070 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343279.195305:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a6070 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.197910:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a6070 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.197936:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a6077 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343279.197946:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a6077 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.197951:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a6077 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.197991:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a6070 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.197996:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a6070 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.198002:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a6070 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.198007:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a6070 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.198012:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ac00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343279.198015:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a6070 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.198021:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a6070 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.198052:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695700) 00010000:00010000:0.0:1763343279.198054:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343279.198058:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a6070 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.198064:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a6070 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.198080:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a6077 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.198085:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a6077 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.198090:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a6077 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.198095:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343279.198097:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a6077 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.198106:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a6077 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.198112:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695200) 00010000:00010000:0.0:1763343279.198115:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343279.198118:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a6077 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.198123:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a6077 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.198169:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6069 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a429 expref: 317 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.198179:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695700) 00010000:00010000:0.0:1763343279.198182:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343279.198185:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6069 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a429 expref: 317 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.198215:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501aa00, rc 0) 00000100:00100000:0.0:1763343279.198278:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57226:x1848998400057088:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3138us (3320us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343279.198287:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11158 00000100:00100000:0.0:1763343279.200452:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343279.200569:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400057216 00000100:00100000:2.0:1763343279.200578:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400057216 00000100:00100000:2.0:1763343279.200640:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11159 00000100:00100000:2.0:1763343279.200650:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57227:x1848998400057216:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343279.200670:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343279.200694:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89a00/0x9104b1ba770a607e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a430 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.200753:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a6085 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343279.200764:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a6085 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.200774:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a6085 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.200782:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a608c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343279.200788:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a608c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.200794:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a608c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.200828:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a6085 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.200834:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a6085 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.200840:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a6085 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.200846:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a6085 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.200851:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343279.200855:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a6085 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.200861:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a6085 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.200870:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48ac100) 00010000:00010000:2.0:1763343279.200872:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343279.200876:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a6085 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.200881:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89400/0x9104b1ba770a6085 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.200891:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a608c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.200896:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a608c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.200901:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a608c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.200905:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343279.200908:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a608c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.200913:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a608c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.200919:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695200) 00010000:00010000:2.0:1763343279.200920:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343279.200923:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a608c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.200927:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a608c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.200947:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89a00/0x9104b1ba770a607e lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a430 expref: 317 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.200955:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48ac100) 00010000:00010000:2.0:1763343279.200956:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343279.200959:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89a00/0x9104b1ba770a607e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a430 expref: 317 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.200969:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89a00, rc 0) 00000100:00100000:2.0:1763343279.201018:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57227:x1848998400057216:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 370us (574us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343279.201051:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11159 00000100:00100000:1.0:1763343279.202740:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343279.202813:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400057344 00000100:00100000:3.0:1763343279.202822:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400057344 00000100:00100000:3.0:1763343279.202872:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11160 00000100:00100000:3.0:1763343279.202881:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57226:x1848998400057344:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343279.202899:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343279.202921:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a6093 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a437 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.202985:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a609a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343279.202997:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a609a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.203008:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a609a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.203017:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a60a1 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343279.203054:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a60a1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.203062:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a60a1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.203102:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a609a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.203109:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a609a lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.203115:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a609a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.203120:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a2000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343279.203124:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a609a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.203131:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a609a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.203141:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:3.0:1763343279.203144:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343279.203147:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a609a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.203152:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a609a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.203162:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a60a1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.203168:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a60a1 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.203174:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a60a1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.203178:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a3000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343279.203181:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a60a1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.203186:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a60a1 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.203203:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695200) 00010000:00010000:3.0:1763343279.203206:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343279.203209:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a60a1 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.203214:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a60a1 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.203239:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a6093 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a437 expref: 317 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.203247:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:3.0:1763343279.203250:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343279.203253:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a6093 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a437 expref: 317 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.203265:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c89a2e00, rc 0) 00000100:00100000:3.0:1763343279.203316:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57226:x1848998400057344:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 437us (585us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343279.203323:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11160 00000100:00100000:1.0:1763343279.208173:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343279.208269:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400057472 00000100:00100000:2.0:1763343279.208279:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400057472 00000100:00100000:2.0:1763343279.208337:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11161 00000100:00100000:2.0:1763343279.208346:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57226:x1848998400057472:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343279.208370:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343279.208394:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89a00/0x9104b1ba770a60a8 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a43e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.208453:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a60af lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343279.208466:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a60af lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.208478:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a60af lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:2.0:1763343279.208520:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763343279.208525:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763343279.208558:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89a00/0x9104b1ba770a60a8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a43e expref: 318 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.208575:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a60af lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a43e expref: 317 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.208583:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48ac100) 00010000:00010000:2.0:1763343279.208586:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763343279.208589:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89800, rc 0) 00000100:00100000:2.0:1763343279.208653:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57226:x1848998400057472:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 308us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343279.208660:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11161 00000100:00100000:0.0:1763343279.214579:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343279.214668:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400057600 00000100:00100000:3.0:1763343279.214678:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400057600 00000100:00100000:3.0:1763343279.214739:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11162 00000100:00100000:3.0:1763343279.214749:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c8599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57226:x1848998400057600:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343279.214772:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343279.214793:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a60b6 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a445 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.214853:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a60bd lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343279.214866:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a60bd lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.214875:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a60bd lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.214883:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a60c4 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343279.214889:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a60c4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.214894:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a60c4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.214926:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a60bd lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.214932:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a60bd lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.214937:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a60bd lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.214942:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a3000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343279.214946:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a60bd lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.214957:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a60bd lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.214966:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48ac100) 00010000:00010000:3.0:1763343279.214969:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343279.214973:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a60bd lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.214978:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a60bd lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.214990:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a60c4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.214996:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a60c4 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.215001:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a60c4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.215006:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a2000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343279.215009:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a60c4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.215014:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a60c4 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.215020:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695200) 00010000:00010000:3.0:1763343279.215563:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343279.215567:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a60c4 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.215574:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a60c4 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.215602:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a60b6 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a445 expref: 318 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.215611:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48ac100) 00010000:00010000:3.0:1763343279.215613:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343279.215616:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a60b6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a445 expref: 318 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.215624:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c89a2e00, rc 0) 00000100:00100000:0.0:1763343279.216200:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c8599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57226:x1848998400057600:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1441us (1618us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343279.216208:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11162 00000100:00100000:1.0:1763343279.221512:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.221595:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400057856 00000100:00100000:0.0:1763343279.221607:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400057856 00000100:00100000:0.0:1763343279.221667:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11163 00000100:00100000:0.0:1763343279.221678:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:57226:x1848998400057856:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343279.221699:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343279.221703:0:33856:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343279.221729:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a60af lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a43e expref: 317 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.221747:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400c48ac100) 00010000:00010000:0.0:1763343279.221758:0:33856:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343279.221773:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a60cb lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a44c expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.221872:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a60d2 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343279.221885:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a60d2 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.221893:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a60d2 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.221903:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a60d9 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343279.221911:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a60d9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.221917:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a60d9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.222404:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a60e0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343279.222413:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a60e0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.222421:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a60e0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:0.0:1763343279.222429:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x230:0x0]: returning size 0 00010000:00010000:0.0:1763343279.222451:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a60d2 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.222458:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a60d2 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.222465:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a60d2 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.222470:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b400 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343279.222474:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a60d2 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.222481:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a60d2 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.222489:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695700) 00010000:00010000:0.0:1763343279.222491:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343279.222495:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a60d2 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.222501:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b400/0x9104b1ba770a60d2 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00000004:00010000:0.0:1763343279.222515:0:33856:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a7d80524 reply state 000000007a6a86b2 transno 4294974064 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a60d9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.222525:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a60d9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.222530:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695200) 00010000:00010000:0.0:1763343279.222533:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343279.222535:0:33856:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343279.222561:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a60cb lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a44c expref: 319 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.222578:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a60e0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a44c expref: 318 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.222586:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:0.0:1763343279.222589:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343279.222591:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a400, rc 0) 00000100:00100000:0.0:1763343279.224350:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+319:57226:x1848998400057856:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2667us (2841us total) trans 4294974064 rc 0/0 00000100:00100000:0.0:1763343279.224360:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11163 00000100:00100000:1.0:1763343279.227202:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343279.227562:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.227914:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400058112 00000100:00100000:0.0:1763343279.227925:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400058112 00000100:00100000:0.0:1763343279.227994:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400058368 00000100:00100000:0.0:1763343279.227998:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400058368 00000100:00100000:0.0:1763343279.228052:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11164 00000100:00100000:0.0:1763343279.228062:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+320:57226:x1848998400058112:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343279.228086:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343279.228109:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a60ee lrc: 2/0,0 mode: --/CR res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a453 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.228238:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a60f5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:0.0:1763343279.228253:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a60e0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a44c expref: 321 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.228262:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a60f5 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.228297:0:33856:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a60e0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a44c expref: 321 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.228312:0:33856:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a60e0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a44c expref: 321 pid: 33856 timeout: 1172 lvb_type: 0 00000100:00100000:0.0:1763343279.228325:0:33856:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c859aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998413032064:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343279.228401:0:33856:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c329cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1763343279.228466:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11165 00000100:00100000:1.0:1763343279.228477:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:57228:x1848998400058368:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343279.228486:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343279.228496:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a60fc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a45a expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.228542:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a6103 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343279.228557:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a6103 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343279.228568:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a6103 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343279.228578:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x230:0x0]: returning size 0 00010000:00010000:1.0:1763343279.228659:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a6103 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343279.228666:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a6103 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343279.228672:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a6103 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343279.228678:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343279.228682:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a6103 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343279.228689:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a6103 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343279.228700:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:1.0:1763343279.228703:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1763343279.228709:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a6103 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343279.228714:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a6103 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343279.228750:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a60fc lrc: 1/0,0 mode: --/CR res: [0x240000404:0x230:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a45a expref: 323 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.228764:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:1.0:1763343279.228767:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343279.228770:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a60fc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x230:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a45a expref: 323 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.228779:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176c00, rc 0) 00000100:00100000:1.0:1763343279.228809:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+322:57228:x1848998400058368:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 335us (1248us total) trans 4294974065 rc 301/301 00000100:00100000:1.0:1763343279.228816:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11165 00000100:00100000:0.0:1763343279.232803:0:33856:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c859aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:33856:1848998413032064:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343279.232831:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a60f5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000100:00100000:1.0:1763343279.233343:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343279.233951:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.234016:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400058496 00000100:00100000:0.0:1763343279.234047:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400058496 00010000:00010000:0.0:1763343279.234085:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a60e0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a44c expref: 322 pid: 33856 timeout: 1172 lvb_type: 0 00000100:00100000:0.0:1763343279.234115:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3636 00000100:00100000:0.0:1763343279.234123:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82dc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+322:2407:x1848998400058496:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343279.234137:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343279.234143:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a60e0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a44c expref: 322 pid: 33856 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343279.234155:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a60e0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a44c expref: 322 pid: 33856 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343279.234175:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a400/0x9104b1ba770a60e0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a44c expref: 322 pid: 33856 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343279.234200:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:0.0:1763343279.234204:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a60f5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.234213:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a60f5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.234220:0:35278:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a60f5 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.234240:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343279.234278:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82dc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:2407:x1848998400058496:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 156us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343279.234285:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3636 00010000:00010000:0.0:1763343279.234329:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a60f5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.234336:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a60f5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:0.0:1763343279.234361:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x230:0x0]: returning size 0 00000004:00080000:0.0:1763343279.234519:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2f0:0x0], index 0: 0 00000004:00080000:0.0:1763343279.234524:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2f1:0x0], index 1: 0 00000004:00080000:0.0:1763343279.234528:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2f2:0x0], index 1: 0 00000004:00080000:0.0:1763343279.234532:0:33856:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2f1:0x0], index 0: 0 00010000:00010000:0.0:1763343279.234621:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a60f5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.234629:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a60f5 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.234636:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a60f5 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.234642:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343279.234646:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a60f5 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.234652:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a60f5 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.234660:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:0.0:1763343279.234663:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343279.234666:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a60f5 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.234672:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a60f5 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:0.0:1763343279.234712:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a60ee lrc: 1/0,0 mode: --/CR res: [0x240000404:0x230:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a453 expref: 321 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.234726:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:0.0:1763343279.234729:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343279.234732:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a60ee lrc: 0/0,0 mode: --/CR res: [0x240000404:0x230:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a453 expref: 321 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.234746:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a800, rc 0) 00000100:00100000:0.0:1763343279.234774:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+320:57226:x1848998400058112:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 6715us (7594us total) trans 4294974066 rc 301/301 00000100:00100000:0.0:1763343279.234781:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11164 00000100:00100000:0.0:1763343279.234946:0:9931:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c859b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9931:1848998413032192:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1763343279.234977:0:9931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343279.235002:0:9931:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c8284480 going to sleep for 11 seconds 00000100:00100000:0.0:1763343279.235015:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413032192 00000100:00100000:0.0:1763343279.235019:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413032192 00000100:00100000:0.0:1763343279.235070:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7648 00000100:00100000:0.0:1763343279.235076:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+73:9931:x1848998413032192:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1763343279.235108:0:27798:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 770 00000100:00100000:0.0:1763343279.236335:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+74:9931:x1848998413032192:12345-0@lo:5:osp-pre-1-1.0 Request processed in 1254us (1352us total) trans 17179872105 rc 0/0 00000100:00100000:0.0:1763343279.236345:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7648 00000100:00100000:0.0:1763343279.236399:0:9931:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c859b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9931:1848998413032192:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1763343279.236411:0:9931:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x2f2:0x0]-[0x2c0000400:0x321:0x0] 00000100:00100000:3.0:1763343279.240430:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400058752 00000100:00100000:3.0:1763343279.240445:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400058752 00000100:00100000:3.0:1763343279.240621:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3949 00000100:00100000:3.0:1763343279.240632:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+320:57228:x1848998400058752:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343279.240926:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:57228:x1848998400058752:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 295us (6974us total) trans 4294974067 rc 0/0 00000100:00100000:3.0:1763343279.240935:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3949 00000100:00100000:0.0:1763343279.241157:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343279.245478:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400059008 00000100:00100000:1.0:1763343279.245495:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400059008 00000100:00100000:1.0:1763343279.245574:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3950 00000100:00100000:1.0:1763343279.245585:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+321:57226:x1848998400059008:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1763343279.245824:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+322:57226:x1848998400059008:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 239us (4665us total) trans 4294974068 rc 0/0 00000100:00100000:1.0:1763343279.245833:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3950 00000100:00100000:1.0:1763343279.250861:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343279.251131:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.251210:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400059520 00000100:00100000:0.0:1763343279.251221:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400059520 00000100:00100000:0.0:1763343279.251273:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3951 00000100:00100000:0.0:1763343279.251282:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+322:57226:x1848998400059520:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343279.251628:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400059264 00000100:00100000:3.0:1763343279.251632:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400059264 00000100:00100000:3.0:1763343279.251667:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11166 00000100:00100000:3.0:1763343279.251673:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+324:57228:x1848998400059264:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343279.251683:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343279.251705:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a6118 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a461 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.251765:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a611f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343279.251784:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a611f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.251795:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a611f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.251804:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a6126 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343279.251811:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a6126 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.251816:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a6126 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.251914:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a612d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:3.0:1763343279.251922:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a612d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.251928:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a612d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:3.0:1763343279.251939:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x230:0x0]: returning size 0 00010000:00010000:3.0:1763343279.251988:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a611f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.251995:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a611f lrc: 2/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.252001:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a611f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.252007:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a2000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343279.252012:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a611f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.252018:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a611f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.252049:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401fd0d4300) 00010000:00010000:3.0:1763343279.252052:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343279.252057:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a611f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.252063:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a611f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.252074:0:33856:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a6126 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.252079:0:33856:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a6126 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.252085:0:33856:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a6126 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.252089:0:33856:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a3000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343279.252092:0:33856:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a6126 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.252096:0:33856:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a6126 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.252103:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695200) 00010000:00010000:3.0:1763343279.252105:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343279.252108:0:33856:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a6126 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.252117:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a3000/0x9104b1ba770a6126 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.252146:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a6118 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a461 expref: 327 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.252165:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a612d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a461 expref: 326 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.252172:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9401fd0d4700) 00010000:00010000:3.0:1763343279.252175:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343279.252178:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c6b99600, rc 0) 00000100:00100000:0.0:1763343279.252352:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+326:57226:x1848998400059520:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1069us (1219us total) trans 4294974069 rc 0/0 00000100:00100000:0.0:1763343279.252361:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3951 00000100:00100000:3.0:1763343279.253107:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+325:57228:x1848998400059264:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1429us (2251us total) trans 4294974070 rc 0/0 00000100:00100000:3.0:1763343279.253115:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11166 00000100:00100000:0.0:1763343279.259322:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.259372:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.259401:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400059648 00000100:00100000:0.0:1763343279.259412:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400059648 00000100:00100000:0.0:1763343279.259460:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400059776 00000100:00100000:0.0:1763343279.259463:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400059776 00000100:00100000:0.0:1763343279.259495:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7649 00000100:00100000:0.0:1763343279.259506:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+37:2410:x1848998400059648:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343279.259526:0:27798:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343279.259550:0:27798:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c501b400/0x9104b1ba770a613b lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a468 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343279.259574:0:27798:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343279.259596:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343279.259599:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343279.259607:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501b400/0x9104b1ba770a613b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a468 expref: 38 pid: 27798 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343279.259625:0:27798:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c501b400/0x9104b1ba770a613b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a468 expref: 38 pid: 27798 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343279.259638:0:27798:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b400, rc 0) 00000100:00100000:0.0:1763343279.259684:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+38:2410:x1848998400059648:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 181us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343279.259692:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7649 00000100:00100000:0.0:1763343279.259711:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7650 00000100:00100000:0.0:1763343279.259717:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2410:x1848998400059776:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343279.259724:0:27798:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343279.259735:0:27798:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c501bc00/0x9104b1ba770a6142 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a46f expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343279.259749:0:27798:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343279.259757:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343279.259759:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343279.259763:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501bc00/0x9104b1ba770a6142 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a46f expref: 14 pid: 27798 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343279.259774:0:27798:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c501bc00/0x9104b1ba770a6142 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a46f expref: 14 pid: 27798 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343279.259782:0:27798:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501bc00, rc 0) 00000100:00100000:0.0:1763343279.259798:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2410:x1848998400059776:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 82us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343279.259804:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7650 00000100:00100000:0.0:1763343279.263811:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343279.263890:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400060032 00000100:00100000:3.0:1763343279.263900:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400060032 00000100:00100000:3.0:1763343279.263956:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3952 00000100:00100000:3.0:1763343279.263966:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+325:57228:x1848998400060032:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1763343279.265544:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+326:57228:x1848998400060032:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1570us (1732us total) trans 4294974071 rc 0/0 00000100:00100000:3.0:1763343279.265557:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3952 00000100:00100000:2.0:1763343279.268653:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343279.268994:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400060288 00000100:00100000:3.0:1763343279.269003:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400060288 00000100:00100000:1.0:1763343279.269343:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11167 00000100:00100000:1.0:1763343279.269357:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+326:55884:x1848998400060288:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343279.269380:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343279.269383:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343279.269412:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a612d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a461 expref: 326 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.269432:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9401fd0d4700) 00010000:00010000:1.0:1763343279.269443:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343279.269462:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a6149 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a476 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.269953:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a6150 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343279.269968:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a6150 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x230:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.269979:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a6150 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x230:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:1.0:1763343279.269992:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x230:0x0]: returning size 0 00010000:00010000:1.0:1763343279.270131:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a6149 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x230:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a476 expref: 328 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.270147:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a6150 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x230:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a476 expref: 327 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.270155:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:1.0:1763343279.270158:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:1.0:1763343279.270161:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177200, rc 0) 00000100:00100000:1.0:1763343279.270599:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+327:55884:x1848998400060288:12345-192.168.201.40@tcp:101:bash.0 Request processed in 1242us (1953us total) trans 4294974072 rc 0/0 00000100:00100000:1.0:1763343279.270607:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11167 00000100:00100000:0.0:1763343279.270639:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343279.270666:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400060544 00000100:00100000:1.0:1763343279.270676:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400060544 00000100:00100000:1.0:1763343279.270719:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11168 00000100:00100000:1.0:1763343279.270728:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+327:57228:x1848998400060544:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343279.270745:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343279.270758:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a615e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a47d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.270808:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6165 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343279.270818:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6165 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.270826:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6165 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.270838:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a616c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343279.270844:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a616c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.270849:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a616c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.270951:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a6173 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343279.270963:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a6173 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.270970:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a6173 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.270980:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a6173 lrc: 3/0,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.270986:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343279.270990:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a6173 lrc: 3/0,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.270997:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a6173 lrc: 4/0,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.271005:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:1.0:1763343279.271010:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a6173 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.271016:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177a00/0x9104b1ba770a6173 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00000004:00200000:1.0:1763343279.271062:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x230:0x0]: returning size 0 00010000:00010000:1.0:1763343279.271114:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6165 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.271121:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6165 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.271127:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6165 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.271133:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6165 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.271139:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343279.271142:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6165 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.271158:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6165 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.271166:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb200) 00010000:00010000:1.0:1763343279.271169:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343279.271172:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6165 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.271177:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6165 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.271185:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a616c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.271199:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a616c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.271204:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a616c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.271209:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343279.271211:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a616c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.271217:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a616c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.271224:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695200) 00010000:00010000:1.0:1763343279.271226:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343279.271229:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a616c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.271234:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a616c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.271264:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a615e lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a47d expref: 329 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.271274:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb200) 00010000:00010000:1.0:1763343279.271277:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343279.271280:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176400/0x9104b1ba770a615e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a47d expref: 329 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.271293:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176400, rc 0) 00000100:00100000:1.0:1763343279.271334:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+328:57228:x1848998400060544:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 607us (697us total) trans 4294974073 rc 301/301 00000100:00100000:1.0:1763343279.271341:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11168 00000100:00100000:0.0:1763343279.276143:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.276215:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343279.276279:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400060672 00000100:00100000:2.0:1763343279.276291:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400060672 00000100:00100000:3.0:1763343279.276297:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400060928 00000100:00100000:3.0:1763343279.276304:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400060928 00000100:00100000:2.0:1763343279.276365:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3953 00000100:00100000:2.0:1763343279.276375:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+329:55884:x1848998400060928:12345-192.168.201.40@tcp:35:bash.0 00000100:00100000:3.0:1763343279.276502:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3954 00000100:00100000:3.0:1763343279.276513:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82c8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+329:57228:x1848998400060672:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:2.0:1763343279.276648:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+330:55884:x1848998400060928:12345-192.168.201.40@tcp:35:bash.0 Request processed in 273us (430us total) trans 4294974074 rc 0/0 00000100:00100000:2.0:1763343279.276656:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3953 00000100:00100000:3.0:1763343279.276754:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82c8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+329:57228:x1848998400060672:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 242us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343279.276761:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3954 00000100:00100000:3.0:1763343279.279302:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343279.280176:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400061056 00000100:00100000:1.0:1763343279.280197:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400061056 00000100:00100000:1.0:1763343279.280267:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11169 00000100:00100000:1.0:1763343279.280278:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+329:55884:x1848998400061056:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:1.0:1763343279.280302:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343279.280328:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a6181 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a484 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.280365:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6188 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343279.280380:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6188 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.280391:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6188 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.280504:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177000/0x9104b1ba770a6181 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a484 expref: 331 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.280521:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6188 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a484 expref: 330 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.280531:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:1.0:1763343279.280534:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343279.280538:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176e00, rc 0) 00000100:00100000:1.0:1763343279.282922:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+330:55884:x1848998400061056:12345-192.168.201.40@tcp:101:bash.0 Request processed in 2630us (3617us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343279.282936:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11169 00000100:00100000:1.0:1763343279.291266:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343279.291576:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400061312 00000100:00100000:3.0:1763343279.291587:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400061312 00000100:00100000:3.0:1763343279.291653:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11170 00000100:00100000:0.0:1763343279.291654:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343279.291668:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+330:55884:x1848998400061312:12345-192.168.201.40@tcp:36:bash.0 00000100:00100000:0.0:1763343279.291680:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400061568 00000100:00100000:0.0:1763343279.291684:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400061568 00000100:00100000:0.0:1763343279.291711:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11171 00000100:00100000:0.0:1763343279.291719:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+331:57229:x1848998400061568:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343279.291727:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343279.291729:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343279.291755:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a618f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a48b expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.291757:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177200/0x9104b1ba770a6150 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x230:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a476 expref: 331 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.291785:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:3.0:1763343279.291790:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343279.291817:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a6196 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343279.291831:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a6196 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343279.291840:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a6196 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343279.291850:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a619d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343279.291856:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a619d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343279.291861:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a619d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343279.291945:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a61a4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:0.0:1763343279.291953:0:7641:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a61a4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343279.291959:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a61a4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343279.291961:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a61ab lrc: 3/0,1 mode: --/PW res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343279.291981:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a61a4 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00000004:00200000:0.0:1763343279.291982:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x230:0x0]: returning size 0 00010000:00010000:3.0:1763343279.291994:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a61ab lrc: 4/0,1 mode: --/PW res: [0x240000404:0x230:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.292021:0:6525:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a61a4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7641 initiator: MDT1 00010000:00010000:3.0:1763343279.292052:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a61ab lrc: 3/0,1 mode: --/PW res: [0x240000404:0x230:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.292061:0:7641:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a6196 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343279.292070:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a6196 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343279.292076:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a6196 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343279.292082:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a6196 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343279.292087:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343279.292090:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a6196 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343279.292096:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a6196 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343279.292104:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:0.0:1763343279.292107:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343279.292111:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a6196 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343279.292116:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a800/0x9104b1ba770a6196 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343279.292126:0:7641:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a619d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343279.292131:0:7641:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a619d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343279.292140:0:7641:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a619d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343279.292144:0:7641:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343279.292147:0:7641:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a619d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343279.292152:0:7641:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a619d lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343279.292159:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695200) 00010000:00010000:0.0:1763343279.292161:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343279.292164:0:7641:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a619d lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343279.292170:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a619d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7641 initiator: MDT1 00010000:00010000:0.0:1763343279.292213:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a618f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a48b expref: 334 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.292235:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a61a4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a48b expref: 333 pid: 7641 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343279.292244:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a61a4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a48b expref: 333 pid: 7641 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343279.292250:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b600, rc 0) 00000100:00100000:0.0:1763343279.292298:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+333:57229:x1848998400061568:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 581us (648us total) trans 4294974076 rc 0/0 00000100:00100000:0.0:1763343279.292308:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11171 00000100:00100000:1.0:1763343279.297208:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343279.297247:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343279.297352:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400061824 00000100:00100000:2.0:1763343279.297361:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400061696 00000100:00100000:3.0:1763343279.297363:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400061824 00000100:00100000:2.0:1763343279.297368:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400061696 00010000:00010000:2.0:1763343279.297405:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a61a4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a48b expref: 334 pid: 7641 timeout: 1172 lvb_type: 0 00000100:00100000:3.0:1763343279.297430:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11172 00000100:00100000:3.0:1763343279.297443:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+334:57229:x1848998400061824:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343279.297460:0:33856:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343279.297485:0:33856:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a61b9 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a492 expref: -99 pid: 33856 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343279.297518:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3637 00000100:00100000:2.0:1763343279.297527:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+335:2409:x1848998400061696:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343279.297539:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343279.297545:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a61a4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a48b expref: 335 pid: 7641 timeout: 1172 lvb_type: 0 00010000:00010000:2.0:1763343279.297559:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a61a4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a48b expref: 335 pid: 7641 timeout: 1172 lvb_type: 0 00010000:00010000:3.0:1763343279.297562:0:33856:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a61c0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 33856 initiator: MDT0 00010000:00010000:2.0:1763343279.297587:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b600/0x9104b1ba770a61a4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a48b expref: 335 pid: 7641 timeout: 1172 lvb_type: 0 00010000:00010000:3.0:1763343279.297762:0:33856:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a61ab lrc: 3/0,1 mode: --/PW res: [0x240000404:0x230:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.297771:0:33856:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a61c0 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.297781:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:2.0:1763343279.297788:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a61c0 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.297796:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a61ab lrc: 4/0,1 mode: --/PW res: [0x240000404:0x230:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000020 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.297807:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a61ab lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x230:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000020 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.297813:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a61ab lrc: 5/0,1 mode: PW/PW res: [0x240000404:0x230:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000020 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.297821:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a61c0 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.297827:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a61c0 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.297838:0:33856:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a61ab lrc: 5/0,1 mode: PW/PW res: [0x240000404:0x230:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 6525 initiator: MDT1 00010000:00010000:3.0:1763343279.297850:0:33856:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a61c0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343279.298485:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a61ab lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x230:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.298495:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a61ab lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x230:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT1 00000001:00080000:1.0:1763343279.298588:0:6525:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294974075 00000004:00010000:1.0:1763343279.298633:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ac3313e7 reply state 00000000c698c9ad transno 4294974077 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a61ab lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x230:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.298647:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a61ab lrc: 4/0,1 mode: TXN/TXN res: [0x240000404:0x230:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:1.0:1763343279.298654:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:1.0:1763343279.298657:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343279.298660:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a61c0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343279.298667:0:6525:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a61c0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00010000:00010000:1.0:1763343279.298673:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a61c0 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 33856 initiator: MDT1 00000100:00100000:1.0:1763343279.298700:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343279.299046:0:33856:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a61c0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.299054:0:33856:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a61c0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00000004:00200000:3.0:1763343279.299077:0:33856:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x230:0x0]: returning size 0 00000004:00200000:3.0:1763343279.299082:0:33856:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343279.299095:0:33856:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a61c0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.299106:0:33856:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a61c0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:3.0:1763343279.299132:0:33856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b99600/0x9104b1ba770a61b9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a492 expref: 337 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.299152:0:33856:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a61c0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a492 expref: 336 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.299160:0:33856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:3.0:1763343279.299162:0:33856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343279.299165:0:33856:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c89a2e00, rc 0) 00010000:00010000:2.0:1763343279.299419:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343279.299692:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+336:55884:x1848998400061312:12345-192.168.201.40@tcp:36:bash.0 Request processed in 8026us (8433us total) trans 4294974077 rc 0/0 00000100:00100000:1.0:1763343279.299701:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11170 00000020:00080000:1.0:1763343279.299709:0:6525:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343279.299782:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+335:57229:x1848998400061824:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2343us (2534us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343279.299788:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11172 00000100:00100000:2.0:1763343279.299963:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+334:2409:x1848998400061696:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 2437us (2774us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343279.299971:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3637 00000100:00100000:1.0:1763343279.305377:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343279.305408:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343279.305483:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400062080 00000100:00100000:2.0:1763343279.305493:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400062080 00000100:00100000:2.0:1763343279.305538:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400062208 00000100:00100000:2.0:1763343279.305541:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400062208 00000100:00100000:2.0:1763343279.305723:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11173 00000100:00100000:2.0:1763343279.305733:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+335:55884:x1848998400062080:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343279.305758:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343279.305761:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343279.305787:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2e00/0x9104b1ba770a61c0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a492 expref: 335 pid: 33856 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.305805:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:2.0:1763343279.305810:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343279.305823:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a61c7 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a499 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343279.305829:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11174 00000100:00100000:0.0:1763343279.305838:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+335:57229:x1848998400062208:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343279.305846:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343279.305854:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a61ce lrc: 2/0,0 mode: --/CR res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a4a0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.305868:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a61d5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343279.305880:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a61d5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.305929:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a61d5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000040:00080000:2.0:1763343279.306222:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1852, 88 off153528 00000004:00080000:2.0:1763343279.306230:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1072430205025ns, next at 1073184352022ns, rc = 0 00010000:00010000:0.0:1763343279.306323:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a61d5 lrc: 2/0,1 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.306334:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a61ce lrc: 4/0,0 mode: --/CR res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4a0 expref: 336 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.306350:0:9827:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a61d5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.306362:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a61ce lrc: 3/0,0 mode: --/CR res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4a0 expref: 336 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.306373:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:0.0:1763343279.306375:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343279.306378:0:9827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a61ce lrc: 3/0,0 mode: --/CR res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4a0 expref: 336 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.306385:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b000, rc 0) 00000100:00100000:0.0:1763343279.306442:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+336:57229:x1848998400062208:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 605us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343279.306448:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11174 00000040:00080000:2.0:1763343279.306855:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1861, 88 off154288 00000004:00080000:2.0:1763343279.306862:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1072430837711ns, next at 1073184383515ns, rc = 0 00000040:00080000:2.0:1763343279.306890:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1862, 88 off154376 00000004:00080000:2.0:1763343279.306895:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1072430870181ns, next at 1073184383515ns, rc = 0 00000040:00080000:2.0:1763343279.306905:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1853, 88 off153616 00000004:00080000:2.0:1763343279.306908:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1072430883670ns, next at 1073184352022ns, rc = 0 00000001:00080000:3.0:1763343279.312162:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974078 is committed 00000004:00080000:3.0:1763343279.312175:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1185 committed 00010000:00010000:2.0:1763343279.312334:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a6038 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.312352:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a6038 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.312359:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a6038 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.312367:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501be00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343279.312371:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a6038 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.312384:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a6038 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00000004:00080000:3.0:1763343279.312402:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1193 committed 00010000:00010000:2.0:1763343279.312403:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695200) 00010000:00010000:2.0:1763343279.312409:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343279.312414:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a6038 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.312422:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501be00/0x9104b1ba770a6038 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.312446:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a60d9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.312453:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a60d9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.312459:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a60d9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.312466:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ac00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343279.312469:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a60d9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.312477:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a60d9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.312486:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695200) 00010000:00010000:2.0:1763343279.312490:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343279.312493:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a60d9 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.312499:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a60d9 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33856 initiator: MDT1 00010000:00010000:2.0:1763343279.312523:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a61ab lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x230:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.312531:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a61ab lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x230:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00000100:00100000:1.0:1763343279.312532:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413032320:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1763343279.312543:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a61ab lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x230:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.312548:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b98200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343279.312550:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a61ab lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x230:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.312555:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a61ab lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x230:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.312562:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:2.0:1763343279.312565:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343279.312568:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a61ab lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x230:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:2.0:1763343279.312573:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c6b98200/0x9104b1ba770a61ab lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x230:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00000100:00100000:1.0:1763343279.312607:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343279.312649:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763343279.312656:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c511d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413032448:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763343279.312680:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343279.312710:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c511ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413032576:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343279.312733:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343279.312752:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763343279.312757:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c511c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413032704:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763343279.312775:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343279.312804:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413032320 00000100:00100000:1.0:1763343279.312812:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413032320 00000100:00100000:2.0:1763343279.312820:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413032448 00000100:00100000:2.0:1763343279.312827:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413032448 00000100:00100000:1.0:1763343279.312858:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413032576 00000100:00100000:1.0:1763343279.312863:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413032576 00000100:00100000:2.0:1763343279.312866:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413032704 00000100:00100000:2.0:1763343279.312871:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413032704 00000100:00100000:1.0:1763343279.312892:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7651 00000100:00100000:2.0:1763343279.312900:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7652 00000100:00100000:1.0:1763343279.312905:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+16:3659:x1848998413032320:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763343279.312912:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edde4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+16:3659:x1848998413032448:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763343279.312933:0:8626:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:751 count 1 00002000:00080000:1.0:1763343279.312933:0:8414:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:750 count 1 00010000:00010000:1.0:1763343279.312960:0:8414:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a61dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343279.312968:0:8626:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343279.312976:0:8626:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89200/0x9104b1ba770a61e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.312981:0:8414:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a5feb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a406 expref: 13 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.312994:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343279.312996:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343279.312998:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343279.313000:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343279.313007:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a61dc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.313008:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89200/0x9104b1ba770a61e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.313059:0:8626:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89200/0x9104b1ba770a61e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.313069:0:8626:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89200/0x9104b1ba770a61e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343279.313071:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7653 00010000:00010000:1.0:1763343279.313083:0:8414:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a5feb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a406 expref: 13 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343279.313085:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+16:3661:x1848998413032576:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1763343279.313090:0:8626:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89200/0x9104b1ba770a61e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.313113:0:8414:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a5feb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a406 expref: 13 pid: 8414 timeout: 1172 lvb_type: 0 00010000:00010000:2.0:1763343279.313118:0:8626:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343279.313128:0:8414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1848998413033344:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343279.313207:0:8414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc523c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343279.313227:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7654 00000100:00100000:1.0:1763343279.313237:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+18:3661:x1848998413032704:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763343279.313269:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+18:3661:x1848998413032576:12345-0@lo:2:osp-syn-0-1.0 Request processed in 187us (533us total) trans 21474839375 rc 0/0 00000100:00100000:0.0:1763343279.313278:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7653 00002000:00010000:1.0:1763343279.313307:0:28561:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2f1:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1763343279.313311:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413033216:0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763343279.313313:0:28561:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2f1:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343279.313320:0:28561:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2f1:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:2.0:1763343279.313322:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edde4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+18:3659:x1848998413032448:12345-0@lo:6:osp-syn-0-1.0 Request processed in 411us (639us total) trans 21474839374 rc 0/0 00002000:00010000:1.0:1763343279.313324:0:28561:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2f1:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763343279.313330:0:28561:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2f1:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343279.313335:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7652 00000100:00100000:0.0:1763343279.313350:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763343279.313406:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1192 committed 00000004:00080000:3.0:1763343279.313418:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1184 committed 00000100:00100000:1.0:1763343279.313463:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+17:3661:x1848998413032704:12345-0@lo:2:osp-syn-0-1.0 Request processed in 228us (686us total) trans 21474839376 rc 0/0 00000100:00100000:0.0:1763343279.313466:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763343279.313471:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7654 00000100:00100000:0.0:1763343279.313475:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413033088:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763343279.313487:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413033216 00000100:00100000:1.0:1763343279.313492:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413033216 00000100:00100000:0.0:1763343279.313507:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343279.314088:0:35284:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343279.314096:0:35284:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89200/0x9104b1ba770a61e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.314106:0:35284:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:3.0:1763343279.314110:0:35284:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89200/0x9104b1ba770a61e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.314124:0:35284:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89200/0x9104b1ba770a61e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.314140:0:35284:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89200/0x9104b1ba770a61e3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.314147:0:35284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89200/0x9104b1ba770a61e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.314164:0:35284:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343279.314166:0:35284:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343279.314168:0:35284:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343279.314856:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413033088 00000100:00100000:1.0:1763343279.314863:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413033088 00000100:00100000:0.0:1763343279.314898:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413032960:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343279.314941:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343279.315880:0:35266:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413032960 00000100:00100000:2.0:1763343279.315888:0:35266:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413032960 00000100:00100000:1.0:1763343279.315893:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7655 00000100:00100000:0.0:1763343279.315905:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763343279.315906:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+76:3662:x1848998413033216:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343279.315917:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401efc73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413032832:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763343279.315925:0:35266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7656 00000100:00100000:2.0:1763343279.315935:0:35266:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+76:3662:x1848998413033088:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763343279.315950:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343279.315976:0:27798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413032832 00000100:00100000:0.0:1763343279.315980:0:27798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413032832 00000100:00100000:0.0:1763343279.316003:0:27798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7657 00000100:00100000:0.0:1763343279.316009:0:27798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+77:3660:x1848998413032960:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763343279.316040:0:27798:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:752 count 1 00002000:00010000:1.0:1763343279.316071:0:28561:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2f2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343279.316071:0:27798:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1763343279.316077:0:28561:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2f2:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343279.316081:0:28561:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2f2:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:0.0:1763343279.316082:0:27798:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a61ea lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343279.316084:0:28561:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2f2:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763343279.316090:0:28561:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2f2:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:0.0:1763343279.316102:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343279.316105:0:27798:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343279.316110:0:27798:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a61ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.316125:0:27798:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a61ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343279.316134:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+79:3662:x1848998413033216:12345-0@lo:2:osp-syn-1-1.0 Request processed in 230us (2784us total) trans 17179872106 rc 0/0 00010000:00010000:0.0:1763343279.316137:0:27798:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a61ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343279.316145:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7655 00010000:00010000:0.0:1763343279.316152:0:27798:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a61ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343279.316167:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7658 00010000:00010000:0.0:1763343279.316174:0:27798:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343279.316178:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+78:3660:x1848998413032832:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343279.316201:0:28561:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:751 count 1 00010000:00010000:1.0:1763343279.316213:0:28561:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a61f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343279.316215:0:35266:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+78:3662:x1848998413033088:12345-0@lo:2:osp-syn-1-1.0 Request processed in 281us (2706us total) trans 17179872107 rc 0/0 00000100:00100000:2.0:1763343279.316231:0:35266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7656 00010000:00010000:1.0:1763343279.316237:0:28561:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5fe4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ff expref: 37 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.316250:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343279.316252:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343279.316255:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a61f1 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.316285:0:28561:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5fe4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ff expref: 37 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.316297:0:28561:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5fe4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ff expref: 37 pid: 28562 timeout: 1172 lvb_type: 0 00000100:00100000:1.0:1763343279.316307:0:28561:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998413033472:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343279.316311:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a61d5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x230:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a499 expref: 311 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.316326:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:2.0:1763343279.316329:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343279.316335:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a61ce lrc: 2/0,0 mode: --/CR res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4a0 expref: 311 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.316347:0:6525:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a61ce lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4a0 expref: 311 pid: 9827 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343279.316366:0:28561:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401edc526c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343279.316369:0:27798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+78:3660:x1848998413032960:12345-0@lo:6:osp-syn-1-1.0 Request processed in 357us (1424us total) trans 17179872108 rc 0/0 00010000:00010000:2.0:1763343279.316373:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a61ce lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4a0 expref: 311 pid: 9827 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343279.316382:0:27798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7657 00010000:00010000:0.0:1763343279.316407:0:7451:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343279.316414:0:7451:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a61ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.316418:0:6525:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a61ce lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4a0 expref: 311 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.316429:0:7451:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501a600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343279.316436:0:7451:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a61ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343279.316439:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5950000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998413033600:192.168.201.40@tcp:105: 00010000:00010000:0.0:1763343279.316452:0:7451:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a61ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.316469:0:7451:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a61ea lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343279.316471:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c53043c0 going to sleep for 11 seconds 00010000:00010000:0.0:1763343279.316485:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c501a600/0x9104b1ba770a61ea lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.316502:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343279.316504:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343279.316506:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343279.316538:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c511c380/2, rc 0, transno 21474839376 00000100:00100000:0.0:1763343279.316544:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c511c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413032704:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763343279.316554:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c511ed80/2, rc 0, transno 21474839375 00000100:00100000:0.0:1763343279.316558:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c511ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413032576:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763343279.316578:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c511d500/2, rc 0, transno 21474839374 00000100:00100000:0.0:1763343279.316582:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c511d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413032448:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1763343279.316607:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401efc70700/2, rc 0, transno 17179872108 00000100:00100000:0.0:1763343279.316611:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413032960:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1763343279.316623:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401efc71180/2, rc 0, transno 17179872107 00000100:00100000:0.0:1763343279.316627:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413033088:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763343279.316634:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401efc71500/2, rc 0, transno 17179872106 00000100:00100000:0.0:1763343279.316637:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413033216:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763343279.320143:0:8414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1848998413033344:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343279.320145:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343279.320179:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:2.0:1763343279.320196:0:8414:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a61dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343279.320219:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343279.320234:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400062464 00000100:00100000:2.0:1763343279.320242:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400062464 00000100:00100000:1.0:1763343279.320251:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400062592 00000100:00100000:1.0:1763343279.320257:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400062592 00010000:00010000:2.0:1763343279.320278:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a5feb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a406 expref: 14 pid: 8414 timeout: 1172 lvb_type: 0 00000100:00100000:2.0:1763343279.320310:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400062336 00000100:00100000:2.0:1763343279.320313:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400062336 00000100:00100000:1.0:1763343279.320318:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3955 00010000:00010000:2.0:1763343279.320331:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5fe4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ff expref: 38 pid: 28562 timeout: 1172 lvb_type: 0 00000100:00100000:1.0:1763343279.320333:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57229:x1848998400062592:12345-192.168.201.40@tcp:49:lfs.0 00000100:00100000:2.0:1763343279.320364:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3638 00000100:00100000:2.0:1763343279.320372:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998400062464:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343279.320387:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343279.320392:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a5feb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a406 expref: 14 pid: 8414 timeout: 1172 lvb_type: 0 00010000:00010000:2.0:1763343279.320406:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a5feb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a406 expref: 14 pid: 8414 timeout: 1172 lvb_type: 0 00010000:00010000:2.0:1763343279.320431:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a5feb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a406 expref: 14 pid: 8414 timeout: 1172 lvb_type: 0 00010000:00010000:2.0:1763343279.320446:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343279.320448:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343279.320453:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a61dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343279.320461:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57229:x1848998400062592:12345-192.168.201.40@tcp:49:lfs.0 Request processed in 131us (239us total) trans 0 rc 0/0 00010000:00010000:2.0:1763343279.320465:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a61dc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343279.320472:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3955 00010000:00010000:2.0:1763343279.320497:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343279.320523:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2407:x1848998400062464:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 151us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343279.320531:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3638 00000100:00100000:2.0:1763343279.320550:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3639 00000100:00100000:2.0:1763343279.320557:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+38:2408:x1848998400062336:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343279.320566:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343279.320571:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5fe4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ff expref: 38 pid: 28562 timeout: 1172 lvb_type: 0 00010000:00010000:2.0:1763343279.320581:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5fe4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ff expref: 38 pid: 28562 timeout: 1172 lvb_type: 0 00010000:00010000:2.0:1763343279.320594:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343279.320595:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343279.320598:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a61f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.320605:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a61f1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.320617:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343279.320636:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+38:2408:x1848998400062336:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 80us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343279.320642:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3639 00010000:00010000:2.0:1763343279.320669:0:8414:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a61dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.320677:0:8414:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a61dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.320707:0:8414:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a61dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.320715:0:8414:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a61dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.320733:0:8414:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343279.320979:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5950000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6525:1848998413033600:192.168.201.40@tcp:105: 00010000:00010000:0.0:1763343279.321005:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88a00/0x9104b1ba770a61c7 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a499 expref: 311 pid: 6525 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763343279.321035:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a61d5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x230:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a499 expref: 310 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.321057:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89e00, rc 0) 00000100:00100000:0.0:1763343279.321080:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:55884:x1848998400062080:12345-192.168.201.40@tcp:101:bash.0 Request processed in 15349us (15713us total) trans 4294974078 rc 0/0 00000100:00100000:0.0:1763343279.321087:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11173 00000100:00100000:2.0:1763343279.321619:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+17:3659:x1848998413032320:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8715us (9009us total) trans 21474839377 rc 0/0 00000100:00100000:2.0:1763343279.321627:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7651 00010000:00010000:2.0:1763343279.322004:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343279.322011:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a61dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.322020:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177a00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343279.322039:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a61dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.322049:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a61dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.322067:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a61dc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.322074:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a61dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.322090:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343279.322092:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343279.322094:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763343279.322125:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c5b25180/2, rc 0, transno 21474839377 00000100:00100000:2.0:1763343279.322131:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413032320:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1763343279.322665:0:28561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c501b200/0x9104b1ba770a5fe4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a3ff expref: 37 pid: 28562 timeout: 1172 lvb_type: 0 00000100:00100000:3.0:1763343279.322679:0:28561:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998413033472:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343279.322696:0:28561:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a61f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.322706:0:28561:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a61f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.322713:0:28561:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a61f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.322722:0:28561:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a61f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.322730:0:28561:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a61f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.322759:0:28561:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343279.322963:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+78:3660:x1848998413032832:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6787us (7011us total) trans 17179872109 rc 0/0 00000100:00100000:3.0:1763343279.322971:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7658 00010000:00010000:2.0:1763343279.323266:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343279.323283:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a61f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.323290:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343279.323294:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a61f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.323302:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a61f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.323315:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a61f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.323322:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a61f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.323335:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343279.323336:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343279.323338:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343279.323487:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9401efc73800/2, rc 0, transno 17179872109 00000100:00100000:0.0:1763343279.323493:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401efc73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413032832:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763343279.326526:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343279.326930:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400062720 00000100:00100000:3.0:1763343279.326940:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400062720 00000100:00100000:3.0:1763343279.326998:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7659 00000100:00100000:3.0:1763343279.327009:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2408:x1848998400062720:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343279.327051:0:28561:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343279.327074:0:28561:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c89a3000/0x9104b1ba770a61f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a4a7 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343279.327095:0:28561:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343279.327112:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343279.327114:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343279.327123:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c89a3000/0x9104b1ba770a61f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4a7 expref: 14 pid: 28561 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343279.327139:0:28561:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c89a3000/0x9104b1ba770a61f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4a7 expref: 14 pid: 28561 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343279.327151:0:28561:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c89a3000, rc 0) 00000100:00100000:3.0:1763343279.327222:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998400062720:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 214us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343279.327229:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7659 00000100:00100000:1.0:1763343279.327426:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343279.327691:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400062848 00000100:00100000:2.0:1763343279.327696:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400062848 00000100:00100000:2.0:1763343279.327730:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7660 00000100:00100000:2.0:1763343279.327738:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:55884:x1848998400062848:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343279.327746:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343279.327756:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a61ff lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a4ae expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.327774:0:8414:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c89a3000/0x9104b1ba770a61f8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4a7 expref: 15 pid: 28561 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343279.327781:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343279.327782:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343279.327786:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a61ff lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4ae expref: 15 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.327817:0:8414:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c89a3000/0x9104b1ba770a61f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4a7 expref: 15 pid: 28561 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343279.327830:0:8414:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c89a3000/0x9104b1ba770a61f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4a7 expref: 15 pid: 28561 timeout: 1172 lvb_type: 1 00000100:00100000:2.0:1763343279.327844:0:8414:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5950000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1848998413033728:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343279.327905:0:8414:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c53049c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343279.331015:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343279.331457:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400063104 00000100:00100000:2.0:1763343279.331467:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400063104 00000100:00100000:1.0:1763343279.331904:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343279.332130:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3956 00000100:00100000:2.0:1763343279.332143:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57229:x1848998400063104:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343279.332383:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57229:x1848998400063104:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 242us (1377us total) trans 4294974079 rc 0/0 00000100:00100000:2.0:1763343279.332391:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3956 00000100:00100000:3.0:1763343279.332825:0:8414:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5950000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8414:1848998413033728:192.168.201.40@tcp:104: 00010000:00010000:3.0:1763343279.332861:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a61ff lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4ae expref: 15 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.332882:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88200, rc 0) 00000100:00100000:0.0:1763343279.332922:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400063232 00000100:00100000:3.0:1763343279.332926:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:55884:x1848998400062848:12345-192.168.201.40@tcp:101:bash.0 Request processed in 5187us (5499us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343279.332929:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400063232 00000100:00100000:3.0:1763343279.332938:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7660 00010000:00010000:0.0:1763343279.332958:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c89a3000/0x9104b1ba770a61f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4a7 expref: 15 pid: 28561 timeout: 1172 lvb_type: 1 00000100:00100000:3.0:1763343279.333001:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3640 00000100:00100000:3.0:1763343279.333009:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998400063232:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343279.333021:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343279.333042:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c89a3000/0x9104b1ba770a61f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4a7 expref: 15 pid: 28561 timeout: 1172 lvb_type: 1 00010000:00010000:3.0:1763343279.333055:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c89a3000/0x9104b1ba770a61f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4a7 expref: 15 pid: 28561 timeout: 1172 lvb_type: 1 00010000:00010000:3.0:1763343279.333077:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c89a3000/0x9104b1ba770a61f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4a7 expref: 15 pid: 28561 timeout: 1172 lvb_type: 1 00010000:00010000:3.0:1763343279.333088:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343279.333090:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343279.333096:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a61ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4ae expref: 14 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.333110:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a61ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4ae expref: 14 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343279.333150:0:6509:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a61ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4ae expref: 14 pid: 8414 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343279.333165:0:6509:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401c9832300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6509:1848998413033856:192.168.201.40@tcp:105: 00000100:00100000:3.0:1763343279.333228:0:6509:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401cbf743c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343279.336142:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343279.336250:0:6509:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401c9832300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6509:1848998413033856:192.168.201.40@tcp:105: 00010000:00010000:3.0:1763343279.336283:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343279.336327:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998400063232:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 3318us (4425us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343279.336340:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3640 00000100:00100000:0.0:1763343279.337401:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400063488 00000100:00100000:0.0:1763343279.337410:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400063488 00000100:00100000:0.0:1763343279.337467:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11175 00000100:00100000:0.0:1763343279.337476:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+311:57229:x1848998400063488:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343279.337499:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343279.337521:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6206 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a4b5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.337609:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a620d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343279.337623:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a620d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.337633:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a620d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.337646:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a6214 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343279.337652:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a6214 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.337659:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a6214 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.337775:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a621b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343279.337786:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a621b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.337793:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a621b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00200000:0.0:1763343279.337803:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x230:0x0]: returning size 2 00000100:00100000:3.0:1763343279.337864:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00010000:00010000:0.0:1763343279.337888:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a620d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.337896:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a620d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.337902:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a620d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.337907:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a620d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.337913:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343279.337918:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a620d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.337931:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a620d lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.337943:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:0.0:1763343279.337946:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343279.337950:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a620d lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.337956:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a620d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.337969:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a6214 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.337974:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a6214 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.337980:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a6214 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.337984:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343279.337987:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a6214 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.337992:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a6214 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.337998:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695e00) 00010000:00010000:0.0:1763343279.338001:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343279.338003:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a6214 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.338008:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a6214 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343279.338086:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6206 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4b5 expref: 314 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.338105:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a621b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4b5 expref: 313 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.338111:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:0.0:1763343279.338114:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343279.338117:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a600, rc 0) 00000100:00100000:0.0:1763343279.338158:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57229:x1848998400063488:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 683us (2025us total) trans 4294974080 rc 0/0 00000100:00100000:0.0:1763343279.338168:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11175 00000100:00100000:2.0:1763343279.340740:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400063616 00000100:00100000:2.0:1763343279.340754:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400063616 00000100:00100000:2.0:1763343279.340824:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7661 00000100:00100000:2.0:1763343279.340835:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+37:55884:x1848998400063616:12345-192.168.201.40@tcp:101:bash.0 00010000:00010000:2.0:1763343279.340854:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343279.340876:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6229 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a4bc expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343279.340900:0:8414:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343279.340922:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343279.340925:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343279.340934:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6229 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4bc expref: 38 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.340951:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6229 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4bc expref: 38 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343279.340962:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88c00, rc 0) 00000100:00100000:2.0:1763343279.341046:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+38:55884:x1848998400063616:12345-192.168.201.40@tcp:101:bash.0 Request processed in 192us (3160us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343279.341055:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7661 00000100:00100000:3.0:1763343279.345224:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343279.345278:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343279.345381:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400063872 00000100:00100000:2.0:1763343279.345391:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400063872 00002000:00010000:2.0:1763343279.345432:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/753 (0->18446744073709551615) 00002000:00100000:2.0:1763343279.345437:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c9831c00 with x1848998400063872 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343279.345449:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401c9831c00. 00000100:00100000:2.0:1763343279.345476:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400063744 00000100:00100000:2.0:1763343279.345480:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400063744 00002000:00010000:2.0:1763343279.345491:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/752 (0->18446744073709551615) 00002000:00100000:2.0:1763343279.345494:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c9831880 with x1848998400063744 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343279.345500:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9401c9831880. 00000100:00100000:2.0:1763343279.345524:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1807 00000100:00100000:2.0:1763343279.345538:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+38:2407:x1848998400063872:12345-192.168.201.40@tcp:10:bash.0 00000100:00100000:0.0:1763343279.345660:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1808 00000100:00100000:0.0:1763343279.345673:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998400063744:12345-192.168.201.40@tcp:10:bash.0 00002000:00010000:2.0:1763343279.345727:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2f1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343279.345731:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2f1:0x0] updating lvb mtime from disk: 0 -> 1763343278 00002000:00010000:2.0:1763343279.345734:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2f1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343279.345736:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2f1:0x0] updating lvb ctime from disk: 0 -> 1763343278 00002000:00010000:2.0:1763343279.345738:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2f1:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343279.345803:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+39:2407:x1848998400063872:12345-192.168.201.40@tcp:10:bash.0 Request processed in 265us (588us total) trans 17179872110 rc 0/0 00000100:00100000:2.0:1763343279.345811:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1807 00002000:00010000:2.0:1763343279.345815:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/753 (0->18446744073709551615) 00002000:00100000:2.0:1763343279.345817:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c9831c00 with x1848998400063872 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343279.345822:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401c9831c00. 00002000:00010000:0.0:1763343279.345856:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2f0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343279.345860:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2f0:0x0] updating lvb mtime from disk: 0 -> 1763343278 00002000:00010000:0.0:1763343279.345863:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2f0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343279.345869:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2f0:0x0] updating lvb ctime from disk: 0 -> 1763343278 00002000:00010000:0.0:1763343279.345871:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2f0:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343279.345898:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998400063744:12345-192.168.201.40@tcp:10:bash.0 Request processed in 228us (625us total) trans 21474839378 rc 0/0 00000100:00100000:0.0:1763343279.345907:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1808 00002000:00010000:0.0:1763343279.345912:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/752 (0->18446744073709551615) 00002000:00100000:0.0:1763343279.345915:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c9831880 with x1848998400063744 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343279.345920:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9401c9831880. 00000100:00100000:1.0:1763343279.346236:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343279.346311:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400064128 00000100:00100000:2.0:1763343279.346317:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400064128 00000100:00100000:2.0:1763343279.346362:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3957 00000100:00100000:2.0:1763343279.346370:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57229:x1848998400064128:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343279.346536:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57229:x1848998400064128:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 166us (301us total) trans 4294974081 rc 0/0 00000100:00100000:2.0:1763343279.346543:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3957 00000100:00100000:3.0:1763343279.348530:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.348583:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400064256 00000100:00100000:0.0:1763343279.348593:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400064256 00000100:00100000:0.0:1763343279.348778:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3958 00000100:00100000:0.0:1763343279.348793:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82ca050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57229:x1848998400064256:12345-192.168.201.40@tcp:33:lfs.0 00000100:00100000:0.0:1763343279.349534:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82ca050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57229:x1848998400064256:12345-192.168.201.40@tcp:33:lfs.0 Request processed in 741us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343279.349543:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3958 00000100:00100000:3.0:1763343279.361533:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343279.361802:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400064512 00000100:00100000:1.0:1763343279.361813:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400064512 00000100:00100000:1.0:1763343279.365336:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11176 00000100:00100000:1.0:1763343279.365362:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57229:x1848998400064512:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343279.365387:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343279.365417:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a6230 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a4c3 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.365534:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a6237 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343279.365565:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a6237 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x230:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343279.365578:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a6237 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x230:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000004:00200000:1.0:1763343279.365592:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x230:0x0]: returning size 2 00010000:00010000:1.0:1763343279.365701:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a6230 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x230:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4c3 expref: 317 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.365719:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a6237 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x230:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4c3 expref: 316 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343279.365728:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:1.0:1763343279.365731:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763343279.365735:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176c00, rc 0) 00000100:00100000:1.0:1763343279.365815:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57229:x1848998400064512:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 465us (4290us total) trans 4294974082 rc 0/0 00000100:00100000:1.0:1763343279.365823:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11176 00000100:00100000:1.0:1763343279.369237:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.369305:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400064768 00000100:00100000:0.0:1763343279.369317:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400064768 00000100:00100000:0.0:1763343279.369381:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3959 00000100:00100000:0.0:1763343279.369393:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+316:57229:x1848998400064768:12345-192.168.201.40@tcp:35:lfs.0 00000004:00010000:0.0:1763343279.369477:0:19639:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x230:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a6237 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x230:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4c3 expref: 316 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.369525:0:19639:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6245 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19639 initiator: MDT0 00010000:00010000:0.0:1763343279.369539:0:19639:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6188 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a484 expref: 316 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.369547:0:19639:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a621b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4b5 expref: 316 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.369555:0:19639:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a61d5 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x230:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a499 expref: 316 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.369562:0:19639:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a61ce lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4a0 expref: 316 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.369576:0:19639:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6245 lrc: 7/0,1 mode: --/EX res: [0x240000404:0x230:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343279.369617:0:19639:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a61ce lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4a0 expref: 316 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.369632:0:19639:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a61ce lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4a0 expref: 316 pid: 9827 timeout: 1172 lvb_type: 0 00000100:00100000:0.0:1763343279.369646:0:19639:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c791a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998413033984:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343279.369743:0:19639:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a61d5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x230:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a499 expref: 316 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.369751:0:19639:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a61d5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x230:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a499 expref: 316 pid: 6525 timeout: 1172 lvb_type: 0 00000100:00100000:0.0:1763343279.369760:0:19639:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7919c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998413034112:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343279.369790:0:19639:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a621b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4b5 expref: 316 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.369798:0:19639:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a621b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4b5 expref: 316 pid: 6525 timeout: 1172 lvb_type: 0 00000100:00100000:0.0:1763343279.369806:0:19639:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c791b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998413034240:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343279.369830:0:19639:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6188 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a484 expref: 316 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.369843:0:19639:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6188 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a484 expref: 316 pid: 6525 timeout: 1172 lvb_type: 0 00000100:00100000:0.0:1763343279.369851:0:19639:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c791ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998413034368:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343279.369872:0:19639:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401fc440300 going to sleep for 11 seconds 00000100:00100000:3.0:1763343279.379284:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343279.379309:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343279.379343:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343279.379363:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.379451:0:19639:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c791b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998413034240:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343279.379462:0:19639:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c791ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998413034368:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343279.379470:0:19639:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c791a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998413033984:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343279.379476:0:19639:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7919c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19639:1848998413034112:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343279.379506:0:19639:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6245 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x230:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00000100:00100000:2.0:1763343279.379616:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400065024 00000100:00100000:2.0:1763343279.379625:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400065024 00010000:00010000:2.0:1763343279.379663:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a61ce lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4a0 expref: 317 pid: 9827 timeout: 1172 lvb_type: 0 00000100:00100000:2.0:1763343279.379916:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400065280 00000100:00100000:2.0:1763343279.379920:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400065280 00010000:00010000:2.0:1763343279.379934:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a61d5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x230:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a499 expref: 318 pid: 6525 timeout: 1172 lvb_type: 0 00000100:00100000:2.0:1763343279.379957:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400065152 00000100:00100000:2.0:1763343279.379960:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400065152 00010000:00010000:2.0:1763343279.379971:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6188 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a484 expref: 319 pid: 6525 timeout: 1172 lvb_type: 0 00000100:00100000:2.0:1763343279.379981:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400064896 00000100:00100000:2.0:1763343279.379983:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400064896 00010000:00010000:2.0:1763343279.379991:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a621b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4b5 expref: 320 pid: 6525 timeout: 1172 lvb_type: 0 00000100:00100000:2.0:1763343279.380004:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3641 00000100:00100000:2.0:1763343279.380011:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9833480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+320:2407:x1848998400065024:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343279.380058:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343279.380066:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a61ce lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4a0 expref: 320 pid: 9827 timeout: 1172 lvb_type: 0 00000100:00100000:0.0:1763343279.380070:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3642 00000100:00100000:0.0:1763343279.380083:0:6511:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+320:2407:x1848998400065280:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343279.380087:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a61ce lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4a0 expref: 320 pid: 9827 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343279.380096:0:6511:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343279.380104:0:6511:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a61d5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x230:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a499 expref: 320 pid: 6525 timeout: 1172 lvb_type: 0 00010000:00010000:2.0:1763343279.380113:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a61ce lrc: 0/0,0 mode: --/CR res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4a0 expref: 320 pid: 9827 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343279.380117:0:6511:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a61d5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x230:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a499 expref: 320 pid: 6525 timeout: 1172 lvb_type: 0 00010000:00010000:2.0:1763343279.380142:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:0.0:1763343279.380142:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e89e00/0x9104b1ba770a61d5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x230:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a499 expref: 319 pid: 6525 timeout: 1172 lvb_type: 0 00010000:00010000:2.0:1763343279.380152:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6245 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x230:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343279.380169:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6245 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x230:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343279.380176:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343279.380233:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9833480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+318:2407:x1848998400065024:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 221us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343279.380240:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3641 00000100:00100000:2.0:1763343279.380258:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3643 00000100:00100000:2.0:1763343279.380264:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:2407:x1848998400065152:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343279.380273:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343279.380278:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6188 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a484 expref: 317 pid: 6525 timeout: 1172 lvb_type: 0 00000100:00100000:3.0:1763343279.380335:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3644 00000100:00100000:3.0:1763343279.380346:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:2408:x1848998400064896:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343279.380354:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343279.380360:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a621b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4b5 expref: 317 pid: 6525 timeout: 1172 lvb_type: 0 00010000:00010000:0.0:1763343279.380385:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:0.0:1763343279.380390:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6245 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x230:0x0].0x0 bits 0x28/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343279.380395:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6245 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x230:0x0].0x0 bits 0x28/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343279.380400:0:6511:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343279.380423:0:6511:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+317:2407:x1848998400065280:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 343us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343279.380430:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3642 00010000:00010000:2.0:1763343279.381374:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6188 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a484 expref: 316 pid: 6525 timeout: 1172 lvb_type: 0 00010000:00010000:2.0:1763343279.381396:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6188 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a484 expref: 316 pid: 6525 timeout: 1172 lvb_type: 0 00010000:00010000:2.0:1763343279.381410:0:35278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:2.0:1763343279.381415:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6245 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x230:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343279.381421:0:35278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6245 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x230:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00010000:00010000:2.0:1763343279.381425:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343279.381700:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a621b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4b5 expref: 315 pid: 6525 timeout: 1172 lvb_type: 0 00010000:00010000:3.0:1763343279.381714:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a621b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4b5 expref: 315 pid: 6525 timeout: 1172 lvb_type: 0 00010000:00010000:3.0:1763343279.381726:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:3.0:1763343279.381729:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6245 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x230:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343279.381737:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6245 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19639 initiator: MDT1 00010000:00010000:3.0:1763343279.381744:0:7904:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6245 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19639 initiator: MDT1 00000100:00100000:2.0:1763343279.382425:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:2407:x1848998400065152:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 2157us (3077us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343279.382435:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3643 00010000:00010000:3.0:1763343279.384342:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343279.384859:0:19639:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6245 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343279.384872:0:19639:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6245 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19639 initiator: MDT1 00000100:00100000:2.0:1763343279.385013:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:2408:x1848998400064896:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 4662us (5641us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343279.385045:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3644 00000004:00020000:0.0:1763343279.385081:0:19639:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0001-mdtlov: can not set all stale mirrors for [0x240000404:0x230:0x0]: rc = -1 00010000:00010000:0.0:1763343279.385111:0:19639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6245 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343279.385119:0:19639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6245 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343279.385126:0:19639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6245 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343279.385132:0:19639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501aa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343279.385136:0:19639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6245 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343279.385148:0:19639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6245 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343279.385163:0:19639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:0.0:1763343279.385166:0:19639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1763343279.385170:0:19639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6245 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x230:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343279.385175:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6245 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x230:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19639 initiator: MDT1 00010000:00010000:0.0:1763343279.385196:0:19639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9400ccadb500) 00010000:00010000:0.0:1763343279.385199:0:19639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343279.385204:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a6237 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x230:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4c3 expref: 312 pid: 9827 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343279.385332:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57229:x1848998400064768:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 15941us (16108us total) trans 4294974083 rc -1/-1 00000100:00100000:0.0:1763343279.385340:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3959 00000100:00100000:1.0:1763343279.389368:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.389614:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400065408 00000100:00100000:0.0:1763343279.389626:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400065408 00000100:00100000:0.0:1763343279.390001:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11177 00000100:00100000:0.0:1763343279.390012:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57229:x1848998400065408:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343279.390133:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343279.390157:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a624c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a4ca expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.390226:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a624c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4ca expref: 313 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.390246:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a624c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4ca expref: 313 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343279.390262:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:0.0:1763343279.390265:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343279.390268:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b200, rc 0) 00000100:00100000:0.0:1763343279.390585:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57229:x1848998400065408:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 573us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343279.390593:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11177 00000100:00100000:3.0:1763343279.393513:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343279.393595:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400065664 00000100:00100000:0.0:1763343279.393607:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400065664 00000100:00100000:0.0:1763343279.393669:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3960 00000100:00100000:0.0:1763343279.393679:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+313:57229:x1848998400065664:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343279.393908:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57229:x1848998400065664:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 229us (406us total) trans 4294974084 rc 0/0 00000100:00100000:0.0:1763343279.393915:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3960 00010000:00010000:3.0:1763343279.870114:0:35284:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343280.898646:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343281.020987:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413034496:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1763343281.021073:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343281.021148:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413034496 00000100:00100000:0.0:1763343281.021156:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413034496 00000100:00100000:0.0:1763343281.021213:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:0.0:1763343281.021220:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+17:3659:x1848998413034496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1763343281.021245:0:8415:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 28672 granted 484923200 pending 0 free 3919192064 avail 3687669760 00000100:00100000:0.0:1763343281.021279:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+17:3659:x1848998413034496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343281.021289:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00080000:0.0:1763343281.021307:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1763343281.021337:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413034496:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1763343281.531530:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1848998413034624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1763343281.531607:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343281.531726:0:14179:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413034624 00000100:00100000:3.0:1763343281.531735:0:14179:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413034624 00000100:00100000:3.0:1763343281.531805:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:3.0:1763343281.531815:0:14179:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1848998413034624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1763343281.531838:0:14179:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 28672 granted 484923200 pending 0 free 3919192064 avail 3687669760 00000100:00100000:3.0:1763343281.531887:0:14179:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1848998413034624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343281.531899:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:3.0:1763343281.531953:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1848998413034624:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1763343281.532021:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1763343281.532800:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1848998413035008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1763343281.532845:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343281.532888:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413034752:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1763343281.532911:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343281.532936:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763343281.532942:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1848998413034880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1763343281.532966:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343281.532999:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413034880 00000100:00100000:0.0:1763343281.533006:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413034880 00000100:00100000:0.0:1763343281.533073:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:0.0:1763343281.533082:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401efc71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1848998413034880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1763343281.533109:0:8415:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484980544 pending 86016 free 3920224256 avail 3688701952 00000100:00100000:0.0:1763343281.533180:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401efc71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1848998413034880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343281.533190:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00100000:1.0:1763343281.533210:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1848998413034880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1763343281.533241:0:6529:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413035008 00000100:00100000:0.0:1763343281.533247:0:6529:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413035008 00000100:00100000:0.0:1763343281.533277:0:6529:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413034752 00000100:00100000:0.0:1763343281.533280:0:6529:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413034752 00000100:00100000:0.0:1763343281.533293:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:0.0:1763343281.533299:0:6529:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1848998413035008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1763343281.533326:0:6529:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445879808 avail 1299640320 00000100:00100000:1.0:1763343281.533379:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:0.0:1763343281.533380:0:6529:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1848998413035008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343281.533389:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:1.0:1763343281.533393:0:7640:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c791b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3661:x1848998413034752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1763343281.533418:0:7640:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445888000 avail 1299648512 00000100:00080000:0.0:1763343281.533422:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1763343281.533464:0:7640:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c791b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3661:x1848998413034752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343281.533471:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:0.0:1763343281.533493:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413034752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1763343281.533634:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1848998413035008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1763343281.533809:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1848998413035520:0@lo:400:kworker.0 00000100:00100000:3.0:1763343281.533844:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343281.533864:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1848998413036032:0@lo:400:kworker.0 00000100:00100000:3.0:1763343281.533888:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343281.533915:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5a605d51-bec9-44a7-a417-e819baf6bfda:3660:1848998413035136:0@lo:400:kworker.0 00000100:00100000:3.0:1763343281.533927:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1848998413035264:0@lo:400:kworker.0 00000100:00100000:2.0:1763343281.533958:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343281.533965:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343281.533998:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1848998413035648:0@lo:400:kworker.0 00000100:00100000:3.0:1763343281.533999:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1848998413035776:0@lo:400:kworker.0 00000100:00100000:3.0:1763343281.534058:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343281.534077:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1763343281.534083:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413035392:0@lo:400:kworker.0 00000100:00100000:2.0:1763343281.534111:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343281.534121:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343281.534147:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1848998413035904:0@lo:400:kworker.0 00000100:00100000:3.0:1763343281.534210:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343281.534240:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413035520 00000100:00100000:3.0:1763343281.534246:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413035520 00000100:00100000:3.0:1763343281.534290:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413036032 00000100:00100000:3.0:1763343281.534294:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413036032 00000100:00100000:1.0:1763343281.534298:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413035264 00000100:00100000:1.0:1763343281.534305:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413035264 00000100:00100000:3.0:1763343281.534309:0:33856:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413035776 00000100:00100000:3.0:1763343281.534314:0:33856:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413035776 00000100:00100000:1.0:1763343281.534333:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413035648 00000100:00100000:3.0:1763343281.534336:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:1.0:1763343281.534339:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413035648 00000100:00100000:3.0:1763343281.534346:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1848998413035520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763343281.534361:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413035904 00000100:00100000:1.0:1763343281.534365:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413035904 00000100:00100000:1.0:1763343281.534386:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:3.0:1763343281.534393:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1848998413035520:12345-0@lo:400:kworker.0 Request processed in 48us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343281.534397:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1848998413036032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763343281.534412:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00100000:3.0:1763343281.534430:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:3.0:1763343281.534439:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1848998413035264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763343281.534445:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1848998413036032:12345-0@lo:400:kworker.0 Request processed in 51us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343281.534452:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00100000:1.0:1763343281.534471:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:3.0:1763343281.534479:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1848998413035264:12345-0@lo:400:kworker.0 Request processed in 40us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343281.534481:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1848998413035776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763343281.534494:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00000100:00100000:3.0:1763343281.534515:0:33856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00100000:1.0:1763343281.534523:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1848998413035776:12345-0@lo:400:kworker.0 Request processed in 44us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343281.534526:0:33856:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1848998413035648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763343281.534538:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:1.0:1763343281.534555:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:1.0:1763343281.534562:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1848998413035904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763343281.534571:0:33856:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1848998413035648:12345-0@lo:400:kworker.0 Request processed in 48us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343281.534579:0:33856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00000100:00100000:1.0:1763343281.534600:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1848998413035904:12345-0@lo:400:kworker.0 Request processed in 38us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343281.534602:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413035392 00000100:00100000:3.0:1763343281.534607:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413035392 00000100:00100000:1.0:1763343281.534611:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00100000:1.0:1763343281.534641:0:32306:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413035136 00000100:00100000:3.0:1763343281.534642:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:1.0:1763343281.534647:0:32306:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413035136 00000100:00100000:3.0:1763343281.534653:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+78:3661:x1848998413035392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763343281.534679:0:32306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1763343281.534688:0:32306:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c487fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a605d51-bec9-44a7-a417-e819baf6bfda+23:3660:x1848998413035136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763343281.534694:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+78:3661:x1848998413035392:12345-0@lo:400:kworker.0 Request processed in 41us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343281.534702:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:1.0:1763343281.534729:0:32306:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c487fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a605d51-bec9-44a7-a417-e819baf6bfda+23:3660:x1848998413035136:12345-0@lo:400:kworker.0 Request processed in 41us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343281.534738:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1848998413035520:0@lo:400:kworker.0 00000100:00100000:1.0:1763343281.534739:0:32306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1763343281.534757:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1848998413036032:0@lo:400:kworker.0 00000100:00100000:3.0:1763343281.534792:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413035392:0@lo:400:kworker.0 00000100:00100000:3.0:1763343281.534802:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1848998413035904:0@lo:400:kworker.0 00000100:00100000:3.0:1763343281.534810:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1848998413035264:0@lo:400:kworker.0 00000100:00100000:3.0:1763343281.534818:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1848998413035776:0@lo:400:kworker.0 00000100:00080000:2.0:1763343281.535004:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1763343281.535009:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1763343281.535011:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1763343281.535065:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5a605d51-bec9-44a7-a417-e819baf6bfda:3660:1848998413035136:0@lo:400:kworker.0 00000100:00100000:2.0:1763343281.535085:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1848998413035648:0@lo:400:kworker.0 00010000:00010000:1.0:1763343281.915250:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343282.940371:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343282.940494:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343282.941341:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343282.941376:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343282.941401:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343282.941430:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343282.941611:0:32304:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400065792 00000100:00100000:3.0:1763343282.941622:0:32304:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400065792 00000100:00100000:3.0:1763343282.941680:0:32304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 150 00000100:00100000:3.0:1763343282.941692:0:32304:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c487f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:115d5667-a2e7-4faf-8d77-45fb38721d60+9:2408:x1848998400065792:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:3.0:1763343282.941764:0:32304:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c487f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:115d5667-a2e7-4faf-8d77-45fb38721d60+9:2408:x1848998400065792:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 74us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343282.941772:0:32304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 150 00000100:00100000:0.0:1763343282.942146:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400066048 00000100:00100000:0.0:1763343282.942151:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400066048 00000100:00100000:0.0:1763343282.942192:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400065920 00000100:00100000:0.0:1763343282.942195:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400065920 00000100:00100000:0.0:1763343282.942221:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1281 00000100:00100000:0.0:1763343282.942229:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:2408:x1848998400066048:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:1.0:1763343282.942266:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400066304 00000100:00100000:1.0:1763343282.942271:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400066304 00000100:00100000:0.0:1763343282.942281:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:2408:x1848998400066048:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 52us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343282.942289:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1281 00000100:00100000:0.0:1763343282.942307:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1282 00000100:00100000:1.0:1763343282.942313:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400066176 00000100:00100000:0.0:1763343282.942316:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998400065920:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:1.0:1763343282.942318:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400066176 00000100:00100000:1.0:1763343282.942348:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 749 00000100:00100000:0.0:1763343282.942353:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998400065920:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 37us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343282.942362:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+39:2408:x1848998400066304:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:0.0:1763343282.942364:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1282 00000100:00100000:0.0:1763343282.942405:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 750 00000100:00100000:1.0:1763343282.942412:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+39:2408:x1848998400066304:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 46us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343282.942417:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998400066176:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:1.0:1763343282.942426:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 749 00000100:00100000:0.0:1763343282.942458:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998400066176:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 44us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343282.942464:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 750 00000100:00080000:3.0:1763343282.943082:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1763343282.943087:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1763343282.943090:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1763343282.943092:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1763343283.067547:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763343283.067573:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413036160:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1763343283.067653:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343283.067763:0:14179:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413036160 00000100:00100000:0.0:1763343283.067774:0:14179:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413036160 00000100:00100000:0.0:1763343283.067846:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00080000:3.0:1763343283.067852:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1763343283.067867:0:14179:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400cc5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+78:3659:x1848998413036160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1763343283.067903:0:14179:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484980544 pending 86016 free 3920224256 avail 3688701952 00000100:00100000:0.0:1763343283.067951:0:14179:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400cc5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+78:3659:x1848998413036160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343283.067958:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00100000:1.0:1763343283.068067:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413036160:0@lo:13:osp-pre-1-1.0 00000001:00080000:2.0:1763343283.076523:0:25994:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872110 is committed 00000001:00080000:2.0:1763343283.076540:0:25994:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872109 is committed 00000100:00100000:3.0:1763343283.375989:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343283.376259:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400066432 00000100:00100000:0.0:1763343283.376270:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400066432 00000100:00100000:0.0:1763343283.376330:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11178 00000100:00100000:0.0:1763343283.376340:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edc2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+314:57652:x1848998400066432:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:0.0:1763343283.376364:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343283.376391:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a6253 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a4d1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343283.376455:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a625a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343283.376469:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a625a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343283.376481:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a625a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343283.376495:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6261 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343283.376501:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6261 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343283.376508:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6261 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343283.376579:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a6268 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:0.0:1763343283.376587:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a6268 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343283.376595:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a6268 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00200000:0.0:1763343283.376632:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x230:0x0]: returning size 2 00000004:00200000:0.0:1763343283.376637:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343283.376657:0:6524:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a6268 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343283.376670:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a6268 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343283.376680:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a625a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343283.376686:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a625a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343283.376693:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a625a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343283.376699:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a625a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343283.376706:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343283.376710:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a625a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343283.376717:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a625a lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343283.376730:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9401f6695e00) 00010000:00010000:0.0:1763343283.376733:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343283.376737:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a625a lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343283.376743:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b000/0x9104b1ba770a625a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343283.376754:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6261 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343283.376760:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6261 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343283.376766:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6261 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343283.376771:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501aa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:0.0:1763343283.376774:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6261 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343283.376779:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6261 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343283.376786:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9401f6695200) 00010000:00010000:0.0:1763343283.376788:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343283.376791:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6261 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343283.376796:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501aa00/0x9104b1ba770a6261 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:0.0:1763343283.376827:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501a600/0x9104b1ba770a6253 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4d1 expref: 316 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343283.376842:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a6268 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4d1 expref: 315 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343283.376850:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:0.0:1763343283.376852:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343283.376854:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501b800, rc 0) 00000100:00100000:0.0:1763343283.382911:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edc2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57652:x1848998400066432:12345-192.168.201.40@tcp:101:rm.0 Request processed in 6555us (6915us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343283.382927:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11178 00000100:00100000:3.0:1763343283.392541:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343283.395103:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400066688 00000100:00100000:1.0:1763343283.395128:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400066688 00000100:00100000:1.0:1763343283.395196:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11179 00000100:00100000:1.0:1763343283.395206:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57652:x1848998400066688:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:1.0:1763343283.395263:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1763343283.395292:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b800/0x9104b1ba770a6268 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x230:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4d1 expref: 315 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343283.395316:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c501b200/0x9104b1ba770a624c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x230:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4ca expref: 314 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343283.395328:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9401f6695c00) 00010000:00010000:1.0:1763343283.395342:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343283.395370:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a626f lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343283.395384:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a626f lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.395392:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a626f lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.395408:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a6276 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343283.395415:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a6276 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.395421:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a6276 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.395499:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a627d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343283.395507:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a627d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.395513:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a627d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000040:00080000:1.0:1763343283.395789:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1854, 64 off153680 00000004:00080000:1.0:1763343283.395799:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1076519774323ns, next at 1077519771777ns, rc = 0 00000040:00080000:1.0:1763343283.395823:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1863, 64 off154440 00000004:00080000:1.0:1763343283.395829:0:6524:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1076519804487ns, next at 1077519803385ns, rc = 0 00000040:00080000:1.0:1763343283.395839:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1864, 64 off154504 00000040:00080000:1.0:1763343283.395848:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1855, 64 off153744 00010000:00010000:1.0:1763343283.395900:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6284 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x230:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343283.395909:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6284 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x230:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.395917:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6284 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x230:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.395928:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6284 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x230:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.395934:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6284 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x230:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.395939:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6284 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x230:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.395957:0:6524:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343283.395973:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a627d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.395979:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a627d lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.395985:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a627d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.395991:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343283.395996:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a627d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.396003:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a627d lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x230:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.396011:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:1.0:1763343283.396014:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343283.396017:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a627d lrc: 2/0,0 mode: --/EX res: [0x240000404:0x230:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.396046:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177e00/0x9104b1ba770a627d lrc: 0/0,0 mode: --/EX res: [0x240000404:0x230:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.396176:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a626f lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.396183:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a626f lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.396189:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a626f lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.396194:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a626f lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.396199:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343283.396202:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a626f lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.396208:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a626f lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.396216:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff9400ccadb400) 00010000:00010000:1.0:1763343283.396218:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343283.396221:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a626f lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.396227:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177800/0x9104b1ba770a626f lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000004:00010000:1.0:1763343283.396239:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008743db15 reply state 000000007741c8f8 transno 4294974085 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a6276 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.396251:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a6276 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.396257:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadb700) 00010000:00010000:1.0:1763343283.396260:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343283.396262:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343283.396344:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+315:57652:x1848998400066688:12345-192.168.201.40@tcp:36:rm.0 Request processed in 1138us (3814us total) trans 4294974085 rc 0/0 00000100:00100000:1.0:1763343283.396352:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11179 00010000:00010000:1.0:1763343283.396384:0:35284:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343283.396389:0:35284:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6284 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x230:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.396396:0:35284:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343283.396399:0:35284:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6284 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x230:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.396405:0:35284:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6284 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x230:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.396413:0:35284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x230:0x0].0x0 (ffff9400ccadb600) 00010000:00010000:1.0:1763343283.396415:0:35284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763343283.396418:0:35284:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6284 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x230:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.396423:0:35284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176e00/0x9104b1ba770a6284 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x230:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT1 00010000:00010000:1.0:1763343283.396434:0:35284:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343283.396436:0:35284:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343283.396438:0:35284:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343283.963293:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1763343284.606732:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974085 is committed 00000004:00080000:1.0:1763343284.606747:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1194 committed 00000004:00080000:1.0:1763343284.606756:0:7443:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1186 committed 00010000:00010000:3.0:1763343284.606891:0:3645:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a6276 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343284.606903:0:3645:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a6276 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343284.606911:0:3645:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a6276 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343284.606917:0:3645:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343284.606921:0:3645:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a6276 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343284.606929:0:3645:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a6276 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343284.606946:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff9400ccadb700) 00010000:00010000:3.0:1763343284.606949:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343284.606954:0:3645:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a6276 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343284.606960:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176000/0x9104b1ba770a6276 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000100:00100000:3.0:1763343284.607000:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400cc5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413036288:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763343284.607276:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343284.607458:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413036416:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763343284.607804:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413036288 00000100:00100000:1.0:1763343284.607814:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413036288 00000100:00100000:1.0:1763343284.607872:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7662 00000100:00100000:1.0:1763343284.607882:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+17:3661:x1848998413036288:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763343284.607910:0:28562:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:752 count 1 00000100:00080000:3.0:1763343284.607990:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1763343284.608261:0:28562:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a628b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.608282:0:28562:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a61ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4ae expref: 14 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.608290:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343284.608292:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343284.608297:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a628b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.608328:0:28562:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a61ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4ae expref: 14 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.608344:0:28562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a61ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4ae expref: 14 pid: 8414 timeout: 1177 lvb_type: 0 00000100:00100000:1.0:1763343284.608356:0:28562:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c8bc0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28562:1848998413036544:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343284.608429:0:28562:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eca1ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1763343284.608963:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343284.609309:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413036416 00000100:00100000:1.0:1763343284.609316:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413036416 00000100:00100000:1.0:1763343284.609350:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7663 00000100:00100000:1.0:1763343284.609357:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1848998413036416:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763343284.609375:0:8626:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:753 count 1 00010000:00010000:1.0:1763343284.609392:0:8626:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a6292 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.609404:0:8626:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6229 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4bc expref: 12 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.609423:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343284.609425:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343284.609427:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a6292 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.609452:0:8626:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6229 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4bc expref: 12 pid: 8414 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.609461:0:8626:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6229 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4bc expref: 12 pid: 8414 timeout: 1177 lvb_type: 0 00000100:00100000:1.0:1763343284.609472:0:8626:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c8bc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998413036672:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343284.609516:0:8626:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eca1e540 going to sleep for 11 seconds 00000001:00080000:0.0:1763343284.610653:0:24675:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839378 is committed 00000001:00080000:0.0:1763343284.610664:0:24675:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839377 is committed 00000100:00100000:2.0:1763343284.612614:0:28562:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c8bc0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28562:1848998413036544:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343284.612645:0:28562:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a628b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343284.612720:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c8bc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998413036672:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343284.612734:0:8626:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a6292 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343284.615291:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343284.615389:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343284.615425:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400066944 00000100:00100000:1.0:1763343284.615435:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400066944 00010000:00010000:1.0:1763343284.615491:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6229 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4bc expref: 13 pid: 8414 timeout: 1177 lvb_type: 0 00000100:00100000:1.0:1763343284.615522:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400066816 00000100:00100000:1.0:1763343284.615525:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400066816 00010000:00010000:1.0:1763343284.615542:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a61ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4ae expref: 12 pid: 8414 timeout: 1177 lvb_type: 0 00000100:00100000:1.0:1763343284.615564:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3645 00000100:00100000:1.0:1763343284.615572:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2408:x1848998400066944:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343284.615588:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343284.615594:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6229 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4bc expref: 13 pid: 8414 timeout: 1177 lvb_type: 0 00010000:00010000:1.0:1763343284.615604:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6229 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4bc expref: 13 pid: 8414 timeout: 1177 lvb_type: 0 00010000:00010000:1.0:1763343284.615626:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6229 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4bc expref: 13 pid: 8414 timeout: 1177 lvb_type: 0 00010000:00010000:1.0:1763343284.615640:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343284.615642:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343284.615646:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a6292 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.615654:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a6292 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.615678:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343284.615728:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:2408:x1848998400066944:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 156us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343284.615736:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3645 00000100:00100000:1.0:1763343284.615754:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3646 00000100:00100000:1.0:1763343284.615760:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:2407:x1848998400066816:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343284.615770:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343284.615774:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a61ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4ae expref: 12 pid: 8414 timeout: 1177 lvb_type: 0 00010000:00010000:1.0:1763343284.615783:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a61ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4ae expref: 12 pid: 8414 timeout: 1177 lvb_type: 0 00010000:00010000:1.0:1763343284.615797:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a61ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4ae expref: 12 pid: 8414 timeout: 1177 lvb_type: 0 00010000:00010000:1.0:1763343284.615807:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343284.615808:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343284.615812:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a628b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.615818:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a628b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.615837:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343284.615857:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+11:2407:x1848998400066816:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 96us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343284.615863:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3646 00000100:00080000:1.0:1763343284.615881:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1763343284.615885:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1763343284.615899:0:28562:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a628b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.615908:0:28562:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a628b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.615918:0:28562:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a628b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.615926:0:28562:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a628b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.615942:0:28562:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343284.616236:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3661:x1848998413036288:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8354us (8960us total) trans 21474839379 rc 0/0 00000100:00100000:1.0:1763343284.616244:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7662 00010000:00010000:1.0:1763343284.616264:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343284.616270:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a628b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.616277:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343284.616282:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a628b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.616290:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a628b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.616302:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a628b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.616309:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a628b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.616329:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343284.616331:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343284.616332:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343284.616369:0:3661:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474839377 gen 2 00000004:00080000:1.0:1763343284.616374:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5a38700, transno 21474839365 00000004:00080000:1.0:1763343284.616383:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5a39880, transno 21474839366 00000004:00080000:1.0:1763343284.616386:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5a39180, transno 21474839367 00000004:00080000:1.0:1763343284.616388:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5a3b100, transno 21474839368 00000004:00080000:1.0:1763343284.616391:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5865180, transno 21474839369 00000004:00080000:1.0:1763343284.616393:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5865f80, transno 21474839370 00000004:00080000:1.0:1763343284.616395:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5867100, transno 21474839371 00000004:00080000:1.0:1763343284.616398:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5864380, transno 21474839372 00000004:00080000:1.0:1763343284.616400:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c511d500, transno 21474839374 00000004:00080000:1.0:1763343284.616402:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c511ed80, transno 21474839375 00000004:00080000:1.0:1763343284.616405:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c511c380, transno 21474839376 00000004:00080000:1.0:1763343284.616408:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b25180, transno 21474839377 00000100:00100000:1.0:1763343284.616414:0:3661:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9400cc5dc000 x1848998413036288/t21474839379(21474839379) o6->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1763343300 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1763343284.616427:0:3661:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400cc5dc000/2, rc 0, transno 21474839379 00000100:00100000:1.0:1763343284.616431:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400cc5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413036288:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1763343284.616552:0:8616:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 1 changes, 1 in progress, 0 in flight, 12 done 00010000:00010000:0.0:1763343284.616912:0:8626:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a6292 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343284.616922:0:8626:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a6292 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343284.616931:0:8626:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a6292 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343284.616942:0:8626:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a6292 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343284.616964:0:8626:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343284.618750:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343284.618762:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a6292 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.618773:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343284.618779:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a6292 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.618788:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a6292 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.618807:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a6292 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.618815:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5176c00/0x9104b1ba770a6292 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.618837:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343284.618839:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343284.618841:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343284.621491:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3662:x1848998413036416:12345-0@lo:6:osp-syn-1-1.0 Request processed in 12124us (12518us total) trans 17179872111 rc 0/0 00000100:00100000:1.0:1763343284.621504:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7663 00000100:00100000:0.0:1763343284.621603:0:3662:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179872109 gen 2 00000004:00080000:0.0:1763343284.621610:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc1a300, transno 17179872016 00000004:00080000:0.0:1763343284.621626:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc1a680, transno 17179872017 00000004:00080000:0.0:1763343284.621628:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc18000, transno 17179872018 00000004:00080000:0.0:1763343284.621630:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc18e00, transno 17179872019 00000004:00080000:0.0:1763343284.621633:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b27800, transno 17179872020 00000004:00080000:0.0:1763343284.621635:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b2d500, transno 17179872021 00000004:00080000:0.0:1763343284.621637:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b25500, transno 17179872022 00000004:00080000:0.0:1763343284.621639:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b26a00, transno 17179872023 00000004:00080000:0.0:1763343284.621642:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c7918a80, transno 17179872025 00000004:00080000:0.0:1763343284.621644:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c7919880, transno 17179872026 00000004:00080000:0.0:1763343284.621646:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c7919f80, transno 17179872027 00000004:00080000:0.0:1763343284.621648:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c7918e00, transno 17179872028 00000004:00080000:0.0:1763343284.621650:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f648b480, transno 17179872031 00000004:00080000:0.0:1763343284.621653:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6489500, transno 17179872032 00000004:00080000:0.0:1763343284.621655:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b2dc00, transno 17179872033 00000004:00080000:0.0:1763343284.621657:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b2e300, transno 17179872034 00000004:00080000:0.0:1763343284.621659:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b1a680, transno 17179872036 00000004:00080000:0.0:1763343284.621662:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b19c00, transno 17179872037 00000004:00080000:0.0:1763343284.621664:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b1b480, transno 17179872038 00000004:00080000:0.0:1763343284.621666:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b1b800, transno 17179872039 00000004:00080000:0.0:1763343284.621669:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6505180, transno 17179872042 00000004:00080000:0.0:1763343284.621671:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6507800, transno 17179872043 00000004:00080000:0.0:1763343284.621674:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bfd500, transno 17179872044 00000004:00080000:0.0:1763343284.621677:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bfd880, transno 17179872045 00000004:00080000:0.0:1763343284.621679:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5dcb800, transno 17179872049 00000004:00080000:0.0:1763343284.621682:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401edc1b480, transno 17179872050 00000004:00080000:0.0:1763343284.621684:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5950380, transno 17179872051 00000004:00080000:0.0:1763343284.621686:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5dcbb80, transno 17179872052 00000004:00080000:0.0:1763343284.621688:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6b56a00, transno 17179872053 00000004:00080000:0.0:1763343284.621691:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6b57b80, transno 17179872054 00000004:00080000:0.0:1763343284.621693:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c59b5500, transno 17179872056 00000004:00080000:0.0:1763343284.621696:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c59b4700, transno 17179872057 00000004:00080000:0.0:1763343284.621698:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c59b6a00, transno 17179872058 00000004:00080000:0.0:1763343284.621700:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b26300, transno 17179872059 00000004:00080000:0.0:1763343284.621702:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c59b7480, transno 17179872060 00000004:00080000:0.0:1763343284.621705:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c59b4a80, transno 17179872061 00000004:00080000:0.0:1763343284.621707:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b2ea00, transno 17179872063 00000004:00080000:0.0:1763343284.621709:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c8bc0000, transno 17179872064 00000004:00080000:0.0:1763343284.621712:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b2c380, transno 17179872065 00000004:00080000:0.0:1763343284.621714:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5b2df80, transno 17179872066 00000004:00080000:0.0:1763343284.621717:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5a3f100, transno 17179872068 00000004:00080000:0.0:1763343284.621719:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bfe680, transno 17179872069 00000004:00080000:0.0:1763343284.621722:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5a3e300, transno 17179872070 00000004:00080000:0.0:1763343284.621725:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5a3ed80, transno 17179872071 00000004:00080000:0.0:1763343284.621727:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5954000, transno 17179872073 00000004:00080000:0.0:1763343284.621729:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5955f80, transno 17179872074 00000004:00080000:0.0:1763343284.621731:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5957b80, transno 17179872075 00000004:00080000:0.0:1763343284.621734:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6401500, transno 17179872076 00000004:00080000:0.0:1763343284.621737:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6280a80, transno 17179872078 00000004:00080000:0.0:1763343284.621739:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6282300, transno 17179872079 00000004:00080000:0.0:1763343284.621741:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6282a00, transno 17179872080 00000004:00080000:0.0:1763343284.621743:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6283b80, transno 17179872081 00000004:00080000:0.0:1763343284.621746:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bfce00, transno 17179872083 00000004:00080000:0.0:1763343284.621748:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5bfc700, transno 17179872084 00000004:00080000:0.0:1763343284.621751:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c586d500, transno 17179872085 00000004:00080000:0.0:1763343284.621753:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c8bc2680, transno 17179872086 00000004:00080000:0.0:1763343284.621756:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c586dc00, transno 17179872089 00000004:00080000:0.0:1763343284.621758:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c586fb80, transno 17179872090 00000004:00080000:0.0:1763343284.621760:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c586b480, transno 17179872091 00000004:00080000:0.0:1763343284.621763:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c586aa00, transno 17179872092 00000004:00080000:0.0:1763343284.621766:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6506d80, transno 17179872096 00000004:00080000:0.0:1763343284.621768:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6505500, transno 17179872097 00000004:00080000:0.0:1763343284.621771:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6505880, transno 17179872098 00000004:00080000:0.0:1763343284.621773:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401f6504a80, transno 17179872099 00000004:00080000:0.0:1763343284.621775:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5869180, transno 17179872100 00000004:00080000:0.0:1763343284.621778:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5868380, transno 17179872101 00000004:00080000:0.0:1763343284.621780:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5868000, transno 17179872102 00000004:00080000:0.0:1763343284.621782:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c5868e00, transno 17179872103 00000004:00080000:0.0:1763343284.621795:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401efc71500, transno 17179872106 00000004:00080000:0.0:1763343284.621798:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401efc71180, transno 17179872107 00000004:00080000:0.0:1763343284.621800:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401efc70700, transno 17179872108 00000004:00080000:0.0:1763343284.621803:0:3662:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9401efc73800, transno 17179872109 00000100:00100000:0.0:1763343284.621810:0:3662:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9400c6b56300 x1848998413036416/t17179872111(17179872111) o6->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1763343300 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1763343284.621822:0:3662:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9400c6b56300/2, rc 0, transno 17179872111 00000100:00100000:0.0:1763343284.621827:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413036416:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1763343284.622400:0:9930:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 1 changes, 1 in progress, 0 in flight, 72 done 00000001:02000400:1.0:1763343284.625377:0:35481:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 70a: flr mode fsx test ================ 20:34:42 (1763343282) 00000100:00100000:1.0:1763343284.732318:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343284.734189:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400067072 00000100:00100000:2.0:1763343284.734202:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400067072 00000100:00100000:2.0:1763343284.734279:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11180 00000100:00100000:2.0:1763343284.734290:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:57808:x1848998400067072:12345-192.168.201.40@tcp:41:stat.0 00000004:00000024:2.0:1763343284.734343:0:9827:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 7839416320 avail 7376257024 00000100:00100000:2.0:1763343284.734422:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:57808:x1848998400067072:12345-192.168.201.40@tcp:41:stat.0 Request processed in 134us (2116us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343284.734431:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11180 00000100:00080000:2.0:1763343284.734456:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1763343284.768263:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343284.768320:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400067200 00000100:00100000:2.0:1763343284.768331:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400067200 00000100:00100000:2.0:1763343284.768397:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11181 00000100:00100000:2.0:1763343284.768407:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:57816:x1848998400067200:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343284.768428:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343284.768449:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88000/0x9104b1ba770a6299 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a4d8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343284.768518:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89e00/0x9104b1ba770a62a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343284.768533:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89e00/0x9104b1ba770a62a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343284.768544:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89e00/0x9104b1ba770a62a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343284.768558:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88a00/0x9104b1ba770a62a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343284.768565:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88a00/0x9104b1ba770a62a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343284.768571:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88a00/0x9104b1ba770a62a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343284.768613:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89e00/0x9104b1ba770a62a0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343284.768620:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89e00/0x9104b1ba770a62a0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343284.768626:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89e00/0x9104b1ba770a62a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343284.768633:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89e00/0x9104b1ba770a62a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343284.768638:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343284.768642:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89e00/0x9104b1ba770a62a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343284.768648:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89e00/0x9104b1ba770a62a0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343284.768659:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9400c4759e00) 00010000:00010000:2.0:1763343284.768662:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343284.768666:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89e00/0x9104b1ba770a62a0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343284.768672:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89e00/0x9104b1ba770a62a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343284.768685:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88a00/0x9104b1ba770a62a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343284.768691:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88a00/0x9104b1ba770a62a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343284.768697:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88a00/0x9104b1ba770a62a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343284.768701:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343284.768704:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88a00/0x9104b1ba770a62a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343284.768710:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88a00/0x9104b1ba770a62a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343284.768717:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x85409d3b (ffff9400c6733c00) 00010000:00010000:2.0:1763343284.768719:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343284.768722:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88a00/0x9104b1ba770a62a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343284.768728:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88a00/0x9104b1ba770a62a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343284.768759:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88000/0x9104b1ba770a6299 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4d8 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343284.768769:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9400c4759e00) 00010000:00010000:2.0:1763343284.768771:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343284.768774:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88000/0x9104b1ba770a6299 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4d8 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343284.768783:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88000, rc 0) 00000100:00100000:2.0:1763343284.768845:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:57816:x1848998400067200:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 438us (593us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343284.768853:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11181 00000100:00100000:2.0:1763343284.781351:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343284.781417:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400067456 00000100:00100000:3.0:1763343284.781428:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400067456 00000100:00100000:3.0:1763343284.781493:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11182 00000100:00100000:3.0:1763343284.781505:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:57816:x1848998400067456:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:3.0:1763343284.781565:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343284.782234:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c8692000/0x9104b1ba7707e6d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b3d731 expref: 18 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343284.782258:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9400c4759e00) 00010000:00010000:3.0:1763343284.782263:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343284.782330:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a2000/0x9104b1ba770a62ae lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.782344:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a2000/0x9104b1ba770a62ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.782355:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a2000/0x9104b1ba770a62ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.782373:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a2e00/0x9104b1ba770a62b5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x85409d3b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.782379:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a2e00/0x9104b1ba770a62b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.782386:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a2e00/0x9104b1ba770a62b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00000040:00080000:3.0:1763343284.783358:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x2:0x0].12, 2160 off44056 00000040:00080000:3.0:1763343284.783446:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000405:0x2:0x0].5, 2360 off42624 00000004:00080000:3.0:1763343284.783454:0:6524:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9401f6422900 with version 15 00000004:00080000:2.0:1763343284.783532:0:32315:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9401cc128c00 version 15 rpc_version 15 00000020:00100000:2.0:1763343284.783570:0:32315:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1763343284.783580:0:32315:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9400c7919880 x1848998413036928/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4224/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1763343284.783603:0:32315:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c7919880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:32315:1848998413036928:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1763343284.783663:0:32315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343284.783714:0:7640:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413036928 00000100:00100000:1.0:1763343284.783723:0:7640:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413036928 00000100:00100000:2.0:1763343284.783726:0:32315:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c601f240 going to sleep for 11 seconds 00000100:00100000:1.0:1763343284.783768:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:1.0:1763343284.783778:0:7640:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:32315:x1848998413036928:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1763343284.784312:0:7640:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:32315:x1848998413036928:12345-0@lo:1000:osp_up1-0.0 Request processed in 534us (646us total) trans 4294974086 rc 0/0 00000100:00100000:1.0:1763343284.784320:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00100000:2.0:1763343284.784443:0:32315:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c7919880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:32315:1848998413036928:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1763343284.787439:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a3000/0x9104b1ba770a62bc lrc: 3/0,1 mode: --/PW res: [0x200000405:0x50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.787459:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a3000/0x9104b1ba770a62bc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.787470:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a3000/0x9104b1ba770a62bc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.787488:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a62c3 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.787494:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a62c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.787499:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a62c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.787547:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9400c6b98200/0x9104b1ba770a62ca lrc: 3/0,1 mode: --/PW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.787554:0:6524:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9400c6b98200/0x9104b1ba770a62ca lrc: 3/0,1 mode: --/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.787565:0:6524:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9400c6b98200/0x9104b1ba770a62ca lrc: 3/0,1 mode: --/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6524 initiator: MDT0 00000100:00100000:3.0:1763343284.787589:0:6524:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5a39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6524:1848998413037056:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1763343284.787653:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343284.787707:0:6524:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401d84dec00 going to sleep for 11 seconds 00000100:00100000:2.0:1763343284.789715:0:6530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413037056 00000100:00100000:2.0:1763343284.789729:0:6530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413037056 00000100:00100000:2.0:1763343284.789799:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:2.0:1763343284.789810:0:6530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6524:x1848998413037056:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1763343284.789835:0:6530:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343284.789861:0:6530:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a62d1 lrc: 2/0,0 mode: --/PW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9104b1ba770a62ca expref: -99 pid: 6530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343284.789897:0:6530:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a62d1 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x9104b1ba770a62ca expref: 7 pid: 6530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343284.789912:0:6530:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a62d1 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9104b1ba770a62ca expref: 7 pid: 6530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343284.789921:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff9400c6733c00) 00010000:00010000:2.0:1763343284.789924:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343284.789928:0:6530:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88000, rc 0) 00000100:00100000:2.0:1763343284.790008:0:6530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6524:x1848998413037056:12345-0@lo:101:mdt00_000.0 Request processed in 199us (2354us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343284.790016:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00100000:3.0:1763343284.790075:0:6524:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5a39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6524:1848998413037056:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1763343284.790106:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9400c6b98200/0x9104b1ba770a62ca lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9104b1ba770a62d1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343284.790120:0:6524:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9400c6b98200/0x9104b1ba770a62ca lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9104b1ba770a62d1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1763343284.790148:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000219c534f reply state 00000000b47f70ae transno 8589935386 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a62c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.790160:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a62c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.790166:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff9401f669e400) 00010000:00010000:3.0:1763343284.790168:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343284.790171:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343284.790177:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9400c6b98200/0x9104b1ba770a62ca lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9104b1ba770a62d1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343284.790183:0:6524:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9400c6b98200/0x9104b1ba770a62ca lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9104b1ba770a62d1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763343284.790194:0:6524:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x240000405:0x6:0x0] 00000004:00010000:3.0:1763343284.790200:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000219c534f reply state 00000000b47f70ae transno 8589935386 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a3000/0x9104b1ba770a62bc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.790208:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a3000/0x9104b1ba770a62bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.790213:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x50:0x0].0x0 (ffff9401f669e300) 00010000:00010000:3.0:1763343284.790216:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343284.790218:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1763343284.790222:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x50:0x0]: returning size 4096 00010000:00010000:3.0:1763343284.790233:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a2000/0x9104b1ba770a62ae lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.790238:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a2000/0x9104b1ba770a62ae lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.790243:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a2000/0x9104b1ba770a62ae lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.790249:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a2000/0x9104b1ba770a62ae lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.790255:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a2000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343284.790259:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a2000/0x9104b1ba770a62ae lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.790266:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a2000/0x9104b1ba770a62ae lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.790276:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9400c4759e00) 00010000:00010000:3.0:1763343284.790278:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343284.790281:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a2000/0x9104b1ba770a62ae lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.790287:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a2000/0x9104b1ba770a62ae lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00000004:00010000:3.0:1763343284.790301:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000219c534f reply state 00000000b47f70ae transno 8589935386 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a2e00/0x9104b1ba770a62b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.790309:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a2e00/0x9104b1ba770a62b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.790315:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x85409d3b (ffff9401f669ec00) 00010000:00010000:3.0:1763343284.790317:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343284.790320:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1763343284.792769:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:57816:x1848998400067456:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 11245us (11408us total) trans 8589935386 rc 0/0 00000100:00100000:3.0:1763343284.792782:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11182 00000100:00100000:1.0:1763343284.812766:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343284.812825:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400067584 00000100:00100000:3.0:1763343284.812835:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400067584 00000100:00100000:3.0:1763343284.813606:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11183 00000100:00100000:3.0:1763343284.813620:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:57820:x1848998400067584:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343284.813645:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343284.813670:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a2000/0x9104b1ba770a62d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a4df expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343284.813743:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2df600/0x9104b1ba770a62df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.813894:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2df600/0x9104b1ba770a62df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.813905:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2df600/0x9104b1ba770a62df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00000004:00200000:3.0:1763343284.813947:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1763343284.813952:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343284.813971:0:6524:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2df600/0x9104b1ba770a62df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.813993:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a2000/0x9104b1ba770a62d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4df expref: 21 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343284.814012:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2df600/0x9104b1ba770a62df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4df expref: 20 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343284.814020:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9400c4759e00) 00010000:00010000:3.0:1763343284.814023:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763343284.814875:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fd2df600, rc 0) 00000100:00100000:3.0:1763343284.814957:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:57820:x1848998400067584:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1340us (2198us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343284.814965:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11183 00000100:00100000:0.0:1763343284.817564:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343284.817723:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400067712 00000100:00100000:3.0:1763343284.817735:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400067712 00000100:00100000:3.0:1763343284.817798:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11184 00000100:00100000:3.0:1763343284.817809:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:57820:x1848998400067712:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343284.817832:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343284.817857:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2dea00/0x9104b1ba770a62e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a4e6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343284.817936:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a62ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.817950:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a62ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.817960:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a62ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.817972:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c3917000/0x9104b1ba770a62f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.817980:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c3917000/0x9104b1ba770a62f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.817986:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c3917000/0x9104b1ba770a62f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.818107:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c3916200/0x9104b1ba770a62fb lrc: 3/1,0 mode: --/PR res: [0x200000405:0x50:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.818116:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c3916200/0x9104b1ba770a62fb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.818122:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c3916200/0x9104b1ba770a62fb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00000004:00200000:3.0:1763343284.818195:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x50:0x0]: returning size 4096 00000004:00200000:3.0:1763343284.818200:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1763343284.818218:0:6524:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9400c3916200/0x9104b1ba770a62fb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.818229:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a62ed lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.818235:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a62ed lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.818240:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a62ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.818246:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a62ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.818255:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fd2dfa00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343284.818259:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a62ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.818267:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a62ed lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.818280:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9400c4759e00) 00010000:00010000:3.0:1763343284.818282:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343284.818287:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a62ed lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.818293:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a62ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.818305:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c3917000/0x9104b1ba770a62f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.818310:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c3917000/0x9104b1ba770a62f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.818315:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c3917000/0x9104b1ba770a62f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.818320:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343284.818323:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c3917000/0x9104b1ba770a62f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.818328:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c3917000/0x9104b1ba770a62f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.818334:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x85409d3b (ffff9401f669ec00) 00010000:00010000:3.0:1763343284.818337:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343284.818340:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c3917000/0x9104b1ba770a62f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.818344:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c3917000/0x9104b1ba770a62f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.818370:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2dea00/0x9104b1ba770a62e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4e6 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343284.818399:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c3916200/0x9104b1ba770a62fb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4e6 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343284.818405:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x50:0x0].0x0 (ffff9401f669e300) 00010000:00010000:3.0:1763343284.818407:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1763343284.818410:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3916200, rc 0) 00000100:00100000:3.0:1763343284.818491:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:57820:x1848998400067712:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 683us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343284.818499:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11184 00000100:00100000:2.0:1763343284.822167:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343284.822278:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400067840 00000100:00100000:1.0:1763343284.822289:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400067840 00000100:00100000:1.0:1763343284.822991:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11185 00000100:00100000:1.0:1763343284.823004:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c7918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:57820:x1848998400067840:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343284.823253:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343284.823275:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a6302 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a4ed expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.823331:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a6309 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.823344:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a6309 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.823354:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a6309 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00000004:00200000:1.0:1763343284.823940:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x6:0x0]: returning size 4096 00000004:00200000:1.0:1763343284.823946:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763343284.823985:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a6302 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4ed expref: 23 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.824003:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a6309 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4ed expref: 22 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.824011:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff9401f669e400) 00010000:00010000:1.0:1763343284.824013:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343284.824017:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176a00, rc 0) 00000100:00100000:1.0:1763343284.824347:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c7918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:57820:x1848998400067840:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1346us (2189us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343284.824359:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11185 00000100:00100000:2.0:1763343284.828609:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343284.828833:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400067968 00000100:00100000:1.0:1763343284.828846:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400067968 00000100:00100000:1.0:1763343284.828924:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11186 00000100:00100000:1.0:1763343284.828935:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+307:57820:x1848998400067968:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343284.828960:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343284.828982:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a6310 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a4f4 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.829085:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a6317 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00000100:00080000:2.0:1763343284.829099:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1763343284.829109:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a62d1 lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9104b1ba770a62ca expref: 6 pid: 6530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.829119:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a6317 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT1 00010000:00010000:1.0:1763343284.829160:0:9827:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a62d1 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x9104b1ba770a62ca expref: 6 pid: 6530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343284.829178:0:9827:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c8bc0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998413037184:0@lo:104: 00000100:00100000:1.0:1763343284.829229:0:9827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343284.829274:0:9827:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eca1ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1763343284.829358:0:6507:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413037184 00000100:00100000:0.0:1763343284.829363:0:6507:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413037184 00000100:00100000:0.0:1763343284.829403:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1763343284.829412:0:6507:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:9827:x1848998413037184:12345-0@lo:104: 00010000:00010000:0.0:1763343284.829424:0:6507:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9400c6b98200/0x9104b1ba770a62ca lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x9104b1ba770a62d1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343284.829486:0:6507:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1763343284.829493:0:6507:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:9827:x1848998413037184:12345-0@lo:104: Request processed in 82us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343284.829501:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00010000:0.0:1763343284.829526:0:35284:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343284.829533:0:35284:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9400c6b98200/0x9104b1ba770a62ca lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x9104b1ba770a62d1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343284.829542:0:35284:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b98200 already unused, calling callback (ffffffffc18ea290) 00010000:00010000:0.0:1763343284.829548:0:35284:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9400c6b98200/0x9104b1ba770a62ca lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x9104b1ba770a62d1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1763343284.829558:0:35284:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9400c6b98200/0x9104b1ba770a62ca lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x9104b1ba770a62d1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343284.829561:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c8bc0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9827:1848998413037184:0@lo:104: 00010000:00010000:3.0:1763343284.829588:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a6317 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:0.0:1763343284.829590:0:35284:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9400c6b98200/0x9104b1ba770a62ca lrc: 2/0,0 mode: --/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x9104b1ba770a62d1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343284.829606:0:35284:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1763343284.829642:0:35284:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9400c6b98200/0x9104b1ba770a62ca lrc: 1/0,0 mode: --/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x9104b1ba770a62d1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343284.829650:0:35284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9400c6b98200/0x9104b1ba770a62ca lrc: 0/0,0 mode: --/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x9104b1ba770a62d1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343284.829656:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6b54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1848998413037312:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1763343284.829674:0:35284:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343284.829679:0:35284:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343284.829683:0:35284:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343284.829691:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343284.829721:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413037312 00000100:00100000:2.0:1763343284.829728:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413037312 00010000:00010000:2.0:1763343284.829749:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a62d1 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x9104b1ba770a62ca expref: 7 pid: 6530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343284.829782:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3647 00000100:00100000:2.0:1763343284.829789:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3659:x1848998413037312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1763343284.829799:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1763343284.831607:0:7443:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974086 is committed 00010000:00010000:2.0:1763343284.831724:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a62d1 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x9104b1ba770a62ca expref: 6 pid: 6530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343284.831744:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff9400c6733c00) 00010000:00010000:2.0:1763343284.831749:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a6317 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343284.831759:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a6317 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343284.831765:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a6317 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT1 00010000:00010000:2.0:1763343284.831795:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343284.831862:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a6317 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:2.0:1763343284.831873:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+5:3659:x1848998413037312:12345-0@lo:103:ldlm_bl.0 Request processed in 2081us (2180us total) trans 0 rc 0/0 00010000:00010000:1.0:1763343284.831878:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a6317 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT1 00000100:00100000:2.0:1763343284.831896:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3647 00000100:00100000:3.0:1763343284.832002:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6b54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1848998413037312:0@lo:103:ldlm_bl.0 00000004:00200000:1.0:1763343284.832123:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x6:0x0]: returning size 4096 00000004:00200000:1.0:1763343284.832129:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763343284.832175:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a6310 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4f4 expref: 309 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.832190:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a6317 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4f4 expref: 308 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.832198:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff9400c6733c00) 00010000:00010000:1.0:1763343284.832201:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343284.832204:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176200, rc 0) 00000100:00100000:1.0:1763343284.832263:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57820:x1848998400067968:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3329us (3664us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343284.832270:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11186 00000100:00100000:0.0:1763343284.836206:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343284.836257:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400068096 00000100:00100000:1.0:1763343284.836269:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400068096 00000100:00100000:1.0:1763343284.836596:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11187 00000100:00100000:1.0:1763343284.836608:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:57820:x1848998400068096:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343284.836627:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343284.836654:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a631e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a4fb expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.836720:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177200/0x9104b1ba770a6325 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.836743:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177200/0x9104b1ba770a6325 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.836753:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177200/0x9104b1ba770a6325 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.836880:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a632c lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.836889:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a632c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.836896:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a632c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.836961:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177200/0x9104b1ba770a6325 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.836968:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177200/0x9104b1ba770a6325 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.836974:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177200/0x9104b1ba770a6325 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.836980:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177200/0x9104b1ba770a6325 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.836985:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343284.836989:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177200/0x9104b1ba770a6325 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.837002:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177200/0x9104b1ba770a6325 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.837018:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff9401f669e400) 00010000:00010000:1.0:1763343284.837021:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343284.837046:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177200/0x9104b1ba770a6325 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.837053:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177200/0x9104b1ba770a6325 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.837065:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a632c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.837069:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a632c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.837074:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a632c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.837080:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343284.837083:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a632c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.837090:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a632c lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.837110:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0xdd396665 (ffff9401fc4f1400) 00010000:00010000:1.0:1763343284.837113:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343284.837116:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a632c lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.837121:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a632c lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.837153:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a631e lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4fb expref: 23 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.837163:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff9401f669e400) 00010000:00010000:1.0:1763343284.837165:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343284.837168:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a631e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4fb expref: 23 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.837177:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177e00, rc 0) 00000100:00100000:1.0:1763343284.837237:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:57820:x1848998400068096:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 632us (1041us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343284.837245:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11187 00000100:00100000:2.0:1763343284.842251:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343284.842689:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400068224 00000100:00100000:1.0:1763343284.842699:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400068224 00000100:00100000:1.0:1763343284.842767:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11188 00000100:00100000:1.0:1763343284.842778:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:57820:x1848998400068224:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343284.842799:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343284.842822:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176400/0x9104b1ba770a6333 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a502 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.842894:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a633a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x50:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.842909:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a633a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.842920:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a633a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00000004:00200000:1.0:1763343284.843277:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x50:0x0]: returning size 4096 00000004:00200000:1.0:1763343284.843281:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1763343284.843300:0:9827:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a633a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.843326:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176400/0x9104b1ba770a6333 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a502 expref: 24 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.843344:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176c00/0x9104b1ba770a633a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x50:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a502 expref: 23 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.843352:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x50:0x0].0x0 (ffff9401f669e300) 00010000:00010000:1.0:1763343284.843355:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1763343284.843359:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176c00, rc 0) 00000100:00100000:1.0:1763343284.843425:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:57820:x1848998400068224:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 649us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343284.843432:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11188 00000100:00100000:2.0:1763343284.848367:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343284.852101:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400068480 00000100:00100000:1.0:1763343284.852115:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400068480 00000100:00100000:1.0:1763343284.852185:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11189 00000100:00100000:1.0:1763343284.852194:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:57820:x1848998400068480:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343284.852213:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343284.852217:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343284.852244:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a6309 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4ed expref: 23 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.852262:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff9401f669e400) 00010000:00010000:1.0:1763343284.852268:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343284.852281:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a6341 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a509 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.852382:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6348 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.852395:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6348 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.852404:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6348 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.852418:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177800/0x9104b1ba770a634f lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.852425:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177800/0x9104b1ba770a634f lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.852430:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177800/0x9104b1ba770a634f lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.854002:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a6356 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.854662:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a6356 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.854680:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a6356 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00000004:00200000:1.0:1763343284.854691:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x51:0x0]: returning size 0 00010000:00010000:1.0:1763343284.854723:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6348 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.854729:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6348 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.854739:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6348 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.854745:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6348 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.854751:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343284.854756:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6348 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.854763:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6348 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.855623:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff9401f669e400) 00010000:00010000:1.0:1763343284.855628:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343284.855636:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6348 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.855644:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6348 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00000004:00010000:1.0:1763343284.855660:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001824f489 reply state 000000000d243b58 transno 8589935387 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177800/0x9104b1ba770a634f lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.855672:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177800/0x9104b1ba770a634f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.855678:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0xdd396665 (ffff9401fc4f1600) 00010000:00010000:1.0:1763343284.855680:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343284.855683:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343284.855729:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a6341 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a509 expref: 25 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.855748:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a6356 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a509 expref: 24 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.855755:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:1.0:1763343284.855757:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343284.855759:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177e00, rc 0) 00000100:00100000:1.0:1763343284.855852:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:57820:x1848998400068480:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3658us (7900us total) trans 8589935387 rc 0/0 00000100:00100000:1.0:1763343284.855862:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11189 00000100:00100000:0.0:1763343284.859495:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343284.859635:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400068736 00000100:00100000:1.0:1763343284.859653:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400068736 00000100:00100000:1.0:1763343284.859736:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11190 00000100:00100000:1.0:1763343284.859745:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:57820:x1848998400068736:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343284.859773:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343284.859795:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176400/0x9104b1ba770a6364 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a510 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.859911:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a636b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.859926:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a6356 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a509 expref: 26 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.859935:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a636b lrc: 4/0,1 mode: --/EX res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.859968:0:9827:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a6356 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a509 expref: 26 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.859987:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a6356 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a509 expref: 26 pid: 9827 timeout: 1177 lvb_type: 0 00000100:00100000:1.0:1763343284.860000:0:9827:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c8bc0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9827:1848998413037440:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343284.860124:0:9827:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401cc046d80 going to sleep for 11 seconds 00000100:00100000:2.0:1763343284.869610:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343284.869744:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c8bc0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9827:1848998413037440:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343284.869780:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a636b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00000100:00100000:3.0:1763343284.870671:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400068864 00000100:00100000:3.0:1763343284.870679:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400068864 00010000:00010000:2.0:1763343284.870765:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a6356 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a509 expref: 27 pid: 9827 timeout: 1177 lvb_type: 0 00000100:00100000:2.0:1763343284.870810:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3648 00000100:00100000:2.0:1763343284.870821:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2407:x1848998400068864:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343284.870835:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343284.870842:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a6356 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a509 expref: 27 pid: 9827 timeout: 1177 lvb_type: 0 00010000:00010000:2.0:1763343284.870854:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a6356 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a509 expref: 27 pid: 9827 timeout: 1177 lvb_type: 0 00010000:00010000:2.0:1763343284.870875:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a6356 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a509 expref: 27 pid: 9827 timeout: 1177 lvb_type: 0 00010000:00010000:2.0:1763343284.870893:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343284.870898:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a636b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343284.870907:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a636b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343284.870914:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a636b lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343284.870947:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343284.871010:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2407:x1848998400068864:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 190us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343284.871018:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3648 00010000:00010000:1.0:1763343284.871667:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a636b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.871676:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a636b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00000004:00200000:1.0:1763343284.871702:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x51:0x0]: returning size 0 00000004:00080000:1.0:1763343284.871957:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x77:0x0], index 1: 0 00000004:00080000:1.0:1763343284.871964:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x95:0x0], index 0: 0 00010000:00010000:1.0:1763343284.872119:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a636b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.872128:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a636b lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.872135:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a636b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.872142:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343284.872146:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a636b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.872155:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a636b lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.872168:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:1.0:1763343284.872171:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343284.872174:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a636b lrc: 2/0,0 mode: --/EX res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.872180:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a636b lrc: 0/0,0 mode: --/EX res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.872230:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176400/0x9104b1ba770a6364 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a510 expref: 26 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.872349:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:1.0:1763343284.872352:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343284.872356:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176400/0x9104b1ba770a6364 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a510 expref: 26 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.872370:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176400, rc 0) 00000100:00100000:1.0:1763343284.872738:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:57820:x1848998400068736:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 12993us (13252us total) trans 8589935388 rc 301/301 00000100:00100000:1.0:1763343284.872747:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11190 00000100:00100000:2.0:1763343284.877176:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343284.877286:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400069120 00000100:00100000:0.0:1763343284.877298:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400069120 00000100:00100000:0.0:1763343284.877356:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3961 00000100:00100000:0.0:1763343284.877367:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:57820:x1848998400069120:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343284.879703:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:57820:x1848998400069120:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 2321us (2519us total) trans 8589935389 rc 0/0 00000100:00100000:0.0:1763343284.879720:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3961 00000100:00100000:2.0:1763343284.882415:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343284.882633:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400069376 00000100:00100000:0.0:1763343284.882643:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400069376 00000100:00100000:0.0:1763343284.882710:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3962 00000100:00100000:0.0:1763343284.882721:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:57820:x1848998400069376:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343284.883699:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:57820:x1848998400069376:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 976us (1287us total) trans 8589935390 rc 0/0 00000100:00100000:0.0:1763343284.883710:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3962 00000100:00100000:3.0:1763343284.942332:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343284.942527:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400069632 00000100:00100000:1.0:1763343284.942537:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400069632 00000100:00100000:1.0:1763343284.942602:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11191 00000100:00100000:1.0:1763343284.942613:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:57821:x1848998400069632:12345-192.168.201.40@tcp:101:fsx.0 00010000:00010000:1.0:1763343284.942641:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343284.942665:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176400/0x9104b1ba770a6379 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a517 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.942797:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a6380 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.942811:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a6380 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.942823:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a6380 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.942834:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a6387 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.942841:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a6387 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.942848:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a6387 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.942904:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a638e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.942912:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a638e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.942918:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a638e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00000004:00200000:1.0:1763343284.942929:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x51:0x0]: returning size 0 00010000:00010000:1.0:1763343284.943008:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a6380 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.943015:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a6380 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.943356:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a6380 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.943366:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a6380 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.943373:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343284.943378:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a6380 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.943386:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a6380 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.943398:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff9401f669e400) 00010000:00010000:1.0:1763343284.943402:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343284.943408:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a6380 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.943414:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a6380 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.943430:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a6387 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.943436:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a6387 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.943442:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a6387 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.943446:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343284.943449:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a6387 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.943457:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a6387 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.943464:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0xdd396665 (ffff9401fc4f1600) 00010000:00010000:1.0:1763343284.943466:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343284.943468:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a6387 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.943475:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a6387 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.943530:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176400/0x9104b1ba770a6379 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a517 expref: 30 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.943543:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a638e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a517 expref: 29 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.943551:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:1.0:1763343284.943553:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343284.943556:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176000, rc 0) 00000100:00100000:1.0:1763343284.943627:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:57821:x1848998400069632:12345-192.168.201.40@tcp:101:fsx.0 Request processed in 1015us (1309us total) trans 8589935391 rc 0/0 00000100:00100000:1.0:1763343284.943635:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11191 00000100:00100000:2.0:1763343284.946366:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343284.946466:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400069760 00000100:00100000:1.0:1763343284.946477:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400069760 00000100:00100000:1.0:1763343284.946649:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11192 00000100:00100000:1.0:1763343284.946660:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c9833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:57821:x1848998400069760:12345-192.168.201.40@tcp:101:fsx.0 00010000:00010000:1.0:1763343284.946684:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343284.946704:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a639c lrc: 2/0,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a51e expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.946736:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177200/0x9104b1ba770a63a3 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.946749:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177200/0x9104b1ba770a63a3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.946759:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177200/0x9104b1ba770a63a3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.946876:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a639c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a51e expref: 31 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.946894:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177200/0x9104b1ba770a63a3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a51e expref: 30 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.946903:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:1.0:1763343284.946906:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343284.946909:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177200, rc 0) 00000100:00100000:1.0:1763343284.950157:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c9833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+30:57821:x1848998400069760:12345-192.168.201.40@tcp:101:fsx.0 Request processed in 3482us (3785us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343284.950174:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11192 00000100:00100000:2.0:1763343284.951019:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343284.951285:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400070016 00000100:00100000:1.0:1763343284.951297:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400070016 00000100:00100000:1.0:1763343284.951355:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11193 00000100:00100000:1.0:1763343284.951367:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+30:57821:x1848998400070016:12345-192.168.201.40@tcp:36:fsx.0 00010000:00010000:1.0:1763343284.951431:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343284.951464:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a638e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a517 expref: 30 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.951488:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:1.0:1763343284.951493:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343284.951676:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a63aa lrc: 3/0,1 mode: --/PW res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.951692:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a63aa lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.951702:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a63aa lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00000001:00080000:1.0:1763343284.951751:0:9827:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935392 00000004:00010000:1.0:1763343284.951774:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c0bcf857 reply state 00000000b8d1ff7b transno 8589935393 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a63aa lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.951786:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a63aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.951793:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:1.0:1763343284.951796:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343284.951798:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343284.951892:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+32:57821:x1848998400070016:12345-192.168.201.40@tcp:36:fsx.0 Request processed in 528us (875us total) trans 8589935393 rc 0/0 00000100:00100000:1.0:1763343284.951899:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11193 00000020:00080000:1.0:1763343284.951905:0:9827:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763343284.954627:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343284.954736:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400070144 00000100:00100000:1.0:1763343284.954748:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400070144 00000100:00100000:1.0:1763343284.954846:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11194 00000100:00100000:1.0:1763343284.954858:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+32:57821:x1848998400070144:12345-192.168.201.40@tcp:101:fsx.0 00010000:00010000:1.0:1763343284.954893:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343284.954923:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176400/0x9104b1ba770a63b1 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a525 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.955019:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176400/0x9104b1ba770a63b1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a525 expref: 33 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.955196:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176400/0x9104b1ba770a63b1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a525 expref: 33 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.955220:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:1.0:1763343284.955224:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343284.955228:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176400, rc 0) 00000100:00100000:1.0:1763343284.955322:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+33:57821:x1848998400070144:12345-192.168.201.40@tcp:101:fsx.0 Request processed in 465us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343284.955330:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11194 00000100:00100000:2.0:1763343284.963240:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343284.964704:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400070272 00000100:00100000:1.0:1763343284.964718:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400070272 00000100:00100000:0.0:1763343284.964927:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7664 00000100:00100000:0.0:1763343284.964941:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:57821:x1848998400070272:12345-192.168.201.40@tcp:101:fsx.0 00010000:00010000:0.0:1763343284.964959:0:8626:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343284.964982:0:8626:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a63b8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a52c expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343284.965006:0:8626:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x77:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343284.965049:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343284.965053:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343284.965062:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a63b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a52c expref: 13 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343284.965080:0:8626:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a63b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a52c expref: 13 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343284.965104:0:8626:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501a800, rc 0) 00000100:00100000:0.0:1763343284.965444:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:57821:x1848998400070272:12345-192.168.201.40@tcp:101:fsx.0 Request processed in 505us (2219us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343284.965453:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7664 00000100:00100000:2.0:1763343284.969248:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343284.970953:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400070400 00000100:00100000:3.0:1763343284.970967:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400070400 00000100:00100000:3.0:1763343284.971627:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7665 00000100:00100000:3.0:1763343284.971639:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+11:57821:x1848998400070400:12345-192.168.201.40@tcp:101:fsx.0 00010000:00010000:3.0:1763343284.971657:0:8626:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343284.971678:0:8626:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c3917000/0x9104b1ba770a63bf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a533 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343284.971700:0:8626:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343284.971721:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343284.971723:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343284.971731:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c3917000/0x9104b1ba770a63bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a533 expref: 12 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343284.971749:0:8626:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c3917000/0x9104b1ba770a63bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a533 expref: 12 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343284.971761:0:8626:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c3917000, rc 0) 00000100:00100000:3.0:1763343284.971945:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:57821:x1848998400070400:12345-192.168.201.40@tcp:101:fsx.0 Request processed in 308us (2705us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343284.971953:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7665 00000100:00100000:2.0:1763343284.974772:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343284.974813:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343284.974881:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400070528 00000100:00100000:1.0:1763343284.974892:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400070528 00002000:00010000:1.0:1763343284.974935:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/119 (0->18446744073709551615) 00002000:00100000:1.0:1763343284.974941:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6276d80 with x1848998400070528 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343284.974954:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c6276d80. 00000100:00100000:1.0:1763343284.974987:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400070656 00000100:00100000:1.0:1763343284.974991:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400070656 00002000:00010000:1.0:1763343284.975004:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:1.0:1763343284.975007:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6274700 with x1848998400070656 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343284.975013:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c6274700. 00000100:00100000:1.0:1763343284.975064:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1809 00000100:00100000:1.0:1763343284.975076:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6276d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2409:x1848998400070528:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:1.0:1763343284.975312:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343284.975315:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 0 -> 1763343284 00002000:00010000:1.0:1763343284.975318:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343284.975320:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 0 -> 1763343284 00002000:00010000:1.0:1763343284.975323:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343284.975380:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6276d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2409:x1848998400070528:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 306us (617us total) trans 17179872112 rc 0/0 00000100:00100000:1.0:1763343284.975388:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1809 00002000:00010000:1.0:1763343284.975392:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/119 (0->18446744073709551615) 00002000:00100000:1.0:1763343284.975395:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6276d80 with x1848998400070528 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343284.975399:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c6276d80. 00000100:00100000:1.0:1763343284.975416:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1810 00000100:00100000:1.0:1763343284.975424:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6274700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+12:2410:x1848998400070656:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:1.0:1763343284.976868:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343284.976877:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 0 -> 1763343284 00002000:00010000:1.0:1763343284.976879:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343284.976881:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 0 -> 1763343284 00002000:00010000:1.0:1763343284.976883:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343284.976940:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6274700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2410:x1848998400070656:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 1514us (2122us total) trans 21474839380 rc 0/0 00000100:00100000:1.0:1763343284.976950:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1810 00002000:00010000:1.0:1763343284.976956:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:1.0:1763343284.976959:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6274700 with x1848998400070656 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343284.976977:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c6274700. 00000100:00100000:2.0:1763343284.982683:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343284.982875:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400070912 00000100:00100000:1.0:1763343284.982886:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400070912 00000100:00100000:1.0:1763343284.982949:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11195 00000100:00100000:1.0:1763343284.982959:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+33:57821:x1848998400070912:12345-192.168.201.40@tcp:101:fsx.0 00010000:00010000:1.0:1763343284.982979:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343284.983000:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a63c6 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a53a expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.983149:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a63cd lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.983164:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a63cd lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.983175:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a63cd lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.983188:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a63d4 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.983194:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a63d4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.983201:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a63d4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00000004:00080000:1.0:1763343284.983545:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x78:0x0], index 1: 0 00010000:00010000:1.0:1763343284.983701:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a63db lrc: 3/1,0 mode: --/PR res: [0x200000405:0x53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.983712:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a63db lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.983719:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a63db lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.983756:0:9827:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a63cd lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.983763:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a63cd lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.983768:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a63cd lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.983774:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a63cd lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.983780:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343284.983784:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a63cd lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.983790:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a63cd lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.983802:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff9401f669e400) 00010000:00010000:1.0:1763343284.983805:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343284.983810:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a63cd lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.983815:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a63cd lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00000004:00010000:1.0:1763343284.983827:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003b58b64b reply state 000000009c15395a transno 8589935394 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a63d4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.983838:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a63d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343284.983844:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0xe8098f29 (ffff9401fc4f1000) 00010000:00010000:1.0:1763343284.983847:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343284.983849:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343284.983877:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a63c6 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a53a expref: 36 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.983891:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177000/0x9104b1ba770a63db lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a53a expref: 35 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343284.983898:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x53:0x0].0x0 (ffff9401fc4f1e00) 00010000:00010000:1.0:1763343284.983901:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343284.983903:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177000, rc 0) 00000100:00100000:1.0:1763343284.983982:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+36:57821:x1848998400070912:12345-192.168.201.40@tcp:101:fsx.0 Request processed in 1023us (1308us total) trans 8589935394 rc 0/0 00000100:00100000:1.0:1763343284.983990:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11195 00010000:00010000:1.0:1763343284.990360:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343284.991556:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343284.991665:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400071168 00000100:00100000:3.0:1763343284.991677:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400071168 00000100:00100000:3.0:1763343284.991742:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11196 00000100:00100000:3.0:1763343284.991752:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+308:57821:x1848998400071168:12345-192.168.201.40@tcp:101:fsx.0 00010000:00010000:3.0:1763343284.991773:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343284.991777:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343284.991805:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c5176200/0x9104b1ba770a6317 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a4f4 expref: 308 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343284.991827:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff9400c6733c00) 00010000:00010000:3.0:1763343284.991838:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343284.991859:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a63e9 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a541 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343284.992014:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a63f0 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.992076:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a63f0 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343284.992085:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a63f0 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343284.992107:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a63f7 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x6:0x0].0x9645bb7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.992114:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a63f7 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x6:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343284.992119:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a63f7 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x6:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00000004:00080000:3.0:1763343284.992483:0:6524:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2f2:0x0], index 0: 0 00010000:00010000:3.0:1763343284.992644:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a63fe lrc: 3/1,0 mode: --/PR res: [0x240000404:0x231:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343284.992654:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a63fe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x231:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343284.992662:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a63fe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x231:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343284.992696:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a63f0 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343284.992707:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a63f0 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343284.992712:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a63f0 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343284.992718:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a63f0 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343284.992724:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fd2dea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:3.0:1763343284.992728:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a63f0 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343284.992736:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a63f0 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343284.992745:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff9401f669ee00) 00010000:00010000:3.0:1763343284.992747:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343284.992750:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a63f0 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343284.992756:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dea00/0x9104b1ba770a63f0 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT1 00000004:00010000:3.0:1763343284.992766:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001e47bafa reply state 00000000a0e52ba2 transno 4294974087 ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a63f7 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x6:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343284.992776:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9401fd2dfa00/0x9104b1ba770a63f7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x6:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT1 00010000:00010000:3.0:1763343284.992781:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x9645bb7c (ffff9401f669e200) 00010000:00010000:3.0:1763343284.992784:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343284.992786:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343284.992821:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9400c3917a00/0x9104b1ba770a63e9 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a541 expref: 310 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343284.992839:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9400c89a2000/0x9104b1ba770a63fe lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x231:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a541 expref: 309 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343284.992846:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x231:0x0].0x0 (ffff9401f669e500) 00000100:00100000:2.0:1763343284.993060:0:8617:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6e8ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8617:1848998413037568:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1763343284.993130:0:8617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343284.993174:0:8617:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f664c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343284.993253:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413037568 00000100:00100000:1.0:1763343284.993261:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413037568 00000100:00100000:1.0:1763343284.993305:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7666 00000100:00100000:1.0:1763343284.993313:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:8617:x1848998413037568:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1763343284.993349:0:8626:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 770 00010000:00010000:3.0:1763343284.994662:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343284.994673:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c89a2000, rc 0) 00000100:00100000:3.0:1763343284.994749:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57821:x1848998400071168:12345-192.168.201.40@tcp:101:fsx.0 Request processed in 2995us (3198us total) trans 4294974087 rc 0/0 00000100:00100000:3.0:1763343284.994759:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11196 00000100:00100000:1.0:1763343284.994974:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:8617:x1848998413037568:12345-0@lo:5:osp-pre-0-1.0 Request processed in 1655us (1837us total) trans 21474839381 rc 0/0 00000100:00100000:1.0:1763343284.994983:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7666 00000100:00100000:3.0:1763343284.995778:0:8617:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6e8ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8617:1848998413037568:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1763343284.995794:0:8617:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x2f2:0x0]-[0x280000400:0x321:0x0] 00000100:00100000:2.0:1763343285.012689:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343285.013539:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400071424 00000100:00100000:3.0:1763343285.013552:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400071424 00000100:00100000:3.0:1763343285.013623:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11197 00000100:00100000:3.0:1763343285.013642:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+36:57821:x1848998400071424:12345-192.168.201.40@tcp:36:fsx.0 00010000:00010000:3.0:1763343285.013895:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a640c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343285.013912:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a640c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343285.013923:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a640c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00000001:00080000:3.0:1763343285.013964:0:6524:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935395 00000004:00010000:3.0:1763343285.013982:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000421f81a2 reply state 000000005193a2d4 transno 8589935396 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a640c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343285.013993:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a640c lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343285.014000:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:3.0:1763343285.014003:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343285.014007:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343285.014128:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+39:57821:x1848998400071424:12345-192.168.201.40@tcp:36:fsx.0 Request processed in 489us (1451us total) trans 8589935396 rc 0/0 00000100:00100000:3.0:1763343285.014135:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11197 00000020:00080000:3.0:1763343285.014139:0:6524:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763343285.017990:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.019992:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400071552 00000100:00100000:1.0:1763343285.020006:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400071552 00002000:00010000:1.0:1763343285.020073:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/119 (0->18446744073709551615) 00002000:00100000:1.0:1763343285.020079:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6e8df80 with x1848998400071552 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343285.020103:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c6e8df80. 00000100:00100000:1.0:1763343285.020141:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1811 00000100:00100000:1.0:1763343285.020153:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998400071552:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:1.0:1763343285.020309:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343285.020312:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:1.0:1763343285.020315:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343285.020318:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:1.0:1763343285.020320:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343285.020398:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998400071552:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 246us (2418us total) trans 17179872113 rc 0/0 00000100:00100000:1.0:1763343285.020406:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1811 00002000:00010000:1.0:1763343285.020410:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/119 (0->18446744073709551615) 00002000:00100000:1.0:1763343285.020413:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6e8df80 with x1848998400071552 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343285.020418:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c6e8df80. 00000100:00100000:2.0:1763343285.021248:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343285.021462:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400071680 00000100:00100000:3.0:1763343285.021479:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400071680 00002000:00010000:3.0:1763343285.021529:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:3.0:1763343285.021535:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6e8ea00 with x1848998400071680 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343285.021549:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c6e8ea00. 00000100:00100000:3.0:1763343285.021594:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1812 00000100:00100000:3.0:1763343285.021606:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2407:x1848998400071680:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:3.0:1763343285.021806:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343285.021810:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:3.0:1763343285.021813:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343285.021815:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:3.0:1763343285.021818:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343285.021901:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998400071680:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 297us (655us total) trans 21474839382 rc 0/0 00000100:00100000:3.0:1763343285.021910:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1812 00002000:00010000:3.0:1763343285.021914:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:3.0:1763343285.021918:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6e8ea00 with x1848998400071680 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343285.021923:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c6e8ea00. 00000100:00100000:2.0:1763343285.026581:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.026701:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400071936 00000100:00100000:1.0:1763343285.026716:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400071936 00000100:00100000:1.0:1763343285.026795:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11198 00000100:00100000:1.0:1763343285.026821:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+39:57821:x1848998400071936:12345-192.168.201.40@tcp:36:fsx.0 00010000:00010000:1.0:1763343285.027120:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6413 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.027138:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6413 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.027150:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6413 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00000001:00080000:1.0:1763343285.027192:0:9827:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935397 00000004:00010000:1.0:1763343285.027214:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005a03882c reply state 000000003b9f3583 transno 8589935398 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6413 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.027226:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6413 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.027234:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:1.0:1763343285.027237:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343285.027241:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343285.027336:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+42:57821:x1848998400071936:12345-192.168.201.40@tcp:36:fsx.0 Request processed in 521us (770us total) trans 8589935398 rc 0/0 00000100:00100000:1.0:1763343285.027344:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11198 00000020:00080000:1.0:1763343285.027350:0:9827:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763343285.031679:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343285.032022:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400072064 00000100:00100000:3.0:1763343285.032252:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400072064 00002000:00010000:2.0:1763343285.032441:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/119 (100000->18446744073709551615) 00002000:00100000:2.0:1763343285.032447:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6e8e300 with x1848998400072064 ext(100000->18446744073709551615) 00002000:00010000:2.0:1763343285.032464:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c6e8e300. 00000100:00100000:2.0:1763343285.032577:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1813 00000100:00100000:2.0:1763343285.032589:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2409:x1848998400072064:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:2.0:1763343285.032900:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 0 -> 100000 00002000:00010000:2.0:1763343285.032905:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.032907:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343285.032910:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.032913:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343285.033354:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2409:x1848998400072064:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 764us (1688us total) trans 17179872114 rc 0/0 00000100:00100000:2.0:1763343285.033365:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1813 00002000:00010000:2.0:1763343285.033370:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/119 (100000->18446744073709551615) 00002000:00100000:2.0:1763343285.033373:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6e8e300 with x1848998400072064 ext(100000->18446744073709551615) 00002000:00010000:2.0:1763343285.033380:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c6e8e300. 00000100:00100000:2.0:1763343285.040279:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.040921:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400072192 00000100:00100000:1.0:1763343285.040946:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400072192 00000100:00100000:1.0:1763343285.041053:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11199 00000100:00100000:1.0:1763343285.041066:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+42:57821:x1848998400072192:12345-192.168.201.40@tcp:101:fsx.0 00010000:00010000:1.0:1763343285.041111:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343285.041140:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a641a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a548 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.041280:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a6421 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.041299:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a6421 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.041313:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a6421 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00000004:00200000:1.0:1763343285.041347:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x51:0x0]: returning size 100000 00000004:00200000:1.0:1763343285.041354:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343285.041379:0:9827:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a6421 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.041410:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a641a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a548 expref: 44 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.041432:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a6421 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a548 expref: 43 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.041442:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:1.0:1763343285.041446:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343285.041450:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177a00, rc 0) 00000100:00100000:1.0:1763343285.041539:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+43:57821:x1848998400072192:12345-192.168.201.40@tcp:101:fsx.0 Request processed in 474us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.041546:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11199 00000100:00100000:2.0:1763343285.047260:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343285.047327:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400072448 00000100:00100000:3.0:1763343285.047341:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400072448 00000100:00100000:3.0:1763343285.047419:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11200 00000100:00100000:3.0:1763343285.047430:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+43:57821:x1848998400072448:12345-192.168.201.40@tcp:36:fsx.0 00010000:00010000:3.0:1763343285.047548:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343285.047589:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a6421 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a548 expref: 43 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343285.047613:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:3.0:1763343285.047619:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343285.047871:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2dea00/0x9104b1ba770a6428 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343285.047889:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2dea00/0x9104b1ba770a6428 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343285.047907:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2dea00/0x9104b1ba770a6428 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00000001:00080000:3.0:1763343285.047967:0:6524:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935399 00000004:00010000:3.0:1763343285.047995:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fbdffc34 reply state 00000000b0d79720 transno 8589935400 ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2dea00/0x9104b1ba770a6428 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343285.048010:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2dea00/0x9104b1ba770a6428 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343285.048017:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:3.0:1763343285.048021:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343285.048078:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343285.048231:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+45:57821:x1848998400072448:12345-192.168.201.40@tcp:36:fsx.0 Request processed in 802us (988us total) trans 8589935400 rc 0/0 00000100:00100000:3.0:1763343285.048240:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11200 00000020:00080000:3.0:1763343285.048247:0:6524:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763343285.055630:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.055679:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.055698:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400072576 00000100:00100000:0.0:1763343285.055712:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400072576 00002000:00010000:0.0:1763343285.055768:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/119 (0->18446744073709551615) 00002000:00100000:0.0:1763343285.055775:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5955f80 with x1848998400072576 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343285.055792:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5955f80. 00000100:00100000:0.0:1763343285.056425:0:8419:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400072704 00000100:00100000:0.0:1763343285.056442:0:8419:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400072704 00002000:00010000:0.0:1763343285.056494:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:0.0:1763343285.056500:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5957b80 with x1848998400072704 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343285.056513:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5957b80. 00000100:00100000:0.0:1763343285.056697:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1814 00000100:00100000:0.0:1763343285.056712:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998400072576:12345-192.168.201.40@tcp:10:fsx.0 00000100:00100000:1.0:1763343285.056795:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1815 00000100:00100000:2.0:1763343285.056901:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998400072704:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:2.0:1763343285.057128:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343285.057133:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.057137:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343285.057139:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.057142:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1763343285.057170:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 100000 -> 0 00002000:00010000:0.0:1763343285.057177:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:0.0:1763343285.057179:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343285.057183:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:0.0:1763343285.057186:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343285.057238:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998400072704:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 430us (1556us total) trans 21474839383 rc 0/0 00000100:00100000:0.0:1763343285.057253:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998400072576:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 536us (1629us total) trans 17179872115 rc 0/0 00000100:00100000:2.0:1763343285.057265:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1815 00002000:00010000:2.0:1763343285.057272:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:2.0:1763343285.057279:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5957b80 with x1848998400072704 ext(0->18446744073709551615) 00000100:00100000:0.0:1763343285.057279:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1814 00002000:00010000:0.0:1763343285.057288:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/119 (0->18446744073709551615) 00002000:00010000:2.0:1763343285.057293:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5957b80. 00002000:00100000:0.0:1763343285.057294:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5955f80 with x1848998400072576 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343285.057306:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5955f80. 00000100:00100000:2.0:1763343285.060773:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.060898:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400072960 00000100:00100000:1.0:1763343285.060916:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400072960 00000100:00100000:1.0:1763343285.061007:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11201 00000100:00100000:1.0:1763343285.061018:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+45:57821:x1848998400072960:12345-192.168.201.40@tcp:101:fsx.0 00010000:00010000:1.0:1763343285.061082:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343285.061086:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343285.061136:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176400/0x9104b1ba770a63b1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a525 expref: 45 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.061166:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:1.0:1763343285.061172:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343285.061193:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a642f lrc: 2/0,0 mode: --/EX res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a54f expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.061266:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a6436 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.061283:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a6436 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x51:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.061296:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a6436 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x51:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00000004:00080000:1.0:1763343285.061484:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x79:0x0], index 1: 0 00000004:00080000:1.0:1763343285.061494:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x96:0x0], index 0: 0 00010000:00010000:1.0:1763343285.061648:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a6436 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x51:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a54f expref: 47 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.061658:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:1.0:1763343285.061661:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343285.061677:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a642f lrc: 0/0,0 mode: --/EX res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a54f expref: 47 pid: 9827 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343285.061700:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a6436 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x51:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a54f expref: 46 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.061728:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:1.0:1763343285.061732:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343285.061736:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177a00, rc 0) 00000100:00100000:1.0:1763343285.061828:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+46:57821:x1848998400072960:12345-192.168.201.40@tcp:101:fsx.0 Request processed in 807us (1060us total) trans 8589935401 rc 0/0 00000100:00100000:1.0:1763343285.061840:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11201 00000100:00100000:3.0:1763343285.067827:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.069159:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400073088 00000100:00100000:2.0:1763343285.069171:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400073088 00000100:00100000:2.0:1763343285.069390:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7667 00000100:00100000:2.0:1763343285.069402:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:57821:x1848998400073088:12345-192.168.201.40@tcp:101:fsx.0 00010000:00010000:2.0:1763343285.069422:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343285.069446:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a643d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a556 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343285.069470:0:28562:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343285.069493:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.069496:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.069504:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a643d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a556 expref: 18 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.069519:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a643d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a556 expref: 18 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.069618:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88c00, rc 0) 00000100:00100000:2.0:1763343285.069692:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:57821:x1848998400073088:12345-192.168.201.40@tcp:101:fsx.0 Request processed in 291us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343285.069699:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7667 00000100:00100000:2.0:1763343285.071751:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.071791:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.071880:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400073216 00000100:00100000:1.0:1763343285.071891:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400073216 00000100:00100000:1.0:1763343285.071956:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400073344 00000100:00100000:1.0:1763343285.071959:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400073344 00000100:00100000:0.0:1763343285.071962:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1816 00000100:00100000:0.0:1763343285.071974:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2407:x1848998400073216:12345-192.168.201.40@tcp:22:fsx.0 00000100:00100000:1.0:1763343285.071991:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1817 00000100:00100000:1.0:1763343285.071998:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2408:x1848998400073344:12345-192.168.201.40@tcp:22:fsx.0 00002000:00010000:1.0:1763343285.072225:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1763343285.072225:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1763343285.072229:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343285.072229:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:1.0:1763343285.072232:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343285.072232:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343285.072235:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343285.072235:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:1.0:1763343285.072237:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 0 -> 6144 00002000:00010000:0.0:1763343285.072237:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:0.0:1763343285.072294:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998400073216:12345-192.168.201.40@tcp:22:fsx.0 Request processed in 321us (550us total) trans 17179872116 rc 0/0 00000100:00100000:0.0:1763343285.072301:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1816 00000100:00100000:1.0:1763343285.072367:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2408:x1848998400073344:12345-192.168.201.40@tcp:22:fsx.0 Request processed in 369us (575us total) trans 17179872117 rc 0/0 00000100:00100000:1.0:1763343285.072374:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1817 00000100:00100000:3.0:1763343285.075149:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.075308:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400073600 00000100:00100000:2.0:1763343285.075321:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400073600 00000100:00100000:1.0:1763343285.075485:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11202 00000100:00100000:1.0:1763343285.075497:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+46:57821:x1848998400073600:12345-192.168.201.40@tcp:36:fsx.0 00010000:00010000:1.0:1763343285.075553:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343285.075582:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a6436 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a54f expref: 46 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.075600:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:1.0:1763343285.075605:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343285.075761:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a6444 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.075776:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a6444 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.075785:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a6444 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00000001:00080000:1.0:1763343285.075833:0:9827:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935402 00000004:00010000:1.0:1763343285.075855:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000801a7471 reply state 00000000ead382c9 transno 8589935403 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a6444 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.075867:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a6444 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.075874:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:1.0:1763343285.075877:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343285.075879:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343285.076062:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+48:57821:x1848998400073600:12345-192.168.201.40@tcp:36:fsx.0 Request processed in 531us (884us total) trans 8589935403 rc 0/0 00000100:00100000:1.0:1763343285.076070:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11202 00000020:00080000:1.0:1763343285.076075:0:9827:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343285.077688:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.077768:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400073728 00000100:00100000:1.0:1763343285.077777:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400073728 00000100:00100000:1.0:1763343285.077834:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11203 00000100:00100000:1.0:1763343285.077844:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+48:57821:x1848998400073728:12345-192.168.201.40@tcp:101:fsx.0 00010000:00010000:1.0:1763343285.077865:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343285.077883:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176400/0x9104b1ba770a644b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a55d expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.077934:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176400/0x9104b1ba770a644b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a55d expref: 49 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.077949:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176400/0x9104b1ba770a644b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a55d expref: 49 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.077967:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:1.0:1763343285.077972:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343285.077975:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176400, rc 0) 00000100:00100000:1.0:1763343285.078058:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+49:57821:x1848998400073728:12345-192.168.201.40@tcp:101:fsx.0 Request processed in 215us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.078065:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11203 00000100:00100000:2.0:1763343285.080323:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.080376:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400073856 00000100:00100000:1.0:1763343285.080386:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400073856 00000100:00100000:1.0:1763343285.080506:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7668 00000100:00100000:1.0:1763343285.080517:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:57821:x1848998400073856:12345-192.168.201.40@tcp:101:fsx.0 00010000:00010000:1.0:1763343285.080592:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343285.080615:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a6452 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a564 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343285.080639:0:28562:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343285.080662:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343285.080664:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343285.080672:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a6452 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a564 expref: 16 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.080688:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a6452 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a564 expref: 16 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.080700:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176200, rc 0) 00000100:00100000:1.0:1763343285.080813:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:57821:x1848998400073856:12345-192.168.201.40@tcp:101:fsx.0 Request processed in 297us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.080822:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7668 00000100:00100000:0.0:1763343285.084356:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.084404:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.084432:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.084464:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343285.084475:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400073984 00000100:00100000:3.0:1763343285.084487:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400073984 00002000:00010000:3.0:1763343285.084525:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/119 (0->18446744073709551615) 00002000:00100000:3.0:1763343285.084530:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6b56a00 with x1848998400073984 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343285.084543:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c6b56a00. 00000100:00100000:3.0:1763343285.084571:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400074240 00000100:00100000:3.0:1763343285.084574:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400074240 00002000:00010000:3.0:1763343285.084585:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/121 (0->18446744073709551615) 00002000:00100000:3.0:1763343285.084588:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6b57b80 with x1848998400074240 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343285.084593:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c6b57b80. 00000100:00100000:3.0:1763343285.084607:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400074112 00000100:00100000:3.0:1763343285.084610:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400074112 00002000:00010000:3.0:1763343285.084621:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:3.0:1763343285.084724:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6b56680 with x1848998400074112 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343285.084731:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c6b56680. 00000100:00100000:3.0:1763343285.084748:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400074368 00000100:00100000:3.0:1763343285.084752:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400074368 00002000:00010000:3.0:1763343285.084765:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/150 (0->18446744073709551615) 00002000:00100000:3.0:1763343285.084768:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c859b100 with x1848998400074368 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343285.084773:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9401c859b100. 00000100:00100000:3.0:1763343285.084793:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1818 00000100:00100000:3.0:1763343285.084802:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2409:x1848998400073984:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:3.0:1763343285.085067:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 1048576 -> 0 00002000:00010000:3.0:1763343285.085071:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:3.0:1763343285.085073:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343285.085075:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:3.0:1763343285.085077:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 2048 -> 0 00000100:00100000:3.0:1763343285.085147:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2409:x1848998400073984:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 345us (802us total) trans 17179872118 rc 0/0 00000100:00100000:3.0:1763343285.085155:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1818 00002000:00010000:3.0:1763343285.085159:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/119 (0->18446744073709551615) 00002000:00100000:3.0:1763343285.085162:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6b56a00 with x1848998400073984 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343285.085166:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c6b56a00. 00000100:00100000:3.0:1763343285.085185:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1819 00000100:00100000:3.0:1763343285.085191:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2409:x1848998400074240:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:3.0:1763343285.085363:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 4194304 -> 0 00002000:00010000:3.0:1763343285.085367:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 0 -> 1763343284 00002000:00010000:3.0:1763343285.085369:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343285.085370:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 0 -> 1763343284 00002000:00010000:3.0:1763343285.085372:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 6144 -> 0 00000100:00100000:3.0:1763343285.085395:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2409:x1848998400074240:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 204us (991us total) trans 17179872119 rc 0/0 00000100:00100000:3.0:1763343285.085402:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1819 00002000:00010000:3.0:1763343285.085405:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/121 (0->18446744073709551615) 00002000:00100000:3.0:1763343285.085407:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6b57b80 with x1848998400074240 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343285.085412:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c6b57b80. 00000100:00100000:3.0:1763343285.085428:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1820 00000100:00100000:3.0:1763343285.085436:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6b56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2409:x1848998400074112:12345-192.168.201.40@tcp:10:fsx.0 00000100:00100000:2.0:1763343285.085457:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1821 00000100:00100000:2.0:1763343285.085470:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2409:x1848998400074368:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:2.0:1763343285.086372:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343285.086378:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 0 -> 1763343284 00002000:00010000:2.0:1763343285.086381:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343285.086383:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 0 -> 1763343284 00002000:00010000:2.0:1763343285.086385:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343285.086419:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2409:x1848998400074368:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 951us (1952us total) trans 21474839384 rc 0/0 00000100:00100000:2.0:1763343285.086427:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1821 00002000:00010000:2.0:1763343285.086430:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/150 (0->18446744073709551615) 00002000:00100000:2.0:1763343285.086432:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401c859b100 with x1848998400074368 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343285.086437:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9401c859b100. 00002000:00010000:2.0:1763343285.090614:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343285.090624:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.090627:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343285.090629:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.090632:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343285.090727:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6b56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2409:x1848998400074112:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 5286us (6287us total) trans 21474839385 rc 0/0 00000100:00100000:2.0:1763343285.090739:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1820 00002000:00010000:2.0:1763343285.090745:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:2.0:1763343285.090749:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c6b56680 with x1848998400074112 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343285.090756:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c6b56680. 00000100:00100000:0.0:1763343285.095285:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.095320:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.095403:0:8418:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400074496 00000100:00100000:1.0:1763343285.095413:0:8418:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400074496 00000100:00100000:3.0:1763343285.096154:0:28389:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400074624 00000100:00100000:3.0:1763343285.096160:0:28389:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400074624 00000100:00100000:3.0:1763343285.096200:0:28389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1822 00000100:00100000:3.0:1763343285.096209:0:28389:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c859aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2407:x1848998400074496:12345-192.168.201.40@tcp:22:fsx.0 00002000:00010000:3.0:1763343285.096353:0:28389:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343285.096356:0:28389:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:3.0:1763343285.096359:0:28389:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343285.096362:0:28389:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:3.0:1763343285.096364:0:28389:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343285.096418:0:28389:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c859aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2407:x1848998400074496:12345-192.168.201.40@tcp:22:fsx.0 Request processed in 209us (1143us total) trans 17179872120 rc 0/0 00000100:00100000:3.0:1763343285.096426:0:28389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1822 00000100:00100000:3.0:1763343285.096444:0:28389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1823 00000100:00100000:3.0:1763343285.096452:0:28389:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2407:x1848998400074624:12345-192.168.201.40@tcp:22:fsx.0 00002000:00010000:3.0:1763343285.096499:0:28389:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343285.096502:0:28389:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:3.0:1763343285.096505:0:28389:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343285.096507:0:28389:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:3.0:1763343285.096509:0:28389:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343285.096528:0:28389:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2407:x1848998400074624:12345-192.168.201.40@tcp:22:fsx.0 Request processed in 77us (1208us total) trans 17179872121 rc 0/0 00000100:00100000:3.0:1763343285.096534:0:28389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1823 00000100:00100000:0.0:1763343285.100986:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.101085:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400074880 00000100:00100000:1.0:1763343285.101123:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400074880 00000100:00100000:1.0:1763343285.101175:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11204 00000100:00100000:1.0:1763343285.101183:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+49:57821:x1848998400074880:12345-192.168.201.40@tcp:36:fsx.0 00010000:00010000:1.0:1763343285.101382:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a6459 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.101399:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a6459 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.101409:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a6459 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00000001:00080000:1.0:1763343285.101445:0:9827:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935404 00000004:00010000:1.0:1763343285.101463:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009ce6e8e8 reply state 000000004d3e357a transno 8589935405 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a6459 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.101473:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a6459 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.101480:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:1.0:1763343285.101483:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343285.101486:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343285.101562:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+52:57821:x1848998400074880:12345-192.168.201.40@tcp:36:fsx.0 Request processed in 378us (584us total) trans 8589935405 rc 0/0 00000100:00100000:1.0:1763343285.101569:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11204 00000020:00080000:1.0:1763343285.101576:0:9827:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763343285.106639:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.106690:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.106724:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.106756:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.106779:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400075008 00000100:00100000:0.0:1763343285.106793:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400075008 00002000:00010000:0.0:1763343285.106841:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/119 (0->18446744073709551615) 00002000:00100000:0.0:1763343285.106846:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5868380 with x1848998400075008 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343285.106862:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5868380. 00000100:00100000:0.0:1763343285.106895:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400075136 00000100:00100000:0.0:1763343285.106899:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400075136 00002000:00010000:0.0:1763343285.106913:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:0.0:1763343285.106917:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5868000 with x1848998400075136 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343285.106923:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5868000. 00000100:00100000:0.0:1763343285.106940:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400075264 00000100:00100000:0.0:1763343285.106943:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400075264 00002000:00010000:0.0:1763343285.106954:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/121 (0->18446744073709551615) 00002000:00100000:0.0:1763343285.106957:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5868e00 with x1848998400075264 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343285.106964:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5868e00. 00000100:00100000:0.0:1763343285.106978:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400075392 00000100:00100000:0.0:1763343285.106981:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400075392 00002000:00010000:0.0:1763343285.106991:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/150 (0->18446744073709551615) 00002000:00100000:0.0:1763343285.106993:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5868a80 with x1848998400075392 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343285.106999:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5868a80. 00000100:00100000:2.0:1763343285.107185:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1824 00000100:00100000:2.0:1763343285.107198:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2407:x1848998400075008:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:2.0:1763343285.107345:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343285.107349:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.107352:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343285.107354:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.107357:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343285.107415:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2407:x1848998400075008:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 219us (786us total) trans 17179872122 rc 0/0 00000100:00100000:2.0:1763343285.107423:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1824 00002000:00010000:2.0:1763343285.107427:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/119 (0->18446744073709551615) 00002000:00100000:2.0:1763343285.107430:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5868380 with x1848998400075008 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343285.107435:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5868380. 00000100:00100000:2.0:1763343285.107453:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1825 00000100:00100000:2.0:1763343285.107461:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2408:x1848998400075136:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:2.0:1763343285.107526:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343285.107529:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.107532:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343285.107534:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.107536:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343285.107558:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2408:x1848998400075136:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 98us (867us total) trans 21474839386 rc 0/0 00000100:00100000:2.0:1763343285.107565:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1825 00002000:00010000:2.0:1763343285.107568:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:2.0:1763343285.107571:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5868000 with x1848998400075136 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343285.107575:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5868000. 00000100:00100000:2.0:1763343285.107589:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1826 00000100:00100000:2.0:1763343285.107596:0:8419:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2407:x1848998400075264:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:2.0:1763343285.107647:0:8419:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343285.107650:0:8419:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.107653:0:8419:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343285.107655:0:8419:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.107657:0:8419:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343285.107680:0:8419:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2407:x1848998400075264:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 84us (955us total) trans 17179872123 rc 0/0 00000100:00100000:2.0:1763343285.107688:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1826 00002000:00010000:2.0:1763343285.107691:0:8419:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/121 (0->18446744073709551615) 00002000:00100000:2.0:1763343285.107695:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5868e00 with x1848998400075264 ext(0->18446744073709551615) 00000100:00100000:3.0:1763343285.107699:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1827 00002000:00010000:2.0:1763343285.107702:0:8419:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5868e00. 00000100:00100000:3.0:1763343285.107713:0:8418:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2408:x1848998400075392:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:3.0:1763343285.107777:0:8418:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343285.107780:0:8418:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:3.0:1763343285.107782:0:8418:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343285.107784:0:8418:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:3.0:1763343285.107786:0:8418:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343285.107874:0:8418:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2408:x1848998400075392:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 165us (1117us total) trans 21474839387 rc 0/0 00000100:00100000:3.0:1763343285.108358:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1827 00002000:00010000:3.0:1763343285.108363:0:8418:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/150 (0->18446744073709551615) 00002000:00100000:3.0:1763343285.108367:0:8418:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5868a80 with x1848998400075392 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343285.108373:0:8418:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5868a80. 00000100:00100000:0.0:1763343285.115260:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.115292:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343285.115361:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400075520 00000100:00100000:3.0:1763343285.115372:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400075520 00000100:00100000:1.0:1763343285.115375:0:23992:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400075648 00000100:00100000:1.0:1763343285.115379:0:23992:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400075648 00000100:00100000:3.0:1763343285.115436:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1828 00000100:00100000:3.0:1763343285.115491:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2410:x1848998400075520:12345-192.168.201.40@tcp:22:fsx.0 00002000:00010000:3.0:1763343285.115746:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:3.0:1763343285.115750:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:3.0:1763343285.115752:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343285.115754:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:3.0:1763343285.115757:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:3.0:1763343285.115811:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2410:x1848998400075520:12345-192.168.201.40@tcp:22:fsx.0 Request processed in 366us (558us total) trans 17179872124 rc 0/0 00000100:00100000:1.0:1763343285.116047:0:23992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1829 00000100:00100000:1.0:1763343285.116057:0:23992:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2410:x1848998400075648:12345-192.168.201.40@tcp:22:fsx.0 00000100:00100000:3.0:1763343285.116114:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1828 00002000:00010000:1.0:1763343285.116179:0:23992:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1763343285.116182:0:23992:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:1.0:1763343285.116184:0:23992:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343285.116186:0:23992:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:1.0:1763343285.116188:0:23992:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 0 -> 6144 00000100:00100000:1.0:1763343285.116212:0:23992:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2410:x1848998400075648:12345-192.168.201.40@tcp:22:fsx.0 Request processed in 158us (919us total) trans 17179872125 rc 0/0 00000100:00100000:1.0:1763343285.116219:0:23992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1829 00000100:00100000:0.0:1763343285.120980:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.121673:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400075904 00000100:00100000:2.0:1763343285.121686:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400075904 00000100:00100000:2.0:1763343285.121745:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11205 00000100:00100000:2.0:1763343285.121756:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+52:57821:x1848998400075904:12345-192.168.201.40@tcp:36:fsx.0 00010000:00010000:2.0:1763343285.122007:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88a00/0x9104b1ba770a6460 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.122064:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88a00/0x9104b1ba770a6460 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.122077:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88a00/0x9104b1ba770a6460 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00000001:00080000:2.0:1763343285.122137:0:6524:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935406 00000004:00010000:2.0:1763343285.122160:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001b1ca1ab reply state 00000000709914ee transno 8589935407 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88a00/0x9104b1ba770a6460 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.122173:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88a00/0x9104b1ba770a6460 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.122180:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.122183:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343285.122187:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343285.122279:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+55:57821:x1848998400075904:12345-192.168.201.40@tcp:36:fsx.0 Request processed in 524us (1309us total) trans 8589935407 rc 0/0 00000100:00100000:2.0:1763343285.122286:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11205 00000020:00080000:2.0:1763343285.122291:0:6524:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343285.128134:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343285.128757:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343285.129162:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.129433:0:8418:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400076160 00000100:00100000:2.0:1763343285.129444:0:8418:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400076160 00002000:00010000:2.0:1763343285.129489:0:8418:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:2.0:1763343285.129494:0:8418:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5a38380 with x1848998400076160 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343285.129507:0:8418:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5a38380. 00000100:00100000:3.0:1763343285.129943:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.129975:0:23992:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400076288 00000100:00100000:1.0:1763343285.129979:0:23992:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400076288 00002000:00010000:1.0:1763343285.129997:0:23992:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/121 (0->18446744073709551615) 00002000:00100000:1.0:1763343285.130001:0:23992:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5a38700 with x1848998400076288 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343285.130007:0:23992:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5a38700. 00000100:00100000:1.0:1763343285.130021:0:23992:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400076416 00000100:00100000:1.0:1763343285.130042:0:23992:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400076416 00002000:00010000:1.0:1763343285.130052:0:23992:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/150 (0->18446744073709551615) 00002000:00100000:1.0:1763343285.130054:0:23992:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5a39880 with x1848998400076416 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343285.130059:0:23992:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5a39880. 00000100:00100000:1.0:1763343285.130074:0:23992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1830 00000100:00100000:1.0:1763343285.130082:0:23992:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998400076160:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:1.0:1763343285.130242:0:23992:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343285.130246:0:23992:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:1.0:1763343285.130249:0:23992:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343285.130251:0:23992:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:1.0:1763343285.130253:0:23992:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343285.130311:0:23992:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2408:x1848998400076160:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 229us (2188us total) trans 21474839388 rc 0/0 00000100:00100000:1.0:1763343285.130319:0:23992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1830 00002000:00010000:1.0:1763343285.130323:0:23992:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:1.0:1763343285.130326:0:23992:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5a38380 with x1848998400076160 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343285.130330:0:23992:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5a38380. 00000100:00100000:1.0:1763343285.130348:0:23992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1831 00000100:00100000:1.0:1763343285.130354:0:23992:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2408:x1848998400076288:12345-192.168.201.40@tcp:10:fsx.0 00000100:00100000:2.0:1763343285.130494:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1832 00000100:00100000:2.0:1763343285.130503:0:8418:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998400076416:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:2.0:1763343285.130563:0:8418:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343285.130567:0:8418:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.130569:0:8418:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343285.130570:0:8418:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.130573:0:8418:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343285.130597:0:8418:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2408:x1848998400076416:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 96us (1436us total) trans 21474839389 rc 0/0 00000100:00100000:2.0:1763343285.130603:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1832 00002000:00010000:2.0:1763343285.130606:0:8418:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/150 (0->18446744073709551615) 00002000:00100000:2.0:1763343285.130608:0:8418:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5a39880 with x1848998400076416 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343285.130613:0:8418:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5a39880. 00000100:00100000:3.0:1763343285.131115:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400076032 00000100:00100000:3.0:1763343285.131122:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400076032 00002000:00010000:3.0:1763343285.131142:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/119 (0->18446744073709551615) 00002000:00100000:3.0:1763343285.131146:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5a39180 with x1848998400076032 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343285.131152:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5a39180. 00000100:00100000:3.0:1763343285.131169:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1833 00000100:00100000:3.0:1763343285.131175:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:2407:x1848998400076032:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:3.0:1763343285.131434:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 1048576 -> 0 00002000:00010000:3.0:1763343285.131438:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:3.0:1763343285.131441:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343285.131443:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:3.0:1763343285.131445:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 2048 -> 0 00000100:00100000:3.0:1763343285.131480:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+30:2407:x1848998400076032:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 304us (1538us total) trans 17179872126 rc 0/0 00000100:00100000:3.0:1763343285.131487:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1833 00002000:00010000:3.0:1763343285.131490:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/119 (0->18446744073709551615) 00002000:00100000:3.0:1763343285.131493:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5a39180 with x1848998400076032 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343285.131497:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5a39180. 00002000:00010000:1.0:1763343285.132179:0:23992:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 4194304 -> 0 00002000:00010000:1.0:1763343285.132183:0:23992:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:1.0:1763343285.132185:0:23992:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343285.132187:0:23992:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:1.0:1763343285.132189:0:23992:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 6144 -> 0 00000100:00100000:1.0:1763343285.132223:0:23992:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+30:2408:x1848998400076288:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 1866us (3466us total) trans 17179872127 rc 0/0 00000100:00100000:1.0:1763343285.132229:0:23992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1831 00002000:00010000:1.0:1763343285.132232:0:23992:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/121 (0->18446744073709551615) 00002000:00100000:1.0:1763343285.132235:0:23992:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5a38700 with x1848998400076288 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343285.132239:0:23992:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5a38700. 00000100:00100000:0.0:1763343285.137490:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.137539:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.138813:0:23992:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400076672 00000100:00100000:2.0:1763343285.138826:0:23992:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400076672 00000100:00100000:2.0:1763343285.138905:0:23992:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400076544 00000100:00100000:2.0:1763343285.138909:0:23992:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400076544 00000100:00100000:2.0:1763343285.139479:0:23992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1834 00000100:00100000:2.0:1763343285.139494:0:23992:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+31:2410:x1848998400076672:12345-192.168.201.40@tcp:22:fsx.0 00002000:00010000:2.0:1763343285.139748:0:23992:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343285.139752:0:23992:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.139755:0:23992:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343285.139757:0:23992:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.139759:0:23992:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 0 -> 6144 00000100:00100000:2.0:1763343285.139825:0:23992:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+32:2410:x1848998400076672:12345-192.168.201.40@tcp:22:fsx.0 Request processed in 335us (2351us total) trans 17179872128 rc 0/0 00000100:00100000:2.0:1763343285.139833:0:23992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1834 00000100:00100000:1.0:1763343285.140020:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1835 00000100:00100000:1.0:1763343285.140038:0:8417:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+31:2410:x1848998400076544:12345-192.168.201.40@tcp:22:fsx.0 00002000:00010000:1.0:1763343285.140137:0:8417:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343285.140140:0:8417:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:1.0:1763343285.140142:0:8417:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343285.140144:0:8417:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:1.0:1763343285.140146:0:8417:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:1.0:1763343285.140167:0:8417:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+32:2410:x1848998400076544:12345-192.168.201.40@tcp:22:fsx.0 Request processed in 132us (2628us total) trans 17179872129 rc 0/0 00000100:00100000:1.0:1763343285.140173:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1835 00000100:00100000:0.0:1763343285.146802:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.149220:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400076928 00000100:00100000:1.0:1763343285.149236:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400076928 00000100:00100000:1.0:1763343285.149318:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11206 00000100:00100000:1.0:1763343285.149328:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+55:57821:x1848998400076928:12345-192.168.201.40@tcp:36:fsx.0 00010000:00010000:1.0:1763343285.149571:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a6467 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.149591:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a6467 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.149604:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a6467 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00000001:00080000:1.0:1763343285.149649:0:9827:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935408 00000004:00010000:1.0:1763343285.149671:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e91694d5 reply state 0000000036cbbd3a transno 8589935409 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a6467 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.149683:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a6467 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.149691:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:1.0:1763343285.149694:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343285.149698:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343285.149803:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+58:57821:x1848998400076928:12345-192.168.201.40@tcp:36:fsx.0 Request processed in 475us (3015us total) trans 8589935409 rc 0/0 00000100:00100000:1.0:1763343285.149811:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11206 00000020:00080000:1.0:1763343285.149816:0:9827:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343285.153512:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343285.156115:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.156241:0:23992:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400077184 00000100:00100000:2.0:1763343285.156254:0:23992:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400077184 00002000:00010000:2.0:1763343285.156303:0:23992:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:2.0:1763343285.156307:0:23992:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5a3b100 with x1848998400077184 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343285.156320:0:23992:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5a3b100. 00000100:00100000:2.0:1763343285.156358:0:23992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1836 00000100:00100000:2.0:1763343285.156368:0:23992:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2407:x1848998400077184:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:2.0:1763343285.156514:0:23992:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343285.156518:0:23992:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.156521:0:23992:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343285.156522:0:23992:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.156525:0:23992:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343285.156599:0:23992:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2407:x1848998400077184:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 231us (3098us total) trans 21474839390 rc 0/0 00000100:00100000:2.0:1763343285.156607:0:23992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1836 00002000:00010000:2.0:1763343285.156611:0:23992:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:2.0:1763343285.156614:0:23992:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5a3b100 with x1848998400077184 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343285.156619:0:23992:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5a3b100. 00000100:00100000:0.0:1763343285.157121:0:28386:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400077440 00000100:00100000:0.0:1763343285.157127:0:28386:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400077440 00002000:00010000:0.0:1763343285.157147:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/150 (0->18446744073709551615) 00002000:00100000:0.0:1763343285.157150:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c586d500 with x1848998400077440 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343285.157157:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c586d500. 00000100:00100000:0.0:1763343285.157220:0:28386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1837 00000100:00100000:0.0:1763343285.157228:0:28386:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2407:x1848998400077440:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:0.0:1763343285.157313:0:28386:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343285.157316:0:28386:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:0.0:1763343285.157318:0:28386:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343285.157320:0:28386:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:0.0:1763343285.157323:0:28386:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343285.157351:0:28386:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2407:x1848998400077440:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 124us (1248us total) trans 21474839391 rc 0/0 00000100:00100000:0.0:1763343285.157358:0:28386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1837 00002000:00010000:0.0:1763343285.157361:0:28386:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/150 (0->18446744073709551615) 00002000:00100000:0.0:1763343285.157363:0:28386:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c586d500 with x1848998400077440 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343285.157367:0:28386:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c586d500. 00000100:00100000:3.0:1763343285.157667:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.158367:0:23992:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400077056 00000100:00100000:2.0:1763343285.158376:0:23992:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400077056 00002000:00010000:2.0:1763343285.158405:0:23992:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/119 (0->18446744073709551615) 00002000:00100000:2.0:1763343285.158409:0:23992:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c586dc00 with x1848998400077056 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343285.158416:0:23992:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c586dc00. 00000100:00100000:3.0:1763343285.158568:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.159468:0:23992:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400077312 00000100:00100000:2.0:1763343285.159476:0:23992:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400077312 00002000:00010000:2.0:1763343285.159503:0:23992:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/121 (0->18446744073709551615) 00002000:00100000:2.0:1763343285.159507:0:23992:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c586fb80 with x1848998400077312 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343285.159514:0:23992:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c586fb80. 00000100:00100000:2.0:1763343285.159545:0:23992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1838 00000100:00100000:2.0:1763343285.159554:0:23992:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+33:2407:x1848998400077056:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:2.0:1763343285.159683:0:23992:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343285.159686:0:23992:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.159689:0:23992:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343285.159691:0:23992:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.159693:0:23992:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1763343285.159746:0:23992:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+34:2407:x1848998400077056:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 193us (2080us total) trans 17179872130 rc 0/0 00000100:00100000:2.0:1763343285.159754:0:23992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1838 00002000:00010000:2.0:1763343285.159758:0:23992:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/119 (0->18446744073709551615) 00002000:00100000:2.0:1763343285.159760:0:23992:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c586dc00 with x1848998400077056 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343285.159765:0:23992:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c586dc00. 00000100:00100000:2.0:1763343285.159780:0:23992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1839 00000100:00100000:2.0:1763343285.159786:0:23992:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+33:2407:x1848998400077312:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:2.0:1763343285.159838:0:23992:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343285.159841:0:23992:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.159843:0:23992:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343285.159845:0:23992:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.159847:0:23992:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:2.0:1763343285.159868:0:23992:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+34:2407:x1848998400077312:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 82us (1301us total) trans 17179872131 rc 0/0 00000100:00100000:2.0:1763343285.159874:0:23992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1839 00002000:00010000:2.0:1763343285.159877:0:23992:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/121 (0->18446744073709551615) 00002000:00100000:2.0:1763343285.160660:0:23992:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c586fb80 with x1848998400077312 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343285.160670:0:23992:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c586fb80. 00000100:00100000:1.0:1763343285.169124:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.169386:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400077568 00000100:00100000:2.0:1763343285.169401:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400077568 00000100:00100000:2.0:1763343285.169461:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7669 00000100:00100000:2.0:1763343285.169470:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+24:2407:x1848998400077568:12345-192.168.201.40@tcp:101:fsx.0 00010000:00010000:2.0:1763343285.169490:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343285.169515:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89e00/0x9104b1ba770a646e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a56b expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343285.169542:0:28562:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343285.169563:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.169566:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.169576:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89e00/0x9104b1ba770a646e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a56b expref: 25 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343285.169594:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89e00/0x9104b1ba770a646e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a56b expref: 25 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343285.169609:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89e00, rc 0) 00000100:00100000:2.0:1763343285.169678:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2407:x1848998400077568:12345-192.168.201.40@tcp:101:fsx.0 Request processed in 209us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343285.169686:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7669 00000100:00100000:0.0:1763343285.172464:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.172594:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400077696 00000100:00100000:2.0:1763343285.172604:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400077696 00000100:00100000:2.0:1763343285.172667:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11207 00000100:00100000:2.0:1763343285.172677:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+58:57821:x1848998400077696:12345-192.168.201.40@tcp:101:fsx.0 00010000:00010000:2.0:1763343285.172702:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343285.172723:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89200/0x9104b1ba770a6475 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a572 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.172817:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a647c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.172830:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a647c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.172841:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a647c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00000004:00200000:2.0:1763343285.172864:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x51:0x0]: returning size 0 00000004:00200000:2.0:1763343285.172868:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343285.172886:0:6524:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a647c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.172910:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89200/0x9104b1ba770a6475 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a572 expref: 60 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.172928:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a647c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a572 expref: 59 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.172937:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.172940:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343285.172943:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89400, rc 0) 00000100:00100000:2.0:1763343285.173145:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+59:57821:x1848998400077696:12345-192.168.201.40@tcp:101:fsx.0 Request processed in 469us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343285.173153:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11207 00000100:00100000:0.0:1763343285.181179:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.181336:0:23992:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400077824 00000100:00100000:2.0:1763343285.181347:0:23992:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400077824 00002000:00100000:2.0:1763343285.181397:0:23992:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (4096->9922) req@ffff9401f7957850 x1848998400077824/t0(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:26/0 lens 6320/0 e 0 to 0 dl 1763343296 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763343285.181408:0:23992:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401f7957850 with x1848998400077824 ext(4096->9922) 00002000:00010000:2.0:1763343285.181415:0:23992:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401f7957850 00000100:00100000:2.0:1763343285.181447:0:23992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1840 00000100:00100000:2.0:1763343285.181457:0:23992:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f7957850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+34:2407:x1848998400077824:12345-192.168.201.40@tcp:4:fsx.0 00000100:00100000:2.0:1763343285.182201:0:23992:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f7957850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+36:2407:x1848998400077824:12345-192.168.201.40@tcp:4:fsx.0 Request processed in 741us (1029us total) trans 17179872132 rc 0/0 00000100:00100000:2.0:1763343285.182210:0:23992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1840 00002000:00100000:2.0:1763343285.182217:0:23992:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (4096->9922) req@ffff9401f7957850 x1848998400077824/t17179872132(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:26/0 lens 6320/448 e 0 to 0 dl 1763343296 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763343285.182227:0:23992:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9401f7957850 with x1848998400077824 ext(4096->9922) 00002000:00010000:2.0:1763343285.182244:0:23992:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9401f7957850 00000100:00100000:0.0:1763343285.187776:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.188434:0:23992:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400077952 00000100:00100000:2.0:1763343285.188445:0:23992:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400077952 00000100:00100000:2.0:1763343285.188519:0:23992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1841 00000100:00100000:2.0:1763343285.188529:0:23992:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+36:2408:x1848998400077952:12345-192.168.201.40@tcp:22:fsx.0 00002000:00010000:2.0:1763343285.189353:0:23992:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 0 -> 9923 00002000:00010000:2.0:1763343285.189358:0:23992:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.189361:0:23992:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343285.189363:0:23992:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.189366:0:23992:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1763343285.189429:0:23992:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+37:2408:x1848998400077952:12345-192.168.201.40@tcp:22:fsx.0 Request processed in 900us (1664us total) trans 17179872133 rc 0/0 00000100:00100000:2.0:1763343285.189437:0:23992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1841 00000100:00100000:0.0:1763343285.197724:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.197778:0:23992:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400078080 00000100:00100000:2.0:1763343285.197789:0:23992:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400078080 00002000:00100000:2.0:1763343285.197837:0:23992:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (4096->8191) req@ffff9400c5bff800 x1848998400078080/t0(0) o3->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:26/0 lens 488/0 e 0 to 0 dl 1763343296 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763343285.197850:0:23992:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5bff800 with x1848998400078080 ext(4096->8191) 00002000:00010000:2.0:1763343285.197856:0:23992:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5bff800 00000100:00100000:2.0:1763343285.197892:0:23992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1842 00000100:00100000:2.0:1763343285.197902:0:23992:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+37:2409:x1848998400078080:12345-192.168.201.40@tcp:3:fsx.0 00000100:00100000:2.0:1763343285.198098:0:23992:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+37:2409:x1848998400078080:12345-192.168.201.40@tcp:3:fsx.0 Request processed in 196us (384us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763343285.198106:0:23992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1842 00002000:00100000:2.0:1763343285.198113:0:23992:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (4096->8191) req@ffff9400c5bff800 x1848998400078080/t0(0) o3->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:26/0 lens 488/4536 e 0 to 0 dl 1763343296 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763343285.198121:0:23992:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5bff800 with x1848998400078080 ext(4096->8191) 00002000:00010000:2.0:1763343285.198125:0:23992:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5bff800 00000100:00100000:0.0:1763343285.203189:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.203265:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400078208 00000100:00100000:1.0:1763343285.203277:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400078208 00002000:00100000:1.0:1763343285.203322:0:28399:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_017: refresh rw locks for [0x2c0000401:0x77:0x0] (8192->12287) req@ffff9400c5bfc380 x1848998400078208/t0(0) o3->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:26/0 lens 488/0 e 0 to 0 dl 1763343296 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763343285.203335:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5bfc380 with x1848998400078208 ext(8192->12287) 00002000:00010000:1.0:1763343285.203341:0:28399:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5bfc380 00000100:00100000:2.0:1763343285.204177:0:23992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1843 00000100:00100000:2.0:1763343285.204192:0:23992:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+37:2410:x1848998400078208:12345-192.168.201.40@tcp:3:fsx.0 00000100:00100000:2.0:1763343285.204355:0:23992:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+37:2410:x1848998400078208:12345-192.168.201.40@tcp:3:fsx.0 Request processed in 167us (1177us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763343285.204362:0:23992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1843 00002000:00100000:2.0:1763343285.204369:0:23992:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (8192->12287) req@ffff9400c5bfc380 x1848998400078208/t0(0) o3->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:26/0 lens 488/4536 e 0 to 0 dl 1763343296 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763343285.204377:0:23992:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5bfc380 with x1848998400078208 ext(8192->12287) 00002000:00010000:2.0:1763343285.204381:0:23992:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5bfc380 00000100:00100000:0.0:1763343285.216969:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.217068:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400078464 00000100:00100000:2.0:1763343285.217080:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400078464 00000100:00100000:2.0:1763343285.217149:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11208 00000100:00100000:2.0:1763343285.217158:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+59:57821:x1848998400078464:12345-192.168.201.40@tcp:36:fsx.0 00010000:00010000:2.0:1763343285.217215:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343285.217248:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a647c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a572 expref: 59 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.217270:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.217276:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343285.217442:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89200/0x9104b1ba770a6483 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.217458:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89200/0x9104b1ba770a6483 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.217467:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89200/0x9104b1ba770a6483 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00000001:00080000:2.0:1763343285.217508:0:6524:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935410 00000004:00010000:2.0:1763343285.217529:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b43ff90f reply state 00000000b2c37df7 transno 8589935411 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89200/0x9104b1ba770a6483 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.217540:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89200/0x9104b1ba770a6483 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.217546:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.217549:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343285.217551:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343285.217641:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+61:57821:x1848998400078464:12345-192.168.201.40@tcp:36:fsx.0 Request processed in 483us (686us total) trans 8589935411 rc 0/0 00000100:00100000:2.0:1763343285.217648:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11208 00000020:00080000:2.0:1763343285.217654:0:6524:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343285.221482:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.223903:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.223926:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400078592 00000100:00100000:1.0:1763343285.223935:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400078592 00002000:00010000:1.0:1763343285.223978:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/119 (262144->18446744073709551615) 00002000:00100000:1.0:1763343285.223983:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5bfca80 with x1848998400078592 ext(262144->18446744073709551615) 00002000:00010000:1.0:1763343285.223996:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5bfca80. 00000100:00100000:1.0:1763343285.224058:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1844 00000100:00100000:1.0:1763343285.224069:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+37:2407:x1848998400078592:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:1.0:1763343285.224281:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 9923 -> 262144 00002000:00010000:1.0:1763343285.224285:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:1.0:1763343285.224288:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343285.224290:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:1.0:1763343285.224293:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 2048 -> 512 00000100:00100000:1.0:1763343285.224359:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+38:2407:x1848998400078592:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 291us (2888us total) trans 17179872134 rc 0/0 00000100:00100000:1.0:1763343285.224368:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1844 00002000:00010000:1.0:1763343285.224372:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/119 (262144->18446744073709551615) 00002000:00100000:1.0:1763343285.224375:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5bfca80 with x1848998400078592 ext(262144->18446744073709551615) 00002000:00010000:1.0:1763343285.224379:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5bfca80. 00000100:00100000:0.0:1763343285.224975:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.225048:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400078720 00000100:00100000:1.0:1763343285.225054:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400078720 00002000:00010000:1.0:1763343285.225076:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/121 (0->18446744073709551615) 00002000:00100000:1.0:1763343285.225079:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5bfdc00 with x1848998400078720 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343285.225100:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5bfdc00. 00000100:00100000:1.0:1763343285.225122:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400078848 00000100:00100000:1.0:1763343285.225126:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400078848 00002000:00010000:1.0:1763343285.225138:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/150 (0->18446744073709551615) 00002000:00100000:1.0:1763343285.225141:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5bfd180 with x1848998400078848 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343285.225147:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5bfd180. 00000100:00100000:1.0:1763343285.225167:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1845 00000100:00100000:1.0:1763343285.225175:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+38:2408:x1848998400078720:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:1.0:1763343285.225253:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343285.225257:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:1.0:1763343285.225259:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343285.225262:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:1.0:1763343285.225264:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:1.0:1763343285.225296:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+39:2408:x1848998400078720:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 121us (1402us total) trans 17179872135 rc 0/0 00000100:00100000:1.0:1763343285.225303:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1845 00002000:00010000:1.0:1763343285.225307:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/121 (0->18446744073709551615) 00002000:00100000:1.0:1763343285.225309:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5bfdc00 with x1848998400078720 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343285.225313:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5bfdc00. 00000100:00100000:1.0:1763343285.225333:0:28399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1846 00000100:00100000:1.0:1763343285.225340:0:28399:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+25:2407:x1848998400078848:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:1.0:1763343285.225406:0:28399:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343285.225409:0:28399:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:1.0:1763343285.225411:0:28399:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343285.225413:0:28399:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:1.0:1763343285.225415:0:28399:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343285.225436:0:28399:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2407:x1848998400078848:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 96us (462us total) trans 21474839392 rc 0/0 00000100:00100000:1.0:1763343285.225443:0:28399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1846 00002000:00010000:1.0:1763343285.225446:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/150 (0->18446744073709551615) 00002000:00100000:1.0:1763343285.225448:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5bfd180 with x1848998400078848 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343285.225452:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5bfd180. 00000100:00100000:2.0:1763343285.232172:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.232470:0:8417:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400078976 00000100:00100000:0.0:1763343285.232484:0:8417:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400078976 00002000:00100000:0.0:1763343285.232535:0:8417:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x77:0x0] (225280->262143) req@ffff9400c5869c00 x1848998400078976/t0(0) o3->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:26/0 lens 488/0 e 0 to 0 dl 1763343296 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763343285.232553:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5869c00 with x1848998400078976 ext(225280->262143) 00002000:00010000:0.0:1763343285.232559:0:8417:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5869c00 00000100:00100000:0.0:1763343285.232596:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1847 00000100:00100000:0.0:1763343285.232606:0:8417:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5869c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+39:2409:x1848998400078976:12345-192.168.201.40@tcp:3:fsx.0 00000100:00100000:1.0:1763343285.236690:0:8417:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5869c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+39:2409:x1848998400078976:12345-192.168.201.40@tcp:3:fsx.0 Request processed in 4073us (4519us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1763343285.236704:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1847 00002000:00100000:1.0:1763343285.236717:0:8417:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x77:0x0] (225280->262143) req@ffff9400c5869c00 x1848998400078976/t0(0) o3->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:26/0 lens 488/440 e 0 to 0 dl 1763343296 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763343285.236733:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5869c00 with x1848998400078976 ext(225280->262143) 00002000:00010000:1.0:1763343285.236740:0:8417:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5869c00 00000100:00100000:1.0:1763343285.241454:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.242121:0:8417:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400079104 00000100:00100000:0.0:1763343285.242132:0:8417:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400079104 00002000:00100000:0.0:1763343285.242181:0:8417:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x77:0x0] (253952->262143) req@ffff9400c8bc1500 x1848998400079104/t0(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:26/0 lens 8680/0 e 0 to 0 dl 1763343296 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763343285.242193:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c8bc1500 with x1848998400079104 ext(253952->262143) 00002000:00010000:0.0:1763343285.242200:0:8417:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c8bc1500 00000100:00100000:0.0:1763343285.242234:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1848 00000100:00100000:0.0:1763343285.242243:0:8417:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+39:2410:x1848998400079104:12345-192.168.201.40@tcp:4:fsx.0 00000100:00100000:0.0:1763343285.242955:0:8417:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+41:2410:x1848998400079104:12345-192.168.201.40@tcp:4:fsx.0 Request processed in 708us (1508us total) trans 17179872136 rc 0/0 00000100:00100000:0.0:1763343285.242965:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1848 00002000:00100000:0.0:1763343285.242978:0:8417:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x77:0x0] (253952->262143) req@ffff9400c8bc1500 x1848998400079104/t17179872136(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:26/0 lens 8680/448 e 0 to 0 dl 1763343296 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763343285.242987:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c8bc1500 with x1848998400079104 ext(253952->262143) 00002000:00010000:0.0:1763343285.242991:0:8417:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c8bc1500 00000100:00100000:2.0:1763343285.245568:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343285.245657:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400079232 00000100:00100000:3.0:1763343285.245668:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400079232 00000100:00100000:3.0:1763343285.245719:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7670 00000100:00100000:3.0:1763343285.245729:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+41:2409:x1848998400079232:12345-192.168.201.40@tcp:16:fsx.0 00000001:00080000:2.0:1763343285.247486:0:25994:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872136 is committed 00000001:00080000:2.0:1763343285.247546:0:25994:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872111 is committed 00000100:00100000:1.0:1763343285.247774:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2409:x1848998400079232:12345-192.168.201.40@tcp:16:fsx.0 Request processed in 2041us (2211us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.247785:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7670 00000100:00100000:2.0:1763343285.252635:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343285.252877:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400079360 00000100:00100000:3.0:1763343285.252888:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400079360 00000100:00100000:3.0:1763343285.252958:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11209 00000100:00100000:3.0:1763343285.252970:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+61:57821:x1848998400079360:12345-192.168.201.40@tcp:101:fsx.0 00010000:00010000:3.0:1763343285.252997:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343285.253020:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a648a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a579 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343285.253168:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a6491 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343285.253184:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a6491 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343285.253195:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a6491 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00000004:00200000:3.0:1763343285.253229:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x51:0x0]: returning size 262144 00000004:00200000:3.0:1763343285.253234:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343285.253253:0:6524:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a6491 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343285.253277:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a648a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a579 expref: 63 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343285.253294:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a6491 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a579 expref: 62 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343285.253308:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:3.0:1763343285.253311:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343285.253315:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401fc4a7e00, rc 0) 00000100:00100000:3.0:1763343285.253372:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+62:57821:x1848998400079360:12345-192.168.201.40@tcp:101:fsx.0 Request processed in 404us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343285.253381:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11209 00000100:00100000:0.0:1763343285.264853:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.264970:0:8417:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400079488 00000100:00100000:1.0:1763343285.264982:0:8417:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400079488 00000100:00100000:1.0:1763343285.265704:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1849 00000100:00100000:1.0:1763343285.265720:0:8417:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998400079488:12345-192.168.201.40@tcp:22:fsx.0 00002000:00010000:1.0:1763343285.266159:0:8417:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:1.0:1763343285.266164:0:8417:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:1.0:1763343285.266166:0:8417:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343285.266169:0:8417:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:1.0:1763343285.266171:0:8417:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 512 -> 440 00000100:00100000:1.0:1763343285.266251:0:8417:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998400079488:12345-192.168.201.40@tcp:22:fsx.0 Request processed in 536us (1410us total) trans 17179872137 rc 0/0 00000100:00100000:1.0:1763343285.266259:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1849 00000100:00100000:0.0:1763343285.271957:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.272064:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400079744 00000100:00100000:2.0:1763343285.272075:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400079744 00000100:00100000:2.0:1763343285.272787:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11210 00000100:00100000:2.0:1763343285.272801:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+62:57821:x1848998400079744:12345-192.168.201.40@tcp:36:fsx.0 00010000:00010000:2.0:1763343285.272866:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343285.272893:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a6491 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a579 expref: 62 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.272912:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.272917:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343285.273618:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89a00/0x9104b1ba770a6498 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.273637:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89a00/0x9104b1ba770a6498 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.273648:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89a00/0x9104b1ba770a6498 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00000001:00080000:2.0:1763343285.273692:0:9827:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935412 00000004:00010000:2.0:1763343285.273913:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e2f03b8b reply state 00000000b6172248 transno 8589935413 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89a00/0x9104b1ba770a6498 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.273927:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89a00/0x9104b1ba770a6498 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.273937:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.273939:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343285.273943:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343285.274588:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+64:57821:x1848998400079744:12345-192.168.201.40@tcp:36:fsx.0 Request processed in 1786us (2638us total) trans 8589935413 rc 0/0 00000100:00100000:2.0:1763343285.274596:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11210 00000020:00080000:2.0:1763343285.274602:0:9827:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763343285.276786:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.276928:0:8417:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400079872 00000100:00100000:1.0:1763343285.276939:0:8417:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400079872 00002000:00010000:1.0:1763343285.276980:0:8417:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/119 (140086->18446744073709551615) 00002000:00100000:1.0:1763343285.276985:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c586b480 with x1848998400079872 ext(140086->18446744073709551615) 00002000:00010000:1.0:1763343285.276998:0:8417:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c586b480. 00000100:00100000:0.0:1763343285.277266:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.277798:0:8417:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400080000 00000100:00100000:1.0:1763343285.277805:0:8417:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400080000 00000100:00100000:0.0:1763343285.277816:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00002000:00010000:1.0:1763343285.277823:0:8417:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/121 (0->18446744073709551615) 00002000:00100000:1.0:1763343285.277826:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5bfed80 with x1848998400080000 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343285.277833:0:8417:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5bfed80. 00000100:00100000:1.0:1763343285.277848:0:8417:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400080128 00000100:00100000:1.0:1763343285.277851:0:8417:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400080128 00002000:00010000:1.0:1763343285.277862:0:8417:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/150 (0->18446744073709551615) 00002000:00100000:1.0:1763343285.277865:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5bfe300 with x1848998400080128 ext(0->18446744073709551615) 00000100:00100000:0.0:1763343285.277865:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1850 00002000:00010000:1.0:1763343285.277870:0:8417:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5bfe300. 00000100:00100000:0.0:1763343285.277874:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400079872:12345-192.168.201.40@tcp:10:fsx.0 00000100:00100000:1.0:1763343285.277890:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1851 00000100:00100000:1.0:1763343285.277896:0:8417:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400080000:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:1.0:1763343285.278011:0:8417:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343285.278015:0:8417:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:1.0:1763343285.278018:0:8417:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343285.278021:0:8417:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00000100:00100000:2.0:1763343285.278153:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1852 00000100:00100000:2.0:1763343285.278163:0:8418:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+26:2408:x1848998400080128:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:0.0:1763343285.278167:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 262144 -> 140086 00002000:00010000:0.0:1763343285.278170:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:0.0:1763343285.278172:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343285.278174:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:0.0:1763343285.278176:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 440 -> 208 00002000:00010000:2.0:1763343285.278229:0:8418:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1763343285.278229:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2407:x1848998400079872:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 356us (1452us total) trans 17179872139 rc 0/0 00002000:00010000:2.0:1763343285.278232:0:8418:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.278234:0:8418:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343285.278236:0:8418:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00000100:00100000:0.0:1763343285.278237:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1850 00002000:00010000:2.0:1763343285.278238:0:8418:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1763343285.278240:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/119 (140086->18446744073709551615) 00002000:00100000:0.0:1763343285.278243:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c586b480 with x1848998400079872 ext(140086->18446744073709551615) 00002000:00010000:0.0:1763343285.278247:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c586b480. 00000100:00100000:2.0:1763343285.278258:0:8418:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2408:x1848998400080128:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 97us (442us total) trans 21474839393 rc 0/0 00000100:00100000:2.0:1763343285.278264:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1852 00002000:00010000:2.0:1763343285.278267:0:8418:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/150 (0->18446744073709551615) 00002000:00100000:2.0:1763343285.278269:0:8418:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5bfe300 with x1848998400080128 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343285.278272:0:8418:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5bfe300. 00002000:00010000:1.0:1763343285.279259:0:8417:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:1.0:1763343285.279323:0:8417:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998400080000:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 1423us (2054us total) trans 17179872138 rc 0/0 00000100:00100000:1.0:1763343285.279333:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1851 00002000:00010000:1.0:1763343285.279339:0:8417:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/121 (0->18446744073709551615) 00002000:00100000:1.0:1763343285.279342:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5bfed80 with x1848998400080000 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343285.279349:0:8417:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5bfed80. 00000100:00100000:0.0:1763343285.282964:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.283478:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400080256 00000100:00100000:2.0:1763343285.283490:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400080256 00000100:00100000:2.0:1763343285.283553:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11211 00000100:00100000:2.0:1763343285.283563:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+64:57821:x1848998400080256:12345-192.168.201.40@tcp:101:fsx.0 00010000:00010000:2.0:1763343285.283588:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343285.283611:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a649f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a580 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.283712:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88000/0x9104b1ba770a64a6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.283727:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88000/0x9104b1ba770a64a6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.283744:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88000/0x9104b1ba770a64a6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00000004:00200000:2.0:1763343285.283771:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x51:0x0]: returning size 140086 00000004:00200000:2.0:1763343285.283775:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343285.283792:0:9827:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88000/0x9104b1ba770a64a6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.283816:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a649f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a580 expref: 66 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.283832:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88000/0x9104b1ba770a64a6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a580 expref: 65 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.283840:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.283843:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343285.283846:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88000, rc 0) 00000100:00100000:2.0:1763343285.283905:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+65:57821:x1848998400080256:12345-192.168.201.40@tcp:101:fsx.0 Request processed in 344us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343285.283913:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11211 00000100:00100000:2.0:1763343285.288262:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343285.288358:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400080512 00000100:00100000:3.0:1763343285.288369:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400080512 00000100:00100000:3.0:1763343285.288427:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11212 00000100:00100000:3.0:1763343285.288437:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+65:57821:x1848998400080512:12345-192.168.201.40@tcp:36:fsx.0 00010000:00010000:3.0:1763343285.288491:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343285.288518:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88000/0x9104b1ba770a64a6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a580 expref: 65 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343285.288539:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:3.0:1763343285.288545:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343285.288760:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a64ad lrc: 3/0,1 mode: --/PW res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343285.288777:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a64ad lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343285.288787:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a64ad lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00000001:00080000:3.0:1763343285.288844:0:6524:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935414 00000004:00010000:3.0:1763343285.288869:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fae8401a reply state 0000000017d3f86e transno 8589935415 ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a64ad lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343285.288889:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a64ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343285.288894:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:3.0:1763343285.288897:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343285.288900:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343285.289012:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+67:57821:x1848998400080512:12345-192.168.201.40@tcp:36:fsx.0 Request processed in 575us (761us total) trans 8589935415 rc 0/0 00000100:00100000:3.0:1763343285.289020:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11212 00000020:00080000:3.0:1763343285.289059:0:6524:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343285.292399:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.292441:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.292471:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343285.292553:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400080640 00000100:00100000:3.0:1763343285.292564:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400080640 00002000:00010000:3.0:1763343285.292606:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/119 (125736->18446744073709551615) 00002000:00100000:3.0:1763343285.292612:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5bff100 with x1848998400080640 ext(125736->18446744073709551615) 00000100:00100000:1.0:1763343285.292614:0:8417:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400080768 00000100:00100000:1.0:1763343285.292623:0:8417:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400080768 00002000:00010000:3.0:1763343285.292631:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5bff100. 00002000:00010000:1.0:1763343285.292644:0:8417:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/121 (0->18446744073709551615) 00002000:00100000:1.0:1763343285.292650:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5bfea00 with x1848998400080768 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343285.292657:0:8417:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5bfea00. 00000100:00100000:3.0:1763343285.292663:0:28399:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400080896 00000100:00100000:3.0:1763343285.292668:0:28399:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400080896 00002000:00010000:3.0:1763343285.292685:0:28399:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/150 (0->18446744073709551615) 00002000:00100000:3.0:1763343285.292689:0:28399:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5bfd500 with x1848998400080896 ext(0->18446744073709551615) 00000100:00100000:1.0:1763343285.292693:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1853 00002000:00010000:3.0:1763343285.292697:0:28399:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5bfd500. 00000100:00100000:1.0:1763343285.292706:0:8418:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2407:x1848998400080640:12345-192.168.201.40@tcp:10:fsx.0 00000100:00100000:3.0:1763343285.292727:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1854 00000100:00100000:3.0:1763343285.292736:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2407:x1848998400080768:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:3.0:1763343285.292872:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343285.292876:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:3.0:1763343285.292878:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343285.292880:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:3.0:1763343285.292882:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:3.0:1763343285.292938:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2407:x1848998400080768:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 203us (497us total) trans 17179872140 rc 0/0 00000100:00100000:3.0:1763343285.292946:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1854 00002000:00010000:3.0:1763343285.292950:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/121 (0->18446744073709551615) 00002000:00100000:3.0:1763343285.292952:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5bfea00 with x1848998400080768 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343285.292955:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5bfea00. 00000100:00100000:3.0:1763343285.292972:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1855 00000100:00100000:3.0:1763343285.292978:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2407:x1848998400080896:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:3.0:1763343285.293072:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343285.293075:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:3.0:1763343285.293077:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343285.293079:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:3.0:1763343285.293082:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343285.293114:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2407:x1848998400080896:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 137us (642us total) trans 21474839394 rc 0/0 00000100:00100000:3.0:1763343285.293121:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1855 00002000:00010000:3.0:1763343285.293124:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/150 (0->18446744073709551615) 00002000:00100000:3.0:1763343285.293126:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5bfd500 with x1848998400080896 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343285.293130:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c5bfd500. 00002000:00010000:1.0:1763343285.294589:0:8418:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 140086 -> 125736 00002000:00010000:1.0:1763343285.294597:0:8418:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:1.0:1763343285.294599:0:8418:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343285.294601:0:8418:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:1.0:1763343285.294604:0:8418:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 208 -> 176 00000100:00100000:1.0:1763343285.294646:0:8418:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2407:x1848998400080640:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 1940us (2255us total) trans 17179872141 rc 0/0 00000100:00100000:1.0:1763343285.294654:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1853 00002000:00010000:1.0:1763343285.294659:0:8418:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/119 (125736->18446744073709551615) 00002000:00100000:1.0:1763343285.294661:0:8418:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5bff100 with x1848998400080640 ext(125736->18446744073709551615) 00002000:00010000:1.0:1763343285.294667:0:8418:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5bff100. 00000100:00100000:0.0:1763343285.299140:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.299254:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400081024 00000100:00100000:2.0:1763343285.299269:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400081024 00000100:00100000:2.0:1763343285.299340:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11213 00000100:00100000:2.0:1763343285.299351:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+67:57821:x1848998400081024:12345-192.168.201.40@tcp:101:fsx.0 00010000:00010000:2.0:1763343285.299384:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343285.299408:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89000/0x9104b1ba770a64b4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a587 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.299508:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89600/0x9104b1ba770a64bb lrc: 3/1,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.299524:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89600/0x9104b1ba770a64bb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.299536:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89600/0x9104b1ba770a64bb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00000004:00200000:2.0:1763343285.299564:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x51:0x0]: returning size 125736 00000004:00200000:2.0:1763343285.299568:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343285.299587:0:9827:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89600/0x9104b1ba770a64bb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.299613:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89000/0x9104b1ba770a64b4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a587 expref: 69 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.299629:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89600/0x9104b1ba770a64bb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a587 expref: 68 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.299638:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.299641:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343285.299644:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89600, rc 0) 00000100:00100000:2.0:1763343285.299713:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+68:57821:x1848998400081024:12345-192.168.201.40@tcp:101:fsx.0 Request processed in 363us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343285.299720:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11213 00000100:00100000:0.0:1763343285.306732:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.306840:0:8417:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400081152 00000100:00100000:1.0:1763343285.306854:0:8417:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400081152 00002000:00100000:1.0:1763343285.306924:0:8417:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x77:0x0] (61440->126975) req@ffff9400c390d500 x1848998400081152/t0(0) o3->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:26/0 lens 488/0 e 0 to 0 dl 1763343296 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763343285.306937:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c390d500 with x1848998400081152 ext(61440->126975) 00002000:00010000:1.0:1763343285.306943:0:8417:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c390d500 00000100:00100000:1.0:1763343285.306986:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1856 00000100:00100000:1.0:1763343285.306997:0:8417:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2410:x1848998400081152:12345-192.168.201.40@tcp:3:fsx.0 00000100:00100000:1.0:1763343285.310945:0:8417:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2410:x1848998400081152:12345-192.168.201.40@tcp:3:fsx.0 Request processed in 3933us (4209us total) trans 0 rc 65536/65536 00000100:00100000:1.0:1763343285.310961:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1856 00002000:00100000:1.0:1763343285.310975:0:8417:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x77:0x0] (61440->126975) req@ffff9400c390d500 x1848998400081152/t0(0) o3->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:26/0 lens 488/440 e 0 to 0 dl 1763343296 ref 1 fl Complete:/600/0 rc 65536/65536 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763343285.310986:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c390d500 with x1848998400081152 ext(61440->126975) 00002000:00010000:1.0:1763343285.310992:0:8417:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c390d500 00000100:00100000:0.0:1763343285.316518:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343285.316732:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400081408 00000100:00100000:3.0:1763343285.316743:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400081408 00000100:00100000:3.0:1763343285.316815:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11214 00000100:00100000:3.0:1763343285.316828:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+68:57821:x1848998400081408:12345-192.168.201.40@tcp:36:fsx.0 00010000:00010000:3.0:1763343285.316898:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343285.316931:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89600/0x9104b1ba770a64bb lrc: 0/0,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a587 expref: 68 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343285.316958:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:3.0:1763343285.316963:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343285.317221:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a64c2 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343285.317239:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a64c2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:3.0:1763343285.317249:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a64c2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00000001:00080000:3.0:1763343285.317358:0:6524:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935416 00000004:00010000:2.0:1763343285.317450:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000084d60452 reply state 00000000d4fcdc27 transno 8589935417 ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a64c2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.317463:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a64c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.317469:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.317471:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343285.317474:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343285.317567:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+70:57821:x1848998400081408:12345-192.168.201.40@tcp:36:fsx.0 Request processed in 740us (1059us total) trans 8589935417 rc 0/0 00000100:00100000:2.0:1763343285.317575:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11214 00000020:00080000:2.0:1763343285.317580:0:6524:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343285.320137:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.320181:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.320256:0:8418:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400081536 00000100:00100000:2.0:1763343285.320268:0:8418:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400081536 00002000:00010000:2.0:1763343285.320322:0:8418:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/119 (214695->18446744073709551615) 00002000:00100000:2.0:1763343285.320328:0:8418:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c390c380 with x1848998400081536 ext(214695->18446744073709551615) 00002000:00010000:2.0:1763343285.320340:0:8418:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c390c380. 00000100:00100000:2.0:1763343285.320375:0:8418:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400081664 00000100:00100000:2.0:1763343285.320379:0:8418:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400081664 00002000:00010000:2.0:1763343285.320391:0:8418:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/121 (0->18446744073709551615) 00002000:00100000:2.0:1763343285.320394:0:8418:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c390ed80 with x1848998400081664 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343285.320399:0:8418:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c390ed80. 00000100:00100000:1.0:1763343285.320428:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1857 00000100:00100000:0.0:1763343285.320436:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.320441:0:8417:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2410:x1848998400081536:12345-192.168.201.40@tcp:10:fsx.0 00000100:00100000:3.0:1763343285.320507:0:23992:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400081792 00000100:00100000:3.0:1763343285.320512:0:23992:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400081792 00002000:00010000:3.0:1763343285.320530:0:23992:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/150 (0->18446744073709551615) 00002000:00100000:3.0:1763343285.320533:0:23992:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c390f100 with x1848998400081792 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343285.320539:0:23992:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c390f100. 00000100:00100000:2.0:1763343285.320566:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1858 00000100:00100000:2.0:1763343285.320579:0:8418:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+20:2410:x1848998400081664:12345-192.168.201.40@tcp:10:fsx.0 00000100:00100000:3.0:1763343285.320583:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1859 00000100:00100000:3.0:1763343285.320596:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2410:x1848998400081792:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:2.0:1763343285.320684:0:8418:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343285.320684:0:8417:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 125736 -> 214695 00002000:00010000:2.0:1763343285.320691:0:8418:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:1.0:1763343285.320692:0:8417:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.320696:0:8418:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343285.320698:0:8417:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343285.320701:0:8418:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:1.0:1763343285.320702:0:8417:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.320706:0:8418:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:1.0:1763343285.320708:0:8417:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 176 -> 176 00000100:00100000:2.0:1763343285.320773:0:8418:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2410:x1848998400081664:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 195us (588us total) trans 17179872142 rc 0/0 00000100:00100000:1.0:1763343285.320774:0:8417:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+22:2410:x1848998400081536:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 332us (643us total) trans 17179872143 rc 0/0 00000100:00100000:2.0:1763343285.320792:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1858 00002000:00010000:2.0:1763343285.320798:0:8418:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/121 (0->18446744073709551615) 00000100:00100000:1.0:1763343285.320801:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1857 00002000:00100000:2.0:1763343285.320804:0:8418:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c390ed80 with x1848998400081664 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343285.320806:0:8417:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/119 (214695->18446744073709551615) 00002000:00010000:2.0:1763343285.320811:0:8418:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c390ed80. 00002000:00100000:1.0:1763343285.320811:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c390c380 with x1848998400081536 ext(214695->18446744073709551615) 00002000:00010000:1.0:1763343285.320820:0:8417:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c390c380. 00002000:00010000:2.0:1763343285.321201:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343285.321204:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.321206:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343285.321208:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.321210:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343285.321242:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:2410:x1848998400081792:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 649us (805us total) trans 21474839395 rc 0/0 00000100:00100000:2.0:1763343285.321248:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1859 00002000:00010000:2.0:1763343285.321251:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/150 (0->18446744073709551615) 00002000:00100000:2.0:1763343285.321253:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c390f100 with x1848998400081792 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343285.321257:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c390f100. 00000100:00100000:0.0:1763343285.328541:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.328889:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400081920 00000100:00100000:2.0:1763343285.328900:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400081920 00002000:00100000:2.0:1763343285.328953:0:28390:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x2c0000401:0x77:0x0] (176128->217087) req@ffff9400c390fb80 x1848998400081920/t0(0) o3->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:26/0 lens 488/0 e 0 to 0 dl 1763343296 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763343285.328965:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c390fb80 with x1848998400081920 ext(176128->217087) 00002000:00010000:2.0:1763343285.328972:0:28390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c390fb80 00000100:00100000:2.0:1763343285.329150:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1860 00000100:00100000:2.0:1763343285.329161:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2410:x1848998400081920:12345-192.168.201.40@tcp:3:fsx.0 00000100:00100000:2.0:1763343285.333317:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2410:x1848998400081920:12345-192.168.201.40@tcp:3:fsx.0 Request processed in 4144us (4774us total) trans 0 rc 40960/40960 00000100:00100000:2.0:1763343285.333332:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1860 00002000:00100000:2.0:1763343285.333347:0:28390:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x2c0000401:0x77:0x0] (176128->217087) req@ffff9400c390fb80 x1848998400081920/t0(0) o3->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:26/0 lens 488/440 e 0 to 0 dl 1763343296 ref 1 fl Complete:/600/0 rc 40960/40960 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763343285.333359:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c390fb80 with x1848998400081920 ext(176128->217087) 00002000:00010000:2.0:1763343285.333367:0:28390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c390fb80 00000100:00100000:1.0:1763343285.337604:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.337707:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400082048 00000100:00100000:2.0:1763343285.337718:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400082048 00002000:00100000:2.0:1763343285.337773:0:28390:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x2c0000401:0x77:0x0] (90112->214694) req@ffff9400c8bc2d80 x1848998400082048/t0(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:26/0 lens 504/0 e 0 to 0 dl 1763343296 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763343285.337784:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c8bc2d80 with x1848998400082048 ext(90112->214694) 00002000:00010000:2.0:1763343285.337790:0:28390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c8bc2d80 00000100:00100000:2.0:1763343285.338117:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1861 00000100:00100000:2.0:1763343285.338130:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2410:x1848998400082048:12345-192.168.201.40@tcp:4:fsx.0 00000100:00100000:2.0:1763343285.344724:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2410:x1848998400082048:12345-192.168.201.40@tcp:4:fsx.0 Request processed in 6586us (7117us total) trans 17179872144 rc 0/0 00000100:00100000:2.0:1763343285.344741:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1861 00002000:00100000:2.0:1763343285.344755:0:28390:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x2c0000401:0x77:0x0] (90112->214694) req@ffff9400c8bc2d80 x1848998400082048/t17179872144(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:26/0 lens 504/448 e 0 to 0 dl 1763343296 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763343285.344774:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c8bc2d80 with x1848998400082048 ext(90112->214694) 00002000:00010000:2.0:1763343285.344780:0:28390:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c8bc2d80 00000100:00100000:1.0:1763343285.348185:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.348301:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400082176 00000100:00100000:2.0:1763343285.348313:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400082176 00000100:00100000:2.0:1763343285.348421:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7671 00000100:00100000:2.0:1763343285.348433:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+23:2410:x1848998400082176:12345-192.168.201.40@tcp:16:fsx.0 00000001:00080000:0.0:1763343285.350435:0:25994:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872144 is committed 00000100:00100000:2.0:1763343285.350620:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2410:x1848998400082176:12345-192.168.201.40@tcp:16:fsx.0 Request processed in 2185us (2440us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343285.350632:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7671 00000100:00100000:1.0:1763343285.353175:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.353300:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400082304 00000100:00100000:2.0:1763343285.353311:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400082304 00000100:00100000:2.0:1763343285.353363:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11215 00000100:00100000:2.0:1763343285.353372:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+70:57821:x1848998400082304:12345-192.168.201.40@tcp:101:fsx.0 00010000:00010000:2.0:1763343285.353394:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343285.353417:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89000/0x9104b1ba770a64c9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a58e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.353513:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a64d0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.353529:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a64d0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.353540:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a64d0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00000004:00200000:2.0:1763343285.353568:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x51:0x0]: returning size 214695 00000004:00200000:2.0:1763343285.353573:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343285.353593:0:6524:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a64d0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.353622:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89000/0x9104b1ba770a64c9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a58e expref: 72 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.353639:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a64d0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a58e expref: 71 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.353648:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.353651:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343285.353655:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88200, rc 0) 00000100:00100000:2.0:1763343285.353714:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+71:57821:x1848998400082304:12345-192.168.201.40@tcp:101:fsx.0 Request processed in 342us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343285.353721:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11215 00000100:00100000:0.0:1763343285.359235:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.359352:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400082432 00000100:00100000:2.0:1763343285.359364:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400082432 00000100:00100000:2.0:1763343285.359434:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1862 00000100:00100000:2.0:1763343285.359445:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2409:x1848998400082432:12345-192.168.201.40@tcp:22:fsx.0 00002000:00010000:2.0:1763343285.359842:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 214695 -> 214695 00002000:00010000:2.0:1763343285.359846:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.359849:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343285.359851:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.359854:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 176 -> 248 00000100:00100000:2.0:1763343285.360440:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2409:x1848998400082432:12345-192.168.201.40@tcp:22:fsx.0 Request processed in 993us (1213us total) trans 17179872145 rc 0/0 00000100:00100000:2.0:1763343285.360449:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1862 00000100:00100000:1.0:1763343285.364540:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.364625:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400082560 00000100:00100000:2.0:1763343285.364636:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400082560 00000100:00100000:2.0:1763343285.365145:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1863 00000100:00100000:2.0:1763343285.365157:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998400082560:12345-192.168.201.40@tcp:22:fsx.0 00002000:00010000:2.0:1763343285.365322:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 214695 -> 214695 00002000:00010000:2.0:1763343285.365326:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.365328:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343285.365330:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.365332:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 248 -> 248 00000100:00100000:2.0:1763343285.365396:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998400082560:12345-192.168.201.40@tcp:22:fsx.0 Request processed in 241us (866us total) trans 17179872146 rc 0/0 00000100:00100000:2.0:1763343285.365403:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1863 00000100:00100000:1.0:1763343285.370632:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343285.370920:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400082816 00000100:00100000:3.0:1763343285.370931:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400082816 00000100:00100000:3.0:1763343285.370997:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11216 00000100:00100000:3.0:1763343285.371008:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+71:57821:x1848998400082816:12345-192.168.201.40@tcp:36:fsx.0 00010000:00010000:3.0:1763343285.371123:0:9827:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343285.371154:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a64d0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a58e expref: 71 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343285.371176:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:3.0:1763343285.371181:0:9827:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343285.371407:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a64d7 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343285.371422:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a64d7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343285.371431:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a64d7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00000001:00080000:3.0:1763343285.371477:0:9827:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935418 00000004:00010000:3.0:1763343285.371500:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d7948ceb reply state 00000000337d14f0 transno 8589935419 ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a64d7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343285.371513:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a64d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343285.371519:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:3.0:1763343285.371522:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343285.371525:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343285.371631:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+73:57821:x1848998400082816:12345-192.168.201.40@tcp:36:fsx.0 Request processed in 624us (1011us total) trans 8589935419 rc 0/0 00000100:00100000:3.0:1763343285.371639:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11216 00000020:00080000:3.0:1763343285.371645:0:9827:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343285.375142:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343285.375182:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343285.375227:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.375325:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400082944 00000100:00100000:2.0:1763343285.375336:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400082944 00002000:00010000:2.0:1763343285.375378:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/119 (232236->18446744073709551615) 00002000:00100000:2.0:1763343285.375384:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c586ce00 with x1848998400082944 ext(232236->18446744073709551615) 00002000:00010000:2.0:1763343285.375397:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c586ce00. 00000100:00100000:2.0:1763343285.375426:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400083200 00000100:00100000:2.0:1763343285.375429:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400083200 00002000:00010000:2.0:1763343285.375442:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/150 (0->18446744073709551615) 00002000:00100000:2.0:1763343285.375445:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c586ea00 with x1848998400083200 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343285.375451:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c586ea00. 00000100:00100000:2.0:1763343285.375466:0:28390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400083072 00000100:00100000:2.0:1763343285.375469:0:28390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400083072 00002000:00010000:2.0:1763343285.375479:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/121 (0->18446744073709551615) 00002000:00100000:2.0:1763343285.375482:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c586c700 with x1848998400083072 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343285.375487:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c586c700. 00000100:00100000:2.0:1763343285.375508:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1864 00000100:00100000:2.0:1763343285.375518:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998400082944:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:2.0:1763343285.375750:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 214695 -> 232236 00002000:00010000:2.0:1763343285.375754:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.375756:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343285.375759:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.375761:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 248 -> 248 00000100:00100000:2.0:1763343285.375823:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998400082944:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 306us (692us total) trans 17179872147 rc 0/0 00000100:00100000:2.0:1763343285.375830:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1864 00002000:00010000:2.0:1763343285.375835:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/119 (232236->18446744073709551615) 00002000:00100000:2.0:1763343285.375838:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c586ce00 with x1848998400082944 ext(232236->18446744073709551615) 00002000:00010000:2.0:1763343285.375842:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c586ce00. 00000100:00100000:2.0:1763343285.375861:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1865 00000100:00100000:2.0:1763343285.375868:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:2408:x1848998400083200:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:2.0:1763343285.375939:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343285.375942:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.375944:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343285.375946:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.375948:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343285.375970:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+30:2408:x1848998400083200:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 103us (787us total) trans 21474839396 rc 0/0 00000100:00100000:2.0:1763343285.375977:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1865 00002000:00010000:2.0:1763343285.375979:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/150 (0->18446744073709551615) 00002000:00100000:2.0:1763343285.375982:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c586ea00 with x1848998400083200 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343285.375986:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c586ea00. 00000100:00100000:2.0:1763343285.375998:0:28390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1866 00000100:00100000:2.0:1763343285.376005:0:28390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998400083072:12345-192.168.201.40@tcp:10:fsx.0 00002000:00010000:2.0:1763343285.376108:0:28390:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343285.376112:0:28390:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.376114:0:28390:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343285.376116:0:28390:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.376118:0:28390:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:2.0:1763343285.376140:0:28390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998400083072:12345-192.168.201.40@tcp:10:fsx.0 Request processed in 135us (912us total) trans 17179872148 rc 0/0 00000100:00100000:2.0:1763343285.376147:0:28390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1866 00002000:00010000:2.0:1763343285.376150:0:28390:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/121 (0->18446744073709551615) 00002000:00100000:2.0:1763343285.376152:0:28390:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c586c700 with x1848998400083072 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343285.376157:0:28390:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c586c700. 00000100:00100000:1.0:1763343285.379672:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.380009:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400083328 00000100:00100000:2.0:1763343285.380020:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400083328 00000100:00100000:2.0:1763343285.380125:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11217 00000100:00100000:2.0:1763343285.380135:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+73:57821:x1848998400083328:12345-192.168.201.40@tcp:101:fsx.0 00010000:00010000:2.0:1763343285.380160:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343285.380184:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89000/0x9104b1ba770a64de lrc: 2/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a595 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.380293:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89c00/0x9104b1ba770a64e5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 18 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.380307:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89c00/0x9104b1ba770a64e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.380323:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89c00/0x9104b1ba770a64e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 18 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00000004:00200000:2.0:1763343285.380352:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x51:0x0]: returning size 232236 00000004:00200000:2.0:1763343285.380357:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343285.380377:0:6524:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89c00/0x9104b1ba770a64e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 18 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.380403:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89000/0x9104b1ba770a64de lrc: 0/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a595 expref: 75 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.380421:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89c00/0x9104b1ba770a64e5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a595 expref: 74 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.380431:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.380434:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343285.380437:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89c00, rc 0) 00000100:00100000:2.0:1763343285.380502:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+74:57821:x1848998400083328:12345-192.168.201.40@tcp:101:fsx.0 Request processed in 367us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343285.380509:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11217 00000100:00100000:1.0:1763343285.385122:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.385201:0:23992:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400083456 00000100:00100000:2.0:1763343285.385213:0:23992:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400083456 00002000:00100000:2.0:1763343285.385265:0:23992:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (0->233471) req@ffff9400c8bc2300 x1848998400083456/t0(0) o3->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:26/0 lens 536/0 e 0 to 0 dl 1763343296 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763343285.385276:0:23992:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c8bc2300 with x1848998400083456 ext(0->233471) 00002000:00010000:2.0:1763343285.385283:0:23992:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c8bc2300 00000100:00100000:2.0:1763343285.387420:0:23992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1867 00000100:00100000:2.0:1763343285.387445:0:23992:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998400083456:12345-192.168.201.40@tcp:3:fsx.0 00000100:00100000:2.0:1763343285.394931:0:23992:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998400083456:12345-192.168.201.40@tcp:3:fsx.0 Request processed in 7487us (9810us total) trans 0 rc 167936/167936 00000100:00100000:2.0:1763343285.394946:0:23992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1867 00002000:00100000:2.0:1763343285.394958:0:23992:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (0->233471) req@ffff9400c8bc2300 x1848998400083456/t0(0) o3->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:26/0 lens 536/440 e 0 to 0 dl 1763343296 ref 1 fl Complete:/600/0 rc 167936/167936 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763343285.394968:0:23992:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c8bc2300 with x1848998400083456 ext(0->233471) 00002000:00010000:2.0:1763343285.394974:0:23992:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c8bc2300 00000100:00100000:1.0:1763343285.407542:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.408218:0:23992:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400083584 00000100:00100000:2.0:1763343285.408230:0:23992:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400083584 00000100:00100000:2.0:1763343285.408305:0:23992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1868 00000100:00100000:2.0:1763343285.408315:0:23992:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998400083584:12345-192.168.201.40@tcp:22:fsx.0 00002000:00010000:2.0:1763343285.408539:0:23992:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 232236 -> 232236 00002000:00010000:2.0:1763343285.408543:0:23992:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.408545:0:23992:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343285.408547:0:23992:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.408549:0:23992:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 248 -> 336 00000100:00100000:2.0:1763343285.408621:0:23992:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2408:x1848998400083584:12345-192.168.201.40@tcp:22:fsx.0 Request processed in 306us (1087us total) trans 17179872149 rc 0/0 00000100:00100000:2.0:1763343285.408629:0:23992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1868 00000100:00100000:1.0:1763343285.423199:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.423363:0:23992:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400083712 00000100:00100000:2.0:1763343285.423373:0:23992:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400083712 00002000:00100000:2.0:1763343285.423501:0:23992:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (28672->73727) req@ffff9400c5953800 x1848998400083712/t0(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:26/0 lens 488/0 e 0 to 0 dl 1763343296 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763343285.423513:0:23992:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5953800 with x1848998400083712 ext(28672->73727) 00002000:00010000:2.0:1763343285.423521:0:23992:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5953800 00000100:00100000:2.0:1763343285.423604:0:23992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1869 00000100:00100000:2.0:1763343285.423617:0:23992:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5953800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2407:x1848998400083712:12345-192.168.201.40@tcp:4:fsx.0 00000100:00100000:2.0:1763343285.428685:0:23992:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5953800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2407:x1848998400083712:12345-192.168.201.40@tcp:4:fsx.0 Request processed in 5058us (5485us total) trans 17179872150 rc 0/0 00000100:00100000:2.0:1763343285.428700:0:23992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1869 00002000:00100000:2.0:1763343285.428713:0:23992:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (28672->73727) req@ffff9400c5953800 x1848998400083712/t17179872150(0) o4->7fb38b1b-5899-4d0b-8379-b65ce0e9e344@192.168.201.40@tcp:26/0 lens 488/448 e 0 to 0 dl 1763343296 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763343285.428725:0:23992:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5953800 with x1848998400083712 ext(28672->73727) 00002000:00010000:2.0:1763343285.428732:0:23992:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5953800 00000100:00100000:1.0:1763343285.434899:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.435005:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400083840 00000100:00100000:2.0:1763343285.435017:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400083840 00000100:00100000:2.0:1763343285.435125:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7672 00000100:00100000:2.0:1763343285.435134:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5952d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+21:2408:x1848998400083840:12345-192.168.201.40@tcp:16:fsx.0 00000001:00080000:1.0:1763343285.436794:0:25994:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872150 is committed 00000100:00100000:2.0:1763343285.437131:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5952d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998400083840:12345-192.168.201.40@tcp:16:fsx.0 Request processed in 1993us (2238us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343285.437144:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7672 00000100:00100000:1.0:1763343285.440835:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.441567:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400084096 00000100:00100000:0.0:1763343285.441577:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400084096 00000100:00100000:0.0:1763343285.442118:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3963 00000100:00100000:0.0:1763343285.442130:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82c9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+74:57821:x1848998400084096:12345-192.168.201.40@tcp:35:fsx.0 00000100:00100000:0.0:1763343285.443207:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82c9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+75:57821:x1848998400084096:12345-192.168.201.40@tcp:35:fsx.0 Request processed in 1074us (2376us total) trans 8589935420 rc 0/0 00000100:00100000:0.0:1763343285.443219:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3963 00000100:00100000:1.0:1763343285.457553:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343285.457642:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400084352 00000100:00100000:3.0:1763343285.457652:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400084352 00000100:00100000:2.0:1763343285.459107:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11218 00000100:00100000:2.0:1763343285.459127:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+75:57822:x1848998400084352:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343285.459153:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343285.459175:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a64ec lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a59c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.459248:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a64f3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.459262:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a64f3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.459285:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a64f3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.459298:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a64fa lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.459305:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a64fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.459311:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a64fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.459425:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89600/0x9104b1ba770a6501 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 18 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.459434:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89600/0x9104b1ba770a6501 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.459441:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89600/0x9104b1ba770a6501 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 18 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00000004:00200000:2.0:1763343285.459451:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x51:0x0]: returning size 232236 00010000:00010000:2.0:1763343285.459529:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a64f3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.459536:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a64f3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.459542:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a64f3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.459547:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a64f3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.459553:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343285.459557:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a64f3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.459564:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a64f3 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.459575:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff9401f669e400) 00010000:00010000:2.0:1763343285.459578:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343285.459583:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a64f3 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.459590:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a64f3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.459603:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a64fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.459608:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a64fa lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.459613:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a64fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.459617:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343285.459620:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a64fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.459625:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a64fa lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.459631:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0xdd396665 (ffff9401fc4f1600) 00010000:00010000:2.0:1763343285.459633:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343285.459636:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a64fa lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.459645:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a64fa lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.459678:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a64ec lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a59c expref: 78 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.459691:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89600/0x9104b1ba770a6501 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 18 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a59c expref: 77 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.459698:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.459700:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343285.459702:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89600, rc 0) 00000100:00100000:2.0:1763343285.459775:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+77:57822:x1848998400084352:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 656us (2233us total) trans 8589935421 rc 0/0 00000100:00100000:2.0:1763343285.459784:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11218 00000100:00100000:2.0:1763343285.464559:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.465765:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.465872:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400084608 00000100:00100000:0.0:1763343285.465882:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400084608 00000100:00100000:0.0:1763343285.465945:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11219 00000100:00100000:0.0:1763343285.465955:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+77:57822:x1848998400084608:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1763343285.465979:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343285.465999:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501ac00/0x9104b1ba770a650f lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a5a3 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343285.466406:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400084736 00000100:00100000:3.0:1763343285.466418:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400084736 00000100:00100000:3.0:1763343285.466460:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 461 00000100:00100000:3.0:1763343285.466467:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5868000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+79:2408:x1848998400084736:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343285.466477:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343285.466496:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89600/0x9104b1ba770a6501 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 19 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a59c expref: 79 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343285.466513:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:3.0:1763343285.466518:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343285.466786:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5868000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+78:2408:x1848998400084736:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 318us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343285.466794:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 461 00010000:00010000:0.0:1763343285.467833:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501be00/0x9104b1ba770a6516 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343285.467849:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501be00/0x9104b1ba770a6516 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:0.0:1763343285.467860:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501be00/0x9104b1ba770a6516 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00000004:00200000:0.0:1763343285.467872:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x54:0x0]: returning size 0 00010000:00010000:0.0:1763343285.467917:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501ac00/0x9104b1ba770a650f lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5a3 expref: 79 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.467933:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501be00/0x9104b1ba770a6516 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5a3 expref: 78 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.467947:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff9400c38f5c00) 00010000:00010000:0.0:1763343285.467950:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343285.467953:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501be00, rc 0) 00000100:00100000:0.0:1763343285.468007:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+78:57822:x1848998400084608:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2054us (3457us total) trans 8589935422 rc 0/0 00000100:00100000:0.0:1763343285.468015:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11219 00000100:00100000:2.0:1763343285.478897:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.480200:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400084992 00000100:00100000:0.0:1763343285.480212:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400084992 00000100:00100000:1.0:1763343285.480346:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11220 00000100:00100000:1.0:1763343285.480359:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+78:57822:x1848998400084992:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343285.480397:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343285.480425:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5088a00/0x9104b1ba770a6524 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a5aa expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.480543:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089600/0x9104b1ba770a652b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.480558:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501be00/0x9104b1ba770a6516 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5a3 expref: 79 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.480568:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089600/0x9104b1ba770a652b lrc: 4/0,1 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.480604:0:9827:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501be00/0x9104b1ba770a6516 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5a3 expref: 79 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.480617:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501be00/0x9104b1ba770a6516 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5a3 expref: 79 pid: 9827 timeout: 1178 lvb_type: 0 00000100:00100000:1.0:1763343285.480629:0:9827:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5952300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9827:1848998413037696:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343285.480742:0:9827:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c45323c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343285.483298:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5952300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9827:1848998413037696:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343285.483326:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089600/0x9104b1ba770a652b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00000100:00100000:2.0:1763343285.488243:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343285.490761:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400085120 00000100:00100000:3.0:1763343285.490778:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400085120 00010000:00010000:3.0:1763343285.490834:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501be00/0x9104b1ba770a6516 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5a3 expref: 80 pid: 9827 timeout: 1178 lvb_type: 0 00000100:00100000:3.0:1763343285.490879:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3649 00000100:00100000:3.0:1763343285.490889:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82df850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+80:2408:x1848998400085120:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343285.490904:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343285.490911:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501be00/0x9104b1ba770a6516 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5a3 expref: 80 pid: 9827 timeout: 1178 lvb_type: 0 00010000:00010000:3.0:1763343285.490923:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501be00/0x9104b1ba770a6516 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5a3 expref: 80 pid: 9827 timeout: 1178 lvb_type: 0 00010000:00010000:3.0:1763343285.490947:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501be00/0x9104b1ba770a6516 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5a3 expref: 80 pid: 9827 timeout: 1178 lvb_type: 0 00010000:00010000:3.0:1763343285.490963:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff9400c38f5c00) 00010000:00010000:3.0:1763343285.490969:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089600/0x9104b1ba770a652b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343285.490978:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089600/0x9104b1ba770a652b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343285.490985:0:7904:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089600/0x9104b1ba770a652b lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343285.491022:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343285.491127:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82df850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+79:2408:x1848998400085120:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 239us (2897us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343285.491136:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3649 00010000:00010000:1.0:1763343285.491473:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089600/0x9104b1ba770a652b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.491483:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089600/0x9104b1ba770a652b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00000004:00200000:1.0:1763343285.491501:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x54:0x0]: returning size 0 00000004:00080000:1.0:1763343285.491883:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x97:0x0], index 0: 0 00000004:00080000:1.0:1763343285.491890:0:9827:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x7a:0x0], index 1: 0 00010000:00010000:1.0:1763343285.492001:0:9827:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089600/0x9104b1ba770a652b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.492009:0:9827:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089600/0x9104b1ba770a652b lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.492016:0:9827:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089600/0x9104b1ba770a652b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.492021:0:9827:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343285.492055:0:9827:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089600/0x9104b1ba770a652b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.492062:0:9827:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089600/0x9104b1ba770a652b lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.492074:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff9400c38f5c00) 00010000:00010000:1.0:1763343285.492078:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343285.492091:0:9827:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089600/0x9104b1ba770a652b lrc: 2/0,0 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.492098:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089600/0x9104b1ba770a652b lrc: 0/0,0 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.492147:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5088a00/0x9104b1ba770a6524 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x54:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5aa expref: 79 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.492157:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff9400c38f5c00) 00010000:00010000:1.0:1763343285.492160:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343285.492163:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5088a00/0x9104b1ba770a6524 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x54:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5aa expref: 79 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.492178:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5088a00, rc 0) 00000100:00100000:1.0:1763343285.492227:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+78:57822:x1848998400084992:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 11870us (13339us total) trans 8589935423 rc 301/301 00000100:00100000:1.0:1763343285.492236:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11220 00000100:00100000:2.0:1763343285.498421:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.498527:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400085376 00000100:00100000:0.0:1763343285.498539:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400085376 00000100:00100000:0.0:1763343285.498600:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3964 00000100:00100000:0.0:1763343285.498610:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+78:57822:x1848998400085376:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:0.0:1763343285.499388:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+79:57822:x1848998400085376:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 776us (976us total) trans 8589935424 rc 0/0 00000100:00100000:0.0:1763343285.499396:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3964 00000100:00100000:2.0:1763343285.504778:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.505343:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400085504 00000100:00100000:1.0:1763343285.505354:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400085504 00000100:00100000:1.0:1763343285.505425:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11221 00000100:00100000:1.0:1763343285.505436:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+79:57822:x1848998400085504:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343285.505463:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343285.505488:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5088a00/0x9104b1ba770a6539 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a5b1 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.505561:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089600/0x9104b1ba770a6540 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.505576:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089600/0x9104b1ba770a6540 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.505587:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089600/0x9104b1ba770a6540 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00000004:00200000:1.0:1763343285.505631:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x54:0x0]: returning size 0 00000004:00200000:1.0:1763343285.505636:0:9827:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343285.505654:0:9827:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089600/0x9104b1ba770a6540 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.505679:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5088a00/0x9104b1ba770a6539 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5b1 expref: 81 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.505696:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089600/0x9104b1ba770a6540 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5b1 expref: 80 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.505706:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff9401fc4f1800) 00010000:00010000:1.0:1763343285.505709:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1763343285.505713:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089600, rc 0) 00000100:00100000:1.0:1763343285.505782:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+80:57822:x1848998400085504:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 347us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.505789:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11221 00000100:00100000:3.0:1763343285.512611:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.513065:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400085632 00000100:00100000:2.0:1763343285.513075:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400085632 00000100:00100000:2.0:1763343285.513151:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7673 00000100:00100000:2.0:1763343285.513161:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+30:2407:x1848998400085632:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343285.513178:0:8626:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343285.513199:0:8626:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a6547 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a5b8 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343285.513222:0:8626:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343285.513246:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.513249:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.513257:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a6547 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5b8 expref: 31 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343285.513273:0:8626:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a6547 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5b8 expref: 31 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343285.513285:0:8626:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88200, rc 0) 00000100:00100000:2.0:1763343285.513348:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+31:2407:x1848998400085632:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 187us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343285.513357:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7673 00000100:00100000:3.0:1763343285.514736:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.514963:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400085760 00000100:00100000:1.0:1763343285.514975:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400085760 00000100:00100000:1.0:1763343285.515055:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7674 00000100:00100000:1.0:1763343285.515067:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998400085760:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343285.515091:0:28562:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343285.515113:0:28562:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a654e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a5bf expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343285.515135:0:28562:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343285.515153:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343285.515155:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343285.515162:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a654e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5bf expref: 15 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343285.515179:0:28562:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a654e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5bf expref: 15 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343285.515190:0:28562:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5088a00, rc 0) 00000100:00100000:1.0:1763343285.515252:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998400085760:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 187us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.515263:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7674 00000100:00100000:3.0:1763343285.521579:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.522674:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400086016 00000100:00100000:2.0:1763343285.522687:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400086016 00000100:00100000:2.0:1763343285.522759:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11222 00000100:00100000:2.0:1763343285.522770:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+80:57822:x1848998400086016:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343285.522790:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343285.522872:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88000/0x9104b1ba770a6555 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 18 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a5c6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.522985:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a655c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 19 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.523003:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a655c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x4/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.523014:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a655c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x4/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00000004:00200000:2.0:1763343285.523041:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x51:0x0]: returning size 232236 00010000:00010000:2.0:1763343285.523162:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88000/0x9104b1ba770a6555 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x1/0x0 rrc: 19 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5c6 expref: 83 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.523180:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a655c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x4/0x0 rrc: 18 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5c6 expref: 82 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.523190:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.523193:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343285.523196:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89400, rc 0) 00000100:00100000:2.0:1763343285.523260:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+82:57822:x1848998400086016:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 492us (1692us total) trans 8589935425 rc 0/0 00000100:00100000:2.0:1763343285.523268:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11222 00000100:00100000:2.0:1763343285.527214:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.527538:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.528163:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343285.528344:0:8414:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400086272 00000100:00100000:3.0:1763343285.528353:0:8414:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400086272 00000100:00100000:0.0:1763343285.528697:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400086144 00000100:00100000:0.0:1763343285.528702:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400086144 00000100:00100000:0.0:1763343285.528737:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400086400 00000100:00100000:0.0:1763343285.528740:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400086400 00000100:00100000:0.0:1763343285.528764:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7675 00000100:00100000:0.0:1763343285.528775:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998400086272:12345-192.168.201.40@tcp:1:lfs.0 00000100:00100000:3.0:1763343285.528943:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7676 00000100:00100000:3.0:1763343285.528952:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998400086144:12345-192.168.201.40@tcp:1:lfs.0 00010000:00010000:3.0:1763343285.528992:0:28561:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a656a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343285.529012:0:28561:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a63b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a52c expref: 16 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343285.529020:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343285.529051:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343285.529056:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a656a lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343285.529110:0:28561:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a63b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a52c expref: 16 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343285.529125:0:28561:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a63b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a52c expref: 16 pid: 8626 timeout: 1178 lvb_type: 0 00000100:00100000:3.0:1763343285.529143:0:28561:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998413037824:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343285.529223:0:28561:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401c7ec3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1763343285.529799:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7677 00000100:00100000:1.0:1763343285.529812:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+31:2408:x1848998400086400:12345-192.168.201.40@tcp:1:lfs.0 00010000:00010000:1.0:1763343285.529837:0:28562:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a6571 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.529850:0:28562:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a6452 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a564 expref: 31 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.529861:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343285.529863:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343285.529866:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a6571 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.529888:0:28562:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a6452 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a564 expref: 31 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.529898:0:28562:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a6452 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a564 expref: 31 pid: 28562 timeout: 1178 lvb_type: 0 00000100:00100000:1.0:1763343285.529910:0:28562:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5950e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28562:1848998413037952:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343285.529941:0:28562:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c45326c0 going to sleep for 11 seconds 00010000:00010000:0.0:1763343285.530416:0:8626:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a6578 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.530430:0:8626:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a643d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a556 expref: 16 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.530441:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343285.530442:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343285.530445:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a6578 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.530468:0:8626:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a643d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a556 expref: 16 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.530477:0:8626:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a643d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a556 expref: 16 pid: 28562 timeout: 1178 lvb_type: 0 00000100:00100000:0.0:1763343285.530488:0:8626:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998413038080:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343285.530513:0:8626:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c4a6e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343285.533528:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.533816:0:28561:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998413037824:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343285.533842:0:28561:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a656a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343285.533909:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400086528 00000100:00100000:2.0:1763343285.533917:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400086528 00010000:00010000:2.0:1763343285.533951:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a63b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a52c expref: 17 pid: 8626 timeout: 1178 lvb_type: 0 00000100:00100000:2.0:1763343285.533981:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3650 00000100:00100000:2.0:1763343285.533990:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998400086528:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343285.534006:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1763343285.534041:0:14071:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 0 -> 1763343284 00002000:00010000:2.0:1763343285.534045:0:14071:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 336 -> 400 00010000:00010000:2.0:1763343285.534051:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a63b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a52c expref: 17 pid: 8626 timeout: 1178 lvb_type: 0 00010000:00010000:2.0:1763343285.534062:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a63b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a52c expref: 17 pid: 8626 timeout: 1178 lvb_type: 0 00010000:00010000:2.0:1763343285.534097:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c501a800/0x9104b1ba770a63b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a52c expref: 17 pid: 8626 timeout: 1178 lvb_type: 0 00010000:00010000:2.0:1763343285.534113:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.534114:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.534119:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a656a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.534128:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a656a lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.534157:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343285.534218:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998400086528:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 229us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343285.534226:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3650 00010000:00010000:1.0:1763343285.534524:0:28561:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a656a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.534533:0:28561:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a656a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.534553:0:28561:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a656a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.534566:0:28561:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a656a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.534574:0:28561:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a656a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.534581:0:28561:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401f1bf0200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343285.534585:0:28561:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a656a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.534593:0:28561:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a656a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.534605:0:28561:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a656a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.534612:0:28561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401f1bf0200/0x9104b1ba770a656a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343285.534665:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998400086144:12345-192.168.201.40@tcp:1:lfs.0 Request processed in 5714us (7127us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.534673:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7676 00000100:00100000:1.0:1763343285.537345:0:28562:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5950e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28562:1848998413037952:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343285.537375:0:28562:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a6571 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343285.537448:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998413038080:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343285.537465:0:8626:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a6578 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343285.538998:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.539791:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.539849:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400086784 00000100:00100000:0.0:1763343285.539859:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400086784 00010000:00010000:0.0:1763343285.539898:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a643d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a556 expref: 15 pid: 28562 timeout: 1178 lvb_type: 0 00000100:00100000:1.0:1763343285.540377:0:35278:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400086656 00000100:00100000:1.0:1763343285.540382:0:35278:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400086656 00010000:00010000:1.0:1763343285.540409:0:35278:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a6452 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a564 expref: 32 pid: 28562 timeout: 1178 lvb_type: 0 00000100:00100000:1.0:1763343285.540440:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3651 00000100:00100000:1.0:1763343285.540450:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998400086784:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343285.540468:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343285.540489:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a643d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a556 expref: 15 pid: 28562 timeout: 1178 lvb_type: 0 00010000:00010000:1.0:1763343285.540501:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a643d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a556 expref: 15 pid: 28562 timeout: 1178 lvb_type: 0 00010000:00010000:1.0:1763343285.540529:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a643d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a556 expref: 15 pid: 28562 timeout: 1178 lvb_type: 0 00010000:00010000:1.0:1763343285.540545:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343285.540547:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343285.540553:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a6578 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.540563:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a6578 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.540594:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343285.540651:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998400086784:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 202us (1660us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.540660:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3651 00000100:00100000:1.0:1763343285.540679:0:35278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3652 00000100:00100000:1.0:1763343285.540685:0:35278:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+32:2408:x1848998400086656:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343285.540694:0:35278:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343285.540706:0:35278:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a6452 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a564 expref: 32 pid: 28562 timeout: 1178 lvb_type: 0 00010000:00010000:1.0:1763343285.540717:0:35278:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a6452 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a564 expref: 32 pid: 28562 timeout: 1178 lvb_type: 0 00010000:00010000:1.0:1763343285.540731:0:35278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5176200/0x9104b1ba770a6452 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a564 expref: 32 pid: 28562 timeout: 1178 lvb_type: 0 00010000:00010000:1.0:1763343285.540741:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343285.540742:0:35278:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343285.540746:0:35278:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a6571 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.540753:0:35278:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a6571 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.540770:0:35278:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343285.540789:0:35278:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+31:2408:x1848998400086656:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 103us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.540796:0:35278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3652 00010000:00010000:1.0:1763343285.540822:0:8626:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a6578 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.540831:0:8626:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a6578 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.540850:0:8626:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a6578 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.540857:0:8626:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a6578 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.540865:0:8626:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a6578 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.540872:0:8626:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501ac00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343285.540876:0:8626:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a6578 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.540885:0:8626:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a6578 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.540896:0:8626:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a6578 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.540903:0:8626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c501ac00/0x9104b1ba770a6578 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343285.540950:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+13:2408:x1848998400086272:12345-192.168.201.40@tcp:1:lfs.0 Request processed in 12177us (13746us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.540956:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7675 00010000:00010000:1.0:1763343285.540981:0:28562:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a6571 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.540988:0:28562:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a6571 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.541000:0:28562:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a6571 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.541007:0:28562:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a6571 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.541014:0:28562:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a6571 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.541019:0:28562:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343285.541022:0:28562:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a6571 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.541048:0:28562:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a6571 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.541058:0:28562:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a6571 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.541064:0:28562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5089000/0x9104b1ba770a6571 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343285.541111:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+30:2408:x1848998400086400:12345-192.168.201.40@tcp:1:lfs.0 Request processed in 11302us (12947us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.541117:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7677 00000100:00100000:3.0:1763343285.544716:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343285.544754:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343285.545470:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.546148:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400087040 00000100:00100000:0.0:1763343285.546161:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400087040 00000100:00100000:0.0:1763343285.546209:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400086912 00000100:00100000:0.0:1763343285.546212:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400086912 00000100:00100000:0.0:1763343285.546228:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400087168 00000100:00100000:0.0:1763343285.546230:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400087168 00000100:00100000:0.0:1763343285.546251:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7678 00000100:00100000:0.0:1763343285.546261:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998400087040:12345-192.168.201.40@tcp:101:lfs.0 00000100:00100000:3.0:1763343285.546365:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7679 00000100:00100000:3.0:1763343285.546375:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998400086912:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343285.546392:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343285.546415:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a657f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a5cd expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343285.546440:0:8414:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x77:0x0] initial LVB size: 232236, mtime: 0x691a7bb4, atime: 0x691a7bb4, ctime: 0x691a7bb4, blocks: 0x190 00010000:00010000:3.0:1763343285.546463:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343285.546465:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343285.546475:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a657f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5cd expref: 15 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343285.546491:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a657f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5cd expref: 15 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343285.546504:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401f1bf1c00, rc 0) 00000100:00100000:3.0:1763343285.546562:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998400086912:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 189us (1806us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343285.546570:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7679 00000100:00100000:3.0:1763343285.546588:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7680 00000100:00100000:3.0:1763343285.546595:0:8414:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+30:2408:x1848998400087168:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343285.546603:0:8414:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343285.546614:0:8414:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf0200/0x9104b1ba770a6586 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a5db expref: -99 pid: 8414 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343285.546628:0:8414:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 0, mtime: 0x691a7bb4, atime: 0x0, ctime: 0x691a7bb4, blocks: 0x0 00010000:00010000:3.0:1763343285.546637:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343285.546638:0:8414:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343285.546643:0:8414:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf0200/0x9104b1ba770a6586 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5db expref: 31 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343285.546653:0:8414:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf0200/0x9104b1ba770a6586 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5db expref: 31 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343285.546661:0:8414:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9401f1bf0200, rc 0) 00000100:00100000:3.0:1763343285.546681:0:8414:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+31:2408:x1848998400087168:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 87us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343285.546688:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7680 00010000:00010000:0.0:1763343285.547013:0:8626:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343285.547049:0:8626:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a658d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a5d4 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343285.547063:0:8626:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 0, mtime: 0x691a7bb4, atime: 0x0, ctime: 0x691a7bb4, blocks: 0x1800 00010000:00010000:0.0:1763343285.547072:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343285.547074:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343285.547089:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a658d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5d4 expref: 15 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343285.547101:0:8626:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a658d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5d4 expref: 15 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343285.547109:0:8626:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c501ba00, rc 0) 00000100:00100000:0.0:1763343285.547129:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998400087040:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 871us (2424us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343285.547135:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7678 00000100:00100000:3.0:1763343285.576439:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.576555:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400087296 00000100:00100000:0.0:1763343285.576566:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400087296 00000100:00100000:0.0:1763343285.576635:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7681 00000100:00100000:0.0:1763343285.576647:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998400087296:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:0.0:1763343285.576804:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998400087296:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 158us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343285.576812:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7681 00000100:00100000:0.0:1763343285.589688:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.589789:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400087424 00000100:00100000:2.0:1763343285.589799:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400087424 00000100:00100000:1.0:1763343285.589909:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11223 00000100:00100000:1.0:1763343285.589920:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+82:57822:x1848998400087424:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343285.589945:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343285.589967:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089000/0x9104b1ba770a6594 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a5e2 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.590005:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089200/0x9104b1ba770a659b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.590018:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089200/0x9104b1ba770a659b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.590121:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089200/0x9104b1ba770a659b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.590254:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089000/0x9104b1ba770a6594 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5e2 expref: 84 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.590274:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089200/0x9104b1ba770a659b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5e2 expref: 83 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.590283:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff9401fc4f1800) 00010000:00010000:1.0:1763343285.590287:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343285.590291:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089200, rc 0) 00000100:00100000:3.0:1763343285.593512:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.594295:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400087680 00000100:00100000:2.0:1763343285.594306:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400087680 00000100:00100000:2.0:1763343285.594367:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11224 00000100:00100000:2.0:1763343285.594377:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+84:57822:x1848998400087680:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:2.0:1763343285.594442:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343285.594467:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089600/0x9104b1ba770a6540 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5b1 expref: 84 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.594485:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff9401fc4f1800) 00010000:00010000:2.0:1763343285.594489:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343285.594634:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a65a2 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.594646:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a65a2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.594654:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a65a2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00000001:00080000:2.0:1763343285.594691:0:6524:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935426 00000004:00010000:2.0:1763343285.594711:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000790f29fb reply state 00000000ad7b1ca7 transno 8589935427 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a65a2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.594723:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a65a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.594729:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff9401fc4f1800) 00010000:00010000:2.0:1763343285.594731:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343285.594734:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343285.594825:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+86:57822:x1848998400087680:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 448us (1323us total) trans 8589935427 rc 0/0 00000100:00100000:2.0:1763343285.594833:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11224 00000020:00080000:2.0:1763343285.594838:0:6524:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343285.595437:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+85:57822:x1848998400087424:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 5515us (5757us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.595444:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11223 00000100:00100000:3.0:1763343285.599283:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.599432:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400087808 00000100:00100000:1.0:1763343285.599444:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400087808 00000100:00100000:1.0:1763343285.599516:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11225 00000100:00100000:1.0:1763343285.599527:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+85:57822:x1848998400087808:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343285.599555:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343285.599581:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089000/0x9104b1ba770a65a9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a5e9 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.599652:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089000/0x9104b1ba770a65a9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5e9 expref: 86 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.599666:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089000/0x9104b1ba770a65a9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5e9 expref: 86 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.599682:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff9401fc4f1800) 00010000:00010000:1.0:1763343285.599685:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343285.599689:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089000, rc 0) 00000100:00100000:1.0:1763343285.599758:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+86:57822:x1848998400087808:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 232us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.599766:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11225 00000100:00100000:0.0:1763343285.601663:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.601928:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400087936 00000100:00100000:2.0:1763343285.601939:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400087936 00000100:00100000:2.0:1763343285.601996:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7682 00000100:00100000:2.0:1763343285.602006:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+31:57822:x1848998400087936:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343285.602022:0:28561:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343285.602141:0:28561:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65b0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a5f0 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.602170:0:28561:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a6547 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5b8 expref: 32 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343285.602179:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.602181:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.602186:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65b0 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5f0 expref: 32 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.602218:0:28561:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a6547 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5b8 expref: 32 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343285.602233:0:28561:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a6547 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5b8 expref: 32 pid: 8626 timeout: 1178 lvb_type: 1 00000100:00100000:2.0:1763343285.602245:0:28561:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28561:1848998413038208:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343285.602423:0:28561:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f664c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343285.604156:0:28561:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28561:1848998413038208:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343285.604191:0:28561:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65b0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5f0 expref: 32 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.604215:0:28561:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89800, rc 0) 00000100:00100000:2.0:1763343285.604271:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+32:57822:x1848998400087936:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2265us (2616us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343285.604280:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7682 00000100:00100000:3.0:1763343285.604411:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.604476:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400088064 00000100:00100000:2.0:1763343285.604483:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400088064 00010000:00010000:2.0:1763343285.604511:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a6547 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5b8 expref: 32 pid: 8626 timeout: 1178 lvb_type: 1 00000100:00100000:2.0:1763343285.604552:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3653 00000100:00100000:2.0:1763343285.604560:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+32:2408:x1848998400088064:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343285.604574:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343285.604579:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a6547 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5b8 expref: 32 pid: 8626 timeout: 1178 lvb_type: 1 00010000:00010000:2.0:1763343285.604592:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a6547 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5b8 expref: 32 pid: 8626 timeout: 1178 lvb_type: 1 00010000:00010000:2.0:1763343285.604614:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a6547 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5b8 expref: 32 pid: 8626 timeout: 1178 lvb_type: 1 00010000:00010000:2.0:1763343285.604627:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.604629:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.604634:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5f0 expref: 31 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.604649:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5f0 expref: 31 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.604679:0:14071:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5f0 expref: 31 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343285.604692:0:14071:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:14071:1848998413038336:192.168.201.40@tcp:105: 00000100:00100000:2.0:1763343285.604747:0:14071:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f664c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343285.606934:0:14071:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:14071:1848998413038336:192.168.201.40@tcp:105: 00010000:00010000:2.0:1763343285.606965:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343285.607070:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+31:2408:x1848998400088064:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 2509us (2658us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343285.607092:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3653 00000100:00100000:3.0:1763343285.607187:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.607311:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400088192 00000100:00100000:2.0:1763343285.607317:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400088192 00000100:00100000:2.0:1763343285.607538:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7683 00000100:00100000:2.0:1763343285.607548:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:57822:x1848998400088192:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343285.607567:0:28561:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343285.607585:0:28561:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a65b7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a5f7 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.607616:0:28561:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a654e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5bf expref: 16 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343285.607631:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.607633:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.607637:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a65b7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5f7 expref: 16 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.607674:0:28561:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a654e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5bf expref: 16 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343285.607688:0:28561:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a654e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5bf expref: 16 pid: 28562 timeout: 1178 lvb_type: 1 00000100:00100000:2.0:1763343285.607703:0:28561:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998413038464:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343285.607771:0:28561:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f664c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343285.609534:0:28561:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998413038464:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343285.609566:0:28561:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a65b7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5f7 expref: 16 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.609584:0:28561:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88000, rc 0) 00000100:00100000:2.0:1763343285.610172:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:57822:x1848998400088192:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2622us (2983us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343285.610184:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7683 00000100:00100000:3.0:1763343285.610462:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.610517:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400088320 00000100:00100000:2.0:1763343285.610524:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400088320 00010000:00010000:2.0:1763343285.610555:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a654e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5bf expref: 16 pid: 28562 timeout: 1178 lvb_type: 1 00000100:00100000:2.0:1763343285.610596:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3654 00000100:00100000:2.0:1763343285.610606:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400088320:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343285.610622:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343285.610628:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a654e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5bf expref: 16 pid: 28562 timeout: 1178 lvb_type: 1 00010000:00010000:2.0:1763343285.610640:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a654e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5bf expref: 16 pid: 28562 timeout: 1178 lvb_type: 1 00010000:00010000:2.0:1763343285.610664:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5088a00/0x9104b1ba770a654e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5bf expref: 16 pid: 28562 timeout: 1178 lvb_type: 1 00010000:00010000:2.0:1763343285.610678:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.610680:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.610686:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a65b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5f7 expref: 15 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.610697:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a65b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5f7 expref: 15 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.610729:0:14071:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88000/0x9104b1ba770a65b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5f7 expref: 15 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343285.610742:0:14071:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:14071:1848998413038592:192.168.201.40@tcp:105: 00000100:00100000:2.0:1763343285.610802:0:14071:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f664c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343285.613014:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343285.613111:0:23992:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400088448 00000100:00100000:3.0:1763343285.613121:0:23992:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400088448 00000100:00100000:2.0:1763343285.613155:0:14071:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:14071:1848998413038592:192.168.201.40@tcp:105: 00002000:00010000:3.0:1763343285.613160:0:23992:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:3.0:1763343285.613164:0:23992:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c390c000 with x1848998400088448 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343285.613174:0:23992:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c390c000. 00010000:00010000:2.0:1763343285.613174:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343285.613205:0:23992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1870 00000100:00100000:3.0:1763343285.613215:0:23992:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+31:2407:x1848998400088448:12345-192.168.201.40@tcp:10:lfs.0 00000100:00100000:0.0:1763343285.613354:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.613441:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998400088320:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 2834us (2978us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343285.613447:0:8417:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400088576 00000100:00100000:2.0:1763343285.613451:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3654 00000100:00100000:0.0:1763343285.613451:0:8417:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400088576 00002000:00010000:2.0:1763343285.613779:0:23992:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343285.613783:0:23992:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 0 -> 1763343284 00002000:00010000:2.0:1763343285.613785:0:23992:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343285.613787:0:23992:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 0 -> 1763343284 00002000:00010000:2.0:1763343285.613790:0:23992:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343285.613815:0:23992:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+32:2407:x1848998400088448:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 602us (811us total) trans 21474839397 rc 0/0 00000100:00100000:2.0:1763343285.613822:0:23992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1870 00002000:00010000:2.0:1763343285.613825:0:23992:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:2.0:1763343285.613827:0:23992:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c390c000 with x1848998400088448 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343285.613831:0:23992:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c390c000. 00002000:00010000:0.0:1763343285.613910:0:8417:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/122 (0->18446744073709551615) 00002000:00100000:0.0:1763343285.613915:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c390e680 with x1848998400088576 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343285.613921:0:8417:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c390e680. 00000100:00100000:0.0:1763343285.613945:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1871 00000100:00100000:0.0:1763343285.613957:0:8417:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998400088576:12345-192.168.201.40@tcp:10:lfs.0 00002000:00010000:0.0:1763343285.614136:0:8417:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343285.614140:0:8417:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 0 -> 1763343284 00002000:00010000:0.0:1763343285.614142:0:8417:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343285.614145:0:8417:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 0 -> 1763343284 00002000:00010000:0.0:1763343285.614147:0:8417:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343285.614172:0:8417:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400088576:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 221us (819us total) trans 17179872151 rc 0/0 00000100:00100000:0.0:1763343285.614179:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1871 00002000:00010000:0.0:1763343285.614183:0:8417:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/122 (0->18446744073709551615) 00002000:00100000:0.0:1763343285.614185:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c390e680 with x1848998400088576 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343285.614190:0:8417:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c390e680. 00000100:00100000:3.0:1763343285.616229:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.616436:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400088704 00000100:00100000:2.0:1763343285.616445:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400088704 00000100:00100000:2.0:1763343285.616496:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7684 00000100:00100000:2.0:1763343285.616506:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400088704:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:2.0:1763343285.616628:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400088704:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 123us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343285.616635:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7684 00000100:00100000:0.0:1763343285.618741:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.618927:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400088832 00000100:00100000:2.0:1763343285.618937:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400088832 00000100:00100000:2.0:1763343285.618988:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7685 00000100:00100000:2.0:1763343285.618997:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400088832:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:2.0:1763343285.619175:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400088832:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 178us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343285.619184:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7685 00000100:00100000:1.0:1763343285.622562:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.622650:0:8417:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400088960 00000100:00100000:0.0:1763343285.622661:0:8417:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400088960 00000100:00100000:0.0:1763343285.622728:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1872 00000100:00100000:0.0:1763343285.622738:0:8417:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5950e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400088960:12345-192.168.201.40@tcp:3:lfs.0 00010000:00010000:0.0:1763343285.622795:0:8417:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c501be00/0x9104b1ba770a65be lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.622812:0:8417:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343285.622815:0:8417:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343285.622820:0:8417:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501be00/0x9104b1ba770a65be lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [4096->12287] (req 4096->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.623199:0:8417:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c501be00/0x9104b1ba770a65be lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [4096->12287] (req 4096->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.623331:0:8417:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c501be00/0x9104b1ba770a65be lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [4096->12287] (req 4096->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.623341:0:8417:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501be00/0x9104b1ba770a65be lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [4096->12287] (req 4096->12287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.623350:0:8417:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c501be00/0x9104b1ba770a65be lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [4096->12287] (req 4096->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.623357:0:8417:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501be00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:0.0:1763343285.623453:0:8417:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c501be00/0x9104b1ba770a65be lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [4096->12287] (req 4096->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.623463:0:8417:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c501be00/0x9104b1ba770a65be lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [4096->12287] (req 4096->12287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.623485:0:8417:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c501be00/0x9104b1ba770a65be lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [4096->12287] (req 4096->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.623492:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c501be00/0x9104b1ba770a65be lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [4096->12287] (req 4096->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343285.623581:0:8417:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5950e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400088960:12345-192.168.201.40@tcp:3:lfs.0 Request processed in 842us (1029us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1763343285.623588:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1872 00000100:00100000:3.0:1763343285.627615:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.627886:0:23992:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400089088 00000100:00100000:2.0:1763343285.627900:0:23992:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400089088 00000100:00100000:2.0:1763343285.628251:0:23992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1873 00000100:00100000:2.0:1763343285.628263:0:23992:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+32:2407:x1848998400089088:12345-192.168.201.40@tcp:4:lfs.0 00010000:00010000:2.0:1763343285.628301:0:23992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a65c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.628322:0:23992:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5f0 expref: 32 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.628330:0:23992:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343285.628332:0:23992:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343285.628337:0:23992:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a65c5 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [4096->12287] (req 4096->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.628377:0:23992:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5f0 expref: 32 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.628392:0:23992:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5f0 expref: 32 pid: 28561 timeout: 1178 lvb_type: 0 00000100:00100000:2.0:1763343285.628406:0:23992:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0000_UUID:23992:1848998413038720:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343285.628479:0:23992:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f664c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343285.633004:0:23992:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0000_UUID:23992:1848998413038720:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343285.633064:0:23992:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a65c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [4096->12287] (req 4096->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343285.634404:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.634690:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400089216 00000100:00100000:2.0:1763343285.634701:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400089216 00010000:00010000:2.0:1763343285.634742:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5f0 expref: 33 pid: 28561 timeout: 1178 lvb_type: 0 00000100:00100000:2.0:1763343285.634792:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3655 00000100:00100000:2.0:1763343285.634802:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5867100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+33:2408:x1848998400089216:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343285.634822:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343285.634843:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5f0 expref: 33 pid: 28561 timeout: 1178 lvb_type: 0 00010000:00010000:2.0:1763343285.634855:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5f0 expref: 33 pid: 28561 timeout: 1178 lvb_type: 0 00010000:00010000:2.0:1763343285.634881:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5f0 expref: 33 pid: 28561 timeout: 1178 lvb_type: 0 00010000:00010000:2.0:1763343285.634899:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.634901:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.634906:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a65c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [4096->12287] (req 4096->12287) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.634922:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a65c5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [4096->12287] (req 4096->12287) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.634962:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343285.635001:0:23992:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a65c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [4096->12287] (req 4096->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343285.635012:0:23992:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a65c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [4096->12287] (req 4096->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343285.635065:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5867100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+32:2408:x1848998400089216:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 221us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343285.635076:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3655 00000001:00080000:0.0:1763343285.639291:0:24675:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839398 is committed 00000001:00080000:0.0:1763343285.639345:0:24675:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839381 is committed 00002000:00010000:2.0:1763343285.639846:0:23992:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 0 -> 12288 00002000:00010000:2.0:1763343285.639851:0:23992:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:2.0:1763343285.639864:0:23992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a65c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [4096->12287] (req 4096->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.639876:0:23992:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a65c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [4096->12287] (req 4096->12287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.639886:0:23992:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a65c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [4096->12287] (req 4096->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.639892:0:23992:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343285.639896:0:23992:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a65c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [4096->12287] (req 4096->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.639906:0:23992:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a65c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [4096->12287] (req 4096->12287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.639925:0:23992:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a65c5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [4096->12287] (req 4096->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.639937:0:23992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a65c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [4096->12287] (req 4096->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343285.640559:0:23992:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998400089088:12345-192.168.201.40@tcp:4:lfs.0 Request processed in 12291us (12950us total) trans 21474839398 rc 0/0 00000100:00100000:2.0:1763343285.640570:0:23992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1873 00000100:00100000:3.0:1763343285.644361:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.644437:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400089344 00000100:00100000:0.0:1763343285.644448:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400089344 00000100:00100000:0.0:1763343285.644517:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7686 00000100:00100000:0.0:1763343285.644528:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5864380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2409:x1848998400089344:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:0.0:1763343285.644670:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5864380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2409:x1848998400089344:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 143us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343285.644677:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7686 00000100:00100000:1.0:1763343285.646312:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.646355:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400089472 00000100:00100000:0.0:1763343285.646363:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400089472 00000100:00100000:0.0:1763343285.646402:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7687 00000100:00100000:0.0:1763343285.646408:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5950700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400089472:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:0.0:1763343285.646497:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5950700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400089472:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 88us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343285.646501:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7687 00000100:00100000:1.0:1763343285.648652:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.648754:0:23992:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400089600 00000100:00100000:2.0:1763343285.648764:0:23992:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400089600 00000100:00100000:2.0:1763343285.648833:0:23992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1874 00000100:00100000:2.0:1763343285.648843:0:23992:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400089600:12345-192.168.201.40@tcp:3:lfs.0 00010000:00010000:2.0:1763343285.648882:0:23992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a65cc lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.648898:0:23992:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.648900:0:23992:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.648906:0:23992:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a65cc lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [28672->73727] (req 28672->73727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.648919:0:23992:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a65cc lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [28672->73727] (req 28672->73727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.650900:0:23992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a65cc lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [28672->73727] (req 28672->73727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.650921:0:23992:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a65cc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [28672->73727] (req 28672->73727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.650935:0:23992:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a65cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [28672->73727] (req 28672->73727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.650942:0:23992:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88200 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343285.650946:0:23992:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a65cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [28672->73727] (req 28672->73727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.650954:0:23992:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a65cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [28672->73727] (req 28672->73727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.650974:0:23992:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a65cc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [28672->73727] (req 28672->73727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.650983:0:23992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88200/0x9104b1ba770a65cc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [28672->73727] (req 28672->73727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343285.651120:0:23992:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400089600:12345-192.168.201.40@tcp:3:lfs.0 Request processed in 2272us (2472us total) trans 0 rc 45056/45056 00000100:00100000:2.0:1763343285.651131:0:23992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1874 00000100:00100000:1.0:1763343285.655168:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.655483:0:23992:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400089728 00000100:00100000:2.0:1763343285.655495:0:23992:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400089728 00000100:00100000:2.0:1763343285.655911:0:23992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1875 00000100:00100000:2.0:1763343285.655924:0:23992:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5951180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998400089728:12345-192.168.201.40@tcp:4:lfs.0 00002000:00010000:2.0:1763343285.655976:0:23992:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 12288, mtime: 0x691a7bb4, atime: 0x0, ctime: 0x691a7bb4, blocks: 0x10 00010000:00010000:2.0:1763343285.655985:0:23992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.656006:0:23992:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.656008:0:23992:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.656013:0:23992:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [28672->73727] (req 28672->73727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.656047:0:23992:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [28672->73727] (req 28672->73727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1763343285.665697:0:24675:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839399 is committed 00002000:00010000:2.0:1763343285.665898:0:23992:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 12288 -> 73728 00002000:00010000:2.0:1763343285.665903:0:23992:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 16 -> 104 00010000:00010000:2.0:1763343285.665917:0:23992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [28672->73727] (req 28672->73727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.665930:0:23992:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [28672->73727] (req 28672->73727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.665938:0:23992:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [28672->73727] (req 28672->73727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.665944:0:23992:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343285.665948:0:23992:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [28672->73727] (req 28672->73727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.665957:0:23992:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [28672->73727] (req 28672->73727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.665977:0:23992:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65d3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [28672->73727] (req 28672->73727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.665988:0:23992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [28672->73727] (req 28672->73727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343285.666943:0:23992:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5951180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998400089728:12345-192.168.201.40@tcp:4:lfs.0 Request processed in 11013us (11776us total) trans 21474839399 rc 0/0 00000100:00100000:2.0:1763343285.666955:0:23992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1875 00000100:00100000:3.0:1763343285.672408:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.672486:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400089856 00000100:00100000:0.0:1763343285.672499:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400089856 00000100:00100000:0.0:1763343285.672711:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7688 00000100:00100000:0.0:1763343285.672723:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5866a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400089856:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:0.0:1763343285.672896:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5866a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400089856:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 175us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343285.672904:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7688 00000100:00100000:0.0:1763343285.678394:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.678479:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400089984 00000100:00100000:1.0:1763343285.678490:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400089984 00000100:00100000:1.0:1763343285.678557:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7689 00000100:00100000:1.0:1763343285.678568:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401edde6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400089984:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:1.0:1763343285.679290:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401edde6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400089984:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 720us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.679299:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7689 00000100:00100000:1.0:1763343285.683088:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.686200:0:23992:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400090112 00000100:00100000:2.0:1763343285.686216:0:23992:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400090112 00000100:00100000:2.0:1763343285.686302:0:23992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1876 00000100:00100000:2.0:1763343285.686311:0:23992:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5952d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400090112:12345-192.168.201.40@tcp:3:lfs.0 00010000:00010000:2.0:1763343285.686365:0:23992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a65da lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.686380:0:23992:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.686383:0:23992:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.686389:0:23992:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a65da lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [204800->217087] (req 204800->217087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.686402:0:23992:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a65da lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [204800->217087] (req 204800->217087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.686517:0:23992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a65da lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [204800->217087] (req 204800->217087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.686526:0:23992:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a65da lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [204800->217087] (req 204800->217087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.686540:0:23992:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a65da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [204800->217087] (req 204800->217087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.686547:0:23992:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343285.686552:0:23992:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a65da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [204800->217087] (req 204800->217087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.686559:0:23992:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a65da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [204800->217087] (req 204800->217087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.686573:0:23992:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a65da lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [204800->217087] (req 204800->217087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.686580:0:23992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a65da lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [204800->217087] (req 204800->217087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343285.686662:0:23992:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5952d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400090112:12345-192.168.201.40@tcp:3:lfs.0 Request processed in 351us (3594us total) trans 0 rc 12288/12288 00000100:00100000:2.0:1763343285.686670:0:23992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1876 00000100:00100000:3.0:1763343285.692536:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.694747:0:8417:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400090240 00000100:00100000:0.0:1763343285.694767:0:8417:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400090240 00000100:00100000:0.0:1763343285.694859:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1877 00000100:00100000:0.0:1763343285.694869:0:8417:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5864700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998400090240:12345-192.168.201.40@tcp:4:lfs.0 00002000:00010000:0.0:1763343285.694920:0:8417:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 73728, mtime: 0x691a7bb4, atime: 0x0, ctime: 0x691a7bb4, blocks: 0x68 00010000:00010000:0.0:1763343285.694929:0:8417:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c501b000/0x9104b1ba770a65e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.694943:0:8417:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343285.694945:0:8417:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343285.694950:0:8417:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501b000/0x9104b1ba770a65e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [204800->217087] (req 204800->217087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.694963:0:8417:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c501b000/0x9104b1ba770a65e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [204800->217087] (req 204800->217087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1763343285.700992:0:24675:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839400 is committed 00002000:00010000:1.0:1763343285.701787:0:8417:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 73728 -> 217088 00002000:00010000:1.0:1763343285.701794:0:8417:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1763343284 -> 1763343285 00002000:00010000:1.0:1763343285.701796:0:8417:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1763343284 -> 1763343285 00002000:00010000:1.0:1763343285.701799:0:8417:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 104 -> 128 00010000:00010000:1.0:1763343285.701814:0:8417:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c501b000/0x9104b1ba770a65e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [204800->217087] (req 204800->217087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.701826:0:8417:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c501b000/0x9104b1ba770a65e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [204800->217087] (req 204800->217087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.701836:0:8417:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c501b000/0x9104b1ba770a65e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [204800->217087] (req 204800->217087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.701843:0:8417:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b000 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343285.701848:0:8417:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c501b000/0x9104b1ba770a65e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [204800->217087] (req 204800->217087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.701857:0:8417:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c501b000/0x9104b1ba770a65e1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [204800->217087] (req 204800->217087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.701885:0:8417:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c501b000/0x9104b1ba770a65e1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [204800->217087] (req 204800->217087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.701892:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c501b000/0x9104b1ba770a65e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [204800->217087] (req 204800->217087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343285.702843:0:8417:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5864700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998400090240:12345-192.168.201.40@tcp:4:lfs.0 Request processed in 7964us (10306us total) trans 21474839400 rc 0/0 00000100:00100000:1.0:1763343285.702854:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1877 00000100:00100000:1.0:1763343285.706345:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.706453:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400090368 00000100:00100000:0.0:1763343285.706464:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400090368 00000100:00100000:0.0:1763343285.706526:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7690 00000100:00100000:0.0:1763343285.706536:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5950700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400090368:12345-192.168.201.40@tcp:23:lfs.0 00000100:00100000:0.0:1763343285.706664:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5950700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400090368:12345-192.168.201.40@tcp:23:lfs.0 Request processed in 128us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343285.706672:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7690 00000100:00100000:3.0:1763343285.709319:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.709404:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400090624 00000100:00100000:2.0:1763343285.709414:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400090624 00000100:00100000:2.0:1763343285.709473:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11226 00000100:00100000:2.0:1763343285.709483:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+86:57822:x1848998400090624:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:2.0:1763343285.709715:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65e8 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.709732:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65e8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.709742:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65e8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00000001:00080000:2.0:1763343285.709782:0:6524:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935428 00000004:00010000:2.0:1763343285.709800:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000031ca7853 reply state 00000000530146a5 transno 8589935429 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65e8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.709812:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.709819:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff9401fc4f1800) 00010000:00010000:2.0:1763343285.709822:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343285.709825:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343285.709918:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+89:57822:x1848998400090624:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 436us (608us total) trans 8589935429 rc 0/0 00000100:00100000:2.0:1763343285.709926:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11226 00000020:00080000:2.0:1763343285.709931:0:6524:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343285.711762:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.711845:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400090752 00000100:00100000:2.0:1763343285.711856:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400090752 00000100:00100000:2.0:1763343285.711937:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7691 00000100:00100000:2.0:1763343285.711946:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5864e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:57822:x1848998400090752:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343285.711961:0:28561:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343285.711980:0:28561:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a65ef lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a5fe expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343285.712001:0:28561:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 217088, mtime: 0x691a7bb5, atime: 0x0, ctime: 0x691a7bb5, blocks: 0x80 00010000:00010000:2.0:1763343285.712156:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.712160:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.712168:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a65ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5fe expref: 15 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.712185:0:28561:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a65ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5fe expref: 15 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.712196:0:28561:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88200, rc 0) 00000100:00100000:2.0:1763343285.712251:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5864e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:57822:x1848998400090752:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 307us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343285.712258:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7691 00000100:00100000:0.0:1763343285.718516:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.718606:0:8417:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400090880 00000100:00100000:1.0:1763343285.718616:0:8417:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400090880 00002000:00010000:1.0:1763343285.718659:0:8417:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (232236->18446744073709551615) 00002000:00100000:1.0:1763343285.718664:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c390c700 with x1848998400090880 ext(232236->18446744073709551615) 00002000:00010000:1.0:1763343285.718675:0:8417:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c390c700. 00000100:00100000:1.0:1763343285.718712:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1878 00000100:00100000:1.0:1763343285.718722:0:8417:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998400090880:12345-192.168.201.40@tcp:10:lfs.0 00002000:00010000:1.0:1763343285.718929:0:8417:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 217088 -> 232236 00002000:00010000:1.0:1763343285.718933:0:8417:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1763343285 -> 1763343285 00002000:00010000:1.0:1763343285.718935:0:8417:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343285.718937:0:8417:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1763343285 -> 1763343285 00002000:00010000:1.0:1763343285.718940:0:8417:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 128 -> 128 00000100:00100000:1.0:1763343285.718996:0:8417:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998400090880:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 276us (491us total) trans 21474839401 rc 0/0 00000100:00100000:1.0:1763343285.719003:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1878 00002000:00010000:1.0:1763343285.719007:0:8417:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (232236->18446744073709551615) 00002000:00100000:1.0:1763343285.719010:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c390c700 with x1848998400090880 ext(232236->18446744073709551615) 00002000:00010000:1.0:1763343285.719014:0:8417:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9400c390c700. 00000100:00100000:3.0:1763343285.720942:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.721120:0:23992:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400091008 00000100:00100000:2.0:1763343285.721129:0:23992:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400091008 00002000:00010000:2.0:1763343285.721164:0:23992:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/122 (0->18446744073709551615) 00002000:00100000:2.0:1763343285.721169:0:23992:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5865180 with x1848998400091008 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343285.721178:0:23992:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5865180. 00000100:00100000:2.0:1763343285.721209:0:23992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1879 00000100:00100000:2.0:1763343285.721218:0:23992:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400091008:12345-192.168.201.40@tcp:10:lfs.0 00002000:00010000:2.0:1763343285.721339:0:23992:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343285.721343:0:23992:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1763343284 -> 1763343285 00002000:00010000:2.0:1763343285.721345:0:23992:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343285.721347:0:23992:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1763343284 -> 1763343285 00002000:00010000:2.0:1763343285.721349:0:23992:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343285.723192:0:23992:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998400091008:12345-192.168.201.40@tcp:10:lfs.0 Request processed in 1963us (2246us total) trans 17179872152 rc 0/0 00000100:00100000:2.0:1763343285.723204:0:23992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1879 00002000:00010000:2.0:1763343285.723212:0:23992:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/122 (0->18446744073709551615) 00002000:00100000:2.0:1763343285.723215:0:23992:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9400c5865180 with x1848998400091008 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343285.723225:0:23992:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9400c5865180. 00000100:00100000:3.0:1763343285.730691:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.730831:0:23992:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400091136 00000100:00100000:2.0:1763343285.730844:0:23992:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400091136 00000100:00100000:2.0:1763343285.731176:0:23992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1880 00000100:00100000:2.0:1763343285.731188:0:23992:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5864380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998400091136:12345-192.168.201.40@tcp:3:lfs.0 00010000:00010000:2.0:1763343285.731230:0:23992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a65f6 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.731246:0:23992:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.731248:0:23992:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.731253:0:23992:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a65f6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.731267:0:23992:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a65f6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.731384:0:23992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a65f6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.731393:0:23992:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a65f6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.731400:0:23992:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a65f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.731407:0:23992:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88e00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343285.731411:0:23992:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a65f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.731424:0:23992:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a65f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.731442:0:23992:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a65f6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.731449:0:23992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88e00/0x9104b1ba770a65f6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343285.732691:0:23992:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5864380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998400091136:12345-192.168.201.40@tcp:3:lfs.0 Request processed in 1497us (2003us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763343285.732703:0:23992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1880 00000100:00100000:0.0:1763343285.736511:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.736760:0:23992:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400091264 00000100:00100000:2.0:1763343285.736771:0:23992:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400091264 00000100:00100000:2.0:1763343285.736973:0:23992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1881 00000100:00100000:2.0:1763343285.736984:0:23992:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2410:x1848998400091264:12345-192.168.201.40@tcp:4:lfs.0 00010000:00010000:2.0:1763343285.737021:0:23992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a65fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.737179:0:23992:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a65ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5fe expref: 16 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.737188:0:23992:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343285.737190:0:23992:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343285.737194:0:23992:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a65fd lrc: 4/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.737237:0:23992:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a65ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5fe expref: 16 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.737251:0:23992:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a65ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5fe expref: 16 pid: 28561 timeout: 1178 lvb_type: 0 00000100:00100000:2.0:1763343285.737266:0:23992:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0000_UUID:23992:1848998413038848:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343285.737342:0:23992:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f664cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1763343285.739903:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.740320:0:23992:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0000_UUID:23992:1848998413038848:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343285.740344:0:23992:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a65fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343285.740414:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400091392 00000100:00100000:0.0:1763343285.740421:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400091392 00010000:00010000:0.0:1763343285.740451:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a65ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5fe expref: 17 pid: 28561 timeout: 1178 lvb_type: 0 00000100:00100000:0.0:1763343285.740475:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3656 00000100:00100000:0.0:1763343285.740483:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82df450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998400091392:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343285.740495:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343285.740513:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a65ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5fe expref: 17 pid: 28561 timeout: 1178 lvb_type: 0 00010000:00010000:0.0:1763343285.740524:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a65ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5fe expref: 17 pid: 28561 timeout: 1178 lvb_type: 0 00010000:00010000:0.0:1763343285.740545:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88200/0x9104b1ba770a65ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5fe expref: 17 pid: 28561 timeout: 1178 lvb_type: 0 00010000:00010000:0.0:1763343285.740559:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343285.740561:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343285.740566:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a65fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.740574:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a65fd lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.740601:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343285.740652:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82df450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400091392:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 168us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343285.740660:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3656 00010000:00010000:2.0:1763343285.741022:0:23992:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a65fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.741058:0:23992:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a65fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1763343285.745067:0:24675:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839402 is committed 00002000:00010000:2.0:1763343285.745207:0:23992:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 232236 -> 233472 00002000:00010000:2.0:1763343285.745212:0:23992:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 128 -> 136 00010000:00010000:2.0:1763343285.745224:0:23992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a65fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.745236:0:23992:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a65fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.745250:0:23992:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a65fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.745257:0:23992:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343285.745262:0:23992:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a65fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.745283:0:23992:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a65fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.745302:0:23992:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a65fd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.745310:0:23992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a65fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343285.745398:0:23992:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2410:x1848998400091264:12345-192.168.201.40@tcp:4:lfs.0 Request processed in 8412us (8893us total) trans 21474839402 rc 0/0 00000100:00100000:2.0:1763343285.745408:0:23992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1881 00000100:00100000:3.0:1763343285.749294:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.749884:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400091520 00000100:00100000:1.0:1763343285.749895:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400091520 00000100:00100000:1.0:1763343285.749959:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11227 00000100:00100000:1.0:1763343285.749969:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+89:57822:x1848998400091520:12345-192.168.201.40@tcp:44:lfs.0 00000001:00080000:0.0:1763343285.759902:0:32299:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935429 is committed 00000100:00100000:1.0:1763343285.760281:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+45:57822:x1848998400091520:12345-192.168.201.40@tcp:44:lfs.0 Request processed in 10304us (10990us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.760294:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11227 00010000:00010000:2.0:1763343285.761332:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a2e00/0x9104b1ba770a62b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761349:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a2e00/0x9104b1ba770a62b5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761357:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a2e00/0x9104b1ba770a62b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761364:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a2e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343285.761369:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a2e00/0x9104b1ba770a62b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761378:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a2e00/0x9104b1ba770a62b5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761399:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x85409d3b (ffff9401f669ec00) 00010000:00010000:2.0:1763343285.761403:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343285.761409:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a2e00/0x9104b1ba770a62b5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761416:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a2e00/0x9104b1ba770a62b5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761444:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a3000/0x9104b1ba770a62bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761450:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a3000/0x9104b1ba770a62bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761456:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a3000/0x9104b1ba770a62bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761461:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c89a3000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343285.761464:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a3000/0x9104b1ba770a62bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761469:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a3000/0x9104b1ba770a62bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761477:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x50:0x0].0x0 (ffff9401f669e300) 00010000:00010000:2.0:1763343285.761480:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343285.761483:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a3000/0x9104b1ba770a62bc lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761494:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c89a3000/0x9104b1ba770a62bc lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761505:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a62c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761511:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a62c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761516:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a62c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761521:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c6b99600 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343285.761524:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a62c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761530:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a62c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761536:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff9401f669e400) 00010000:00010000:2.0:1763343285.761539:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343285.761542:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a62c3 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761546:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c6b99600/0x9104b1ba770a62c3 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761566:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177800/0x9104b1ba770a634f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761572:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177800/0x9104b1ba770a634f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761577:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177800/0x9104b1ba770a634f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761582:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343285.761585:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177800/0x9104b1ba770a634f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761591:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177800/0x9104b1ba770a634f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761598:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0xdd396665 (ffff9401fc4f1600) 00010000:00010000:2.0:1763343285.761600:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343285.761603:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177800/0x9104b1ba770a634f lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761608:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177800/0x9104b1ba770a634f lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761622:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a63aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761630:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a63aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761635:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a63aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761638:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343285.761641:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a63aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761646:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a63aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761654:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.761657:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343285.761660:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a63aa lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761665:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a63aa lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761674:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a63d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761680:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a63d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761686:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a63d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761692:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343285.761695:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a63d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761700:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a63d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761707:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0xe8098f29 (ffff9401fc4f1000) 00010000:00010000:2.0:1763343285.761709:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343285.761712:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a63d4 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761718:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a63d4 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761731:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a640c lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761736:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a640c lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761743:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a640c lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761748:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c3917a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343285.761750:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a640c lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761756:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a640c lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761763:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.761764:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343285.761767:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a640c lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761771:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c3917a00/0x9104b1ba770a640c lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761781:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6413 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761786:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6413 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761792:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6413 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761797:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343285.761799:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6413 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761805:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6413 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761816:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.761818:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343285.761821:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6413 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761827:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6413 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761836:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2dea00/0x9104b1ba770a6428 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761842:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2dea00/0x9104b1ba770a6428 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761847:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2dea00/0x9104b1ba770a6428 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761852:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fd2dea00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343285.761854:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2dea00/0x9104b1ba770a6428 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761859:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2dea00/0x9104b1ba770a6428 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761865:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.761867:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343285.761869:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2dea00/0x9104b1ba770a6428 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761875:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9401fd2dea00/0x9104b1ba770a6428 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.761884:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a6444 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761890:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a6444 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761896:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a6444 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761900:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343285.761903:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a6444 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761907:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a6444 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761913:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.761915:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343285.761918:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a6444 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.761924:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a6444 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765213:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a6459 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765224:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a6459 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765233:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a6459 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765239:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343285.765244:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a6459 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765257:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a6459 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765277:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.765281:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343285.765285:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a6459 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765292:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177a00/0x9104b1ba770a6459 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765302:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88a00/0x9104b1ba770a6460 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765308:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88a00/0x9104b1ba770a6460 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765314:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88a00/0x9104b1ba770a6460 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765318:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343285.765321:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88a00/0x9104b1ba770a6460 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765326:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88a00/0x9104b1ba770a6460 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765332:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.765334:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343285.765337:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88a00/0x9104b1ba770a6460 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765342:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88a00/0x9104b1ba770a6460 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765354:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a6467 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765360:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a6467 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765365:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a6467 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765369:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5177e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343285.765372:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a6467 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765377:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a6467 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765383:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.765385:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343285.765387:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a6467 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765392:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177e00/0x9104b1ba770a6467 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765399:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89200/0x9104b1ba770a6483 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765404:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89200/0x9104b1ba770a6483 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765410:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89200/0x9104b1ba770a6483 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765415:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343285.765419:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89200/0x9104b1ba770a6483 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765424:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89200/0x9104b1ba770a6483 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765431:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.765433:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343285.765435:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89200/0x9104b1ba770a6483 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765440:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89200/0x9104b1ba770a6483 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765447:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89a00/0x9104b1ba770a6498 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765453:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89a00/0x9104b1ba770a6498 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765458:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89a00/0x9104b1ba770a6498 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765462:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343285.765464:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89a00/0x9104b1ba770a6498 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765469:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89a00/0x9104b1ba770a6498 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765475:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.765477:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343285.765479:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89a00/0x9104b1ba770a6498 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765489:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89a00/0x9104b1ba770a6498 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765498:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a64ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765503:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a64ad lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765507:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a64ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765512:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a6a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343285.765514:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a64ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765520:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a64ad lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765526:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.765529:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343285.765531:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a64ad lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765535:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a6a00/0x9104b1ba770a64ad lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765545:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a64c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765550:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a64c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765555:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a64c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765561:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a7200 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343285.765564:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a64c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765569:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a64c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765576:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.765579:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343285.765581:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a64c2 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765586:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7200/0x9104b1ba770a64c2 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765595:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a64d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765601:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a64d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765606:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a64d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765611:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9401fc4a7e00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343285.765614:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a64d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765619:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a64d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765627:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.765629:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343285.765633:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a64d7 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765638:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9401fc4a7e00/0x9104b1ba770a64d7 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.765648:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a65a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765654:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a65a2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765659:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a65a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765663:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343285.765666:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a65a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765672:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a65a2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765680:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff9401fc4f1800) 00010000:00010000:2.0:1763343285.765682:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343285.765684:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a65a2 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765690:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a65a2 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765699:0:3646:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765705:0:3646:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765715:0:3646:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765720:0:3646:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89800 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343285.765723:0:3646:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765728:0:3646:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765735:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff9401fc4f1800) 00010000:00010000:2.0:1763343285.765737:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343285.765739:0:3646:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65e8 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.765745:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a65e8 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00000100:00100000:3.0:1763343285.766550:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343285.766590:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.766942:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400091776 00000100:00100000:0.0:1763343285.766957:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400091776 00000100:00100000:0.0:1763343285.767053:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400091648 00000100:00100000:0.0:1763343285.767057:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400091648 00000100:00100000:0.0:1763343285.767102:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7692 00000100:00100000:0.0:1763343285.767113:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5867100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998400091776:12345-192.168.201.40@tcp:16:lfs.0 00000100:00100000:1.0:1763343285.767272:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7693 00000100:00100000:1.0:1763343285.767283:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998400091648:12345-192.168.201.40@tcp:16:lfs.0 00000100:00100000:1.0:1763343285.767381:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2407:x1848998400091648:12345-192.168.201.40@tcp:16:lfs.0 Request processed in 100us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.767390:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7693 00000001:00080000:1.0:1763343285.773898:0:25994:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872152 is committed 00000100:00100000:2.0:1763343285.774292:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5867100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998400091776:12345-192.168.201.40@tcp:16:lfs.0 Request processed in 7160us (7731us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343285.774308:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7692 00000100:00100000:3.0:1763343285.797488:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.798452:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400091904 00000100:00100000:2.0:1763343285.798468:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400091904 00000100:00100000:2.0:1763343285.798680:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7694 00000100:00100000:2.0:1763343285.798693:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998400091904:12345-192.168.201.40@tcp:1:lfs.0 00010000:00010000:2.0:1763343285.798751:0:8626:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a6604 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.798770:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.798773:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.798781:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a6604 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.798800:0:8626:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a6604 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.798833:0:8626:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a6604 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.798843:0:8626:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a6604 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.798853:0:8626:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a6604 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.798861:0:8626:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343285.798866:0:8626:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a6604 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.798875:0:8626:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a6604 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.798893:0:8626:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a6604 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.798901:0:8626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e89800/0x9104b1ba770a6604 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343285.804836:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998400091904:12345-192.168.201.40@tcp:1:lfs.0 Request processed in 6124us (7342us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343285.804859:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7694 00000100:00100000:3.0:1763343285.805798:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343285.805959:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.806066:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400092032 00000100:00100000:1.0:1763343285.806107:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400092032 00000100:00100000:1.0:1763343285.806176:0:28562:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400092160 00000100:00100000:1.0:1763343285.806180:0:28562:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400092160 00000100:00100000:1.0:1763343285.806211:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7695 00000100:00100000:1.0:1763343285.806221:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998400092032:12345-192.168.201.40@tcp:1:lfs.0 00010000:00010000:1.0:1763343285.806287:0:28562:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a660b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.806308:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343285.806311:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343285.806320:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a660b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.806344:0:28562:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a660b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.806384:0:28562:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a660b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.806394:0:28562:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a660b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.806403:0:28562:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a660b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.806417:0:28562:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089600 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343285.806422:0:28562:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a660b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.806431:0:28562:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a660b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.806448:0:28562:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a660b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.806456:0:28562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5089600/0x9104b1ba770a660b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343285.806558:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998400092032:12345-192.168.201.40@tcp:1:lfs.0 Request processed in 338us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.806567:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7695 00000100:00100000:1.0:1763343285.806585:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7696 00000100:00100000:1.0:1763343285.806593:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998400092160:12345-192.168.201.40@tcp:1:lfs.0 00010000:00010000:1.0:1763343285.806615:0:28562:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a6612 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.806624:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343285.806626:0:28562:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343285.806629:0:28562:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a6612 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.806638:0:28562:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a6612 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.806654:0:28562:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a6612 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.806662:0:28562:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a6612 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.806669:0:28562:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a6612 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.806675:0:28562:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5089c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343285.806679:0:28562:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a6612 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.806687:0:28562:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a6612 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.806696:0:28562:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a6612 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.806704:0:28562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5089c00/0x9104b1ba770a6612 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28562 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343285.806738:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:2408:x1848998400092160:12345-192.168.201.40@tcp:1:lfs.0 Request processed in 146us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.806744:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7696 00000100:00100000:0.0:1763343285.813587:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.813671:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400092416 00000100:00100000:1.0:1763343285.813685:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400092416 00000100:00100000:1.0:1763343285.813758:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11228 00000100:00100000:1.0:1763343285.813769:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:57822:x1848998400092416:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:1.0:1763343285.813880:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5088a00/0x9104b1ba770a6619 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.813900:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5088a00/0x9104b1ba770a6619 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.813913:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5088a00/0x9104b1ba770a6619 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00000004:00010000:1.0:1763343285.814121:0:9827:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004b2057f3 reply state 0000000069616138 transno 8589935430 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5088a00/0x9104b1ba770a6619 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.814136:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5088a00/0x9104b1ba770a6619 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:1.0:1763343285.814145:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff9401fc4f1800) 00010000:00010000:1.0:1763343285.814148:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343285.814153:0:9827:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343285.814292:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:57822:x1848998400092416:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 523us (718us total) trans 8589935430 rc 0/0 00000100:00100000:1.0:1763343285.814301:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11228 00000100:00100000:3.0:1763343285.818267:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.818424:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400092544 00000100:00100000:2.0:1763343285.818439:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400092544 00000100:00100000:2.0:1763343285.818511:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7697 00000100:00100000:2.0:1763343285.818524:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+14:57822:x1848998400092544:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343285.818547:0:8626:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343285.818576:0:8626:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a6620 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a605 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343285.818607:0:8626:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 233472, mtime: 0x691a7bb5, atime: 0x0, ctime: 0x691a7bb5, blocks: 0x88 00010000:00010000:2.0:1763343285.818635:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.818638:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.818647:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a6620 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a605 expref: 15 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.818665:0:8626:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a6620 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a605 expref: 15 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.818680:0:8626:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89800, rc 0) 00000100:00100000:2.0:1763343285.820959:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:57822:x1848998400092544:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2420us (2691us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343285.820973:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7697 00000100:00100000:0.0:1763343285.825465:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.826784:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400092672 00000100:00100000:2.0:1763343285.826805:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400092672 00000100:00100000:2.0:1763343285.826886:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7698 00000100:00100000:2.0:1763343285.826899:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2407:x1848998400092672:12345-192.168.201.40@tcp:2:lfs.0 00002000:00010000:2.0:1763343285.827144:0:8626:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 233472 -> 233472 00002000:00010000:2.0:1763343285.827148:0:8626:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1763343285 -> 1763343284 00002000:00010000:2.0:1763343285.827151:0:8626:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 1763343284 00002000:00010000:2.0:1763343285.827153:0:8626:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1763343285 -> 1763343285 00002000:00010000:2.0:1763343285.827155:0:8626:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 136 -> 136 00000100:00100000:2.0:1763343285.827227:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400092672:12345-192.168.201.40@tcp:2:lfs.0 Request processed in 331us (1777us total) trans 21474839403 rc 0/0 00000100:00100000:2.0:1763343285.827234:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7698 00000100:00100000:3.0:1763343285.827361:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.827785:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400092800 00000100:00100000:2.0:1763343285.827791:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400092800 00000100:00100000:0.0:1763343285.828449:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7699 00000100:00100000:1.0:1763343285.828583:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+15:2408:x1848998400092800:12345-192.168.201.40@tcp:2:lfs.0 00002000:00010000:1.0:1763343285.828746:0:8626:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343285.828750:0:8626:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1763343285 -> 1763343284 00002000:00010000:1.0:1763343285.828753:0:8626:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 1763343284 00002000:00010000:1.0:1763343285.828755:0:8626:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1763343285 -> 1763343285 00002000:00010000:1.0:1763343285.828758:0:8626:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343285.829313:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998400092800:12345-192.168.201.40@tcp:2:lfs.0 Request processed in 850us (1948us total) trans 17179872153 rc 0/0 00000100:00100000:1.0:1763343285.829323:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7699 00000100:00100000:3.0:1763343285.832013:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.832191:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400093056 00000100:00100000:2.0:1763343285.832205:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400093056 00000100:00100000:2.0:1763343285.832285:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11229 00000100:00100000:2.0:1763343285.832298:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:57822:x1848998400093056:12345-192.168.201.40@tcp:55:lfs.0 00010000:00010000:2.0:1763343285.832393:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6627 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.832414:0:6524:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089200/0x9104b1ba770a659b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5e2 expref: 29 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.832426:0:6524:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6627 lrc: 4/0,1 mode: --/PW res: [0x200000405:0x54:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.832471:0:6524:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089200/0x9104b1ba770a659b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5e2 expref: 29 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.832488:0:6524:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089200/0x9104b1ba770a659b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5e2 expref: 29 pid: 9827 timeout: 1178 lvb_type: 0 00000100:00100000:2.0:1763343285.832512:0:6524:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1848998413038976:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343285.832618:0:6524:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f664c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343285.835645:0:6524:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1848998413038976:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343285.835681:0:6524:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6627 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x54:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00000100:00100000:3.0:1763343285.836280:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.836849:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400093184 00000100:00100000:1.0:1763343285.836865:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400093184 00010000:00010000:1.0:1763343285.836915:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089200/0x9104b1ba770a659b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5e2 expref: 30 pid: 9827 timeout: 1178 lvb_type: 0 00000100:00100000:1.0:1763343285.836959:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3657 00000100:00100000:1.0:1763343285.836971:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+30:2407:x1848998400093184:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343285.836990:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343285.836998:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089200/0x9104b1ba770a659b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5e2 expref: 30 pid: 9827 timeout: 1178 lvb_type: 0 00010000:00010000:1.0:1763343285.837012:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089200/0x9104b1ba770a659b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5e2 expref: 30 pid: 9827 timeout: 1178 lvb_type: 0 00010000:00010000:1.0:1763343285.837089:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089200/0x9104b1ba770a659b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5e2 expref: 30 pid: 9827 timeout: 1178 lvb_type: 0 00010000:00010000:1.0:1763343285.837109:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff9401fc4f1800) 00010000:00010000:1.0:1763343285.837115:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6627 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x54:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.837126:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6627 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.837134:0:7904:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6627 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.837160:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343285.837228:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:2407:x1848998400093184:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 259us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.837237:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3657 00010000:00010000:2.0:1763343285.837537:0:6524:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6627 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.837548:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6627 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.837601:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6627 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.837608:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6627 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.837615:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6627 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.837622:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343285.837626:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6627 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.837633:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6627 lrc: 4/0,0 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.837642:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff9401fc4f1800) 00010000:00010000:2.0:1763343285.837645:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1763343285.837649:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6627 lrc: 2/0,0 mode: --/PW res: [0x200000405:0x54:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.837655:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6627 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x54:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00000100:00100000:2.0:1763343285.837713:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:57822:x1848998400093056:12345-192.168.201.40@tcp:55:lfs.0 Request processed in 5418us (5716us total) trans 0 rc -22/-22 00000100:00100000:2.0:1763343285.837721:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11229 00000100:00100000:3.0:1763343285.839855:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.840132:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400093440 00000100:00100000:2.0:1763343285.840145:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400093440 00000100:00100000:2.0:1763343285.840740:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11230 00000100:00100000:2.0:1763343285.840754:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:57822:x1848998400093440:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:2.0:1763343285.840823:0:6524:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343285.840855:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89c00/0x9104b1ba770a64e5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a595 expref: 28 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.840881:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.840886:0:6524:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343285.840952:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89a00/0x9104b1ba770a662e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.840970:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89a00/0x9104b1ba770a662e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.840981:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89a00/0x9104b1ba770a662e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00000004:00010000:2.0:1763343285.841186:0:6524:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d2e33c7f reply state 00000000952ae74f transno 8589935431 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89a00/0x9104b1ba770a662e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.841200:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89a00/0x9104b1ba770a662e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:2.0:1763343285.841208:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.841211:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343285.841214:0:6524:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343285.841496:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:57822:x1848998400093440:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 744us (1650us total) trans 8589935431 rc 0/0 00000100:00100000:2.0:1763343285.841505:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11230 00000100:00100000:0.0:1763343285.844998:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.845579:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400093568 00000100:00100000:1.0:1763343285.845593:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400093568 00000100:00100000:1.0:1763343285.845663:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7700 00000100:00100000:1.0:1763343285.845675:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:57822:x1848998400093568:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343285.845700:0:8626:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343285.845724:0:8626:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a6635 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a60c expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.845769:0:8626:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a657f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5cd expref: 17 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343285.845777:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343285.845780:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343285.845785:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a6635 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a60c expref: 17 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.845827:0:8626:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a657f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5cd expref: 17 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343285.845842:0:8626:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a657f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5cd expref: 17 pid: 8414 timeout: 1178 lvb_type: 1 00000100:00100000:1.0:1763343285.845857:0:8626:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5951880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998413039104:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343285.845961:0:8626:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c4532540 going to sleep for 11 seconds 00000100:00100000:1.0:1763343285.849416:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5951880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998413039104:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343285.849473:0:8626:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a6635 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a60c expref: 17 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.849502:0:8626:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089200, rc 0) 00000100:00100000:1.0:1763343285.850507:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:57822:x1848998400093568:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 4825us (5514us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.850527:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7700 00000100:00100000:1.0:1763343285.852763:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.853827:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400093696 00000100:00100000:0.0:1763343285.853842:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400093696 00010000:00010000:0.0:1763343285.853904:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a657f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5cd expref: 17 pid: 8414 timeout: 1178 lvb_type: 1 00000100:00100000:0.0:1763343285.853959:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3658 00000100:00100000:0.0:1763343285.853971:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5951880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998400093696:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343285.853993:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343285.854020:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a657f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5cd expref: 17 pid: 8414 timeout: 1178 lvb_type: 1 00010000:00010000:0.0:1763343285.854057:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a657f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5cd expref: 17 pid: 8414 timeout: 1178 lvb_type: 1 00010000:00010000:0.0:1763343285.854099:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9401f1bf1c00/0x9104b1ba770a657f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5cd expref: 17 pid: 8414 timeout: 1178 lvb_type: 1 00010000:00010000:0.0:1763343285.854120:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343285.854123:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343285.854133:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a6635 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a60c expref: 16 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.854146:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a6635 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a60c expref: 16 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.854198:0:14071:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a6635 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a60c expref: 16 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343285.854214:0:14071:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:14071:1848998413039232:192.168.201.40@tcp:105: 00000100:00100000:0.0:1763343285.854317:0:14071:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c4a6e240 going to sleep for 11 seconds 00000100:00100000:3.0:1763343285.856775:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.857094:0:14071:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:14071:1848998413039232:192.168.201.40@tcp:105: 00010000:00010000:0.0:1763343285.857128:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343285.857204:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5951880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400093696:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 3233us (4452us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343285.857221:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3658 00000100:00100000:1.0:1763343285.857619:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400093824 00000100:00100000:1.0:1763343285.857629:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400093824 00000100:00100000:1.0:1763343285.857680:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7701 00000100:00100000:1.0:1763343285.857689:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:57822:x1848998400093824:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343285.857718:0:8626:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343285.857744:0:8626:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a663c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a613 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.857781:0:8626:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a658d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5d4 expref: 17 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343285.857789:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343285.857791:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343285.857795:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a663c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a613 expref: 17 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.857834:0:8626:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a658d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5d4 expref: 17 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343285.857851:0:8626:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a658d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5d4 expref: 17 pid: 8626 timeout: 1178 lvb_type: 1 00000100:00100000:1.0:1763343285.857867:0:8626:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5951f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998413039360:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343285.857945:0:8626:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c4532540 going to sleep for 11 seconds 00000100:00100000:3.0:1763343285.863000:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.863292:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5951f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8626:1848998413039360:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343285.863336:0:8626:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a663c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a613 expref: 17 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.863364:0:8626:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089c00, rc 0) 00000100:00100000:1.0:1763343285.863447:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:57822:x1848998400093824:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 5759us (6684us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.863457:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7701 00000100:00100000:0.0:1763343285.863631:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400093952 00000100:00100000:0.0:1763343285.863640:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400093952 00010000:00010000:0.0:1763343285.863679:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a658d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5d4 expref: 17 pid: 8626 timeout: 1178 lvb_type: 1 00000100:00100000:0.0:1763343285.863720:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3659 00000100:00100000:0.0:1763343285.863731:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998400093952:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343285.863752:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343285.863778:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a658d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5d4 expref: 17 pid: 8626 timeout: 1178 lvb_type: 1 00010000:00010000:0.0:1763343285.863791:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a658d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5d4 expref: 17 pid: 8626 timeout: 1178 lvb_type: 1 00010000:00010000:0.0:1763343285.863823:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c501ba00/0x9104b1ba770a658d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5d4 expref: 17 pid: 8626 timeout: 1178 lvb_type: 1 00010000:00010000:0.0:1763343285.863837:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343285.863840:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343285.863847:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a663c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a613 expref: 16 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.863858:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a663c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a613 expref: 16 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.863903:0:14071:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5089c00/0x9104b1ba770a663c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a613 expref: 16 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343285.863917:0:14071:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:14071:1848998413039488:192.168.201.40@tcp:105: 00000100:00100000:0.0:1763343285.863979:0:14071:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c4a6e240 going to sleep for 11 seconds 00000100:00100000:0.0:1763343285.876666:0:14071:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:14071:1848998413039488:192.168.201.40@tcp:105: 00010000:00010000:0.0:1763343285.876783:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343285.876942:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2408:x1848998400093952:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 13209us (13952us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.876957:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3659 00000100:00100000:2.0:1763343285.877625:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.877689:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400094080 00000100:00100000:1.0:1763343285.877699:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400094080 00000100:00100000:1.0:1763343285.878278:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7702 00000100:00100000:1.0:1763343285.878288:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:57822:x1848998400094080:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343285.878310:0:8626:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343285.879923:0:8626:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5089600/0x9104b1ba770a6643 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a61a expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.879988:0:8626:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf0200/0x9104b1ba770a6586 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5db expref: 17 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343285.879999:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343285.880002:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343285.880007:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089600/0x9104b1ba770a6643 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a61a expref: 17 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.880070:0:8626:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf0200/0x9104b1ba770a6586 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5db expref: 17 pid: 8414 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343285.880109:0:8626:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf0200/0x9104b1ba770a6586 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5db expref: 17 pid: 8414 timeout: 1179 lvb_type: 1 00000100:00100000:1.0:1763343285.880130:0:8626:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5951f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8626:1848998413039616:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343285.880248:0:8626:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c4532540 going to sleep for 11 seconds 00000100:00100000:3.0:1763343285.886765:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.887160:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5951f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8626:1848998413039616:192.168.201.40@tcp:104: 00010000:00010000:1.0:1763343285.887218:0:8626:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5089600/0x9104b1ba770a6643 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a61a expref: 17 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.887249:0:8626:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5089600, rc 0) 00000100:00100000:1.0:1763343285.887887:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:57822:x1848998400094080:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 9594us (10260us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.887899:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7702 00000100:00100000:2.0:1763343285.889207:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400094208 00000100:00100000:2.0:1763343285.889224:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400094208 00010000:00010000:2.0:1763343285.889273:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf0200/0x9104b1ba770a6586 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5db expref: 17 pid: 8414 timeout: 1179 lvb_type: 1 00000100:00100000:2.0:1763343285.889307:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3660 00000100:00100000:2.0:1763343285.889315:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998400094208:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343285.889334:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343285.889358:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf0200/0x9104b1ba770a6586 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5db expref: 17 pid: 8414 timeout: 1179 lvb_type: 1 00010000:00010000:2.0:1763343285.889373:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf0200/0x9104b1ba770a6586 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5db expref: 17 pid: 8414 timeout: 1179 lvb_type: 1 00010000:00010000:2.0:1763343285.889405:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9401f1bf0200/0x9104b1ba770a6586 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5db expref: 17 pid: 8414 timeout: 1179 lvb_type: 1 00010000:00010000:2.0:1763343285.889423:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.889426:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343285.889435:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5089600/0x9104b1ba770a6643 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a61a expref: 16 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.889447:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5089600/0x9104b1ba770a6643 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a61a expref: 16 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.889489:0:14071:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5089600/0x9104b1ba770a6643 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a61a expref: 16 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343285.889504:0:14071:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:14071:1848998413039744:192.168.201.40@tcp:105: 00000100:00100000:2.0:1763343285.889629:0:14071:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f664cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1763343285.898374:0:14071:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:14071:1848998413039744:192.168.201.40@tcp:105: 00010000:00010000:2.0:1763343285.898416:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343285.898501:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400094208:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 9182us (11752us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343285.898515:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3660 00000100:00100000:1.0:1763343285.901926:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.901977:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.902018:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400094336 00000100:00100000:2.0:1763343285.902068:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400094336 00000100:00100000:2.0:1763343285.902152:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400094464 00000100:00100000:2.0:1763343285.902157:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400094464 00000100:00100000:2.0:1763343285.902183:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7703 00000100:00100000:0.0:1763343285.902194:0:11289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7704 00000100:00100000:2.0:1763343285.902200:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998400094336:12345-192.168.201.40@tcp:2:lfs.0 00000100:00100000:0.0:1763343285.902212:0:11289:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998400094464:12345-192.168.201.40@tcp:2:lfs.0 00000100:00100000:1.0:1763343285.902594:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343285.902857:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400094592 00000100:00100000:3.0:1763343285.902863:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400094592 00000100:00100000:3.0:1763343285.902948:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7705 00000100:00100000:3.0:1763343285.902957:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5953100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400094592:12345-192.168.201.40@tcp:2:lfs.0 00002000:00010000:3.0:1763343285.903097:0:28561:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343285.903101:0:28561:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:3.0:1763343285.903104:0:28561:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 0 -> 1763343284 00002000:00010000:3.0:1763343285.903107:0:28561:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1763343284 -> 1763343285 00002000:00010000:3.0:1763343285.903110:0:28561:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343285.903188:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5953100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998400094592:12345-192.168.201.40@tcp:2:lfs.0 Request processed in 232us (594us total) trans 21474839404 rc 0/0 00000100:00100000:3.0:1763343285.903197:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7705 00002000:00010000:0.0:1763343285.903355:0:11289:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343285.903358:0:11289:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:0.0:1763343285.903360:0:11289:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 0 -> 1763343284 00002000:00010000:0.0:1763343285.903362:0:11289:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1763343284 -> 1763343285 00002000:00010000:0.0:1763343285.903365:0:11289:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:0.0:1763343285.903391:0:11289:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2408:x1848998400094464:12345-192.168.201.40@tcp:2:lfs.0 Request processed in 1187us (1413us total) trans 17179872155 rc 0/0 00000100:00100000:0.0:1763343285.903399:0:11289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7704 00002000:00010000:2.0:1763343285.904834:0:8626:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 232236 -> 232236 00002000:00010000:2.0:1763343285.904844:0:8626:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.904847:0:8626:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1763343284 -> 1763343284 00002000:00010000:2.0:1763343285.904849:0:8626:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1763343284 -> 1763343285 00002000:00010000:2.0:1763343285.904852:0:8626:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 400 -> 400 00000100:00100000:2.0:1763343285.904922:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2407:x1848998400094336:12345-192.168.201.40@tcp:2:lfs.0 Request processed in 2723us (3008us total) trans 17179872154 rc 0/0 00000100:00100000:2.0:1763343285.904932:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7703 00000100:00100000:1.0:1763343285.918607:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343285.918725:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400094848 00000100:00100000:0.0:1763343285.918740:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400094848 00000100:00100000:0.0:1763343285.918819:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3965 00000100:00100000:0.0:1763343285.918832:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:57822:x1848998400094848:12345-192.168.201.40@tcp:35:lfs.0 00000004:00010000:0.0:1763343285.918961:0:6528:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x51:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a655c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5c6 expref: 29 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.919082:0:6528:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501b000/0x9104b1ba770a664a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 00010000:00010000:0.0:1763343285.919098:0:6528:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177200/0x9104b1ba770a63a3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a51e expref: 29 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.919109:0:6528:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176400/0x9104b1ba770a644b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a55d expref: 29 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.919119:0:6528:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501b000/0x9104b1ba770a664a lrc: 5/0,1 mode: --/EX res: [0x200000405:0x51:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 00010000:00010000:0.0:1763343285.919160:0:6528:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176400/0x9104b1ba770a644b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a55d expref: 29 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.919176:0:6528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176400/0x9104b1ba770a644b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a55d expref: 29 pid: 9827 timeout: 1179 lvb_type: 0 00000100:00100000:0.0:1763343285.919195:0:6528:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6528:1848998413039872:192.168.201.40@tcp:104: 00010000:00010000:0.0:1763343285.921221:0:6528:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177200/0x9104b1ba770a63a3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a51e expref: 29 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343285.921244:0:6528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177200/0x9104b1ba770a63a3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a51e expref: 29 pid: 9827 timeout: 1179 lvb_type: 0 00000100:00100000:0.0:1763343285.921263:0:6528:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6528:1848998413040000:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343285.921333:0:6528:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c4a6e240 going to sleep for 11 seconds 00000100:00100000:0.0:1763343285.925633:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.925679:0:6528:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6528:1848998413039872:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343285.925679:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.925697:0:6528:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6528:1848998413040000:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343285.925740:0:6528:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501b000/0x9104b1ba770a664a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x51:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 00000100:00100000:3.0:1763343285.925873:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400094976 00000100:00100000:3.0:1763343285.925883:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400094976 00010000:00010000:3.0:1763343285.925930:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176400/0x9104b1ba770a644b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a55d expref: 30 pid: 9827 timeout: 1179 lvb_type: 0 00000100:00100000:3.0:1763343285.925971:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400095104 00000100:00100000:3.0:1763343285.925975:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400095104 00010000:00010000:3.0:1763343285.925989:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177200/0x9104b1ba770a63a3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a51e expref: 31 pid: 9827 timeout: 1179 lvb_type: 0 00000100:00100000:3.0:1763343285.926018:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3661 00000100:00100000:1.0:1763343285.926145:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3662 00000100:00100000:1.0:1763343285.926158:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6281500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+31:2408:x1848998400095104:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343285.926178:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343285.926187:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177200/0x9104b1ba770a63a3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a51e expref: 31 pid: 9827 timeout: 1179 lvb_type: 0 00010000:00010000:1.0:1763343285.926199:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177200/0x9104b1ba770a63a3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a51e expref: 31 pid: 9827 timeout: 1179 lvb_type: 0 00010000:00010000:1.0:1763343285.926229:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177200/0x9104b1ba770a63a3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a51e expref: 31 pid: 9827 timeout: 1179 lvb_type: 0 00010000:00010000:1.0:1763343285.926250:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:1.0:1763343285.926256:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501b000/0x9104b1ba770a664a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x51:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 00010000:00010000:1.0:1763343285.926268:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501b000/0x9104b1ba770a664a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x51:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 00000100:00100000:3.0:1763343285.927157:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6281f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+30:2408:x1848998400094976:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343285.927173:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343285.927182:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176400/0x9104b1ba770a644b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a55d expref: 30 pid: 9827 timeout: 1179 lvb_type: 0 00010000:00010000:1.0:1763343285.927247:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343285.927344:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6281500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+30:2408:x1848998400095104:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1190us (1665us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.927354:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3662 00010000:00010000:3.0:1763343285.928655:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176400/0x9104b1ba770a644b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a55d expref: 29 pid: 9827 timeout: 1179 lvb_type: 0 00010000:00010000:3.0:1763343285.928692:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176400/0x9104b1ba770a644b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a55d expref: 29 pid: 9827 timeout: 1179 lvb_type: 0 00010000:00010000:3.0:1763343285.928709:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:3.0:1763343285.928714:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501b000/0x9104b1ba770a664a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x51:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 00010000:00010000:3.0:1763343285.928722:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501b000/0x9104b1ba770a664a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x51:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 00010000:00010000:3.0:1763343285.928731:0:7904:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501b000/0x9104b1ba770a664a lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x51:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 00010000:00010000:1.0:1763343285.928855:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343285.928915:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6281f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2408:x1848998400094976:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1770us (3295us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.928925:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3661 00010000:00010000:2.0:1763343285.929178:0:6528:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501b000/0x9104b1ba770a664a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x51:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343285.929188:0:6528:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501b000/0x9104b1ba770a664a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x51:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343285.929219:0:6528:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6651 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343285.929232:0:6528:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089000/0x9104b1ba770a65a9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5e9 expref: 28 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.929241:0:6528:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6651 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343285.930270:0:6528:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089000/0x9104b1ba770a65a9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5e9 expref: 28 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.930295:0:6528:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089000/0x9104b1ba770a65a9 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5e9 expref: 28 pid: 9827 timeout: 1179 lvb_type: 0 00000100:00100000:2.0:1763343285.930314:0:6528:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6528:1848998413040128:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343285.930399:0:6528:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f664cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1763343285.934267:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.935145:0:6528:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6528:1848998413040128:192.168.201.40@tcp:104: 00000100:00100000:1.0:1763343285.935158:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400095232 00000100:00100000:1.0:1763343285.935167:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400095232 00010000:00010000:2.0:1763343285.935181:0:6528:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6651 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 00010000:00010000:1.0:1763343285.935213:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089000/0x9104b1ba770a65a9 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5e9 expref: 28 pid: 9827 timeout: 1179 lvb_type: 0 00000100:00100000:1.0:1763343285.935259:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3663 00000100:00100000:1.0:1763343285.935485:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82df050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:2407:x1848998400095232:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343285.935507:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343285.935515:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089000/0x9104b1ba770a65a9 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5e9 expref: 28 pid: 9827 timeout: 1179 lvb_type: 0 00010000:00010000:1.0:1763343285.935526:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089000/0x9104b1ba770a65a9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5e9 expref: 28 pid: 9827 timeout: 1179 lvb_type: 0 00010000:00010000:1.0:1763343285.935549:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5089000/0x9104b1ba770a65a9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5e9 expref: 28 pid: 9827 timeout: 1179 lvb_type: 0 00010000:00010000:1.0:1763343285.935564:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff9401fc4f1800) 00010000:00010000:1.0:1763343285.935568:0:7904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6651 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 00010000:00010000:1.0:1763343285.935577:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6651 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 00010000:00010000:1.0:1763343285.935583:0:7904:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6651 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 00010000:00010000:1.0:1763343285.935604:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343285.935634:0:6528:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6651 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343285.935640:0:6528:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6651 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 00000100:00100000:1.0:1763343285.935686:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82df050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+27:2407:x1848998400095232:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 416us (1430us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.935693:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3663 00000100:00100000:2.0:1763343285.936060:0:6528:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1848998413040256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763343285.936133:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343285.936165:0:6528:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c601f240 going to sleep for 11 seconds 00000100:00100000:1.0:1763343285.936274:0:7640:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413040256 00000100:00100000:1.0:1763343285.936282:0:7640:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413040256 00000100:00100000:1.0:1763343285.936332:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:1.0:1763343285.936338:0:7640:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6528:x1848998413040256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763343285.936449:0:7640:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6528:x1848998413040256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 110us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.936456:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00100000:3.0:1763343285.936542:0:6528:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1848998413040256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763343285.936612:0:6528:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c514f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1848998413040384:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763343285.936642:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343285.936664:0:6528:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1763343285.936724:0:6530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413040384 00000100:00100000:0.0:1763343285.936728:0:6530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413040384 00000100:00100000:0.0:1763343285.936769:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1353 00000100:00100000:0.0:1763343285.936776:0:6530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6528:x1848998413040384:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763343285.936843:0:6530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6528:x1848998413040384:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 68us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343285.936850:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1353 00000100:00100000:0.0:1763343285.936880:0:6528:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c514f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1848998413040384:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:2.0:1763343285.936890:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1763343285.936895:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1763343285.936924:0:6528:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c6282680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1848998413040512:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763343285.936959:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343285.936976:0:6528:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1763343285.937059:0:7640:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413040512 00000100:00100000:1.0:1763343285.937064:0:7640:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413040512 00000100:00100000:1.0:1763343285.937100:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:1.0:1763343285.937107:0:7640:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6528:x1848998413040512:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763343285.937162:0:7640:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6528:x1848998413040512:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 56us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.937169:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00100000:2.0:1763343285.937471:0:6528:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c6282680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1848998413040512:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763343285.937517:0:6528:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1848998413040640:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763343285.937546:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343285.937571:0:6528:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c2f56240 going to sleep for 11 seconds 00000100:00100000:1.0:1763343285.937639:0:6530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413040640 00000100:00100000:1.0:1763343285.937644:0:6530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413040640 00000100:00100000:1.0:1763343285.937670:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:1.0:1763343285.937676:0:6530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c586b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6528:x1848998413040640:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763343285.937739:0:6530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c586b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6528:x1848998413040640:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 63us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.937745:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:2.0:1763343285.937804:0:6528:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1848998413040640:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763343285.937838:0:6528:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1848998413040768:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763343285.937860:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343285.937993:0:6528:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1763343285.938092:0:6530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413040768 00000100:00100000:1.0:1763343285.938097:0:6530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413040768 00000100:00100000:1.0:1763343285.938126:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:1.0:1763343285.938132:0:6530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5869500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6528:x1848998413040768:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763343285.938191:0:6530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5869500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6528:x1848998413040768:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 59us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.938198:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:2.0:1763343285.938292:0:6528:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1848998413040768:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763343285.938327:0:6528:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1848998413040896:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763343285.938354:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343285.938382:0:6528:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c2f56240 going to sleep for 11 seconds 00000100:00100000:3.0:1763343285.938758:0:6529:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413040896 00000100:00100000:3.0:1763343285.938765:0:6529:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413040896 00000100:00100000:3.0:1763343285.938806:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1357 00000100:00100000:3.0:1763343285.938813:0:6529:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6528:x1848998413040896:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763343285.938892:0:6529:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6528:x1848998413040896:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 80us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343285.938898:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1357 00000100:00100000:2.0:1763343285.938903:0:6528:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1848998413040896:0@lo:1000:mdt_rdpg00_001.0 00000040:00080000:2.0:1763343285.939688:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x2:0x0].13, 640 off44696 00000001:00080000:2.0:1763343285.939708:0:6528:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935432 00000100:00100000:2.0:1763343285.939798:0:6528:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1848998413041024:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763343285.939841:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343285.940910:0:6528:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401eddd0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1763343285.940935:0:6529:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413041024 00000100:00100000:3.0:1763343285.940947:0:6529:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413041024 00000100:00100000:0.0:1763343285.941200:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1358 00000100:00100000:0.0:1763343285.941212:0:6529:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6528:x1848998413041024:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763343285.941432:0:6529:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6528:x1848998413041024:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 221us (1589us total) trans 21474839405 rc 0/0 00000100:00100000:0.0:1763343285.941440:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1358 00000100:00100000:2.0:1763343285.941527:0:6528:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1848998413041024:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763343285.941579:0:6528:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1848998413041152:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763343285.941613:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343285.941636:0:6528:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f664c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343285.941649:0:6529:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413041152 00000100:00100000:0.0:1763343285.941654:0:6529:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413041152 00000100:00100000:0.0:1763343285.941682:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1359 00000100:00100000:0.0:1763343285.941688:0:6529:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6528:x1848998413041152:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763343285.941774:0:6529:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6528:x1848998413041152:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 85us (159us total) trans 17179872156 rc 0/0 00000100:00100000:0.0:1763343285.941780:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1359 00000100:00100000:2.0:1763343285.941803:0:6528:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1848998413041152:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1763343285.941886:0:6528:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935433 00010000:00010000:2.0:1763343285.941923:0:6528:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6651 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343285.941936:0:6528:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6651 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343285.941944:0:6528:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6651 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343285.941952:0:6528:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88c00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343285.941957:0:6528:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6651 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343285.941966:0:6528:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6651 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343285.941988:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff9401fc4f1800) 00010000:00010000:2.0:1763343285.941991:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1763343285.941998:0:6528:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6651 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343285.942003:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6651 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343285.942017:0:6528:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501b000/0x9104b1ba770a664a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x51:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343285.942020:0:6528:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501b000/0x9104b1ba770a664a lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x51:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343285.942048:0:6528:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501b000/0x9104b1ba770a664a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x51:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343285.942053:0:6528:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c501b000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:2.0:1763343285.942056:0:6528:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501b000/0x9104b1ba770a664a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x51:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343285.942061:0:6528:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501b000/0x9104b1ba770a664a lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x51:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343285.942070:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.942086:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1763343285.942089:0:6528:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501b000/0x9104b1ba770a664a lrc: 2/0,0 mode: --/EX res: [0x200000405:0x51:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343285.942095:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c501b000/0x9104b1ba770a664a lrc: 0/0,0 mode: --/EX res: [0x200000405:0x51:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343285.942108:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.942112:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343285.942120:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a655c lrc: 0/0,0 mode: --/PW res: [0x200000405:0x51:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a5c6 expref: 29 pid: 6524 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343285.942230:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:57822:x1848998400094848:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 23400us (23639us total) trans 8589935434 rc 0/0 00000100:00100000:2.0:1763343285.942239:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3965 00000020:00080000:2.0:1763343285.942244:0:6528:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1763343285.947559:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.949128:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400095360 00000100:00100000:2.0:1763343285.949148:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400095360 00000100:00100000:2.0:1763343285.949248:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11231 00000100:00100000:2.0:1763343285.949262:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+28:57822:x1848998400095360:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343285.949299:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343285.949329:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89200/0x9104b1ba770a6658 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a621 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.949409:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89200/0x9104b1ba770a6658 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a621 expref: 29 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.949426:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89200/0x9104b1ba770a6658 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x51:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a621 expref: 29 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.949449:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.949452:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343285.949457:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89200, rc 0) 00000100:00100000:2.0:1763343285.949552:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:57822:x1848998400095360:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 293us (2008us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343285.949560:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11231 00000100:00100000:3.0:1763343285.953916:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.955318:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400095616 00000100:00100000:2.0:1763343285.955337:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400095616 00000100:00100000:2.0:1763343285.955420:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3966 00000100:00100000:2.0:1763343285.955432:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+29:57822:x1848998400095616:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343285.955768:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+30:57822:x1848998400095616:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 338us (1869us total) trans 8589935435 rc 0/0 00000100:00100000:2.0:1763343285.955776:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3966 00000100:00100000:3.0:1763343285.958733:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.959094:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400095872 00000100:00100000:2.0:1763343285.959108:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400095872 00000100:00100000:2.0:1763343285.959184:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3967 00000100:00100000:2.0:1763343285.959196:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+30:57822:x1848998400095872:12345-192.168.201.40@tcp:35:lfs.0 00000004:00080000:2.0:1763343285.959478:0:6528:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x54:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1763343285.959603:0:6528:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a665f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343285.959625:0:6528:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a665f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343285.959640:0:6528:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a665f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343285.959649:0:6528:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a665f lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343285.959655:0:6528:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a665f lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343285.959661:0:6528:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a665f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 00010000:00010000:2.0:1763343285.959688:0:6528:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343285.959718:0:6513:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343285.959727:0:6513:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a665f lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 00010000:00010000:1.0:1763343285.959735:0:6513:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e89400 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:1.0:1763343285.959739:0:6513:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a665f lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 00010000:00010000:1.0:1763343285.959751:0:6513:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a665f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT0 00010000:00010000:1.0:1763343285.959766:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff9401fc4f1800) 00010000:00010000:1.0:1763343285.959769:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763343285.959776:0:6513:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a665f lrc: 1/0,0 mode: --/PW res: [0x200000405:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 00010000:00010000:1.0:1763343285.959782:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89400/0x9104b1ba770a665f lrc: 0/0,0 mode: --/PW res: [0x200000405:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 00010000:00010000:1.0:1763343285.959796:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343285.959798:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343285.959799:0:6513:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343285.961137:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+31:57822:x1848998400095872:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 1928us (2405us total) trans 8589935436 rc 0/0 00000100:00100000:2.0:1763343285.961154:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3967 00000100:00100000:0.0:1763343285.981738:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.983866:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400096000 00000100:00100000:2.0:1763343285.983891:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400096000 00000100:00100000:1.0:1763343285.984543:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11232 00000100:00100000:1.0:1763343285.984559:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+31:57823:x1848998400096000:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343285.984595:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343285.984628:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177200/0x9104b1ba770a6666 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a628 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.984716:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a666d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.984732:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a666d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.984746:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a666d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.984759:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6674 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.984770:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6674 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.984776:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6674 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.984881:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a667b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.984892:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a667b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.984899:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a667b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00000004:00200000:1.0:1763343285.984955:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x51:0x0]: returning size 232236 00000004:00200000:1.0:1763343285.984961:0:6524:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343285.984984:0:6524:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a667b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.984997:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a667b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.985007:0:6524:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a666d lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.985013:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a666d lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.985020:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a666d lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.985061:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a666d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.985082:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176a00 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343285.985087:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a666d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.985095:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a666d lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.985109:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff9401f6696500) 00010000:00010000:1.0:1763343285.985113:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343285.985119:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a666d lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.985125:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176a00/0x9104b1ba770a666d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.985141:0:6524:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6674 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.985146:0:6524:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6674 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.985151:0:6524:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6674 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.985157:0:6524:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5176000 already unused, calling callback (ffffffffc18dd550) 00010000:00010000:1.0:1763343285.985160:0:6524:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6674 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.985165:0:6524:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6674 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.985172:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0xdd396665 (ffff9401f6696900) 00010000:00010000:1.0:1763343285.985175:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343285.985178:0:6524:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6674 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.985183:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176000/0x9104b1ba770a6674 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.985217:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177200/0x9104b1ba770a6666 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a628 expref: 33 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.985233:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a667b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a628 expref: 32 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.985241:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:1.0:1763343285.985243:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343285.985246:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177c00, rc 0) 00000100:00100000:1.0:1763343285.985352:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+32:57823:x1848998400096000:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 796us (3629us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343285.985362:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11232 00000100:00100000:3.0:1763343285.989444:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343285.991419:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400096256 00000100:00100000:1.0:1763343285.991440:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400096256 00000100:00100000:1.0:1763343285.991535:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11233 00000100:00100000:1.0:1763343285.991548:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+32:57823:x1848998400096256:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1763343285.991581:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343285.991615:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a6682 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a62f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.991774:0:6524:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177800/0x9104b1ba770a6689 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.991793:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177800/0x9104b1ba770a6689 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x51:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 00010000:00010000:1.0:1763343285.991807:0:6524:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177800/0x9104b1ba770a6689 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x51:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 00000004:00200000:1.0:1763343285.991821:0:6524:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x51:0x0]: returning size 232236 00010000:00010000:1.0:1763343285.991981:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5176e00/0x9104b1ba770a6682 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a62f expref: 35 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.992003:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177800/0x9104b1ba770a6689 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x51:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a62f expref: 34 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343285.992014:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:1.0:1763343285.992017:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1763343285.992022:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177800, rc 0) 00000100:00100000:1.0:1763343285.992163:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+34:57823:x1848998400096256:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 616us (2733us total) trans 8589935437 rc 0/0 00000100:00100000:1.0:1763343285.992171:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11233 00000100:00100000:3.0:1763343285.997128:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343285.997555:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400096512 00000100:00100000:2.0:1763343285.997569:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400096512 00000100:00100000:2.0:1763343285.997651:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11234 00000100:00100000:2.0:1763343285.997663:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+34:57823:x1848998400096512:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1763343285.997695:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343285.997725:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6697 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a636 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.997864:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88a00/0x9104b1ba770a669e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.997883:0:9827:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88a00/0x9104b1ba770a669e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343285.997896:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88a00/0x9104b1ba770a669e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00000004:00200000:2.0:1763343285.997912:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x51:0x0]: returning size 232236 00010000:00010000:2.0:1763343285.999527:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a6697 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a636 expref: 37 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.999563:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88a00/0x9104b1ba770a669e lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x51:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a636 expref: 36 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343285.999573:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343285.999578:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343285.999582:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88a00, rc 0) 00000100:00100000:2.0:1763343285.999696:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+36:57823:x1848998400096512:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2034us (2584us total) trans 8589935438 rc 0/0 00000100:00100000:2.0:1763343285.999709:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11234 00010000:00010000:1.0:1763343286.012651:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343286.078981:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343286.079119:0:23992:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400096640 00000100:00100000:2.0:1763343286.079133:0:23992:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400096640 00000100:00100000:2.0:1763343286.079259:0:23992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1882 00000100:00100000:2.0:1763343286.079272:0:23992:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2410:x1848998400096640:12345-192.168.201.40@tcp:3:lfs.0 00010000:00010000:2.0:1763343286.079330:0:23992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a66ac lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.079358:0:23992:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a6635 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a60c expref: 18 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.079368:0:23992:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343286.079371:0:23992:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343286.079375:0:23992:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a66ac lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.079421:0:23992:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a6635 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a60c expref: 18 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.079439:0:23992:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a6635 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a60c expref: 18 pid: 8626 timeout: 1179 lvb_type: 0 00000100:00100000:2.0:1763343286.079459:0:23992:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:23992:1848998413041280:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343286.079597:0:23992:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f664c9c0 going to sleep for 11 seconds 00000100:00080000:1.0:1763343286.079690:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1763343286.084770:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343286.084936:0:7904:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400096768 00000100:00100000:1.0:1763343286.084952:0:7904:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400096768 00010000:00010000:1.0:1763343286.085010:0:7904:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a6635 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a60c expref: 19 pid: 8626 timeout: 1179 lvb_type: 0 00000100:00100000:1.0:1763343286.085108:0:7904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3664 00000100:00100000:1.0:1763343286.085121:0:7904:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2408:x1848998400096768:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343286.085143:0:7904:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343286.085171:0:7904:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a6635 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a60c expref: 19 pid: 8626 timeout: 1179 lvb_type: 0 00010000:00010000:1.0:1763343286.085187:0:7904:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a6635 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a60c expref: 19 pid: 8626 timeout: 1179 lvb_type: 0 00010000:00010000:1.0:1763343286.085223:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343286.085225:0:7904:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343286.085231:0:7904:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a66ac lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343286.085242:0:7904:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a66ac lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343286.085270:0:7904:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343286.085460:0:23992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5089200/0x9104b1ba770a6635 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a60c expref: 19 pid: 8626 timeout: 1179 lvb_type: 0 00000100:00100000:2.0:1763343286.085481:0:23992:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:23992:1848998413041280:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343286.085510:0:23992:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a66ac lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.085522:0:23992:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a66ac lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343286.086707:0:7904:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998400096768:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1575us (1947us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343286.086723:0:7904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3664 00010000:00010000:2.0:1763343286.087193:0:23992:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a66ac lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.097432:0:23992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a66ac lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.097457:0:23992:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a66ac lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.097470:0:23992:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a66ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.097477:0:23992:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88c00 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343286.097482:0:23992:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a66ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.097491:0:23992:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a66ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.097521:0:23992:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a66ac lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.097529:0:23992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c5e88c00/0x9104b1ba770a66ac lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343286.097656:0:23992:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2410:x1848998400096640:12345-192.168.201.40@tcp:3:lfs.0 Request processed in 18379us (18685us total) trans 0 rc 232236/232236 00000100:00100000:2.0:1763343286.097668:0:23992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1882 00000100:00100000:0.0:1763343286.112745:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343286.112815:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343286.112892:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400097024 00000100:00100000:3.0:1763343286.112906:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400097024 00000100:00100000:2.0:1763343286.112916:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400096896 00000100:00100000:2.0:1763343286.112921:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400096896 00000100:00100000:3.0:1763343286.112983:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7706 00000100:00100000:3.0:1763343286.112995:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2409:x1848998400097024:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343286.113051:0:28561:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1763343286.113051:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7707 00000100:00100000:2.0:1763343286.113060:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6282a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2410:x1848998400096896:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:3.0:1763343286.113088:0:28561:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a66b3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a644 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.113096:0:8626:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343286.113108:0:8626:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a66ba lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a63d expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343286.113178:0:28561:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c514df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998413041408:192.168.201.40@tcp:106: 00000100:00100000:3.0:1763343286.113297:0:28561:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401d862c600 going to sleep for 11 seconds 00000100:00080000:1.0:1763343286.113481:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1763343286.113634:0:8626:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5951880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8626:1848998413041536:192.168.201.40@tcp:106: 00000100:00100000:1.0:1763343286.113680:0:8626:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c45326c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343286.118982:0:28561:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c514df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28561:1848998413041408:192.168.201.40@tcp:106: 00000100:00100000:1.0:1763343286.118987:0:8626:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5951880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8626:1848998413041536:192.168.201.40@tcp:106: 00010000:00010000:1.0:1763343286.119093:0:8626:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a66ba lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a63d expref: 18 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343286.119097:0:28561:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a66b3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a644 expref: 18 pid: 28561 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343286.119138:0:28561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9400c4514200/0x9104b1ba770a66b3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a644 expref: 18 pid: 28561 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343286.119155:0:28561:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c4514200, rc 0) 00000100:00100000:3.0:1763343286.119238:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2409:x1848998400097024:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 6243us (6507us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343286.119252:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7706 00010000:00010000:1.0:1763343286.119411:0:8626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88c00/0x9104b1ba770a66ba lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a63d expref: 18 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343286.119423:0:8626:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88c00, rc 0) 00000100:00100000:1.0:1763343286.119461:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6282a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2410:x1848998400096896:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 6403us (6646us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343286.119468:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7707 00000100:00100000:0.0:1763343286.126568:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343286.126661:0:23992:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400097152 00000100:00100000:2.0:1763343286.126678:0:23992:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400097152 00000100:00100000:2.0:1763343286.126782:0:23992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1883 00000100:00100000:2.0:1763343286.126796:0:23992:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2409:x1848998400097152:12345-192.168.201.40@tcp:3:lfs.0 00010000:00010000:2.0:1763343286.126852:0:23992:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a66c1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.126877:0:23992:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a6620 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a605 expref: 17 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.126892:0:23992:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343286.126896:0:23992:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343286.126900:0:23992:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a66c1 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.126947:0:23992:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a6620 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a605 expref: 17 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.126964:0:23992:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a6620 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a605 expref: 17 pid: 8626 timeout: 1179 lvb_type: 0 00000100:00100000:2.0:1763343286.126982:0:23992:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0000_UUID:23992:1848998413041664:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343286.127411:0:23992:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f664c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343286.130107:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343286.130184:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400097280 00000100:00100000:0.0:1763343286.130198:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400097280 00010000:00010000:0.0:1763343286.130250:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a6620 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a605 expref: 18 pid: 8626 timeout: 1179 lvb_type: 0 00000100:00100000:0.0:1763343286.130301:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3665 00000100:00100000:0.0:1763343286.130314:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c514df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998400097280:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343286.130333:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343286.130518:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a6620 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a605 expref: 18 pid: 8626 timeout: 1179 lvb_type: 0 00010000:00010000:0.0:1763343286.130536:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a6620 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a605 expref: 18 pid: 8626 timeout: 1179 lvb_type: 0 00010000:00010000:0.0:1763343286.130574:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343286.130576:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343286.130583:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a66c1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343286.130595:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a66c1 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343286.130621:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343286.130653:0:23992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a6620 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a605 expref: 18 pid: 8626 timeout: 1179 lvb_type: 0 00000100:00100000:2.0:1763343286.130673:0:23992:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0000_UUID:23992:1848998413041664:192.168.201.40@tcp:104: 00000100:00100000:0.0:1763343286.130690:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c514df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998400097280:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 378us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343286.130698:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3665 00010000:00010000:2.0:1763343286.130758:0:23992:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a66c1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.130770:0:23992:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a66c1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.130778:0:23992:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a66c1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.137928:0:23992:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a66c1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.137957:0:23992:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a66c1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.137967:0:23992:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a66c1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.137975:0:23992:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9400c5e88800 already unused, calling callback (ffffffffc0ca3b40) 00010000:00010000:2.0:1763343286.137980:0:23992:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a66c1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.137990:0:23992:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a66c1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.138015:0:23992:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a66c1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.138057:0:23992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a66c1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23992 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343286.138203:0:23992:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2409:x1848998400097152:12345-192.168.201.40@tcp:3:lfs.0 Request processed in 11403us (11644us total) trans 0 rc 232236/232236 00000100:00100000:2.0:1763343286.138219:0:23992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1883 00000004:00080000:3.0:1763343286.139281:0:8617:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1079263253795ns, next at 1080263250810ns, rc = 0 00000100:00100000:3.0:1763343286.139315:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343286.139338:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413041792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1763343286.139404:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343286.139517:0:14179:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413041792 00000100:00100000:1.0:1763343286.139529:0:14179:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413041792 00000100:00080000:2.0:1763343286.139602:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1763343286.139611:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:1.0:1763343286.139623:0:14179:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6489880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1848998413041792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1763343286.139694:0:14179:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484893632 pending 0 free 3919192064 avail 3687501824 00000100:00100000:1.0:1763343286.139749:0:14179:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6489880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1848998413041792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343286.139758:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00100000:3.0:1763343286.139839:0:3659:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474839381 gen 2 00000004:00080000:3.0:1763343286.139845:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400cc5dc000, transno 21474839379 00000100:00100000:3.0:1763343286.139933:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1848998413041792:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1763343286.154755:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343286.154888:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400097408 00000100:00100000:3.0:1763343286.154902:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400097408 00000100:00080000:2.0:1763343286.154988:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1763343286.155123:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 462 00000100:00100000:3.0:1763343286.155136:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+36:57823:x1848998400097408:12345-192.168.201.40@tcp:103:lfs.0 00010000:00010000:3.0:1763343286.155157:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343286.155190:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88a00/0x9104b1ba770a669e lrc: 0/0,0 mode: --/PW res: [0x200000405:0x51:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a636 expref: 36 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343286.155216:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:3.0:1763343286.155427:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343286.155617:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+35:57823:x1848998400097408:12345-192.168.201.40@tcp:103:lfs.0 Request processed in 483us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343286.155626:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 462 00000100:00100000:1.0:1763343286.160474:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343286.160869:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400097664 00000100:00100000:2.0:1763343286.160884:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400097664 00000100:00100000:2.0:1763343286.161132:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3968 00000100:00100000:2.0:1763343286.161147:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401c82c9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+35:57823:x1848998400097664:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:2.0:1763343286.161506:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401c82c9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+36:57823:x1848998400097664:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 362us (1049us total) trans 8589935439 rc 0/0 00000100:00100000:2.0:1763343286.161515:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3968 00000100:00100000:1.0:1763343286.168279:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343286.168847:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400097920 00000100:00100000:2.0:1763343286.168862:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400097920 00000100:00100000:2.0:1763343286.168951:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11235 00000100:00100000:2.0:1763343286.168963:0:9827:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+36:57821:x1848998400097920:12345-192.168.201.40@tcp:101:fsx.0 00010000:00010000:2.0:1763343286.169001:0:9827:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343286.169091:0:9827:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a66c8 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a64b expref: -99 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.169283:0:9827:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a66cf lrc: 3/0,1 mode: --/CW res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343286.169303:0:9827:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a667b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a628 expref: 37 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.169314:0:9827:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a66cf lrc: 4/0,1 mode: --/CW res: [0x200000405:0x51:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343286.169363:0:9827:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a667b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a628 expref: 37 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.169380:0:9827:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a667b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a628 expref: 37 pid: 6524 timeout: 1179 lvb_type: 0 00000100:00100000:2.0:1763343286.169402:0:9827:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9827:1848998413041920:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343286.169523:0:9827:0:(client.c:2690:ptlrpc_set_wait()) set ffff9400c2f56240 going to sleep for 11 seconds 00000100:00100000:2.0:1763343286.172960:0:9827:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9827:1848998413041920:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343286.173005:0:9827:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a66cf lrc: 3/0,1 mode: --/CW res: [0x200000405:0x51:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00000100:00100000:1.0:1763343286.177246:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343286.177357:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400098048 00000100:00100000:3.0:1763343286.177370:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400098048 00010000:00010000:3.0:1763343286.177432:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a667b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a628 expref: 38 pid: 6524 timeout: 1179 lvb_type: 0 00000100:00100000:3.0:1763343286.177713:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3666 00000100:00100000:3.0:1763343286.177727:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5951c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+38:2408:x1848998400098048:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343286.177749:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343286.177758:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a667b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a628 expref: 38 pid: 6524 timeout: 1179 lvb_type: 0 00010000:00010000:3.0:1763343286.177774:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a667b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a628 expref: 38 pid: 6524 timeout: 1179 lvb_type: 0 00010000:00010000:3.0:1763343286.177806:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5177c00/0x9104b1ba770a667b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a628 expref: 38 pid: 6524 timeout: 1179 lvb_type: 0 00010000:00010000:3.0:1763343286.177827:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:3.0:1763343286.177834:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a66cf lrc: 3/0,1 mode: --/CW res: [0x200000405:0x51:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343286.177848:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a66cf lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x51:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343286.177857:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a66cf lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x51:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT0 00010000:00010000:3.0:1763343286.177902:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343286.177989:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5951c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+37:2408:x1848998400098048:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 264us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343286.177999:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3666 00010000:00010000:2.0:1763343286.178338:0:9827:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a66cf lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x51:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00010000:00010000:2.0:1763343286.178349:0:9827:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a66cf lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x51:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 00000004:00200000:2.0:1763343286.178378:0:9827:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x51:0x0]: returning size 232236 00010000:00010000:2.0:1763343286.178558:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88800/0x9104b1ba770a66c8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a64b expref: 38 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.178579:0:9827:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a66cf lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x51:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a64b expref: 37 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.178587:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343286.178590:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1763343286.178593:0:9827:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89800, rc 0) 00000100:00100000:2.0:1763343286.178642:0:9827:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+37:57821:x1848998400097920:12345-192.168.201.40@tcp:101:fsx.0 Request processed in 9681us (10382us total) trans 8589935440 rc 0/0 00000100:00100000:2.0:1763343286.178651:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11235 00000100:00100000:1.0:1763343286.181971:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343286.182100:0:9827:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400098176 00000100:00100000:2.0:1763343286.182116:0:9827:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400098176 00000100:00100000:3.0:1763343286.182704:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 11236 00000100:00100000:3.0:1763343286.182730:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+37:57821:x1848998400098176:12345-192.168.201.40@tcp:101:fsx.0 00010000:00010000:2.0:1763343286.182899:0:7641:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343286.182934:0:7641:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a66dd lrc: 2/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a652 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.183107:0:7641:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89600/0x9104b1ba770a66e4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343286.183128:0:7641:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a66cf lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x51:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a64b expref: 38 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.183140:0:7641:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89600/0x9104b1ba770a66e4 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343286.183186:0:7641:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a66cf lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x51:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a64b expref: 38 pid: 9827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.183202:0:7641:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a66cf lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x51:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a64b expref: 38 pid: 9827 timeout: 1179 lvb_type: 0 00000100:00100000:2.0:1763343286.183218:0:7641:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7641:1848998413042048:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343286.183452:0:7641:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f664c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343286.187318:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343286.187393:0:7641:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7641:1848998413042048:192.168.201.40@tcp:104: 00000100:00100000:3.0:1763343286.187461:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400098304 00000100:00100000:3.0:1763343286.187470:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400098304 00010000:00010000:2.0:1763343286.187503:0:7641:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89600/0x9104b1ba770a66e4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343286.187514:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a66cf lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x51:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a64b expref: 39 pid: 9827 timeout: 1179 lvb_type: 0 00000100:00100000:3.0:1763343286.187609:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3667 00000100:00100000:3.0:1763343286.187621:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6280380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+39:2407:x1848998400098304:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343286.187641:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343286.187649:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a66cf lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x51:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a64b expref: 39 pid: 9827 timeout: 1179 lvb_type: 0 00010000:00010000:3.0:1763343286.187741:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a66cf lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x51:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a64b expref: 39 pid: 9827 timeout: 1179 lvb_type: 0 00010000:00010000:3.0:1763343286.187780:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89800/0x9104b1ba770a66cf lrc: 0/0,0 mode: --/CW res: [0x200000405:0x51:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a64b expref: 39 pid: 9827 timeout: 1179 lvb_type: 0 00010000:00010000:3.0:1763343286.187800:0:14071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:3.0:1763343286.187806:0:14071:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89600/0x9104b1ba770a66e4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x51:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343286.187819:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89600/0x9104b1ba770a66e4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343286.187827:0:14071:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89600/0x9104b1ba770a66e4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7641 initiator: MDT0 00010000:00010000:3.0:1763343286.188277:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343286.188368:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6280380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+38:2407:x1848998400098304:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 747us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343286.188379:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3667 00010000:00010000:2.0:1763343286.188468:0:7641:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89600/0x9104b1ba770a66e4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343286.188476:0:7641:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89600/0x9104b1ba770a66e4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT0 00000004:00200000:2.0:1763343286.188554:0:7641:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x51:0x0]: returning size 232236 00000004:00200000:2.0:1763343286.188560:0:7641:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343286.188589:0:7641:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89600/0x9104b1ba770a66e4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7641 initiator: MDT0 00010000:00010000:2.0:1763343286.188635:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a66dd lrc: 0/0,0 mode: --/CR res: [0x200000405:0x51:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a652 expref: 38 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.188653:0:7641:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9400c5e89600/0x9104b1ba770a66e4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a652 expref: 37 pid: 7641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.188669:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x51:0x0].0x0 (ffff9401fc4f1400) 00010000:00010000:2.0:1763343286.188672:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343286.188675:0:7641:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e89600, rc 0) 00000100:00100000:2.0:1763343286.188709:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+37:57821:x1848998400098176:12345-192.168.201.40@tcp:101:fsx.0 Request processed in 5993us (6753us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343286.188716:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 11236 00000100:00100000:0.0:1763343286.192537:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343286.192711:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400098432 00000100:00100000:1.0:1763343286.192724:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400098432 00000100:00100000:1.0:1763343286.192794:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7708 00000100:00100000:1.0:1763343286.192805:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2408:x1848998400098432:12345-192.168.201.40@tcp:101:fsx.0 00010000:00010000:1.0:1763343286.192830:0:8626:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343286.192861:0:8626:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a66eb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a659 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343286.192890:0:8626:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x77:0x0] initial LVB size: 232236, mtime: 0x691a7bb4, atime: 0x691a7bb4, ctime: 0x691a7bb5, blocks: 0x190 00010000:00010000:1.0:1763343286.192917:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343286.192920:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343286.192934:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a66eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a659 expref: 18 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343286.192956:0:8626:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5176200/0x9104b1ba770a66eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a659 expref: 18 pid: 8626 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343286.192978:0:8626:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5176200, rc 0) 00000100:00100000:1.0:1763343286.193508:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:2408:x1848998400098432:12345-192.168.201.40@tcp:101:fsx.0 Request processed in 701us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343286.193518:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7708 00000100:00100000:0.0:1763343286.197065:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343286.197206:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400098560 00000100:00100000:1.0:1763343286.197217:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400098560 00000100:00100000:1.0:1763343286.197280:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7709 00000100:00100000:1.0:1763343286.197291:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6282680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+18:57821:x1848998400098560:12345-192.168.201.40@tcp:101:fsx.0 00010000:00010000:1.0:1763343286.197310:0:8626:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343286.197335:0:8626:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a66f2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a660 expref: -99 pid: 8626 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343286.197360:0:8626:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343286.197394:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343286.197397:0:8626:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343286.197406:0:8626:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a66f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->233471) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a660 expref: 19 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343286.197422:0:8626:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9400c5177c00/0x9104b1ba770a66f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->233471) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a660 expref: 19 pid: 8626 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343286.197435:0:8626:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5177c00, rc 0) 00000100:00100000:1.0:1763343286.197496:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6282680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:57821:x1848998400098560:12345-192.168.201.40@tcp:101:fsx.0 Request processed in 207us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343286.197504:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7709 00000100:00100000:3.0:1763343286.207378:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343286.207499:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400098816 00000100:00100000:2.0:1763343286.207509:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400098816 00000100:00100000:2.0:1763343286.207572:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3969 00000100:00100000:2.0:1763343286.207583:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+37:57821:x1848998400098816:12345-192.168.201.40@tcp:35:fsx.0 00000001:00080000:2.0:1763343286.207803:0:6528:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935441 00000100:00100000:2.0:1763343286.207916:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+39:57821:x1848998400098816:12345-192.168.201.40@tcp:35:fsx.0 Request processed in 333us (546us total) trans 8589935442 rc 0/0 00000100:00100000:2.0:1763343286.207923:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3969 00000020:00080000:2.0:1763343286.207928:0:6528:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343286.212455:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343286.213381:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400098944 00000100:00100000:3.0:1763343286.213393:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400098944 00000100:00100000:2.0:1763343286.213848:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7710 00000100:00100000:2.0:1763343286.213861:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6281500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:57821:x1848998400098944:12345-192.168.201.40@tcp:101:fsx.0 00010000:00010000:2.0:1763343286.213879:0:28561:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343286.213906:0:28561:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a66f9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7bb82aba7b4a667 expref: -99 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.213935:0:28561:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89e00/0x9104b1ba770a646e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a56b expref: 17 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343286.213944:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343286.213946:0:28561:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343286.213950:0:28561:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a66f9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2f2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a667 expref: 17 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.213981:0:28561:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89e00/0x9104b1ba770a646e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a56b expref: 17 pid: 28562 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343286.213995:0:28561:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89e00/0x9104b1ba770a646e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a56b expref: 17 pid: 28562 timeout: 1179 lvb_type: 1 00000100:00100000:2.0:1763343286.214008:0:28561:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c390ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28561:1848998413042176:192.168.201.40@tcp:104: 00000100:00100000:2.0:1763343286.214822:0:28561:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401f664c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343286.218676:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1763343286.218802:0:28561:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c390ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28561:1848998413042176:192.168.201.40@tcp:104: 00010000:00010000:2.0:1763343286.218838:0:28561:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a66f9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2f2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a667 expref: 17 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343286.218860:0:28561:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9400c5e88e00, rc 0) 00000100:00100000:2.0:1763343286.218922:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6281500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:57821:x1848998400098944:12345-192.168.201.40@tcp:101:fsx.0 Request processed in 5063us (6476us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343286.218932:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7710 00000100:00100000:3.0:1763343286.219192:0:14071:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400099072 00000100:00100000:3.0:1763343286.219199:0:14071:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400099072 00010000:00010000:3.0:1763343286.219231:0:14071:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89e00/0x9104b1ba770a646e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a56b expref: 17 pid: 28562 timeout: 1179 lvb_type: 1 00000100:00100000:3.0:1763343286.219255:0:14071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3668 00000100:00100000:3.0:1763343286.219263:0:14071:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c6281f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+17:2407:x1848998400099072:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343286.219287:0:14071:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343286.219308:0:14071:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89e00/0x9104b1ba770a646e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a56b expref: 17 pid: 28562 timeout: 1179 lvb_type: 1 00010000:00010000:3.0:1763343286.219320:0:14071:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89e00/0x9104b1ba770a646e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a56b expref: 17 pid: 28562 timeout: 1179 lvb_type: 1 00010000:00010000:3.0:1763343286.219343:0:14071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e89e00/0x9104b1ba770a646e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a56b expref: 17 pid: 28562 timeout: 1179 lvb_type: 1 00010000:00010000:3.0:1763343286.219356:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343286.219358:0:14071:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343286.219365:0:14071:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a66f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a667 expref: 16 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343286.219375:0:14071:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a66f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a667 expref: 16 pid: 28561 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343286.219406:0:14071:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9400c5e88e00/0x9104b1ba770a66f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.40@tcp remote: 0xb7bb82aba7b4a667 expref: 16 pid: 28561 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343286.219419:0:14071:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f648b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:14071:1848998413042304:192.168.201.40@tcp:105: 00000100:00100000:3.0:1763343286.219487:0:14071:0:(client.c:2690:ptlrpc_set_wait()) set ffff9401d862c600 going to sleep for 11 seconds 00000100:00100000:3.0:1763343286.222561:0:14071:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f648b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:14071:1848998413042304:192.168.201.40@tcp:105: 00010000:00010000:3.0:1763343286.222589:0:14071:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343286.222756:0:14071:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c6281f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2407:x1848998400099072:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 3491us (4091us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343286.222768:0:14071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3668 00000100:00100000:0.0:1763343286.225079:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343286.225164:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400099328 00000100:00100000:1.0:1763343286.225175:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400099328 00000100:00080000:2.0:1763343286.225433:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1763343286.225538:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3970 00000100:00100000:1.0:1763343286.225550:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+310:57821:x1848998400099328:12345-192.168.201.40@tcp:35:fsx.0 00000001:00080000:1.0:1763343286.225983:0:19639:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294974088 00000100:00100000:1.0:1763343286.226328:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:57821:x1848998400099328:12345-192.168.201.40@tcp:35:fsx.0 Request processed in 778us (1299us total) trans 4294974089 rc 0/0 00000100:00100000:1.0:1763343286.226336:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3970 00000020:00080000:1.0:1763343286.226342:0:19639:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343286.228542:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1763343286.228649:0:19639:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400099584 00000100:00100000:1.0:1763343286.228660:0:19639:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400099584 00000100:00100000:1.0:1763343286.228768:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3971 00000100:00100000:1.0:1763343286.228780:0:19639:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+39:57821:x1848998400099584:12345-192.168.201.40@tcp:35:fsx.0 00000100:00100000:1.0:1763343286.229467:0:19639:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+40:57821:x1848998400099584:12345-192.168.201.40@tcp:35:fsx.0 Request processed in 686us (930us total) trans 8589935443 rc 0/0 00000100:00100000:1.0:1763343286.229476:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3971 00000100:00100000:2.0:1763343286.653498:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f648b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1848998413042432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1763343286.653577:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343286.653653:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413042944:0@lo:400:kworker.0 00000100:00100000:1.0:1763343286.653669:0:14179:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413042432 00000100:00100000:1.0:1763343286.653677:0:14179:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413042432 00000100:00100000:2.0:1763343286.653682:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343286.653711:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1848998413043456:0@lo:400:kworker.0 00000100:00100000:1.0:1763343286.653727:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:2.0:1763343286.653741:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343286.653742:0:14179:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c390ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1848998413042432:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1763343286.653762:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00002000:00000024:1.0:1763343286.653766:0:14179:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484893632 pending 0 free 3919192064 avail 3687501824 00000100:00100000:2.0:1763343286.653770:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5952680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5a605d51-bec9-44a7-a417-e819baf6bfda:3661:1848998413042560:0@lo:400:kworker.0 00000100:00100000:2.0:1763343286.653804:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343286.653823:0:14179:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c390ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1848998413042432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343286.653831:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1848998413043072:0@lo:400:kworker.0 00000100:00100000:1.0:1763343286.653832:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:2.0:1763343286.653859:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343286.653863:0:32306:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413042560 00000100:00100000:1.0:1763343286.653869:0:32306:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413042560 00000100:00100000:1.0:1763343286.653894:0:32306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1763343286.653899:0:32306:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c487d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a605d51-bec9-44a7-a417-e819baf6bfda+23:3661:x1848998413042560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763343286.653927:0:32306:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c487d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a605d51-bec9-44a7-a417-e819baf6bfda+23:3661:x1848998413042560:12345-0@lo:400:kworker.0 Request processed in 28us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343286.653933:0:32306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1763343286.653980:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1848998413042816:0@lo:400:kworker.0 00000100:00100000:1.0:1763343286.654007:0:28561:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413042944 00000100:00100000:1.0:1763343286.654048:0:28561:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413042944 00000100:00100000:2.0:1763343286.654077:0:3661:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1848998413043584:0@lo:400:kworker.0 00000100:00100000:1.0:1763343286.654101:0:28561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:2.0:1763343286.654107:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343286.654112:0:28561:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3661:x1848998413042944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763343286.654153:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f648b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1848998413042432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1763343286.654155:0:28561:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3661:x1848998413042944:12345-0@lo:400:kworker.0 Request processed in 45us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343286.654164:0:28561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00100000:2.0:1763343286.654183:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5952680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5a605d51-bec9-44a7-a417-e819baf6bfda:3661:1848998413042560:0@lo:400:kworker.0 00000100:00100000:1.0:1763343286.654187:0:6530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413043584 00000100:00100000:1.0:1763343286.654192:0:6530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413043584 00000100:00100000:2.0:1763343286.654195:0:3661:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179872111 gen 2 00000004:00080000:2.0:1763343286.654200:0:3661:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9400c6b56300, transno 17179872111 00000100:00100000:2.0:1763343286.654213:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1848998413042944:0@lo:400:kworker.0 00000100:00100000:1.0:1763343286.654218:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:1.0:1763343286.654226:0:6530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1848998413043584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763343286.654267:0:6530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1848998413043584:12345-0@lo:400:kworker.0 Request processed in 42us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343286.654273:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00100000:1.0:1763343286.654310:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1763343286.654336:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1763343286.654336:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1848998413043328:0@lo:400:kworker.0 00000100:00100000:2.0:1763343286.654359:0:3661:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294974086 gen 2 00000004:00080000:2.0:1763343286.654365:0:3661:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294974086 committed transno 4294974086 00000100:00100000:1.0:1763343286.654365:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1763343286.654374:0:3661:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9401f6422c00 refcount 2 committed 0 result 0 batchid 4294969308 00000020:00080000:2.0:1763343286.654377:0:3661:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9401f660b500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9401f6422900 00000020:00080000:2.0:1763343286.654382:0:3661:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000405:0x2:0x0].5 00000020:00080000:2.0:1763343286.654384:0:3661:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9401f660b000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9400c5920a00 00000100:00100000:1.0:1763343286.654387:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000020:00080000:2.0:1763343286.654388:0:3661:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x2:0x0].12 00000100:00100000:1.0:1763343286.654396:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5952300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413042688:0@lo:400:kworker.0 00000100:00100000:2.0:1763343286.654413:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1848998413043584:0@lo:400:kworker.0 00000100:00100000:1.0:1763343286.654420:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343286.654440:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c586c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1848998413043200:0@lo:400:kworker.0 00000100:00100000:2.0:1763343286.654451:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413043456 00000100:00100000:2.0:1763343286.654456:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413043456 00000100:00100000:1.0:1763343286.654461:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343286.654479:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c8bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1848998413043712:0@lo:400:kworker.0 00000100:00100000:2.0:1763343286.654494:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413043072 00000100:00100000:2.0:1763343286.654499:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413043072 00000100:00100000:1.0:1763343286.654503:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343286.654518:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413042816 00000100:00100000:2.0:1763343286.654523:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413042816 00000100:00100000:1.0:1763343286.654540:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413043328 00000100:00100000:2.0:1763343286.654543:0:7641:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413043200 00000100:00100000:1.0:1763343286.654545:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413043328 00000100:00100000:2.0:1763343286.654549:0:7641:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413043200 00000100:00100000:1.0:1763343286.654573:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413043712 00000100:00100000:1.0:1763343286.654577:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413043712 00000100:00100000:2.0:1763343286.654578:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:2.0:1763343286.654588:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1848998413043456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763343286.654601:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:1.0:1763343286.654609:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c478b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1848998413043072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763343286.654630:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1848998413043456:12345-0@lo:400:kworker.0 Request processed in 43us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343286.654638:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00100000:1.0:1763343286.654649:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c478b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1848998413043072:12345-0@lo:400:kworker.0 Request processed in 41us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343286.654656:0:7641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:2.0:1763343286.654668:0:7641:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1848998413042816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763343286.654703:0:7641:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1848998413042816:12345-0@lo:400:kworker.0 Request processed in 40us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343286.654801:0:6529:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413042688 00000100:00100000:0.0:1763343286.654805:0:6529:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413042688 00000100:00100000:0.0:1763343286.654847:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1361 00000100:00100000:0.0:1763343286.654854:0:6529:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3660:x1848998413042688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763343286.654886:0:6529:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3660:x1848998413042688:12345-0@lo:400:kworker.0 Request processed in 33us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343286.654892:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1361 00000100:00100000:3.0:1763343286.655137:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343286.655146:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c5b28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1848998413043840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1763343286.655174:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1763343286.655207:0:32329:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969308 committed batchid 4294969307 00000020:00080000:3.0:1763343286.655249:0:32329:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969307 00000100:00100000:1.0:1763343286.657694:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00100000:1.0:1763343286.657741:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1286 00000100:00100000:1.0:1763343286.657757:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1848998413043328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763343286.657841:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1848998413043328:12345-0@lo:400:kworker.0 Request processed in 92us (3475us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343286.657847:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1286 00000100:00100000:1.0:1763343286.657860:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1287 00000100:00100000:1.0:1763343286.657866:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c8bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1848998413043200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763343286.657891:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c8bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1848998413043200:12345-0@lo:400:kworker.0 Request processed in 27us (3431us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343286.657896:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1287 00000100:00100000:1.0:1763343286.657905:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:1.0:1763343286.657911:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1848998413043712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763343286.657932:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1848998413043712:12345-0@lo:400:kworker.0 Request processed in 22us (3431us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343286.657937:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00100000:1.0:1763343286.658004:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5952300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413042688:0@lo:400:kworker.0 00000100:00100000:1.0:1763343286.658016:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1848998413043200:0@lo:400:kworker.0 00000100:00100000:2.0:1763343286.658464:0:7641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00000100:00100000:2.0:1763343286.658500:0:7640:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413043840 00000100:00100000:2.0:1763343286.658506:0:7640:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413043840 00000100:00100000:2.0:1763343286.658549:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1362 00000100:00100000:3.0:1763343286.658557:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f6488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413044096:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1763343286.658560:0:7640:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1848998413043840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1763343286.658594:0:7640:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445871616 avail 1299632128 00000100:00100000:3.0:1763343286.658606:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343286.658632:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343286.658639:0:3662:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9401f648b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1848998413043968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1763343286.658651:0:7640:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1848998413043840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (3474us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343286.658659:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1362 00000100:00100000:3.0:1763343286.658667:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343286.658695:0:8416:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413043968 00000100:00100000:3.0:1763343286.658699:0:8416:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413043968 00000100:00100000:3.0:1763343286.658726:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:3.0:1763343286.658732:0:8416:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f648bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1848998413043968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1763343286.658747:0:8416:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484894528 pending 0 free 3916029952 avail 3684294656 00000100:00100000:1.0:1763343286.659071:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c8bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1848998413043712:0@lo:400:kworker.0 00000100:00100000:2.0:1763343286.659325:0:7640:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413044096 00000100:00100000:2.0:1763343286.659330:0:7640:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413044096 00000100:00100000:2.0:1763343286.659347:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1363 00000100:00100000:2.0:1763343286.659352:0:7640:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9401f6488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3662:x1848998413044096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1763343286.659371:0:7640:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445875712 avail 1299636224 00000100:00080000:0.0:1763343286.659581:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1763343286.659586:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1763343286.659888:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1848998413042816:0@lo:400:kworker.0 00000100:00100000:1.0:1763343286.659903:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1848998413043328:0@lo:400:kworker.0 00000100:00100000:2.0:1763343286.659921:0:7640:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f6488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3662:x1848998413044096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 565us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343286.659931:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1363 00000100:00100000:2.0:1763343286.659977:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c5b28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1848998413043840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1763343286.660003:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f6488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1848998413044096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1763343286.660669:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1848998413043072:0@lo:400:kworker.0 00000100:00100000:1.0:1763343286.660788:0:3661:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c586ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1848998413043456:0@lo:400:kworker.0 00000100:00100000:3.0:1763343286.660931:0:8416:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9401f648bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1848998413043968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2197us (2262us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343286.660940:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1763343286.661078:0:3662:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9401f648b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1848998413043968:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1763343287.038522:0:35284:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1763343287.420848:0:35529:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_70a: @@@@@@ FAIL: fsx FLR file /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr failed 00000100:00100000:0.0:1763343288.053132:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343288.053177:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1763343288.053204:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343288.053234:0:32304:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400099712 00000100:00100000:0.0:1763343288.053241:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343288.053245:0:32304:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400099712 00000100:00100000:3.0:1763343288.053314:0:32304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 152 00000100:00100000:0.0:1763343288.053318:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1763343288.053329:0:32304:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c487c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:115d5667-a2e7-4faf-8d77-45fb38721d60+9:2410:x1848998400099712:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:0.0:1763343288.053345:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400100224 00000100:00100000:0.0:1763343288.053351:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400100224 00000100:00100000:0.0:1763343288.053392:0:8626:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400100096 00000100:00100000:0.0:1763343288.053395:0:8626:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400100096 00000100:00100000:3.0:1763343288.053401:0:32304:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c487c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:115d5667-a2e7-4faf-8d77-45fb38721d60+9:2410:x1848998400099712:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 74us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343288.053410:0:32304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 152 00000100:00100000:0.0:1763343288.053419:0:8626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 752 00000100:00100000:0.0:1763343288.053429:0:8626:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2410:x1848998400100224:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:0.0:1763343288.053464:0:8626:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+19:2410:x1848998400100224:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 37us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343288.053472:0:28562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 753 00000100:00100000:3.0:1763343288.053481:0:28562:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2409:x1848998400100096:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:3.0:1763343288.053510:0:28562:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+16:2409:x1848998400100096:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 30us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343288.054373:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400099840 00000100:00100000:1.0:1763343288.054380:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400099840 00000100:00100000:1.0:1763343288.054420:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998400099968 00000100:00100000:1.0:1763343288.054423:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998400099968 00000100:00100000:1.0:1763343288.054446:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1289 00000100:00100000:1.0:1763343288.054453:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+40:2409:x1848998400099840:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:1.0:1763343288.054492:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+40:2409:x1848998400099840:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 40us (1371us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343288.054499:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1289 00000100:00100000:1.0:1763343288.054513:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 1290 00000100:00100000:1.0:1763343288.054520:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c5b29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:2410:x1848998400099968:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:1.0:1763343288.054551:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c5b29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7fb38b1b-5899-4d0b-8379-b65ce0e9e344+312:2410:x1848998400099968:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 31us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343288.054557:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 1290 00000100:00080000:1.0:1763343288.055576:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1763343288.055582:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1763343288.055586:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1763343288.055588:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1763343288.055811:0:8626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 752 00000100:00100000:3.0:1763343288.055821:0:28562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 753 00010000:00010000:1.0:1763343288.064996:0:7451:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343288.189188:0:9931:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1081313160691ns, next at 1082313158322ns, rc = 0 00000100:00100000:1.0:1763343288.189217:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763343288.189238:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9400c59b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413044224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1763343288.189302:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343288.190262:0:8416:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998413044224 00000100:00100000:3.0:1763343288.190272:0:8416:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998413044224 00000100:00080000:1.0:1763343288.190318:0:6520:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1763343288.190338:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:3.0:1763343288.190348:0:8416:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9400c59b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1848998413044224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1763343288.190379:0:8416:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484894528 pending 0 free 3916873728 avail 3685351424 00000100:00100000:3.0:1763343288.190447:0:8416:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9400c59b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1848998413044224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343288.190456:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00100000:1.0:1763343288.190496:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9400c59b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1848998413044224:0@lo:13:osp-pre-1-1.0 Debug log: 68654 lines, 68654 kept, 0 dropped, 0 bad.